Commit graph

126 commits

Author SHA1 Message Date
Takashi Kajinami
71d2c41764 Add back ParallelDeploymentsTest in upgrade test
Change-Id: Id83c803b68640a403560703ed554e9aa627788fc
Signed-off-by: Takashi Kajinami <kajinamit@oss.nttdata.com>
2025-11-23 01:10:51 +09:00
Pavlo Shchelokovskyy
0242c28d5f Use authentication with keystone ec2token api
As a result of fixing OSSA-2025-002, ec2tokens API in Keystone
now by default requires authentication.

The config section `[ec2authtoken]` is now expected to have
auth information for Heat to be able to use this API.

In multicloud configuration keystone auth credentials are
required for each cloud. These can be configured using the new clouds
option and the ``[ec2authtoken.{cloud}]`` sections.

NOTE:
 Disables test_software_config.ParallelDeploymentsTest in
 grenade. Should follow up to re-enable once fix has been
 backported.

Related-Bug: #2119646
Change-Id: Ib41f76c1ba56005b6c4233424cca5768657a7686
Co-Authored-By: Adrian Jarvis <adrian.jarvis@catalystcloud.nz>
Co-Authored-By: Takashi Kajinami <kajinamit@oss.nttdata.com>
Signed-off-by: Pavlo Shchelokovskyy <shchelokovskyy@gmail.com>
2025-11-18 00:57:19 +09:00
Takashi Kajinami
eddcbd93c1 devstack: Use global uwsgi
... following the global method.

Closes-Bug: #2126581
Change-Id: Ie4b2c73bb6364917d260d2ae9947fdf4802f346d
Signed-off-by: Takashi Kajinami <kajinamit@oss.nttdata.com>
2025-10-04 11:52:30 +09:00
Takashi Kajinami
aea477842f Switch back pre-upgrade check to source branch
... because commit 1fd4e26f6b was
backported.

Depends-on: https://review.opendev.org/955294
Change-Id: I8f999b05b0a0cbd12c059b80bb50652d7f8bdbc5
Signed-off-by: Takashi Kajinami <kajinamit@oss.nttdata.com>
2025-07-17 23:49:26 +09:00
Zuul
42bd9bf043 Merge "Fix instance_group/autoscaling_group intermittent test failures" 2025-07-17 13:28:40 +00:00
rabi
b64f70d834 Fix instance_group/autoscaling_group intermittent test failures
With convergence there is a chance some leaf resource won't be
processed by workers if the stack is marked as failed due to
failure of one resources and stack traversal set to empty string
i.e traversal cancelled.

Also uses TestResource to simplifly the tests.

Change-Id: I1a04853d42f519d9a14dd345ac8cb441b08c4d77
Signed-off-by: rabi <ramishra@redhat.com>
2025-07-16 20:06:00 +05:30
Takashi Kajinami
e910a85ebd Drop bind_host/port
The bind_host option is used only for osprofiler. It is used to
identify the host where the api service runs and can be replaced
the `host` option.

Also the port option is used only for logging.

Change-Id: Ia55b269207987c419f30a4bfc0cebcf75d8fcb4a
Signed-off-by: Takashi Kajinami <kajinamit@oss.nttdata.com>
2025-07-11 17:27:36 +09:00
Dmitriy Rabotyagov
f7804606da Set proper role name for the grenade job
At the moment devstack upgrade tries to assign `Member` role
to which Keystone replies with 404 as role naming is case sensitive.

Change-Id: Ib85a920eae6c3ce2369a76282e8ea2fc90f7290b
2025-04-02 13:50:09 +00:00
Takashi Kajinami
6a0150df63 devstack: Remove mod_wsgi support
The same is being removed from devstack (for example:
https://review.opendev.org/c/openstack/devstack/+/932195 ) in favor of
the global usage of uwsgi.

Change-Id: I0a496c09b4fa7b40b070f6c36dc4e80e994c10a0
2024-11-23 05:24:16 +09:00
Zuul
1d04accdbb Merge "Fix incomplete service name" 2024-11-17 07:45:03 +00:00
Takashi Kajinami
c573a6cc26 Fix incomplete service name
Change-Id: I708aa5afcc6b7fa587f35b33841f76425f241406
2024-11-17 08:01:29 +09:00
Takashi Kajinami
7898473b8f Replace deprecated configure_auth_token_middleware
It was deprecated some years ago by [1].

[1] https://review.opendev.org/628651

Change-Id: I996abbae495fd11a9f0ce7d6047dcb6b4a462d74
2024-11-15 02:03:47 +00:00
Zuul
19113fbcdb Merge "Fix python executable file for heat: greande GLOBAL_VENV" 2024-10-17 04:58:16 +00:00
Takashi Kajinami
b03667a2a0 Enable GLOBAL_VENV
... because it is required in Ubuntu 24.04 .

Change-Id: Iba939edff0f015900ccb72c761c1e3d833805feb
2024-10-16 20:05:15 +09:00
Ghanshyam Mann
b3bd897cc3 Fix python executable file for heat: greande GLOBAL_VENV
Grenade is going to install and run everything from virtual env

- https://review.opendev.org/c/openstack/grenade/+/930507

Heat grenade job needs to install and run from venv. This
fixes the heat bin directory locaiton otherwise it will fail
with below error

- https://zuul.opendev.org/t/openstack/build/9b20c32fe9594d8b963c17c9f02aa76e

Needed-By: https://review.opendev.org/c/openstack/grenade/+/930507/12
Change-Id: I3a670795593da81078bb3709eedda0804871ad63
2024-10-15 12:48:12 -07:00
Takashi Kajinami
1292ebb1bf Add wsgi module
The wsgi_script feature is being removed because of some changes in
underlying python packaging tooling. This makes heat to vendor the wsgi
module which can be used instead of the wsgi script, according to
the proposed community goal[1]. The existing wsgi scripts are kept now
for smooth transition.

[1] https://review.opendev.org/c/openstack/governance/+/902807

Depends-On: https://review.opendev.org/c/openstack/devstack/+/902758
Change-Id: I4dc92f06610753171215913180ce7cdab15ba047
2024-09-30 06:34:26 +00:00
Pierre Riteau
ee05707038 Remove old upgrade script
Change-Id: I2c50d1dffecefcb2e976237553c3faa7d8169013
2024-09-13 20:29:42 +02:00
Takashi Kajinami
a806b400cf Try archive path to download Fedora image
This is a temporal workaround to allow downloading Fedora 37 image
which was moved to the archive path.

Change-Id: I9b1702749976a2cea42a24130e5fec2931b75ce1
2024-08-31 12:56:47 +09:00
Takashi Kajinami
33fba03f84 Always use Identity v3 API
... because v2 API was removed multiple cycles ago.

Depends-on: https://review.opendev.org/924027
Change-Id: I434b7bd8fd7f23040a69c2ffc05902c4491c2b27
2024-07-17 00:36:35 +00:00
Takashi Kajinami
c0ab825629 Fix [heat_plugin] auth_version
The OS_IDENTITY_API_VERSION environment has been removed from tempest.
Replace the environment by the hard-coded value because now only v3
is available.

Depends-on: https://review.opendev.org/c/openstack/devstack/+/923660
Change-Id: If80b48204ac8583714bbff550ad8f73c815ec684
2024-07-12 12:15:40 +09:00
Takashi Kajinami
9b5697ff17 Restore tests disabled because of libvirt bug
It seems the latest libvirt in Ubuntu is no longer affected by
the known problem with device handlings. This re-enables some test
cases which were previously disabled because of the problem.

Change-Id: I538462414f0a9b634d4d216230ed04b49cf71c40
2024-03-12 00:35:18 +09:00
Zuul
98bf27eec1 Merge "Ensure ca_file is set for core services" 2023-12-20 12:37:56 +00:00
Zuul
7b4db13222 Merge "Remove redundant usage of is_ssl_enabled_service" 2023-12-20 12:21:25 +00:00
Takashi Kajinami
46a6d5fa4b Remove references to Neutron LBaaS tests
... because these tests are already removed.

Depends-on: https://review.opendev.org/c/openstack/heat-tempest-plugin/+/896184
Change-Id: I34f75971fec826032377c47bf7b4e7a380522b8f
2023-12-17 00:37:49 +00:00
Takashi Kajinami
6d13e93a37 Enable new defaults and scope checks by default
Based on the agreed steps to implement the SRBAC community goal, this
enables the new policy defaults and scope checks by default.

Change-Id: I315893150549d1174c3270c37c031e6a519f9a28
2023-10-24 13:18:40 +09:00
Takashi Kajinami
4421498cd3 Add devstack plugin option to enforce new defaults and scope
This is a prep work to enforce new default policy rules and scope
checking, and allows users to enable/disable the enforcement by setting
the single knob.

Change-Id: I8248f825a90b50fe874224c7ee06a1de299f1feb
2023-10-24 13:17:57 +09:00
Takashi Kajinami
397657f667 Upgrade flavor for Fedora VM
Since we bumped Fedora version used in CI from 36 to 37, we've
seen timeout during boot process more frequently, which results
in job failure. This increases core and ram assigned to Fedora
VMs, to reduce failure rate.

To avoid consuming too much resources, this limits concurrency
of test runner.

Change-Id: I12e8ee0861629fd42a6bd03ec8705751da12ff61
2023-09-21 04:02:06 +00:00
Takashi Kajinami
0e51506419 Bump Fedora image used in CI
Fedora 36 is already EOLed so we should use more recent version.

Because guest enters to emergency shell when Fedora 38 (latest at
the time of writing) is used, we select Fedora 37 for now.

Change-Id: Ie0876080c771fb124d4dd36f803fbfd3b108e240
2023-09-07 21:20:31 +09:00
Takashi Kajinami
528bc75ef0 Add non-voting CentOS 9 Stream job
This introduces non-voting CentOS 9 Stream functional jobs, to restore
some tests which were disabled because of the known libvirt bug. Though
the bug also affects CentOS 9 Stream, we observe much low failure rate
in CentOS 9 Stream so we can restore these test cases in CentOS 9
Stream. The job is kept non-voting until it is proven to be stable
after a while.

Change-Id: I37211aa941be1892ad0ddf0694a758972a0aebba
2023-06-20 10:19:02 +09:00
Takashi Kajinami
9fbe8e4d35 Disable unstable test cases in grenade
Some test have been unstable in Ubuntu Jammy because of the known
libvirt bug, and we have disabled these in functional jobs.

Let's disable the test case in grenade jobs, because these test cases
now cause frequent job failures.

Related-Bug: #1998274
Change-Id: I7038ce3ec2840b133e9ae5eb09a96dc8a5f3abc2
2023-03-23 23:32:49 +09:00
Zuul
6272280d3c Merge "Skip basic scenario test" 2023-03-06 06:23:37 +00:00
Takashi Kajinami
add8d16284 Skip basic scenario test
This test is very frequently failing now. The test case creates a stack
with an instance but the stack can't be deleted within timeout because
of the known libvirt bug in Ubuntu Jammy. Because the release deadline
is already over, we'll disable this test so that we can merge some
changes now. We'll revisit this (and the other test cases we disabled)
later.

Related-Bug: #1998274
Story: 2010631
Task: 47589
Change-Id: I87c4b1e7a911fd78e327393b1af200667e89c999
2023-03-06 10:32:36 +09:00
Ghanshyam Mann
604111b0ba Fix setting the tempest virtual env constraints env var
Heat upgrade script set the env var TOX_CONSTRAINTS_FILE/UPPER_CONSTRAINTS_FILE
which are used to use the constraints during Tempest virtual env
installation. Those env var are set to non-master constraint when
we need to use non-master constraints but when we need to use the
master constraints we do not set/reset them point to master constraints.

This create the issue when this grenade script install the tempest with
stable constraints but with master Tempest and as there is mismatch of
constraints now with fasteners of stable branches. Below is failure
of heat greande job on stable/yoga

- https://zuul.opendev.org/t/openstack/build/3aaec4d59bb84068bb4d4428ea747cbd/log/controller/logs/grenade.sh_log.txt#3245

Similar way, role should set stable constraints only for the stable EM branch
not for all otherwise it fail when constraints/requirements are bumped.

- https://zuul.opendev.org/t/openstack/build/74f86b8097f44c35acaffdcfe41d9693

We should set/reset those constraint env var to master constraints if configuration
tell to use the master constraints.

Closes-Bug: #2003993
Change-Id: I024cd134577338fc1075e7742df7f006dc914646
2023-02-21 16:05:09 +00:00
Takashi Kajinami
b452ea7089 Skip test_stack_update_with_replacing_userdata
This test case is frequently failing because of a known libvirt issue
in Ubuntu Jammy. We already disabled one functional test case, but will
disable this test case as well, to reduce failure rate of CI runs and
unblock gate.

The existing skip for a different test case[1] is re-implemented using
the proper configuration knob.

This also fixes tox.ini to adapt to new tox 4.0.
 - Update how passenv is defined because space-separated list is no
   longer allowed. Also the values are not case sensitive.
 - skipdist=True breaks installation so is removed.

[1] https://review.opendev.org/c/openstack/heat/+/866545

Co-Authored-By: Rabi Mishra <ramishra@redhat.com>
Related-Bug: #1998274
Story: 2010487
Task: 47056
Change-Id: I915dc83ccde6b6b8497642857292f9974fd84e98
2022-12-23 13:26:52 +09:00
Brendan Shephard
0aa0b38251 Update stestr args for inclusive language
stestr has removed whitelist / blacklist. This change updates the
devstack upgrade tests to ensure we use the new include-list instead.
9ffeb470fb

Change-Id: Ia0df9b3468fee9382c42c8bd6a35b76ed7f2b4e5
2022-11-09 16:11:34 +10:00
Brendan Shephard
7787140214 Remove CloudWatch cleanup tasks
This change removes the cloud watch cleanup tasks
as part of general housecleaning.

Change-Id: Id8f678dfd504ff27d6fdb86011129d353a31f3cf
2022-07-21 23:34:28 +00:00
Rabi Mishra
e446ecbb21 Use openstack commands in upgrade plugin
Change-Id: I94075f261ce095c509635aab395df42878aceb1c
2022-07-13 13:17:54 +05:30
Rabi Mishra
39d653fa57 Use constraints when creating venv for grenade
As a followup for change I6a8cffdc86c895eebe4269c5cd37841325566c54
let's use branch specific upper constraints when running tests in
grenade.

Change-Id: I71f8398b6aa57b7c1910750b8e048825383e3d9a
2022-06-30 10:54:34 +05:30
Matthias Runge
78244c5f0f Use f36 instead of f33 for testing
F33 is unsupported for a while. We should not use it for any testing.

Change-Id: I7d1017bcd7147329c4e187336daee1a1ae280fa9
2022-05-31 10:35:53 +02:00
Takashi Kajinami
964e15d68f Ensure ca_file is set for core services
When tls-proxy is enabled, devstack enables SSL for the core services
(Cinder, Glance, Keystone, Nova, Neutron and Swift). This change
ensures that the ca_file parameter is properly defined in clients_*
section for these options, so that requests to these services pick up
the CA certificate.

Change-Id: Ib6278d95d1ce31dc86aa8784a621227e17dc0fe7
2022-01-19 18:10:26 +09:00
Takashi Kajinami
25c007636f Remove redundant usage of is_ssl_enabled_service
The is_ssl_enabled_service function is kept for backword compatibility,
and now returns the same value as `is_service_enabled tls-proxy`
since [1] was merged.

[1] f3b2f4c85307b14f115a020f5eaf6c92026b55b4

Change-Id: I5a3311121e56a7cfaefb73be39d3f60809bafb06
2021-11-23 16:07:37 +00:00
rabi
f5da6d210e Fix broken devstack plugin
This devstack plugin seems broken with devstack secure rbac changes
to use OS_CLOUD.

Change-Id: I9f0d3d97e4cc7d5ed6858eca9c042fedb14139d1
2021-11-19 14:17:55 +00:00
Ian Wienand
bf9186a37e Fallback to upstream for Fedora image
OpenDev infra only keep around the latest two Fedora releases in their
mirrors.  Probe for the image from the local test mirror, but if not
found, fallback to upstream.  This will be much less reliable, but can
avoid gate breakage until new images can be used.

Also, use endpoint_type when creating keystoneclient

Keystone admin endpoint has been removed from devstack with[1].
This would use the public endpoint by default.

Change-Id: I96ab14871ee8c5d5b83cc0cd4abc840ef0218ca8
2021-11-12 15:32:19 +05:30
Zuul
fc056ef70a Merge "Remove deprecated tail_log function" 2021-03-11 21:19:21 +00:00
Matthias Runge
6a9c35d898 Move testing to Fedora 33
Now that the gate is unblocked, we can also test F33 for gating purposes
here.

Change-Id: Ie1c9075623d85b27aaf1ac67a3063e219726bc6f
2021-01-19 16:38:43 +00:00
Matthias Runge
61e53c4eca Replace Fedora test image with F32
Fedora 31 was retired and the image is gone from mirrors.
heat-cfntools have been dropped from fedora images, disable
the test till that's resolved.

Also makes grenade job non-voting, till this is backported
to stable/victoria.

Change-Id: Id869f83a46454897c2fe7a532eebfa2863befe5e
2020-12-04 12:18:59 +05:30
Eyal
960428ca78 Remove deprecated tail_log function
This function has been deprecated for a long time, let's finally
remove it. It is only generating a warning anyway.

Change-Id: I0f69076ef7c288c113f4e7739c7e12fcfb11d91d
2020-11-24 09:15:50 +02:00
Rabi Mishra
9efbec6cd9 Stop testing ceilometer and aodh
Ceilometer uses gnocchi as the default backend. Also we use
gnocchi based aodh alarms in tests.

gnocchi seems unmaintained with last commit a year or so ago and
does not look like the openstack telemetry team is involved in
that project.

It's better to disable the services and tests in heat to avoid
broken gate like last time, where we fixed it by banning latest
pecan release[1] that does not work with python-gnocchiclient.

[1] https://review.opendev.org/#/c/746261/

Change-Id: Id2ffdf6b9d342e800bab4a94ec46742228361ee8
2020-09-14 13:09:09 +00:00
Rabi Mishra
f18a676792 Use Fedora 31 for tests
Change-Id: Ia45e957bb24f5596a5ef16271f71ba8b77df9e42
2020-05-12 11:28:31 +05:30
Cédric Ollivier
a3be28bed7 Reduce Heat engine workers
It conforms with API_WORKERS default calculation to avoid too much
processes consuming the memory.

Change-Id: If2b483711668715047662a286cb0f0e3b52bbdac
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2020-04-15 11:25:21 +02:00