Skip to main content

SCS end-to-end testing: Notes

Tempest introduction​

Tempest is the OpenStack Integration Test Suite. It is a set of integration tests to be run against a live OpenStack cluster. Tempest has batteries of tests for OpenStack API validation, scenarios, and other specific tests useful in validating an OpenStack deployment.

See also:

Test cases​

SCS conformance tests are expected to be executable without admin privileges (see §2 of Regulations for achieving SCS-compatible certification). The list of test cases stated in the standard has been curated accordingly.

Test cases that may be skipped​

In general, test cases must not be skipped. However, well-founded exceptions are possible. What counts as well-founded has to be decided on a case-by-case basis. So far, the following exceptions have been agreed upon:

  • tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password this test only runs when Nova allows instances to be created with an initial admin password, which is not used for typical Un*x VMs with injected ssh keys. It may or may not be necessary for certain non-Un*x use cases; however, it poses a security risk, so we think this feature should not be mandatory.

    Note: Windows users could circumvent this feature by switching to cloud-ready images such as the cloudbase.it ones (no endorsement).

Further exceptions may be made in the future.

How to run Tempest against your cluster​

TODO provide step-by-step walkthrough here