The naming convention used is the following:

(ATK-PW-xxxx) Title @tag1 @tag2 ...
ATK-PW-xxxx = use this to specify an exact test
ATK = Automated Testing Kit
PW = For the Playwright testing framework.
xxxx = Test number, grouped by category
Title = Title of the test, can also find with --grep on the command line
@tag1 @tag2 = tags for labeling and categorizing tests, such as "@ATK-PY-1000 @register-login @smoke @alters-db"

By convention:

  • the first tag is the code for the test; having a code makes it possible to execute specific tests in the pipeline and cross-reference tests from reports
  • the second tag is the web site component; create component tags according to your website.
  • the subsequent tags indicate important properties of tests allowing you to select tags with logic like "run all smoke tests that don't alter the database and are active (i.e. don't have the @skip tag). Each framework has a different way of filtering by tag. Refer to their documentation.

Some tags ATK uses are below; you can add as many tags as you want to your tests.

@smoke
@alters-db
@skip

Automated Testing Kit Component List

Tests in the Kit have the following categories:

@contact-us
@media
@node
@register-login
@page-error
@taxonomy
@user
@xml-sitemap

Playwright (PW)

Playwright files end with .spec.js.

Test ID
File Name
Category
Tags
Test
ATK-XX-1000
atk_register_login
@register-login
@smoke       
@alters-db
Register with form and confirm email with Ethereal.email. Requires SMTP Mailer or equivalent mail transfer module.
ATK-XX-1010
atk_register_login
@register-login
@smoke
Log in with form. Requires qaUsers.json.
ATK-XX-1011
atk_register_login
@register-login
@smoke
Log in with POST. Requires qaUsers.json.
ATK-XX-1012
atk_register_login
@register-login
@smoke
Log in via ULI. Requires qaUsers.json).
ATK-XX-1030
atk_register_login
@register-login
@smoke
Reset password. Requires qaUsers.json.
ATK-XX-1050
atk_contact_us
@contact-us
@smoke    
@alters-db
Contact Us form accepts input, sends email. Requires Contact module (in core).
ATK-XX-1060
atk_page_error
@page-error
@smoke
Validate that 403 page appears.
ATK-XX-1061
atk_page_error
@page-error
@smoke
Validate that 404 page appears.
ATK-XX-1070
atk_sitemap
@xml-sitemap
@smoke
@drush
Return # of sitemap files; fail if zero.
ATK-XX-1071
atk_sitemap
@xml-sitemap 
@smoke
@drush
Regenerate sitemap files. Uses drush fprop (custom drush command).
ATK-XX-1080
atk_sitemap
@simple-xml-sitemap
@smoke
Reserved for Simple XML Sitemap
ATK-XX-1100
atk_user
@user
@smoke   
@drush   
@alters-db
Create and delete user with Drush.
ATK-XX-1101
atk_user
@user
@smoke   
@drush   
@alters-db
Create user with Drush, delete by UID.
ATK-XX-1110
atk_node
@node
@smoke   
@alters-db
Create, update, delete a page via the UI.
ATK-XX-1111
atk_node
@node
@smoke   
@alters-db
Create, update, delete an article via the UI.
ATK-XX-1120
atk_taxonomy
@taxonomy
@smoke   
@alters-db
Create, update, delete a taxonomy term via the UI.
ATK-XX-1130
atk_media
@media
@smoke   
@alters-db
Create, update, delete an image via the UI.