browsertests: profile for default settings
Some scenarii are meant to be tested on specific wiki instances such as commmons.beta.wmflabs.org or sandbox.translatewiki.net. For the Gerrit integration, we are using a fresh wiki having the default ULS settings, hence the specific tests will definitely fail. This patch introduces a new cucumber tag `@needs-custom-setup`, it is meant to flag tests which require further configuration tweaking, for example tests explicitly targetting an already existing wiki such as beta or translatewiki I am introducing a new cucumber profile 'ciwmf' which exclude any test tagged '@needs-custom-setup' or '@phantomjs-bug'. That profile is going to be used by the Jenkins/Gerrit install using something like: cucumber -p ciwmf equivalent to: cucumber -t '~@phantomjs-bug' -t '~@needs-custom-setup' Marked some tests as being bugged on phantomjs: * autonym ones because of bug 57101 "browser tests must normalize font-family". * accept_language since we dont have yet a way to pass the accept language header via phantomjs. * Commented out an 'input method is visible' test with Vector + Hebrew since it does not pass. * Malayalam link is looked by title which is translated by default. This patch is passing on my local wiki, albeit skipping a lot of steps. Change-Id: Ib055f5470886e1b818d4c53cb4c61a751d81e154
This commit is contained in:
@@ -1,2 +1,7 @@
|
|||||||
|
# Cloudbee/Saucelab configuration:
|
||||||
ci: --format Cucumber::Formatter::Sauce --out reports/junit
|
ci: --format Cucumber::Formatter::Sauce --out reports/junit
|
||||||
|
|
||||||
|
# WMF Jenkins/Gerrit
|
||||||
|
ciwmf: -t ~@needs-custom-setup -t ~@phantomjs-bug
|
||||||
|
|
||||||
default: --format progress
|
default: --format progress
|
||||||
|
|||||||
@@ -1,4 +1,5 @@
|
|||||||
@language @sandbox.translatewiki.net
|
# On phantomjs, we need to figure out a way to pass the accept language header.
|
||||||
|
@language @phantomjs-bug @sandbox.translatewiki.net
|
||||||
Feature: Accept-Language
|
Feature: Accept-Language
|
||||||
|
|
||||||
Scenario Outline: Accept-Language
|
Scenario Outline: Accept-Language
|
||||||
|
|||||||
@@ -1,3 +1,8 @@
|
|||||||
|
# The tests do not normalize the font-family passed back by the browser
|
||||||
|
# Firefox/Chrome/Phantomjs handle the normalization differently.
|
||||||
|
#
|
||||||
|
# https://bugzilla.wikimedia.org/show_bug.cgi?id=57101
|
||||||
|
@phantomjs-bug
|
||||||
Feature: Autonym font
|
Feature: Autonym font
|
||||||
|
|
||||||
* Web font should always be applied to the ULS language selector's language
|
* Web font should always be applied to the ULS language selector's language
|
||||||
|
|||||||
@@ -1,4 +1,4 @@
|
|||||||
@commons.wikimedia.beta.wmflabs.org @login
|
@commons.wikimedia.beta.wmflabs.org @login @needs-custom-setup
|
||||||
Feature: Font selection
|
Feature: Font selection
|
||||||
|
|
||||||
In order to have better using experience,
|
In order to have better using experience,
|
||||||
|
|||||||
@@ -14,7 +14,7 @@ input method.
|
|||||||
When I click on an input box
|
When I click on an input box
|
||||||
Then I should see the input method indicator
|
Then I should see the input method indicator
|
||||||
|
|
||||||
@commons.wikimedia.beta.wmflabs.org
|
@commons.wikimedia.beta.wmflabs.org @needs-custom-setup
|
||||||
Scenario: Input method menu
|
Scenario: Input method menu
|
||||||
|
|
||||||
Input method menu is shown when user clicks the input method indicator.
|
Input method menu is shown when user clicks the input method indicator.
|
||||||
@@ -26,6 +26,7 @@ input method.
|
|||||||
And I should see a list of available input methods
|
And I should see a list of available input methods
|
||||||
And I should see a list of suggested languages
|
And I should see a list of suggested languages
|
||||||
|
|
||||||
|
@needs-custom-setup
|
||||||
Scenario: Unsupported input language
|
Scenario: Unsupported input language
|
||||||
|
|
||||||
User visits a wiki with content language that does not have have an input
|
User visits a wiki with content language that does not have have an input
|
||||||
@@ -35,7 +36,7 @@ input method.
|
|||||||
When I open the input method menu
|
When I open the input method menu
|
||||||
Then I should see input methods for Kotava
|
Then I should see input methods for Kotava
|
||||||
|
|
||||||
@commons.wikimedia.beta.wmflabs.org
|
@needs-custom-setup @commons.wikimedia.beta.wmflabs.org
|
||||||
Scenario: Sticky input methods
|
Scenario: Sticky input methods
|
||||||
|
|
||||||
Chosen input method selection persists across page loads.
|
Chosen input method selection persists across page loads.
|
||||||
|
|||||||
@@ -5,7 +5,7 @@ Feature: Live preview of display language changes
|
|||||||
Given I am logged in
|
Given I am logged in
|
||||||
And I am at random page
|
And I am at random page
|
||||||
|
|
||||||
@commons.wikimedia.beta.wmflabs.org
|
@needs-custom-setup @commons.wikimedia.beta.wmflabs.org
|
||||||
Scenario: Display language change is previewed immediately
|
Scenario: Display language change is previewed immediately
|
||||||
Given I open the Universal Language Selector
|
Given I open the Universal Language Selector
|
||||||
And I open Display panel of language settings
|
And I open Display panel of language settings
|
||||||
|
|||||||
@@ -1,4 +1,5 @@
|
|||||||
@commons.wikimedia.beta.wmflabs.org @login
|
# First scenario seems to fail whenever OpenDyslexic is missing
|
||||||
|
@commons.wikimedia.beta.wmflabs.org @login @needs-custom-setup
|
||||||
Feature: Persistent settings
|
Feature: Persistent settings
|
||||||
|
|
||||||
This assumes wiki content language is English.
|
This assumes wiki content language is English.
|
||||||
|
|||||||
@@ -18,7 +18,8 @@ Feature: Font preferences respected in different languages
|
|||||||
And I start editing a page
|
And I start editing a page
|
||||||
Then I should see the edit area text being displayed using "monospace" font
|
Then I should see the edit area text being displayed using "monospace" font
|
||||||
|
|
||||||
@commons.wikimedia.beta.wmflabs.org
|
# Needs OpenDyslexic font to have been configured on the target wiki
|
||||||
|
@needs-custom-setup @commons.wikimedia.beta.wmflabs.org
|
||||||
Scenario: Edit area should use the fonts selected by the user from ULS for a language
|
Scenario: Edit area should use the fonts selected by the user from ULS for a language
|
||||||
When I select OpenDyslexic font for the content language
|
When I select OpenDyslexic font for the content language
|
||||||
And I start editing a page
|
And I start editing a page
|
||||||
@@ -42,6 +43,7 @@ Feature: Font preferences respected in different languages
|
|||||||
And I start editing a page
|
And I start editing a page
|
||||||
Then I should see the edit area text being displayed using "monospace" font
|
Then I should see the edit area text being displayed using "monospace" font
|
||||||
|
|
||||||
|
@phantomjs-bug
|
||||||
Scenario: Edit area should use browser's default Monospace font for languages that have a default monospace font (Latin, Cyrillic, Hebrew etc.)
|
Scenario: Edit area should use browser's default Monospace font for languages that have a default monospace font (Latin, Cyrillic, Hebrew etc.)
|
||||||
When I start editing a page
|
When I start editing a page
|
||||||
Then I should see the edit area text being displayed using "monospace" font
|
Then I should see the edit area text being displayed using "monospace" font
|
||||||
|
|||||||
@@ -1,3 +1,4 @@
|
|||||||
|
@needs-custom-setup
|
||||||
Feature: Trigger in personal toolbar
|
Feature: Trigger in personal toolbar
|
||||||
|
|
||||||
@commons.wikimedia.beta.wmflabs.org @login
|
@commons.wikimedia.beta.wmflabs.org @login
|
||||||
|
|||||||
Reference in New Issue
Block a user