User:😂/Testing tests

We've been doing some work to PHPUnit in the last week or 2. Getting some high memory counts and language converter errors (supposedly as of r62006) and SQL errors (probably from r62089) which go away when using TAP output and prove. Will paste output from both methods of running the tests. Using r62125.


phpunit output

edit
chadsmac:tests chad$ phpunit
PHPUnit 3.4.9 by Sebastian Bergmann.
IIIII..................................III..................  60 / 719
..F......................................................... 120 / 719
............................................................ 180 / 719
............................................................ 240 / 719
............................................................ 300 / 719
............................................................ 360 / 719
............................................................ 420 / 719
............................................................ 480 / 719
............................................................ 540 / 719
............................................................ 600 / 719
....................................................F...F.F. 660 / 719
.........EFEF......................

Time: 02:59, Memory: 775.75Mb

There were 2 errors:

1) SearchMySQL4Test::testTextSearch
DBQueryError: A database error has occurred
Query: CREATE TEMPORARY TABLE `parsertest_page` (LIKE `parsertest_page`)
Function: 
Error: 1066 Not unique table/alias: 'parsertest_page' (127.0.0.1)


/opt/local/apache2/htdocs/phase3/includes/db/Database.php:576
/opt/local/apache2/htdocs/phase3/includes/db/Database.php:538
/opt/local/apache2/htdocs/phase3/maintenance/tests/MediaWiki_Setup.php:20
/opt/local/apache2/htdocs/phase3/maintenance/tests/SearchMySQL4Test.php:10

2) SearchMySQL4Test::testTitleSearch
DBQueryError: A database error has occurred
Query: CREATE TEMPORARY TABLE `parsertest_page` (LIKE `parsertest_page`)
Function: 
Error: 1066 Not unique table/alias: 'parsertest_page' (127.0.0.1)


/opt/local/apache2/htdocs/phase3/includes/db/Database.php:576
/opt/local/apache2/htdocs/phase3/includes/db/Database.php:538
/opt/local/apache2/htdocs/phase3/maintenance/tests/MediaWiki_Setup.php:20
/opt/local/apache2/htdocs/phase3/maintenance/tests/SearchMySQL4Test.php:10

--

There were 6 failures:

1) LanguageConverterTest::testGetPreferredVariantUserOption
Failed asserting that two strings are equal.
--- Expected
+++ Actual
@@ @@
-tg-latn
+tg

/opt/local/apache2/htdocs/phase3/maintenance/tests/LanguageConverterTest.php:82

2) Warning
No tests found in class "ParserUnitTest".

3) RevisionTest::testGetRevisionTextUtf8Legacy
Failed asserting that two strings are equal.
--- Expected
+++ Actual
@@ @@
-Wiki est l'école superieur !
+Wiki est l'?cole superieur !

/opt/local/apache2/htdocs/phase3/maintenance/tests/RevisionTest.php:61

4) RevisionTest::testGetRevisionTextUtf8LegacyGzip
Failed asserting that two strings are equal.
--- Expected
+++ Actual
@@ @@
-Wiki est l'école superieur !
+Wiki est l'?cole superieur !

/opt/local/apache2/htdocs/phase3/maintenance/tests/RevisionTest.php:81

5) SearchMySQL4Test::testTextPowerSearch
Power search failed
Failed asserting that two arrays are equal.
--- Expected
+++ Actual
@@ @@
 Array
 (
-    [0] => Smithee
-    [1] => Talk:Main Page
 )

/opt/local/apache2/htdocs/phase3/maintenance/tests/SearchEngineTest.php:104

6) SearchMySQL4Test::testTextTitlePowerSearch
Title power search failed
Failed asserting that two arrays are equal.
--- Expected
+++ Actual
@@ @@
 Array
 (
-    [0] => Alan Smithee
-    [1] => Smithee
-    [2] => Talk:Smithee
 )

/opt/local/apache2/htdocs/phase3/maintenance/tests/SearchEngineTest.php:132

FAILURES!
Tests: 695, Assertions: 3434, Failures: 6, Errors: 2, Incomplete: 8.

prove output

edit
chadsmac:tests chad$ make
prove -e 'phpunit --tap' *Test*.php
ApiTest..................ok   
CdbTest..................ok   
DatabaseTest.............ok   
GlobalTest...............ok    
HttpTest.................ok    
IPTest...................ok   
ImageFunctionsTest.......ok   
LanguageConverterTest....ok   
LicensesTest.............skipped: (no reason given)
LocalFileTest............ok    
MediaWikiParserTest......ok     
RevisionTest............. Dubious, test returned 1 (wstat 256, 0x100)
 Failed 2/8 subtests SanitizerTest............ok   
SearchEngineTest.........skipped: (no reason given)
SearchMySQL4Test.........ok   
SearchUpdateTest.........ok   
SiteConfigurationTest....ok   
TimeAdjustTest...........ok   
TitleTest................ok   
XmlTest..................ok
    
Test Summary Report
-------------------
RevisionTest         (Wstat: 256 Tests: 8 Failed: 2)
  Failed tests:  4, 6
  Non-zero exit status: 1
  Parse errors: More than one plan found in TAP output
                No plan found in TAP output
Files=20, Tests=694, 167 wallclock secs ( 0.38 usr  0.13 sys + 36.72 cusr 25.58 csys = 62.81 CPU)
Result: FAIL
make: *** [tap] Error 1