annotate test/ProblemList.txt @ 5060:5e56d498e913

7147087: Remove AWT/Swing/client tests from ProblemList Reviewed-by: ohair
author alanb
date Mon, 20 Feb 2012 19:33:32 +0000
parents 59884f656b7d
children 585f2c72d042
rev   line source
ohair@1821 1 ###########################################################################
ohair@1821 2 #
ohair@3909 3 # Copyright (c) 2009, 2011, Oracle and/or its affiliates. All rights reserved.
ohair@1821 4 # DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
ohair@1821 5 #
ohair@1821 6 # This code is free software; you can redistribute it and/or modify it
ohair@1821 7 # under the terms of the GNU General Public License version 2 only, as
ohair@2362 8 # published by the Free Software Foundation. Oracle designates this
ohair@1821 9 # particular file as subject to the "Classpath" exception as provided
ohair@2362 10 # by Oracle in the LICENSE file that accompanied this code.
ohair@1821 11 #
ohair@1821 12 # This code is distributed in the hope that it will be useful, but WITHOUT
ohair@1821 13 # ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
ohair@1821 14 # FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
ohair@1821 15 # version 2 for more details (a copy is included in the LICENSE file that
ohair@1821 16 # accompanied this code).
ohair@1821 17 #
ohair@1821 18 # You should have received a copy of the GNU General Public License version
ohair@1821 19 # 2 along with this work; if not, write to the Free Software Foundation,
ohair@1821 20 # Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
ohair@1821 21 #
ohair@2362 22 # Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
ohair@2362 23 # or visit www.oracle.com if you need additional information or have any
ohair@2362 24 # questions.
ohair@1821 25 #
ohair@1821 26 ###########################################################################
ohair@1821 27 #
ohair@1821 28 # List of tests that should not be run by test/Makefile, for various reasons:
ohair@1821 29 # 1. Does not run with jtreg -samevm mode
ohair@1821 30 # 2. Causes problems in jtreg -samevm mode for jtreg or tests that follow it
ohair@1821 31 # 3. The test is too slow or consumes too many system resources
ohair@1821 32 # 4. The test fails when run on any official build systems
ohair@1821 33 #
ohair@1821 34 # It is possible that a test being on this list is a mistake, and that some
ohair@1821 35 # other test in samevm mode caused tests to fail, mistakes happen.
ohair@1821 36 #
ohair@1821 37 # Tests marked @ignore are not run by test/Makefile, but harmless to be listed.
ohair@1821 38 #
ohair@1821 39 # Tests that explicitly state "@run main/othervm ...", and are not listed here,
ohair@1821 40 # will be run in the same batch as the samevm tests.
ohair@1821 41 #
ohair@1821 42 # Shell tests are othervm by default.
ohair@1821 43 #
mduigou@3589 44 # List items are testnames followed by labels, all MUST BE commented
ohair@1821 45 # as to why they are here and use a label:
michaelm@4598 46 # generic-all Problems on all platforms
michaelm@4598 47 # generic-ARCH Where ARCH is one of: sparc, sparcv9, x64, i586, etc.
michaelm@4598 48 # OSNAME-all Where OSNAME is one of: solaris, linux, windows
michaelm@4598 49 # OSNAME-ARCH Specific on to one OSNAME and ARCH, e.g. solaris-x64
michaelm@4598 50 # OSNAME-REV Specific on to one OSNAME and REV, e.g. solaris-5.8
mduigou@3589 51 #
ohair@1821 52 # More than one label is allowed but must be on the same line.
ohair@1821 53 #
ohair@1821 54 #############################################################################
ohair@1821 55 #
ohair@1821 56 # Running the tests:
ohair@1821 57 # cd test && make JT_HOME=jtreg_home PRODUCT_HOME=jdk_home jdk_all
ohair@1821 58 # Or instead of jdk_all, use any of the jdk_* targets.
ohair@1821 59 #
ohair@1821 60 # Samevm Notes:
ohair@1821 61 # * Although some tests may have only been seen to fail on some platforms,
ohair@1821 62 # they might be flagged as 'generic-all' because the problem they have
ohair@1821 63 # could cause hidden slowdowns on other platforms.
ohair@1821 64 # Most samevm problems will be generic-all, but windows usually dislikes
ohair@1821 65 # them the most.
ohair@1821 66 # Address already in use or connection errors indicate a generic port issue.
ohair@1821 67 # (this is not necessarily a samevm issue, but an issue for running the tests
ohair@1821 68 # on shared machines, two people or two test runs will collide).
ohair@1821 69 # * Samevm problem (windows in particular) is not closing all input/output
ohair@1821 70 # * Samevm problem when a test calls setSecurityManager()
ohair@1821 71 # * Samevm problem with setHttps*() is used? (not exactly sure here)
ohair@1821 72 # * Samevm problem when stuffing system properties with non Strings or anything
ohair@1821 73 # * Samevm problem when changing vm settings, or registering any vm actions
ohair@1821 74 # * Samevm problems with deleteOnExit(), if it must happen at end of test
ohair@1821 75 # * Samevm problems with URLClassLoader? (no details here)
ohair@1821 76 # * Samevm problems with dependence on predictable GC or finalizations
ohair@1821 77 #
ohair@1821 78 # Any of the above problems may mean the test needs to be flagged as "othervm".
ohair@1821 79 #
ohair@1821 80 #############################################################################
ohair@1821 81 #
ohair@1821 82 # Fixing the tests:
ohair@1821 83 #
ohair@1821 84 # Some tests just may need to be run with "othervm", and that can easily be
ohair@1821 85 # done my adding a @run line (or modifying any existing @run):
ohair@1821 86 # @run main/othervm NameOfMainClass
ohair@1821 87 # Make sure this @run follows any use of @library.
ohair@1821 88 # Otherwise, if the test is a samevm possibility, make sure the test is
ohair@1821 89 # cleaning up after itself, closing all streams, deleting temp files, etc.
ohair@1821 90 #
ohair@1821 91 # Keep in mind that the bug could be in many places, and even different per
ohair@1821 92 # platform, it could be a bug in any one of:
ohair@1821 93 # - the testcase
ohair@1821 94 # - the jdk (jdk classes, native code, or hotspot)
ohair@1821 95 # - the native compiler
ohair@1821 96 # - the javac compiler
ohair@1821 97 # - the OS (depends on what the testcase does)
ohair@1821 98 #
ohair@1821 99 # If you managed to really fix one of these tests, here is how you can
ohair@1821 100 # remove tests from this list:
ohair@1821 101 # 1. Make sure test passes on all platforms with samevm, or mark it othervm
ohair@1821 102 # 2. Make sure test passes on all platforms when run with it's entire group
ohair@1821 103 # 3. Make sure both VMs are tested, -server and -client, if possible
ohair@1821 104 # 4. Make sure you try the -d64 option on Solaris
ohair@1821 105 # 5. Use a tool like JPRT or something to verify these results
ohair@1821 106 # 6. Delete lines in this file, include the changes with your test changes
ohair@1821 107 #
ohair@1821 108 # You may need to repeat your testing 2 or even 3 times to verify good
ohair@1821 109 # results, some of these samevm failures are not very predictable.
ohair@1821 110 #
ohair@1821 111 #############################################################################
ohair@1821 112
ohair@1821 113 ############################################################################
ohair@1821 114
ohair@1821 115 # jdk_awt
ohair@1821 116
ohair@1821 117 ############################################################################
ohair@1821 118
ohair@1821 119 # jdk_beans
ohair@1821 120
ohair@1821 121 ############################################################################
ohair@1821 122
ohair@1821 123 # jdk_lang
ohair@1821 124
alanb@4928 125 # 7123972
alanb@4928 126 java/lang/annotation/loaderLeak/Main.java generic-all
alanb@4928 127
alanb@4504 128 # 7079093
michaelm@4598 129 java/lang/instrument/ManifestTest.sh windows-all
alanb@4504 130
alanb@4504 131 # 6944188
michaelm@4598 132 java/lang/management/ThreadMXBean/ThreadStateTest.java generic-all
alanb@4504 133
smarks@4482 134 # 7067973
smarks@4482 135 java/lang/management/MemoryMXBean/CollectionUsageThreshold.java generic-all
smarks@4482 136
alanb@4928 137 ############################################################################
alanb@4928 138
alanb@4928 139 # jdk_management
alanb@4928 140
alanb@5060 141 # 6959636
alanb@5060 142 javax/management/loading/LibraryLoader/LibraryLoaderTest.java windows-all
alanb@5060 143
alanb@5060 144 # 7144846
alanb@5060 145 javax/management/remote/mandatory/connection/ReconnectTest.java generic-all
alanb@5060 146
alanb@5029 147 # 7073626
alanb@5029 148 sun/management/jmxremote/bootstrap/RmiBootstrapTest.sh windows-all
alanb@5029 149 sun/management/jmxremote/bootstrap/RmiSslBootstrapTest.sh windows-all
ohair@1821 150
ohair@1821 151 ############################################################################
ohair@1821 152
ohair@1821 153 # jdk_math
ohair@1821 154
ohair@1821 155 ############################################################################
ohair@1821 156
ohair@1821 157 # jdk_misc
ohair@1821 158
alanb@4928 159 # 6988950
alanb@4928 160 demo/jvmti/compiledMethodLoad/CompiledMethodLoadTest.java generic-all
alanb@4928 161
ohair@1821 162 # Need to be marked othervm, or changed to be samevm safe
michaelm@4598 163 com/sun/jndi/rmi/registry/RegistryContext/UnbindIdempotent.java generic-all
ohair@1821 164
ohair@1821 165 ############################################################################
ohair@1821 166
ohair@1821 167 # jdk_net
ohair@1821 168
alanb@4425 169 # Filed 7052625
michaelm@4598 170 com/sun/net/httpserver/bugs/6725892/Test.java generic-all
alanb@4425 171
alanb@4425 172 # Filed 7036666
michaelm@4598 173 com/sun/net/httpserver/Test9a.java generic-all
alanb@4425 174
weijun@4488 175 # 7079145 java/net/ipv6tests/UdpTest.java hang at IPv6 only data exchange
weijun@4488 176 java/net/ipv6tests/UdpTest.java linux-all
weijun@4488 177
alanb@4504 178 # 7081476
michaelm@4598 179 java/net/InetSocketAddress/B6469803.java generic-all
alanb@4504 180
michaelm@4654 181 # 7102670
michaelm@4654 182 java/net/InetAddress/CheckJNI.java linux-all
michaelm@4654 183
michaelm@4654 184 # failing on vista 32/64 on nightly
michaelm@4654 185 # 7102702
michaelm@4654 186 java/net/PortUnreachableException/OneExceptionOnly.java windows-all
alanb@5060 187
ohair@1821 188 ############################################################################
ohair@1821 189
alanb@2546 190 # jdk_io
alanb@2546 191
alanb@2546 192 # 6962637
alanb@2546 193 java/io/File/MaxPathLength.java windows-all
alanb@2546 194
alanb@4504 195 # 7076644
michaelm@4598 196 java/io/File/Basic.java windows-all
alanb@4504 197
alanb@2546 198 ############################################################################
alanb@2546 199
ohair@1821 200 # jdk_nio
ohair@1821 201
alanb@2546 202 # 6963118
alanb@2546 203 java/nio/channels/Selector/Wakeup.java windows-all
ohair@2203 204
alanb@4820 205 # 7052549
alanb@4820 206 java/nio/channels/FileChannel/ReleaseOnCloseDeadlock.java windows-all
alanb@4504 207
ohair@1821 208 ############################################################################
ohair@1821 209
ohair@1821 210 # jdk_rmi
ohair@1821 211
alanb@5029 212 # 7140992
alanb@5029 213 java/rmi/server/Unreferenced/finiteGCLatency/FiniteGCLatency.java generic-all
ohair@1821 214
alanb@5029 215 # 6948101
alanb@5029 216 java/rmi/transport/pinLastArguments/PinLastArguments.java generic-all
ohair@1821 217
alanb@4968 218 # 7132247
alanb@4968 219 java/rmi/registry/readTest/readTest.sh windows-all
alanb@4968 220
ohair@1821 221 ############################################################################
ohair@1821 222
ohair@1821 223 # jdk_security
ohair@1821 224
alanb@5060 225 # 7145024
alanb@5060 226 sun/security/ssl/com/sun/net/ssl/internal/ssl/GenSSLConfigs/main.java solaris-all
alanb@5060 227
alanb@5060 228 # 7147060
alanb@5060 229 com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java generic-all
alanb@5060 230
ohair@2228 231 # Failing on Solaris i586, 3/9/2010, not a -samevm issue (jdk_security3)
michaelm@4598 232 sun/security/pkcs11/Secmod/AddPrivateKey.java solaris-i586
michaelm@4598 233 sun/security/pkcs11/ec/ReadCertificates.java solaris-i586
michaelm@4598 234 sun/security/pkcs11/ec/ReadPKCS12.java solaris-i586
michaelm@4598 235 sun/security/pkcs11/ec/TestCurves.java solaris-i586
michaelm@4598 236 sun/security/pkcs11/ec/TestECDSA.java solaris-i586
michaelm@4598 237 #sun/security/pkcs11/ec/TestECGenSpec.java solaris-i586
michaelm@4598 238 #sun/security/pkcs11/ec/TestKeyFactory.java solaris-i586
michaelm@4598 239 sun/security/pkcs11/sslecc/ClientJSSEServerJSSE.java solaris-i586
ohair@2228 240
weijun@4479 241 # Fails on Fedora 9/Ubuntu 10.04 64bit, PKCS11Exception: CKR_DEVICE_ERROR
michaelm@4598 242 sun/security/pkcs11/KeyAgreement/TestDH.java generic-all
ohair@2017 243
ohair@1821 244 # Run too slow on Solaris 10 sparc
ohair@1821 245 sun/security/ssl/com/sun/net/ssl/internal/ssl/InputRecord/SSLSocketTimeoutNulls.java solaris-sparc
ohair@1821 246 sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/ClientTimeout.java solaris-sparc
ohair@1821 247 sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/ServerTimeout.java solaris-sparc
ohair@1821 248 sun/security/ssl/sun/net/www/protocol/https/HttpsURLConnection/ReadTimeout.java solaris-sparc
ohair@1821 249 sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/NotifyHandshakeTest.sh solaris-sparc
ohair@1821 250
ohair@1821 251 # Solaris 10 sparc, passed/failed confusion? java.security.ProviderException: update() failed
ohair@1821 252 sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLSocketImpl/AsyncSSLSocketClose.java generic-all
ohair@1821 253
ohair@1821 254 # Othervm, sparc, NoRouteToHostException: Cannot assign requested address
ohair@1821 255 sun/security/ssl/javax/net/ssl/NewAPIs/SessionCacheSizeTests.java generic-all
ohair@1821 256
ohair@1821 257 # Times out on windows X64, othervm mode
ohair@1821 258 # Solaris sparc and sparcv9 -server, timeout
michaelm@4598 259 sun/security/ssl/javax/net/ssl/NewAPIs/SessionTimeOutTests.java generic-all
ohair@1821 260
ohair@1821 261 # Various failures on Linux Fedora 9 X64, othervm mode
ohair@1821 262 sun/security/ssl/javax/net/ssl/NewAPIs/SSLEngine/TestAllSuites.java generic-all
michaelm@4598 263 sun/security/ssl/sanity/ciphersuites/CheckCipherSuites.java generic-all
ohair@1821 264
ohair@1821 265 # Various failures on Linux Fedora 9 X64, othervm mode
michaelm@4598 266 sun/security/ssl/sanity/interop/ClientJSSEServerJSSE.java generic-all
ohair@1821 267
weijun@4488 268 # 7079203 sun/security/tools/keytool/printssl.sh fails on solaris with timeout
weijun@4488 269 sun/security/tools/keytool/printssl.sh solaris-all
weijun@4488 270
alanb@4504 271 # 7081817
michaelm@4598 272 sun/security/provider/certpath/X509CertPath/IllegalCertiticates.java generic-all
alanb@4504 273
weijun@4551 274 # 7041639, Solaris DSA keypair generation bug (Note: jdk_util also affected)
weijun@4551 275 java/security/KeyPairGenerator/SolarisShortDSA.java solaris-all
weijun@4551 276 sun/security/tools/jarsigner/onlymanifest.sh solaris-all
weijun@4551 277 sun/security/tools/jarsigner/ts.sh solaris-all
weijun@4551 278 sun/security/tools/keytool/emptysubject.sh solaris-all
weijun@4551 279 sun/security/tools/keytool/importreadall.sh solaris-all
weijun@4551 280 sun/security/tools/keytool/readjar.sh solaris-all
weijun@4551 281 sun/security/tools/keytool/selfissued.sh solaris-all
weijun@4551 282 sun/security/tools/keytool/standard.sh solaris-all
weijun@4551 283
ohair@1821 284 ############################################################################
ohair@1821 285
alanb@5060 286 # jdk_sound
ohair@1821 287
alanb@5060 288 ############################################################################
alanb@5060 289
alanb@5060 290 # jdk_swing
ohair@1821 291
ohair@1821 292 ############################################################################
ohair@1821 293
ohair@1821 294 # jdk_text
ohair@1821 295
ohair@1821 296 ############################################################################
ohair@1821 297
ohair@1821 298 # jdk_tools
ohair@1821 299
alanb@5029 300 # 6461635
alanb@5029 301 com/sun/tools/attach/BasicTests.sh generic-all
alanb@5029 302
ohair@2812 303 # Filed 6952105
michaelm@4598 304 com/sun/jdi/SuspendThreadTest.java generic-all
ohair@2812 305
alanb@4425 306 # Filed 6653793
michaelm@4598 307 com/sun/jdi/RedefineCrossEvent.java generic-all
alanb@4425 308
alanb@4425 309 # Filed 6987312
michaelm@4598 310 com/sun/jdi/DoubleAgentTest.java generic-all
alanb@4425 311
alanb@4425 312 # Filed 7020857
michaelm@4598 313 com/sun/jdi/FieldWatchpoints.java generic-all
alanb@4425 314
alanb@4425 315 # Filed 6402201
michaelm@4598 316 com/sun/jdi/ProcessAttachTest.sh generic-all
alanb@4425 317
ohair@2812 318 # Filed 6979016
michaelm@4598 319 sun/tools/jconsole/ResourceCheckTest.sh generic-all
ohair@2812 320
alanb@4968 321 # 7132203
alanb@4968 322 sun/jvmstat/monitor/MonitoredVm/CR6672135.java generic-all
alanb@4968 323
alanb@5060 324 # Tests take too long, see 7143279
alanb@5029 325 tools/pack200/CommandLineTests.java generic-all
alanb@5029 326 tools/pack200/Pack200Test.java generic-all
alanb@5029 327
ohair@1821 328 ############################################################################
ohair@1821 329
ohair@1821 330 # jdk_util
ohair@1821 331
ohair@2812 332 # Filed 6933803
michaelm@4598 333 java/util/concurrent/ThreadPoolExecutor/CoreThreadTimeOut.java generic-all
ohair@2812 334
alanb@4425 335 # Filed 6772009
ohair@1821 336 java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java generic-all
ohair@1821 337
weijun@4551 338 # 7041639, Solaris DSA keypair generation bug
weijun@4551 339 java/util/TimeZone/TimeZoneDatePermissionCheck.sh solaris-all
weijun@4551 340
ohair@1821 341 ############################################################################
ohair@1821 342