annotate test/ProblemList.txt @ 5870:53ca38f76eaa

7198871: cleanup security tests in problem lists with no CR attached Reviewed-by: alanb
author weijun
date Tue, 18 Sep 2012 17:38:43 +0800
parents 39e97f68fa8c
children bc5e7ec12717
rev   line source
ohair@1821 1 ###########################################################################
ohair@1821 2 #
sla@5086 3 # Copyright (c) 2009, 2012, Oracle and/or its affiliates. All rights reserved.
ohair@1821 4 # DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
ohair@1821 5 #
ohair@1821 6 # This code is free software; you can redistribute it and/or modify it
ohair@1821 7 # under the terms of the GNU General Public License version 2 only, as
ohair@2362 8 # published by the Free Software Foundation. Oracle designates this
ohair@1821 9 # particular file as subject to the "Classpath" exception as provided
ohair@2362 10 # by Oracle in the LICENSE file that accompanied this code.
ohair@1821 11 #
ohair@1821 12 # This code is distributed in the hope that it will be useful, but WITHOUT
ohair@1821 13 # ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
ohair@1821 14 # FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
ohair@1821 15 # version 2 for more details (a copy is included in the LICENSE file that
ohair@1821 16 # accompanied this code).
ohair@1821 17 #
ohair@1821 18 # You should have received a copy of the GNU General Public License version
ohair@1821 19 # 2 along with this work; if not, write to the Free Software Foundation,
ohair@1821 20 # Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
ohair@1821 21 #
ohair@2362 22 # Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
ohair@2362 23 # or visit www.oracle.com if you need additional information or have any
ohair@2362 24 # questions.
ohair@1821 25 #
ohair@1821 26 ###########################################################################
ohair@1821 27 #
ohair@1821 28 # List of tests that should not be run by test/Makefile, for various reasons:
ohair@1821 29 # 1. Does not run with jtreg -samevm mode
ohair@1821 30 # 2. Causes problems in jtreg -samevm mode for jtreg or tests that follow it
ohair@1821 31 # 3. The test is too slow or consumes too many system resources
ohair@1821 32 # 4. The test fails when run on any official build systems
ohair@1821 33 #
ohair@1821 34 # It is possible that a test being on this list is a mistake, and that some
ohair@1821 35 # other test in samevm mode caused tests to fail, mistakes happen.
ohair@1821 36 #
ohair@1821 37 # Tests marked @ignore are not run by test/Makefile, but harmless to be listed.
ohair@1821 38 #
ohair@1821 39 # Tests that explicitly state "@run main/othervm ...", and are not listed here,
ohair@1821 40 # will be run in the same batch as the samevm tests.
ohair@1821 41 #
ohair@1821 42 # Shell tests are othervm by default.
ohair@1821 43 #
mduigou@3589 44 # List items are testnames followed by labels, all MUST BE commented
ohair@1821 45 # as to why they are here and use a label:
michaelm@4598 46 # generic-all Problems on all platforms
michaelm@4598 47 # generic-ARCH Where ARCH is one of: sparc, sparcv9, x64, i586, etc.
michaelm@4598 48 # OSNAME-all Where OSNAME is one of: solaris, linux, windows
michaelm@4598 49 # OSNAME-ARCH Specific on to one OSNAME and ARCH, e.g. solaris-x64
michaelm@4598 50 # OSNAME-REV Specific on to one OSNAME and REV, e.g. solaris-5.8
mduigou@3589 51 #
ohair@1821 52 # More than one label is allowed but must be on the same line.
ohair@1821 53 #
ohair@1821 54 #############################################################################
ohair@1821 55 #
ohair@1821 56 # Running the tests:
ohair@1821 57 # cd test && make JT_HOME=jtreg_home PRODUCT_HOME=jdk_home jdk_all
ohair@1821 58 # Or instead of jdk_all, use any of the jdk_* targets.
ohair@1821 59 #
ohair@1821 60 # Samevm Notes:
ohair@1821 61 # * Although some tests may have only been seen to fail on some platforms,
ohair@1821 62 # they might be flagged as 'generic-all' because the problem they have
ohair@1821 63 # could cause hidden slowdowns on other platforms.
ohair@1821 64 # Most samevm problems will be generic-all, but windows usually dislikes
ohair@1821 65 # them the most.
ohair@1821 66 # Address already in use or connection errors indicate a generic port issue.
ohair@1821 67 # (this is not necessarily a samevm issue, but an issue for running the tests
ohair@1821 68 # on shared machines, two people or two test runs will collide).
ohair@1821 69 # * Samevm problem (windows in particular) is not closing all input/output
ohair@1821 70 # * Samevm problem when a test calls setSecurityManager()
ohair@1821 71 # * Samevm problem with setHttps*() is used? (not exactly sure here)
ohair@1821 72 # * Samevm problem when stuffing system properties with non Strings or anything
ohair@1821 73 # * Samevm problem when changing vm settings, or registering any vm actions
ohair@1821 74 # * Samevm problems with deleteOnExit(), if it must happen at end of test
ohair@1821 75 # * Samevm problems with URLClassLoader? (no details here)
ohair@1821 76 # * Samevm problems with dependence on predictable GC or finalizations
ohair@1821 77 #
ohair@1821 78 # Any of the above problems may mean the test needs to be flagged as "othervm".
ohair@1821 79 #
ohair@1821 80 #############################################################################
ohair@1821 81 #
ohair@1821 82 # Fixing the tests:
ohair@1821 83 #
ohair@1821 84 # Some tests just may need to be run with "othervm", and that can easily be
ohair@1821 85 # done my adding a @run line (or modifying any existing @run):
ohair@1821 86 # @run main/othervm NameOfMainClass
ohair@1821 87 # Make sure this @run follows any use of @library.
ohair@1821 88 # Otherwise, if the test is a samevm possibility, make sure the test is
ohair@1821 89 # cleaning up after itself, closing all streams, deleting temp files, etc.
ohair@1821 90 #
ohair@1821 91 # Keep in mind that the bug could be in many places, and even different per
ohair@1821 92 # platform, it could be a bug in any one of:
ohair@1821 93 # - the testcase
ohair@1821 94 # - the jdk (jdk classes, native code, or hotspot)
ohair@1821 95 # - the native compiler
ohair@1821 96 # - the javac compiler
ohair@1821 97 # - the OS (depends on what the testcase does)
ohair@1821 98 #
ohair@1821 99 # If you managed to really fix one of these tests, here is how you can
ohair@1821 100 # remove tests from this list:
ohair@1821 101 # 1. Make sure test passes on all platforms with samevm, or mark it othervm
ohair@1821 102 # 2. Make sure test passes on all platforms when run with it's entire group
ohair@1821 103 # 3. Make sure both VMs are tested, -server and -client, if possible
ohair@1821 104 # 4. Make sure you try the -d64 option on Solaris
ohair@1821 105 # 5. Use a tool like JPRT or something to verify these results
ohair@1821 106 # 6. Delete lines in this file, include the changes with your test changes
ohair@1821 107 #
ohair@1821 108 # You may need to repeat your testing 2 or even 3 times to verify good
ohair@1821 109 # results, some of these samevm failures are not very predictable.
ohair@1821 110 #
ohair@1821 111 #############################################################################
ohair@1821 112
ohair@1821 113 ############################################################################
ohair@1821 114
ohair@1821 115 # jdk_awt
ohair@1821 116
ohair@1821 117 ############################################################################
ohair@1821 118
ohair@1821 119 # jdk_beans
ohair@1821 120
ohair@1821 121 ############################################################################
ohair@1821 122
ohair@1821 123 # jdk_lang
ohair@1821 124
dcubed@5762 125 # 7194607
dcubed@5762 126 java/lang/instrument/VerifyLocalVariableTableOnRetransformTest.sh generic-all
dcubed@5762 127
alanb@4504 128 # 6944188
michaelm@4598 129 java/lang/management/ThreadMXBean/ThreadStateTest.java generic-all
alanb@4504 130
smarks@4482 131 # 7067973
smarks@4482 132 java/lang/management/MemoryMXBean/CollectionUsageThreshold.java generic-all
smarks@4482 133
alanb@5087 134 # 7148492
alanb@5087 135 java/lang/management/MemoryMXBean/ResetPeakMemoryUsage.java generic-all
alanb@5087 136
alanb@4928 137 ############################################################################
alanb@4928 138
alanb@4928 139 # jdk_management
alanb@4928 140
alanb@5060 141 # 6959636
alanb@5060 142 javax/management/loading/LibraryLoader/LibraryLoaderTest.java windows-all
alanb@5060 143
alanb@5060 144 # 7144846
alanb@5060 145 javax/management/remote/mandatory/connection/ReconnectTest.java generic-all
alanb@5060 146
alanb@5751 147 # 7158614, locks up Windows machines at least
alanb@5751 148 sun/management/jmxremote/startstop/JMXStartStopTest.sh windows-all
alanb@5751 149
sla@5866 150 # 7120365
sla@5866 151 javax/management/remote/mandatory/notif/DiffHBTest.java generic-all
sla@5866 152
ohair@1821 153 ############################################################################
ohair@1821 154
ohair@1821 155 # jdk_math
ohair@1821 156
ohair@1821 157 ############################################################################
ohair@1821 158
ohair@1821 159 # jdk_misc
ohair@1821 160
alanb@4928 161 # 6988950
alanb@4928 162 demo/jvmti/compiledMethodLoad/CompiledMethodLoadTest.java generic-all
alanb@4928 163
michaelm@5289 164 # 7162111
michaelm@5289 165 demo/jvmti/mtrace/TraceJFrame.java macosx-all
michaelm@5289 166 javax/script/CauseExceptionTest.java macosx-all
michaelm@5289 167 javax/script/GetInterfaceTest.java macosx-all
michaelm@5289 168 javax/script/JavaScriptScopeTest.java macosx-all
michaelm@5289 169 javax/script/NullUndefinedVarTest.java macosx-all
michaelm@5289 170 javax/script/PluggableContextTest.java macosx-all
michaelm@5289 171 javax/script/ProviderTest.sh macosx-all
michaelm@5289 172 javax/script/RhinoExceptionTest.java macosx-all
michaelm@5289 173 javax/script/StringWriterPrintTest.java macosx-all
michaelm@5289 174 javax/script/Test1.java macosx-all
michaelm@5289 175 javax/script/Test2.java macosx-all
michaelm@5289 176 javax/script/Test3.java macosx-all
michaelm@5289 177 javax/script/Test4.java macosx-all
michaelm@5289 178 javax/script/Test5.java macosx-all
michaelm@5289 179 javax/script/Test6.java macosx-all
michaelm@5289 180 javax/script/Test7.java macosx-all
michaelm@5289 181 javax/script/Test8.java macosx-all
michaelm@5289 182 javax/script/UnescapedBracketRegExTest.java macosx-all
michaelm@5289 183 javax/script/VersionTest.java macosx-all
ohair@1821 184 ############################################################################
ohair@1821 185
ohair@1821 186 # jdk_net
ohair@1821 187
alanb@4425 188 # Filed 7052625
michaelm@4598 189 com/sun/net/httpserver/bugs/6725892/Test.java generic-all
alanb@4425 190
alanb@4425 191 # Filed 7036666
michaelm@4598 192 com/sun/net/httpserver/Test9a.java generic-all
alanb@4425 193
weijun@4488 194 # 7079145 java/net/ipv6tests/UdpTest.java hang at IPv6 only data exchange
weijun@4488 195 java/net/ipv6tests/UdpTest.java linux-all
weijun@4488 196
michaelm@4654 197 # 7102670
michaelm@4654 198 java/net/InetAddress/CheckJNI.java linux-all
michaelm@4654 199
michaelm@4654 200 # failing on vista 32/64 on nightly
michaelm@4654 201 # 7102702
michaelm@4654 202 java/net/PortUnreachableException/OneExceptionOnly.java windows-all
alanb@5060 203
alanb@5087 204 # 7148829
alanb@5087 205 sun/net/InetAddress/nameservice/simple/CacheTest.java generic-all
alanb@5087 206 sun/net/InetAddress/nameservice/simple/DefaultCaching.java generic-all
alanb@5087 207
michaelm@5116 208 # 7122846
michaelm@5116 209 java/net/MulticastSocket/NoLoopbackPackets.java macosx-all
michaelm@5116 210 java/net/MulticastSocket/SetLoopbackMode.java macosx-all
michaelm@5116 211
michaelm@5116 212 # 7145658
michaelm@5116 213 java/net/MulticastSocket/Test.java macosx-all
michaelm@5116 214
michaelm@5116 215 #7143960
michaelm@5116 216 java/net/DatagramSocket/SendDatagramToBadAddress.java macosx-all
michaelm@5116 217
michaelm@5116 218 # 7150552
michaelm@5116 219 sun/net/www/protocol/http/B6299712.java macosx-all
michaelm@5116 220 java/net/CookieHandler/CookieManagerTest.java macosx-all
michaelm@5116 221
ohair@1821 222 ############################################################################
ohair@1821 223
alanb@2546 224 # jdk_io
alanb@2546 225
alanb@5751 226 # 7162111 - these tests need to be updated to run headless
michaelm@5116 227 java/io/Serializable/resolveClass/deserializeButton/run.sh macosx-all
alanb@5751 228 java/io/Serializable/serialver/classpath/run.sh macosx-all
alanb@5751 229 java/io/Serializable/serialver/nested/run.sh macosx-all
michaelm@5116 230
alanb@2546 231 ############################################################################
alanb@2546 232
ohair@1821 233 # jdk_nio
ohair@1821 234
alanb@2546 235 # 6963118
alanb@2546 236 java/nio/channels/Selector/Wakeup.java windows-all
ohair@2203 237
alanb@4820 238 # 7052549
alanb@4820 239 java/nio/channels/FileChannel/ReleaseOnCloseDeadlock.java windows-all
alanb@4504 240
michaelm@5116 241 # 7133499, 7133497
michaelm@5116 242 java/nio/channels/AsyncCloseAndInterrupt.java macosx-all
michaelm@5116 243 java/nio/channels/AsynchronousFileChannel/Lock.java macosx-all
michaelm@5116 244 java/nio/channels/FileChannel/Transfer.java macosx-all
michaelm@5116 245
michaelm@5116 246 # 7141822
michaelm@5116 247 java/nio/channels/DatagramChannel/ChangingAddress.java macosx-all
michaelm@5116 248
michaelm@5116 249 # 7132677
michaelm@5116 250 java/nio/channels/Selector/OutOfBand.java macosx-all
michaelm@5116 251
alanb@5751 252 # 7142919
alanb@5751 253 java/nio/channels/AsyncCloseAndInterrupt.java solaris-all
alanb@5751 254
ohair@1821 255 ############################################################################
ohair@1821 256
ohair@1821 257 # jdk_rmi
ohair@1821 258
alanb@5087 259 # 7146541
alanb@5087 260 java/rmi/transport/rapidExportUnexport/RapidExportUnexport.java linux-all
alanb@5087 261
smarks@5801 262 # 7187882
smarks@5801 263 java/rmi/activation/checkusage/CheckUsage.java generic-all
smarks@5801 264
smarks@5801 265 # 7190106
smarks@5801 266 java/rmi/reliability/benchmark/runRmiBench.sh generic-all
smarks@5801 267
smarks@5801 268 # 7191877
smarks@5801 269 java/rmi/transport/checkLeaseInfoLeak/CheckLeaseLeak.java generic-all
smarks@5801 270
smarks@5801 271 # 7195095
smarks@5801 272 sun/rmi/transport/proxy/EagerHttpFallback.java linux-all
smarks@5801 273
ohair@1821 274 ############################################################################
ohair@1821 275
ohair@1821 276 # jdk_security
ohair@1821 277
weijun@5865 278 # 7164518: no PortUnreachableException on Mac
weijun@5865 279 sun/security/krb5/auto/Unreachable.java macosx-all
weijun@5865 280
alanb@5751 281 # 7193792
alanb@5751 282 sun/security/pkcs11/ec/TestECDSA.java solaris-all
alanb@5751 283 sun/security/pkcs11/ec/TestECDSA.java linux-all
alanb@5751 284
alanb@5751 285 # 7193793
alanb@5751 286 sun/security/pkcs11/ec/TestECDH.java linux-all
alanb@5751 287
weijun@5870 288 # 7198198: the test also fails on SuSE Linux
weijun@5870 289 sun/security/pkcs11/ec/ReadCertificates.java linux-all
weijun@5870 290
alanb@5060 291 # 7147060
alanb@5060 292 com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java generic-all
alanb@5060 293
weijun@5870 294 # 6988842: 4 tests failing on Solaris 5.10
weijun@5870 295 sun/security/pkcs11/Secmod/AddPrivateKey.java solaris-all
weijun@5870 296 sun/security/pkcs11/ec/ReadCertificates.java solaris-all
weijun@5870 297 sun/security/pkcs11/ec/ReadPKCS12.java solaris-all
weijun@5870 298 sun/security/pkcs11/sslecc/ClientJSSEServerJSSE.java solaris-all
weijun@4488 299
weijun@4551 300 # 7041639, Solaris DSA keypair generation bug (Note: jdk_util also affected)
weijun@4551 301 java/security/KeyPairGenerator/SolarisShortDSA.java solaris-all
weijun@4551 302 sun/security/tools/jarsigner/onlymanifest.sh solaris-all
weijun@4551 303 sun/security/tools/jarsigner/ts.sh solaris-all
weijun@4551 304 sun/security/tools/keytool/emptysubject.sh solaris-all
weijun@4551 305 sun/security/tools/keytool/importreadall.sh solaris-all
weijun@4551 306 sun/security/tools/keytool/readjar.sh solaris-all
weijun@4551 307 sun/security/tools/keytool/selfissued.sh solaris-all
weijun@4551 308 sun/security/tools/keytool/standard.sh solaris-all
weijun@4551 309
ohair@1821 310 ############################################################################
ohair@1821 311
alanb@5060 312 # jdk_sound
ohair@1821 313
alanb@5060 314 ############################################################################
alanb@5060 315
alanb@5060 316 # jdk_swing
ohair@1821 317
ohair@1821 318 ############################################################################
ohair@1821 319
ohair@1821 320 # jdk_text
ohair@1821 321
ohair@1821 322 ############################################################################
ohair@1821 323
ohair@1821 324 # jdk_tools
ohair@1821 325
alanb@5029 326 # 6461635
alanb@5029 327 com/sun/tools/attach/BasicTests.sh generic-all
alanb@5029 328
ohair@2812 329 # Filed 6952105
michaelm@4598 330 com/sun/jdi/SuspendThreadTest.java generic-all
ohair@2812 331
alanb@4425 332 # Filed 6653793
michaelm@4598 333 com/sun/jdi/RedefineCrossEvent.java generic-all
alanb@4425 334
alanb@4425 335 # Filed 6987312
michaelm@4598 336 com/sun/jdi/DoubleAgentTest.java generic-all
alanb@4425 337
alanb@4425 338 # Filed 7020857
michaelm@4598 339 com/sun/jdi/FieldWatchpoints.java generic-all
alanb@4425 340
alanb@4425 341 # Filed 6402201
michaelm@4598 342 com/sun/jdi/ProcessAttachTest.sh generic-all
alanb@4425 343
alanb@5736 344 # Filed 7172176
michaelm@4598 345 sun/tools/jconsole/ResourceCheckTest.sh generic-all
alanb@5493 346 sun/tools/jconsole/ImmutableResourceTest.sh generic-all
alanb@5493 347
alanb@4968 348 # 7132203
alanb@4968 349 sun/jvmstat/monitor/MonitoredVm/CR6672135.java generic-all
alanb@4968 350
alanb@5060 351 # Tests take too long, see 7143279
alanb@5029 352 tools/pack200/CommandLineTests.java generic-all
alanb@5029 353 tools/pack200/Pack200Test.java generic-all
alanb@5029 354
michaelm@5116 355 # 7150569
michaelm@5116 356 tools/launcher/UnicodeTest.java macosx-all
michaelm@5116 357
ohair@1821 358 ############################################################################
ohair@1821 359
ohair@1821 360 # jdk_util
ohair@1821 361
alanb@5751 362 # 7162111 - test needs to be changed to run headless
alanb@5751 363 java/util/ResourceBundle/Control/Bug6530694.java macosx-all
alanb@5751 364
ohair@2812 365 # Filed 6933803
michaelm@4598 366 java/util/concurrent/ThreadPoolExecutor/CoreThreadTimeOut.java generic-all
ohair@2812 367
alanb@4425 368 # Filed 6772009
ohair@1821 369 java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java generic-all
ohair@1821 370
weijun@4551 371 # 7041639, Solaris DSA keypair generation bug
weijun@4551 372 java/util/TimeZone/TimeZoneDatePermissionCheck.sh solaris-all
weijun@4551 373
ohair@1821 374 ############################################################################