1 Reply Latest reply on Dec 19, 2013 1:01 PM by DCwebGuy

    Why "slow server alert" when NO running requests and NO open connections??

    DCwebGuy Level 1

      The snapshot below says it all.  Why on earth would my dev machine with no running requests, and no open database connections, kick off a slow server alert?

       

      I will tell you that at the exact same time this snapshot was generated, my other two servers WERE hung and were reporting "Unresponsive alerts", and they connect to the same databases.  I am chasing down a chronic communication failure between our database and web servers where everything with a databae connection gets locked/hung at the same time every night, 7 days a week.  The hang lasts anywhere from a few mins to 40+ mins.

       

      Is this why my dev server would report slow?  And if so, is it the skimmers or what that's causing a slow server alert??  Would it only report "Unresponsive" if there were actual page requests hanging, vs. a "Slow Server Alert"?

       

      This is CF10 (update 12) 64-bit on Windows 2008 R2, IIS 7, connecting to separate Oracle 11g server.

       

      Thanks for any insights.

       

      Snapshot generated on : Sun Dec 08 20:10:43 EST 2013  Caused by : Slow Server Alert
      Profiling : Disabled
      Memory Tracking : Disabled

       

      Average server response time is more than 20 seconds.

       

      *Total Running requests - 0

      *Total Queued requests - 0

      Template Running requests - 0

      Template Queued requests - 0

      Flash Remoting Running requests - 0

      Flash Remoting Queued requests - 0

      CFC method Running requests - 0

      CFC method Queued requests - 0

      Web Service Running requests - 0

      Web Service Queued requests - 0

       

      JVM Memory Stats

      Free Memory : 295634776 bytes

      Used Memory : 239663272 bytes

       

      Throttle Stats [Throttle Queue Size : Throttle Memory Used]


      0  : 0.0 megabytes

       

      Query Cache Stats -

      [Hit Ratio : Size : Count]

         0.0 : 0 bytes : 3

       

      Cached Queries -

      [Query Name : DSN : Size : TIme Executed : Time Taken : Line No : Function Name : Template Path]

       

      DB Pool Stats -

      [DSN :Open Conn Count : Total Conn Count : Max Con Count : Avg Open Conn Count : Avg Total Conn Count]

         GWAS_dev : 0 : 0 : Unlimited : 0 : 0

         dev_trnd_assignmentdesk : 0 : 0 : Unlimited : 0 : 0

         ADHD : 0 : 0 : Unlimited : 0 : 0

         web_dev : 0 : 7 : Unlimited : 1 : 5

         web_prod : 0 : 7 : Unlimited : 0 : 2

         nVision : 0 : 0 : Unlimited : 0 : 0

         legislation_dev : 0 : 0 : Unlimited : 0 : 0

         ISC_dev : 0 : 0 : Unlimited : 0 : 0

         legislation : 0 : 0 : Unlimited : 0 : 0

         dev_intranet : 0 : 1 : Unlimited : 1 : 5

         dev_DNADay : 0 : 0 : Unlimited : 0 : 0

         dvinciSpanish : 0 : 0 : Unlimited : 0 : 0

         dvinciORACLE : 0 : 0 : Unlimited : 0 : 0

         dev_assignmentdesk : 0 : 0 : Unlimited : 0 : 0

       

       

       

       

      Java stack trace -

      Full thread dump Java 1.7.0_45

       

      "obj-skimmer-dev_assignmentdesk" prio=5 tid=1011 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "obj-skimmer-GWAS_dev" prio=5 tid=1027 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "Reference Handler" prio=10 tid=2 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)

       

      "obj-skimmer-dvinciSpanish" prio=5 tid=1021 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "GC Daemon" prio=2 tid=11 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at sun.misc.GC$Daemon.run(GC.java:117)

       

      "obj-skimmer-web_dev" prio=5 tid=1033 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "DefaultQuartzScheduler_Worker-9" prio=5 tid=46 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "scheduler-2" prio=5 tid=97 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.scheduling.Scheduler.createRunnable(Scheduler.java:132)

      at coldfusion.scheduling.ThreadPool.createRunnable(ThreadPool.java:138)

      at coldfusion.scheduling.WorkerThread.run(WorkerThread.java:68)

       

      "ajp-bio-8012-exec-342" prio=5 tid=1484 RUNNABLE


      at java.net.SocketInputStream.socketRead0(Native Method)

      at java.net.SocketInputStream.read(SocketInputStream.java:152)

      at java.net.SocketInputStream.read(SocketInputStream.java:122)

      at org.apache.coyote.ajp.AjpProcessor.read(AjpProcessor.java:319)

      at org.apache.coyote.ajp.AjpProcessor.readMessage(AjpProcessor.java:445)

      at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:132)

      at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.jav a:539)

      at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:298)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "ajp-bio-8012-exec-345" prio=5 tid=1488 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "DefaultQuartzScheduler_Worker-1" prio=5 tid=38 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "Timer-4" prio=5 tid=63 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at java.util.TimerThread.mainLoop(Timer.java:526)

      at java.util.TimerThread.run(Timer.java:505)

       

      "DefaultQuartzScheduler_QuartzSchedulerThread" prio=5 tid=48 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:430)

       

      "ajp-bio-8012-AsyncTimeout" prio=5 tid=78 TIMED_WAITING


      at java.lang.Thread.sleep(Native Method)

      at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:136)

      at java.lang.Thread.run(Thread.java:744)

       

      "cfthread-0" prio=5 tid=884 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.util.GenericThreadPool$ThreadPoolRunnableFactory.createRunnable(GenericThreadP ool.java:177)

      at coldfusion.scheduling.ThreadPool.createRunnable(ThreadPool.java:138)

      at coldfusion.scheduling.WorkerThread.run(WorkerThread.java:68)

       

      "DefaultQuartzScheduler_Worker-8" prio=5 tid=45 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "Timer-2" prio=5 tid=16 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at java.util.TimerThread.mainLoop(Timer.java:552)

      at java.util.TimerThread.run(Timer.java:505)

       

      "Timer-0" prio=5 tid=14 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at java.util.TimerThread.mainLoop(Timer.java:526)

      at java.util.TimerThread.run(Timer.java:505)

       

      "worker #3" prio=5 tid=71 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at com.jnbridge.jnbcore.server.b.c.run(Unknown Source)

      at java.lang.Thread.run(Thread.java:744)

       

      "MulticastListener" prio=5 tid=55 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "ajp-bio-8012-exec-347" prio=5 tid=1493 RUNNABLE


      at java.net.SocketInputStream.socketRead0(Native Method)

      at java.net.SocketInputStream.read(SocketInputStream.java:152)

      at java.net.SocketInputStream.read(SocketInputStream.java:122)

      at org.apache.coyote.ajp.AjpProcessor.read(AjpProcessor.java:319)

      at org.apache.coyote.ajp.AjpProcessor.readMessage(AjpProcessor.java:445)

      at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:132)

      at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.jav a:539)

      at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:298)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "DefaultQuartzScheduler_Worker-7" prio=5 tid=44 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "obj-skimmer-dev_trnd_assignmentdesk" prio=5 tid=1017 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "ContainerBackgroundProcessor[StandardEngine[Catalina]]" prio=5 tid=76 TIMED_WAITING


      at java.lang.Thread.sleep(Native Method)

      at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.jav a:1474)

      at java.lang.Thread.run(Thread.java:744)

       

      "ajp-bio-8012-exec-333" prio=5 tid=1442 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "ajp-bio-8012-exec-337" prio=5 tid=1450 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "worker #4" prio=5 tid=72 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at com.jnbridge.jnbcore.server.b.c.run(Unknown Source)

      at java.lang.Thread.run(Thread.java:744)

       

      "Signal Dispatcher" prio=9 tid=4 RUNNABLE

       

      "scheduler-5" prio=5 tid=859 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.scheduling.Scheduler.createRunnable(Scheduler.java:132)

      at coldfusion.scheduling.ThreadPool.createRunnable(ThreadPool.java:138)

      at coldfusion.scheduling.WorkerThread.run(WorkerThread.java:68)

       

      "net.sf.ehcache.CacheManager@485165c7" prio=5 tid=100 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at java.util.TimerThread.mainLoop(Timer.java:552)

      at java.util.TimerThread.run(Timer.java:505)

       

      "scheduler-1" prio=5 tid=58 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.scheduling.Scheduler.createRunnable(Scheduler.java:132)

      at coldfusion.scheduling.ThreadPool.createRunnable(ThreadPool.java:138)

      at coldfusion.scheduling.WorkerThread.run(WorkerThread.java:68)

       

      "Java2D Disposer" prio=10 tid=73 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)

      at sun.java2d.Disposer.run(Disposer.java:145)

      at java.lang.Thread.run(Thread.java:744)

       

      "Timer-5" prio=5 tid=74 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at java.util.TimerThread.mainLoop(Timer.java:552)

      at java.util.TimerThread.run(Timer.java:505)

       

      "Thread-5" prio=5 tid=17 TIMED_WAITING


      at java.lang.Thread.sleep(Native Method)

      at org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:104)

       

      "Thread-30" prio=5 tid=88 RUNNABLE


      at java.net.DualStackPlainSocketImpl.accept0(Native Method)

      at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)

      at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:198)

      at java.net.ServerSocket.implAccept(ServerSocket.java:530)

      at java.net.ServerSocket.accept(ServerSocket.java:498)

      at org.apache.catalina.core.StandardServer.await(StandardServer.java:447)

      at com.adobe.coldfusion.launcher.Launcher.await(Launcher.java:499)

      at com.adobe.coldfusion.launcher.Launcher.access$000(Launcher.java:63)

      at com.adobe.coldfusion.launcher.Launcher$1.run(Launcher.java:341)

      at java.lang.Thread.run(Thread.java:744)

       

      "obj-skimmer-ISC_dev" prio=5 tid=1029 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "AuthCacheManager" prio=5 tid=19 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at java.util.TimerThread.mainLoop(Timer.java:552)

      at java.util.TimerThread.run(Timer.java:505)

       

      "DefaultQuartzScheduler_Worker-5" prio=5 tid=42 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "DefaultQuartzScheduler_Worker-10" prio=5 tid=47 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "ajp-bio-8012-exec-338" prio=5 tid=1477 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "obj-skimmer-ADHD" prio=5 tid=25 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "scheduler-4" prio=5 tid=844 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.scheduling.Scheduler.createRunnable(Scheduler.java:132)

      at coldfusion.scheduling.ThreadPool.createRunnable(ThreadPool.java:138)

      at coldfusion.scheduling.WorkerThread.run(WorkerThread.java:68)

       

      "ajp-bio-8012-exec-343" prio=5 tid=1486 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "ajp-bio-8012-exec-346" prio=5 tid=1489 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "MulticastListener" prio=5 tid=51 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "Thread-1" prio=1 tid=10 TIMED_WAITING


      at java.lang.Thread.sleep(Native Method)

      at com.adobe.coldfusion.bootstrap.ConsoleLogRotationHandler$1.run(ConsoleLogRotationHandler. java:57)

      at java.lang.Thread.run(Thread.java:744)

       

      "DefaultQuartzScheduler_Worker-3" prio=5 tid=40 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "obj-skimmer-web_prod" prio=5 tid=1025 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "ajp-bio-8012-Acceptor-0" prio=5 tid=77 RUNNABLE


      at java.net.DualStackPlainSocketImpl.accept0(Native Method)

      at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)

      at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:198)

      at java.net.ServerSocket.implAccept(ServerSocket.java:530)

      at java.net.ServerSocket.accept(ServerSocket.java:498)

      at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFac tory.java:60)

      at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:207)

      at java.lang.Thread.run(Thread.java:744)

       

      "DefaultQuartzScheduler_Worker-2" prio=5 tid=39 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "MulticastListener" prio=5 tid=57 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "Thread-375" prio=5 tid=944 RUNNABLE


      at sun.print.Win32PrintServiceLookup.notifyPrinterChange(Native Method)

      at sun.print.Win32PrintServiceLookup.access$100(Win32PrintServiceLookup.java:50)

      at sun.print.Win32PrintServiceLookup$PrinterChangeListener.run(Win32PrintServiceLookup.java: 323)

       

      "Timer-3" prio=5 tid=49 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at java.util.TimerThread.mainLoop(Timer.java:552)

      at java.util.TimerThread.run(Timer.java:505)

       

      "ajp-bio-8012-exec-305" prio=5 tid=1357 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "DefaultQuartzScheduler_Worker-4" prio=5 tid=41 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "ajp-bio-8012-exec-319" prio=5 tid=1379 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "DestroyJavaVM" prio=5 tid=89 RUNNABLE

       

      "ajp-bio-8012-exec-331" prio=5 tid=1438 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "obj-skimmer-dvinciORACLE" prio=5 tid=1019 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "obj-skimmer-nVision" prio=5 tid=28 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "ServerThread" prio=5 tid=67 RUNNABLE


      at java.net.DualStackPlainSocketImpl.waitForNewConnection(Native Method)

      at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:135)

      at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)

      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:198)

      at java.net.ServerSocket.implAccept(ServerSocket.java:530)

      at java.net.ServerSocket.accept(ServerSocket.java:498)

      at com.jnbridge.jnbcore.server.b.b.if(Unknown Source)

      at com.jnbridge.jnbcore.JNBMain$a.run(Unknown Source)

       

      "Thread-26" prio=5 tid=66 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at coldfusion.util.SimpleThreadPool.getAssignment(SimpleThreadPool.java:113)

      at coldfusion.util.SimpleWorkerThread.run(SimpleThreadPool.java:211)

       

      "obj-skimmer-legislation" prio=5 tid=1023 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "ajp-bio-8012-exec-299" prio=5 tid=1349 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "scheduler-0" prio=5 tid=21 RUNNABLE


      at java.lang.Thread.getStackTrace(Thread.java:1588)

      at coldfusion.monitor.stack.J5StackTrace.getAllStackTraces(J5StackTrace.java:39)

      at coldfusion.monitor.active.Snapshot.getJavaStackTrace(Snapshot.java:606)

      at coldfusion.monitor.active.Snapshot.getSnapshotData(Snapshot.java:165)

      at coldfusion.monitor.active.Snapshot.dumpSnapshot(Snapshot.java:595)

      at coldfusion.monitor.alert.Alert.dumpSnapshot(Alert.java:599)

      at coldfusion.monitor.alert.SlowServerAlert$SlowServerAlertTask.run(SlowServerAlert.java:166 )

      at coldfusion.monitor.MonitoringServiceImpl$RunnableWrapper.run(MonitoringServiceImpl.java:1 570)

      at coldfusion.scheduling.ThreadPool.run(ThreadPool.java:211)

      at coldfusion.scheduling.WorkerThread.run(WorkerThread.java:71)

       

      "MulticastListener" prio=5 tid=54 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "Attach Listener" prio=5 tid=5 RUNNABLE

       

      "ajp-bio-8012-exec-326" prio=5 tid=1432 RUNNABLE


      at java.net.SocketInputStream.socketRead0(Native Method)

      at java.net.SocketInputStream.read(SocketInputStream.java:152)

      at java.net.SocketInputStream.read(SocketInputStream.java:122)

      at org.apache.coyote.ajp.AjpProcessor.read(AjpProcessor.java:319)

      at org.apache.coyote.ajp.AjpProcessor.readMessage(AjpProcessor.java:445)

      at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:132)

      at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.jav a:539)

      at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:298)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "ajp-bio-8012-exec-332" prio=5 tid=1441 WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueue dSynchronizer.java:2043)

      at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)

      at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:104)

      at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "MulticastListener" prio=5 tid=59 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "MulticastListener" prio=5 tid=52 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "obj-skimmer-dev_DNADay" prio=5 tid=1013 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "AWT-Windows" prio=6 tid=202 RUNNABLE


      at sun.awt.windows.WToolkit.eventLoop(Native Method)

      at sun.awt.windows.WToolkit.run(WToolkit.java:299)

      at java.lang.Thread.run(Thread.java:744)

       

      "MulticastListener" prio=5 tid=60 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "ajp-bio-8012-exec-339" prio=5 tid=1479 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "Finalizer" prio=8 tid=3 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)

      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)

      at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)

       

      "worker #0" prio=5 tid=68 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at com.jnbridge.jnbcore.server.b.c.run(Unknown Source)

      at java.lang.Thread.run(Thread.java:744)

       

      "DefaultQuartzScheduler_Worker-6" prio=5 tid=43 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:552)

       

      "MulticastListener" prio=5 tid=50 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "MulticastListener" prio=5 tid=53 RUNNABLE


      at java.net.TwoStacksPlainDatagramSocketImpl.receive0(Native Method)

      at java.net.TwoStacksPlainDatagramSocketImpl.receive(TwoStacksPlainDatagramSocketImpl.java:1 14)

      at java.net.DatagramSocket.receive(DatagramSocket.java:786)

      at coldfusion.license.g.run(Unknown Source)

       

      "Timer-1" prio=5 tid=15 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at java.util.TimerThread.mainLoop(Timer.java:526)

      at java.util.TimerThread.run(Timer.java:505)

       

      "ajp-bio-8012-exec-344" prio=5 tid=1487 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "scheduler-3" prio=5 tid=795 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.scheduling.Scheduler.createRunnable(Scheduler.java:132)

      at coldfusion.scheduling.ThreadPool.createRunnable(ThreadPool.java:138)

      at coldfusion.scheduling.WorkerThread.run(WorkerThread.java:68)

       

      "customcache.data" prio=5 tid=101 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoo lExecutor.java:1090)

      at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoo lExecutor.java:807)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "ajp-bio-8012-exec-348" prio=5 tid=1494 TIMED_WAITING


      at sun.misc.Unsafe.park(Native Method)

      at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)

      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Abstract QueuedSynchronizer.java:2082)

      at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86)

      at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32)

      at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

       

      "Thread-25" prio=5 tid=65 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at coldfusion.util.SimpleThreadPool.getAssignment(SimpleThreadPool.java:113)

      at coldfusion.util.SimpleWorkerThread.run(SimpleThreadPool.java:211)

       

      "worker #2" prio=5 tid=70 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at com.jnbridge.jnbcore.server.b.c.run(Unknown Source)

      at java.lang.Thread.run(Thread.java:744)

       

      "worker #1" prio=5 tid=69 WAITING


      at java.lang.Object.wait(Native Method)

      at java.lang.Object.wait(Object.java:503)

      at com.jnbridge.jnbcore.server.b.c.run(Unknown Source)

      at java.lang.Thread.run(Thread.java:744)

       

      "obj-skimmer-legislation_dev" prio=5 tid=1031 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)

       

      "obj-skimmer-dev_intranet" prio=5 tid=1015 TIMED_WAITING


      at java.lang.Object.wait(Native Method)

      at coldfusion.server.j2ee.pool.PoolSkimmerThread.run(PoolSkimmerThread.java:47)

      at java.lang.Thread.run(Thread.java:744)