Skip navigation
Currently Being Moderated

Coldfusion automatically restarted - tracking the cause

Nov 27, 2012 5:36 AM

Tags: #coldfusion #cf9 #redhat

Coldfusion is automatically restarting, a lot. It comes in waves, everything seems fine for a while then the server struggles for a few minutes, restarts a lot then settles down again.

 

 

I have Fusion Reactor installed, but when CF goes down FR stops logging so it's not really helping. Looking through the archived logs just shows gaps in the logs.

 

 

These are all the occourances of the phrase "Coldfusion started" today.

 

 

    [root@server2 logs]# grep -i "Coldfusion started" server.log | grep "11/27/12"

    "Information","main","11/27/12","01:49:35",,"ColdFusion started"

    "Information","main","11/27/12","01:50:46",,"ColdFusion started"

    "Information","main","11/27/12","01:52:39",,"ColdFusion started"

    "Information","main","11/27/12","01:54:08",,"ColdFusion started"

    "Information","main","11/27/12","01:55:12",,"ColdFusion started"

    "Information","main","11/27/12","01:56:29",,"ColdFusion started"

    "Information","main","11/27/12","01:57:36",,"ColdFusion started"

    "Information","main","11/27/12","01:58:57",,"ColdFusion started"

    "Information","main","11/27/12","01:59:56",,"ColdFusion started"

    "Information","main","11/27/12","02:01:38",,"ColdFusion started"

    "Information","main","11/27/12","02:03:11",,"ColdFusion started"

    "Information","main","11/27/12","02:04:41",,"ColdFusion started"

    "Information","main","11/27/12","02:07:53",,"ColdFusion started"

    "Information","main","11/27/12","02:10:45",,"ColdFusion started"

    "Information","main","11/27/12","02:11:49",,"ColdFusion started"

    "Information","main","11/27/12","02:13:09",,"ColdFusion started"

    "Information","main","11/27/12","02:14:18",,"ColdFusion started"

    "Information","main","11/27/12","02:15:44",,"ColdFusion started"

    "Information","main","11/27/12","02:17:06",,"ColdFusion started"

    "Information","main","11/27/12","02:34:19",,"ColdFusion started"

    "Information","main","11/27/12","03:01:20",,"ColdFusion started"

    "Information","main","11/27/12","05:25:59",,"ColdFusion started"

    "Information","main","11/27/12","06:30:48",,"ColdFusion started"

    "Information","main","11/27/12","06:36:20",,"ColdFusion started"

    "Information","main","11/27/12","09:34:07",,"ColdFusion started"

    "Information","main","11/27/12","09:35:39",,"ColdFusion started"

    "Information","main","11/27/12","09:36:41",,"ColdFusion started"

    "Information","main","11/27/12","09:39:15",,"ColdFusion started"

    "Information","main","11/27/12","09:40:42",,"ColdFusion started"

    "Information","main","11/27/12","09:42:55",,"ColdFusion started"

    "Information","main","11/27/12","09:44:23",,"ColdFusion started"

    "Information","main","11/27/12","09:46:18",,"ColdFusion started"

    "Information","main","11/27/12","09:47:35",,"ColdFusion started"

    "Information","main","11/27/12","09:48:53",,"ColdFusion started"

    "Information","main","11/27/12","09:50:04",,"ColdFusion started"

    "Information","main","11/27/12","09:51:51",,"ColdFusion started"

    "Information","main","11/27/12","09:53:05",,"ColdFusion started"

    "Information","main","11/27/12","09:54:24",,"ColdFusion started"

    "Information","main","11/27/12","09:55:28",,"ColdFusion started"

    "Information","main","11/27/12","09:56:38",,"ColdFusion started"

    "Information","main","11/27/12","09:58:03",,"ColdFusion started"

    "Information","main","11/27/12","09:59:03",,"ColdFusion started"

    "Information","main","11/27/12","10:04:37",,"ColdFusion started"

    "Information","main","11/27/12","12:04:02",,"ColdFusion started"

 

 

I've been looking at the live server metrics in FR on a second screen all day, the CPU, Memory and requests all seemed fine about 12 midday, then the server rebooted.

 

 

Looking at the logs for the hour between 9am and 10am (more than 15 restarts in the hour), the CPU never went over 44% usage and the Memory never exceeded 53% usage - in the recorded stats at least.

 

 

There is no JDBC tracking at the moment, so I'll add that to tracking and see if it's MySQL causing a problem, but can anyone help me narrow down the problem, what would cause Cold Fusion to auto restart, and I'm assuming the auto restart is only happening because Fusion Reactor is installed.

 

 

It's a Red Hat 5 LAMP stack running Coldfusion 9 and Fusion Reactor 4.5.2

 
Replies
  • Currently Being Moderated
    Nov 27, 2012 6:10 AM   in reply to PeteComcar

    Is this a new server, upgraded server, changed server?

    Just trying to determine if the server restarting is a new thing on this server or if it has been doing this all along (recently built).

     
    |
    Mark as:
  • Currently Being Moderated
    Nov 27, 2012 6:23 AM   in reply to PeteComcar

    I have not used Fusion Reactor but since it is a server monitoring tool it seems odd that it is not logging anything.  Before installing Fusion Reactor was ColdFusion restarting or just stopping?  I'm not pointing to Fusion Reactor as the culprit but just thinking that if it is not helping you then perhaps you can disable it until the next ColdFusion failure.  Maybe then you will see something in the logs.  Or can you check previous logs before you installed Fusion Reactor to see what ColdFusion was reporting (if anything).

     

    Just thinking out loud here...

     
    |
    Mark as:
  • Currently Being Moderated
    Nov 27, 2012 7:03 AM   in reply to PeteComcar

    The ColdFusion server log doesn't generally report much.  I'm not sure on Linux installs but does the JRun4/logs directory still contain the cfusion-out.log file?  That log file shows a much broader picture of what is happening.

     
    |
    Mark as:
  • Currently Being Moderated
    Nov 27, 2012 8:10 AM   in reply to PeteComcar

    There is a setting under the datasource(s) in the ColdFusion admin to log database activity.  It might depend on the drivers being used. 

     
    |
    Mark as:
  • Currently Being Moderated
    Nov 27, 2012 8:13 AM   in reply to PeteComcar

    PeteComcar wrote:

     

    I have no idea where the JRun logs are, I will try and find them and look in there.

     

     

    I found this regarding the JRun logfiles http://helpx.adobe.com/legacy/kb/jrun-4-0-configuring-java.html

     
    |
    Mark as:
  • Currently Being Moderated
    Nov 27, 2012 11:27 PM   in reply to PeteComcar

    PeteComcar wrote:

     

    I have no idea where the JRun logs are, I will try and find them and look in there.

    I think you will find what you're looking for in {CF_INSTALLATION_DIR}/runtime/logs. However, my feeling is that we will get clues by examining exception.log, application.log, coldfusion-out.log and server.log. They are located in {CF_INSTALLATION_DIR}/logs.

     
    |
    Mark as:
  • Currently Being Moderated
    Nov 28, 2012 11:53 AM   in reply to PeteComcar

    PeteComcar wrote:

     

    11/28 09:13:42 error Cannot create cookie: , CFID = 10620790

    We can at least debug this one. It very likely occurs because you have, in your cookie code, given a cookie a name that is a reserved word. See Jochem van Dieten's article on using reserved names for cookies. So review your code for places where cookies are named.

     
    |
    Mark as:

More Like This

  • Retrieving data ...

Bookmarked By (0)

Answers + Points = Status

  • 10 points awarded for Correct Answers
  • 5 points awarded for Helpful Answers
  • 10,000+ points
  • 1,001-10,000 points
  • 501-1,000 points
  • 5-500 points