Navigation :

WatchdogApp

Alarms

The following 87 alarms may be generated by N2SVCD Application “WatchdogApp”.

Show: Alarm Warning Clear Notice

No alarms found that match search criteria.

N2::Application

SV-AP-10000
WARNING

Connection

Error sending statistics: %s

Cause: An error was encountered sending application statistics.	%s = The error that occurred when sending statistics.
Resolution: Review N2SVCD statistics configuration. Ensure the endpoint is available.

SV-AP-10012
NOTICE

Application

Trace Level is '%s'.

Cause: Parameter configuration at startup. Configured application trace level.	%s = The configured application trace level.
Resolution: None.

SV-AP-10013
NOTICE

Application

Trace Level Max is '%s'.

Cause: Parameter configuration at startup. Configured application max trace level.	%s = The configured max trace level.
Resolution: None.

SV-AP-10014
NOTICE

Application

Trace Per Second is '%s'.

Cause: Parameter configuration at startup. Configured application trace per second.	%s = The configured trace per second.
Resolution: None.

SV-AP-10015
NOTICE

Application

Retaining '%d' shutdown instances.

Cause: Parameter configuration at startup. Configured application instance retention count.	%d = The configured shutdown instance retention count.
Resolution: None.

SV-AP-10016
NOTICE

Application

Statistics Slice Count is '%s'.

Cause: Parameter configuration at startup. Configured application statistics slice count.	%s = The configured statistics slice count.
Resolution: None.

SV-AP-10017
NOTICE

Application

Statistics Slice Seconds is '%s'.

Cause: Parameter configuration at startup. Configured application statistics slice seconds.	%s = The configured statistics slice seconds.
Resolution: None.

SV-AP-10019
NOTICE

Application

EDR Application Name = '%s'.

Cause: Parameter configuration at startup. Configured EDR application name.	%s = The configured EDR application name.
Resolution: None.

SV-AP-10020
NOTICE

Application

EDR Default Stream = '%s'.

Cause: Parameter configuration at startup. Configured EDR stream.	%s = The configured EDR stream.
Resolution: None.

SV-AP-10021
WARNING

Configuration

Cannot write EDRs. Configured EDR App '%s' is not a known Application.

Cause: Configured EDR application to utilize does not map to known application.	%s = The name of the EDR app that is not known.
Resolution: Check application configuration defines configured EDR application. Check configured EDR application exists and is configured.

SV-AP-10029
NOTICE

Application

EDRs are Supported but NOT Enabled.

Cause: Parameter configuration at startup. Application supports EDRs but they are not enabled.	-
Resolution: None.

SV-AP-10030
WARNING

Application

Application did not handle timeout reason '%s'.

Cause: Received timeout that the underlying application did not handle.	%s = The reason the timeout was not handled.
Resolution: Contact N-Squared support.

SV-AP-10031
NOTICE

Application

Configuration Scalar Update of '%s' %s.

Cause: Application configuration scalar value updated.	%s = The configuration key that was updated. %s = Whether or not the update was successful.
Resolution: None.

SV-AP-10032
NOTICE

Application

Configuration Vector Change of '%s' [%s] Succeeded.

Cause: Application configuration vector updated.	%s = The updated configuration key. %s = The update action.
Resolution: None.

SV-AP-10033
ALARM

Application

Application transition from %s -> %s.

Cause: Application access has transitioned between ONLINE <=> SHUTDOWN/OFFLINE/QUIESCE.	%s = The original access level name (ONLINE). %s = The new access level name (SHUTDOWN/OFFLINE/QUIESCE).
Resolution: Confirm that this state change is expected.

SV-AP-10033
CLEAR

Application

Application transition from %s -> %s.

Cause: Application access has transitioned between SHUTDOWN/OFFLINE/QUIESCE <=> ONLINE.	%s = The original access level name (SHUTDOWN/OFFLINE/QUIESCE). %s = The new access level name (ONLINE).
Resolution: None.

SV-AP-10034
WARNING

Internal

Instance [%s] already over when performing instance_over().

Cause: Instance received duplicate 'over' handler.	%s = Instance index.
Resolution: Contact N-Squared support.

SV-AP-10035
WARNING

Internal

Instance [%s] not found when performing instance_over().

Cause: Instance not found when performing over handler.	%s = Instance index.
Resolution: Contact N-Squared support.

SV-AP-10038
WARNING

Application

Failed to cancel timer [%s]: %s

Cause: Failed to cancel in progress timer.	%s = The reason the timer could not be canceled. %s = The error result when trying to cancel the timer.
Resolution: Review the associated error reason. Review the associated error result. Contact N-Squared support.

SV-AP-10039
WARNING

Internal

Discarding Message from unknown sender '%s'.

Cause: Received application message from unknown sender.	%s = The unknown sender.
Resolution: Contact N-Squared support.

SV-AP-10040
WARNING

Application

Failed to process %s from %s: %s

Cause: Failed to process admin queue message.	%s = The message. %s = The sending application. %s = The error result when trying to read from the message queue.
Resolution: Contact N-Squared support.

SV-AP-10041
WARNING

Application

Failed to process %s from %s: %s

Cause: Failed to process user queue message.	%s = The message. %s = The sending application. %s = The error result when trying to read from the message queue.
Resolution: Contact N-Squared support.

SV-AP-10042
WARNING

Configuration

Configuration Request for '%s' (%s) Failed: %s

Cause: Failed to query application configuration vector.	%s = The configuration key. %s = The configuration row key. %s = The error result when trying to query the configuration vector.
Resolution: Review the associated error result. Check the inbound message content construction.

SV-AP-10043
WARNING

Message

Resources Request for '%s' (%s) Failed: %s

Cause: Failed to query application resource.	%s = The resource key. %s = The resource key row. %s = The error result when trying to query the resource.
Resolution: Review the associated error result. Check the inbound message content construction.

SV-AP-10044
WARNING

Configuration

Configuration Update of '%s' Failed: %s

Cause: Failed to update application configuration scalar.	%s = The configuration key. %s = The error result when trying to update the configuration scalar.
Resolution: Review the associated error result. Check the configuration update message content construction.

SV-AP-10045
WARNING

Application

Received instance message %s with no context. Discarding.

Cause: Received instance message with no context.	%s = The message.
Resolution: Review message construction. Ensure instance message contains instance context.

SV-AP-10046
WARNING

Application

Configuration environment translation for '\${%s}' is not defined.

Cause: Configuration environment not defined.	%s = The configuration variable name.
Resolution: Check environment configuration.

SV-AP-10047
WARNING

Application

Command `%s` failed to execute: %s

Cause: Failed to execute variable command.	%s = The error message generated when trying to execute the command. %s = The command.
Resolution: Review the associated command error. Check application execution permissions. Check command syntax and structure.

SV-AP-10048
WARNING

Application

Command `%s` died with signal %d.

Cause: Variable command execution exited with non-zero exit code.	%s = The command. %d = The exit signal.
Resolution: Review the associated error signal. Check application execution permissions. Check command syntax and structure.

SV-AP-10049
WARNING

Application

Command `%s` exited with non-zero value %d.

Cause: Variable command execution exited with non-zero exit code.	%s = The command. %d = The exit code.
Resolution: Review the associated exit code. Check command syntax and structure.

SV-AP-10050
WARNING

Resource
Configuration

Hostname '%s' is not known.

Cause: Failed to convert Hostname into address. Hostname is not known.	%s = The hostname.
Resolution: Check Hostname configuration. Check address configuration. Check DNS availability.

SV-AP-10051
WARNING

Application

Unhandled Message '%s' for Context '%s' from App '%s'.

Cause: Application unable to handle message.	%s = The message. %s = The message context. %s = The sending application name.
Resolution: Contact N-Squared support.

SV-AP-10052
ALARM

Application

Application is now OVERLOADED.

Cause: Application is now overloaded to the point where processing is affected.	-
Resolution: Check application traffic levels and configuration.

SV-AP-10052
CLEAR

Application

Application is now %s (not OVERLOADED).

Cause: Application is no longer overloaded.	%s = The new loading level (NORMAL or HIGH)
Resolution: None.

SV-AP-10053
NOTICE

Application

Throttle Enabled: max %d instances, max tps (%d average over %d secs).

Cause: Parameter configuration at startup. Configured application throttling parameters.	%d = The configured maximum active instance count. %d = The configured maximum TPS (new instances per second). %d = The configured sliding window (in seconds) for measuring TPS.
Resolution: None.

SV-AP-10054
ALARM

Application

Application is now at HIGH LOAD.

Cause: Application is now at high-load (processing is not yet affected).	-
Resolution: Check application traffic levels and configuration.

SV-AP-10054
CLEAR

Application

Application is now %s (not HIGH LOAD).

Cause: Application is no longer at high-load.	%s = The new loading level (NORMAL)
Resolution: None.

SV-AP-10056
NOTICE

Application

Resource Vector Operation '%s' Succeeded.

Cause: Application resource vector operation successful.	%s = The vector operation key.
Resolution: None.

SV-AP-10057
WARNING

Internal

ERROR thawing %d byte envelope: %s

Cause: Failed to thaw message byte envelope.	%d = The message envelope length. %s = The error that occurred trying to thaw the payload.
Resolution: Contact N-Squared support.

SV-AP-10058
WARNING

Configuration

Resource Operation of '%s' Failed: %s

Cause: Failed to perform resource operation.	%s = The resource key. %s = The error result when trying to perform the resource operation.
Resolution: Review the associated error result. Check the configuration update message content construction.

N2::TCP::ClientConnection

SV-TP-10100
WARNING

Application

SSL is not supported on '%s' connections. Ignored.

Cause: SSL is enabled. SSL is not supported for the current TCP protocol.	%s = The configured TCP protocol.
Resolution: Check application SSL and TCP protocol configuration.

SV-TP-10101
WARNING

Socket

Failed to create %s client socket: %s

Cause: Failed to create protocol socket.	%s = The socket protocol. %s = The error that occurred when trying to create to the socket.
Resolution: Review the associated error result. Check TCP configuration. Check the host machine supports creating TCP sockets.

SV-TP-10102
WARNING

Connection

Cannot set (new outbound) socket attributes: %s

Cause: Failed to set (new outbound) socket attributes.	%s = Description of the reason for failure, including the attribute type which could not be set.
Resolution: Review the associated error result. Check TCP configuration. Check the host machine supports getting socket flags.

SV-TP-10103
WARNING

Socket

Failed to bind %s socket to '%s:%d': %s

Cause: Failed to bind to local socket.	%s = The configured TCP protocol. %s = The configured local host. %d = The configured local port. %s = The error that occurred when trying to bind to the local socket.
Resolution: Review the associated error result. Check local bind configuration. Check the host machine supports creating sockets.

SV-TP-10104
WARNING

Application

Error resolving remote host '%s': %s

Cause: Unable to determine remote host.	%s = The configured remote host. %s = The error that occurred when trying to bind to the remote host.
Resolution: Review the associated error result. Check remote host configuration. Check remote host is accessible and accepting connections.

SV-TP-10105
WARNING

Connection

Error connecting to remote host %s:%d: %s

Cause: Failed to connect to remote host.	%s = The configured remote host. %d = The configured remote port. %s = The error that occurred when trying to connect to the remote host.
Resolution: Review the associated error result. Check remote host configuration. Check remote host is accessible and accepting connections.

SV-TP-10106
WARNING

Connection.

Connection error [%s:%d]: %s

Cause: Connection error.	%s = The remote host. %d = The remote port. %s = The error that occurred when trying to connect to the remote host.,
Resolution: Review the associated error message. Check client connection configuration. Check remote host is up and accessible.

SV-TP-10107
WARNING

Connection

Connection error flagged: %s

Cause: Socket error when connecting to remote end.	%s = The socket error that occurred when trying to connect to the remote application,
Resolution: Review the associated error result. Check remote host is up and accepting connections.

SV-TP-10108
WARNING

Socket

Outbound connection SSL setup error: %s

Cause: Failed to convert outbound raw socket into Net::SSL context.	%s = The error that occurred when trying to convert socket to SSL.
Resolution: Review the associated error result. Check SSL configuration.

N2::TCP::Connection

SV-TP-10500
WARNING

Message

UDP Datagram sent only %d of %d bytes. Datagram was truncated.

Cause: Mis-formed UDP datagram detected.	%d = The number of bytes that were written via UDP. %d = The total number of bytes that makes up the message.
Resolution: Review the message content construction. Inspect the UDP datagram payload.

SV-TP-10501
WARNING

Connection

Error calling recv: %s

Cause: Failed to receive on connection.	%s = The error that occurred when trying to read from the connection.
Resolution: Review the associated error result.

SV-TP-10502
WARNING

Connection

Error calling send: %s

Cause: Failed to send on connection.	%s = The error that occurred when trying to write to the connection.
Resolution: Review the associated error result.

N2::Trace

SV-AP-10065
WARNING

Application

Suppressed a total of %d duplicate warnings [%s].

Cause: The same warning ID was logged too many times in a fixed interval.	%d = The number of warnings that were suppressed. %s = The event ID of the suppressed warnings.
Resolution: Address the underlying problem which caused the warnings.

WatchdogApp

SV-WD-10000
NOTICE

Configuration

Shutdown Notice = %d seconds.

Cause: Parameter configuration at startup. Shutdown notice seconds.	%d = The configured shutdown notice seconds.
Resolution: None.

SV-WD-10001
NOTICE

Configuration

Termination Notice = %d milliseconds.

Cause: Parameter configuration at startup. Termination notice seconds.	%d = The configured termination notice seconds.
Resolution: None.

SV-WD-10002
NOTICE

Configuration

Heartbeat Interval = %d seconds.

Cause: Parameter configuration at startup. Heartbeat interval seconds.	%d = The configured heartbeat interval seconds.
Resolution: None.

SV-WD-10003
NOTICE

Configuration

Heartbeat Response = %d milliseconds.

Cause: Parameter configuration at startup. Heartbeat response milliseconds.	%d = The configured heartbeat response milliseconds.
Resolution: None.

SV-WD-10004
NOTICE

Application

Sending Shutdown NOW. Termination in %d ms.

Cause: Shutdown event received.	%d = Time till application termination.
Resolution: None.

SV-WD-10005
NOTICE

Application

Heartbeats have been stopped.

Cause: Heartbeats have been stopped.	-
Resolution: None.

SV-WD-10006
NOTICE

Application

Handle but ignore duplicate SIGINT.

Cause: Received duplicate SIGINT. Signal ignored.	-
Resolution: None.

SV-WD-10007
NOTICE

Application

Sending Shutdown Notice NOW. Shutdown in %d secs.

Cause: Sending shutdown notice to child applications.	%d = Shutdown notice seconds.
Resolution: None.

SV-WD-10008
NOTICE

Application

Overdue App '%s' has been killed.

Cause: Overdue application has died, killed by the Watchdog.	%s = The application name.
Resolution: None.

SV-WD-10009
NOTICE

Application

Deceased App '%s' RESTART NOW.

Cause: Application is deceased. Restarting it now.	%s = The application name.
Resolution: None.

SV-WD-10010
NOTICE

Application

Deceased App '%s' RESTART APPEARS SUCCESSFUL.

Cause: Deceased application restarted.	%s = The application name.
Resolution: None.

SV-WD-10011
NOTICE

Application

Heartbeats have been re-started.

Cause: Heartbeats have been re-enabled.	-
Resolution: None.

SV-WD-10012
NOTICE

Application

Late heartbeat for overdue app '%s'. Termination has been cancelled.

Cause: Received late heartbeat response from application.	%s = The application name.
Resolution: None.

SV-WD-10013
NOTICE

Configuration

Application '%s' overrides Heartbeat Startup = %d seconds.

Cause: Parameter configuration at startup. Application-specific startup heartbeat seconds.	%s = The application name to override the startup heartbeat value for. %d = The overridden heartbeat startup seconds.
Resolution: None.

SV-WD-10014
WARNING

Application

Failed to receive !HEARTBEAT-RESPONSE for Application '%s', PID %s.

Cause: Failed to receive heartbeat for application.	%s = The application name. %s = The application PID.
Resolution: Check application is not overloaded or in stuck state.

SV-WD-10015
WARNING

Application

Overdue App '%s' error checking for expiry at level '%s': %s

Cause: Application has been warned of overdue heartbeat.	%s = The application name. %s = The current warning level attributed to the application. %s = The current application process status.
Resolution: Check the application is not overloaded.

SV-WD-10016
WARNING

Application

Overdue App '%s' has died (independently).

Cause: Application has died.	%s = The application name.
Resolution: Contact N-Squared support.

SV-WD-10017
WARNING

Application

Overdue App '%s' will now be terminated.

Cause: Overdue application is being terminated.	%s = The application name.
Resolution: Check the application was not overloaded.

SV-WD-10018
WARNING

Application

Overdue App '%s' failed to confirm process termination: %s

Cause: Failed to confirm that application was terminated successfully.	%s = The name of the terminated application. %s = The error that occurred when checking for termination.
Resolution: Check the application was not overloaded. Check process permissions and kernel error log.

SV-WD-10019
WARNING

Application

Overdue App '%s' has died (we terminated it).

Cause: Overdue application has terminated cleanly.	%s = The application name.
Resolution: Check the application was not overloaded.

SV-WD-10020
WARNING

Application

Overdue App '%s' will now be killed.

Cause: Overdue application did not cleanly terminate. Force kill.	%s = The application name.
Resolution: Check the application was not overloaded.

SV-WD-10021
WARNING

Application

Overdue App '%s' failed to confirm process termination: %s

Cause: Failed to confirm that a force-killed application was terminated successfully.	%s = The name of the terminated application. %s = The error that occurred when checking for termination.
Resolution: Check the application was not overloaded. Check process permissions and kernel error log.

SV-WD-10022
NOTICE

Configuration

Application Heartbeats DISABLED.

Cause: Parameter configuration at startup. Application heartbeats are disabled.	-
Resolution: None.

SV-WD-10023
WARNING

Application

Deceased App '%s' RESTART FAILED: %s

Cause: Failed to restart deceased application.	%s = The application name. %s = The error result when attempting to restart the deceased application.
Resolution: Review the associated error result.

SV-WD-10024
NOTICE

Application

Late heartbeat for overdue app '%s' is too late. Termination is already under way.

Cause: Heartbeat overdue for application. Terminating.	%s = The application name.
Resolution: None.

SV-WD-10025
WARNING

Internal

Discarding '%s' message with no Heartbeat App Name.

Cause: Received heartbeat response with no application name.	%s = The message name received.
Resolution: Contact N-Squared support.

SV-WD-10026
WARNING

Configuration

Unable to send application-specific heartbeat to Application '%s'.

Cause: Unable to send application-specific heartbeat to named application.	%s = The application name.
Resolution: Check configured heartbeat application name is valid and that application is available.

SV-WD-10027
WARNING

Internal

Heartbeat Application Name '%s' not known!

Cause: Received heartbeat for unknown application.	%s = The application name.
Resolution: Contact N-Squared support.

SV-WD-10028
NOTICE

Configuration

Application '%s' overrides Heartbeat Interval = %d seconds.

Cause: Parameter configuration at startup. Application-specific heartbeat interval seconds.	%s = The application name to override the interval value for. %d = The overridden heartbeat interval seconds.
Resolution: None.

SV-WD-10029
NOTICE

Configuration

Application '%s' overrides Heartbeat Response = %d milliseconds.

Cause: Parameter configuration at startup. Application-specific heartbeat response milliseconds.	%s = The application name to override the response value for. %d = The overridden heartbeat response milliseconds.
Resolution: None.

SV-WD-10030
NOTICE

Configuration

Application '%s' Heartbeats DISABLED.

Cause: Parameter configuration at startup. Application specific heartbeats are disabled.	%s = The application name that has had heartbeats disabled.
Resolution: None.

SV-WD-10031
NOTICE

Application

Heartbeats have been stopped for Application = '%s'.

Cause: Heartbeats have been stopped for a specific application.	%s = The application that heartbeats have been stopped for.
Resolution: None.

SV-WD-10032
WARNING

Application

Failed to receive !HEARTBEAT-RESPONSE for Application '%s', PID %s.

Cause: Failed to receive heartbeat for application.	%s = The application name. %s = The application PID.
Resolution: Check application is not overloaded or in stuck state.

SV-WD-10033
WARNING

Internal

Discarding '%s' message with no Heartbeat ID.

Cause: Received heartbeat response with no heartbeat ID.	%s = The message name received.
Resolution: Contact N-Squared support.

Statistics

The following 9 statistics may be generated by N2SVCD Application “WatchdogApp”.

No statistics found that match search criteria.

N2::Application

instance.throttle.max_instances

Scope:

Message

Type:

Counter

Cause:

Maximum number of instances exceeding the max number of instances.

instance.throttle.max_tps_average

Scope:

Message

Type:

Counter

Cause:

Average max TPS for the last throttle period.

WatchdogApp

application.alive

Scope:

Application

Type:

Gauge

Cause:

Applications deemed to be alive based on heartbeat responses. A gauge value of 1 indicates an application responding to heartbeats, 0 indicates potentially dead or overloaded applications).

Tags:	`app`	`xyz`	The monitored application name. Will override the Watchdog's tag, if applicable.
Tags:	`app_instance`	`xyz`	The monitored application instance ID, if repeated. Will override the Watchdog's tag, if applicable.

application.load.pc

Scope:

Application

Type:

Gauge

Cause:

Self-reported application load percentage, 0-100.

Tags:	`app`	`xyz`	The monitored application name. Will override the Watchdog's tag, if applicable.
Tags:	`app_instance`	`xyz`	The monitored application instance ID, if repeated. Will override the Watchdog's tag, if applicable.

application.load.state

Scope:

Application

Type:

Gauge

Cause:

Application self-reported load state.

Tags:	`app`	`xyz`	The monitored application name. Will override the Watchdog's tag, if applicable.
	`app_instance`	`xyz`	The monitored application instance ID, if repeated. Will override the Watchdog's tag, if applicable.
	`state`	`normal`	Applications reporting a normal load.
		`high`	Applications reporting a high load.
		`overload`	Applications reporting overload.

application.online

Scope:

Application

Type:

Gauge

Cause:

Applications deemed to be accessible based on reported application access level. A gauge value of 1 indicates an application that is online, 0 indicates not online (e.g. quiescing, offline, etc.).

Tags:	`app`	`xyz`	The monitored application name. Will override the Watchdog's tag, if applicable.
Tags:	`app_instance`	`xyz`	The monitored application instance ID, if repeated. Will override the Watchdog's tag, if applicable.

heartbeat.failed

Scope:

Application

Type:

Counter

Cause:

Application heartbeats that did not receive a successful response.

Tags:	`type`	`common`	Heartbeats sent using common configuration.
		`specific`	Application-specific heartbeats sent.

heartbeat.ok

Scope:

Application

Type:

Counter

Cause:

Application heartbeats that received a successful response.

Tags:	`type`	`common`	Heartbeats sent using common configuration.
		`specific`	Application-specific heartbeats sent.

heartbeat.sent

Scope:

Application

Type:

Counter

Cause:

Application heartbeats sent.

Tags:	`type`	`common`	Heartbeats sent using common configuration.
		`specific`	Application-specific heartbeats sent.