1 INFO   NodeMain [main]: NodeMain.main(): portalHost = null
1355 INFO   NodeManager [main]: Starting NodeManager at 02/21/2016 04:58:20 GMT (1456030700662), version: $Name:  $
1358 INFO   NodeManager [main]: Node IP: node2/134.89.36.2
2029 INFO   NodeManager [main]: Node ID has been set to 1598
3235 INFO   PortManager [main]: Found 14 configured ports in properties file
3298 INFO   MOOSPortManager [main]: Found DPA at slot: 0
5179 INFO   MOOSPortManager [main]: Found DPA at slot: 1
6789 INFO   MOOSPortManager [main]: Found DPA at slot: 2
8379 INFO   MOOSPortManager [main]: Found DPA at slot: 3
9967 INFO   MOOSPortManager [main]: No DPA found at slot: 4
9971 INFO   MOOSPortManager [main]: No DPA found at slot: 5
10018 INFO   WDTManager [main]: WDTManager constructor
10020 INFO   MOOSWDTManager [main]: MOOSWDTManager constructor
10083 INFO   SleepManager [main]: SleepManager constructor
10087 INFO   MOOSSleepManager [main]: MOOSSleepManager constructor
11755 INFO   CommsLeaseListener [main]: CommsLeaseListener() complete
11821 INFO   CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor
11836 INFO   CpuLease [main]: CpuLease() constructor
11838 INFO   CpuLease [Thread-5]: CpuLease started
13826 ERROR  NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException
13925 INFO   MOOSNodeService [main]: Last MMC reset code: 6
14125 INFO   NodeManager [main]: Starting registry... 
14166 INFO   NodeManager [main]: registry started.
14167 INFO   NodeManager [main]: binding NodeService to rmi://localhost/node
14785 INFO   NodeManager [main]: NodeService is bound to rmi://localhost/node
14948 INFO   MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer
14956 ERROR  MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!!
15118 INFO   PortManager [main]: Service jar not specified for port /dev/ttySX0
16066 INFO   PortManager [main]: Starting service...
16325 INFO   MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful
31924 INFO   BaseInstrumentService [main]: initializeInstrument() for 
33499 WARN   StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP
38534 INFO   StreamingSBE19 [main]: Event detection disabled by attribute
38617 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
46743 INFO   PortManager [main]: service started
47295 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
47935 INFO   PortManager [main]: Starting service...
68713 INFO   BaseInstrumentService [main]: initializeInstrument() for 
68715 INFO   WetLabsECO [main]: Initializing...
84078 INFO   WetLabsECO [main]: Initializing completed
84079 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
93090 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827
93092 INFO   PolledInstrumentService [main]: id 1535 slaved to 1827
93111 INFO   PortManager [main]: service started
93118 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
93137 INFO   WetLabsECO [Thread-25]: TEST: ID=1535, trigger sample at 1456030792451
95127 INFO   PortManager [main]: Starting service...
95513 INFO   WetLabsECO [Thread-25]: TEST: ID=1535, got complete sample at + 1456030794826
156312 INFO   BaseInstrumentService [main]: initializeInstrument() for 
158398 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
164556 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
164665 INFO   Aquadopp [main]: Retrieving Aquadopp state Metadata...
166647 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
174426 INFO   PortManager [main]: service started
174434 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
174881 INFO   PortManager [main]: Starting service...
176577 INFO   Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2
185694 INFO   BaseInstrumentService [main]: initializeInstrument() for 
188003 ERROR  StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command
190667 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
192573 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535
192575 INFO   PolledInstrumentService [main]: id 1524 slaved to 1535
192579 INFO   PortManager [main]: service started
192607 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
192619 INFO   AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456030891933
193653 INFO   PortManager [main]: Starting service...
230016 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
235644 INFO   BaseInstrumentService [main]: initializeInstrument() for 
235647 INFO   StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825
235657 INFO   StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes
238624 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
238664 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
238707 INFO   StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
238708 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
238964 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
239003 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
239048 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
239049 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
239051 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
239053 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1
239054 INFO   StreamingWorkhorseADCP-1825 [main]: Start pinging
239242 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
242345 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD?
242383 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
242925 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF?
242963 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243494 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN?
243533 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
244112 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP?
244156 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
244684 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS?
244723 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245284 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV?
245323 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245866 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
245909 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
246454 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP?
246493 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247024 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS?
247111 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247645 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA?
247683 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248214 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB?
248253 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248835 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED?
248874 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
249424 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES?
249460 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
249995 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX?
250030 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
250595 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ?
250633 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
251164 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
251203 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
251745 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA?
251766 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
252464 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
252551 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
258071 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5513 ms outbuf.len=8192 avail: 47 read: 5375Request=RR?
259144 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
261355 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
262424 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
264641 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
265222 ERROR  StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V


265464 INFO   PortManager [main]: service started
265486 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
267425 INFO   PortManager [main]: Starting service...
338401 ERROR  DeviceLog [main]: readLogData: data size mismatch
338403 ERROR  DeviceLog [main]:   bytes read from file: 1173
338404 ERROR  DeviceLog [main]:   dataSize in index entry: 1927
338487 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
349144 INFO   BaseInstrumentService [main]: initializeInstrument() for 
349146 INFO   StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828
349156 INFO   StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes
351857 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
351904 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
351996 INFO   StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
351997 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
352235 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
352274 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
352359 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
352360 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
352362 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
352363 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1
352395 INFO   StreamingWorkhorseADCP-1828 [main]: Start pinging
352582 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
355384 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD?
355424 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
355985 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF?
356024 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
356554 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN?
356594 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357134 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP?
357173 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357725 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS?
357764 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
358315 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV?
358354 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
358904 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
358943 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
359504 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP?
359544 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360075 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS?
360113 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360694 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA?
360733 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361304 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB?
361344 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361887 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED?
361928 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
362494 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES?
362533 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363075 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX?
363113 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363704 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ?
363743 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
364304 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
364344 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
364894 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA?
364915 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
365485 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
365524 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
372726 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 7187 ms outbuf.len=8192 avail: 3881 read: 3095Request=RR?
375594 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
378556 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
382465 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
385405 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
385975 ERROR  StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V