1 INFO   NodeMain [main]: NodeMain.main(): portalHost = null
1378 INFO   NodeManager [main]: Starting NodeManager at 02/27/2016 23:02:28 GMT (1456614148874), version: $Name:  $
1380 INFO   NodeManager [main]: Node IP: node2/134.89.36.2
2046 INFO   NodeManager [main]: Node ID has been set to 1598
3254 INFO   PortManager [main]: Found 14 configured ports in properties file
3318 INFO   MOOSPortManager [main]: Found DPA at slot: 0
5199 INFO   MOOSPortManager [main]: Found DPA at slot: 1
6808 INFO   MOOSPortManager [main]: Found DPA at slot: 2
8399 INFO   MOOSPortManager [main]: Found DPA at slot: 3
9986 INFO   MOOSPortManager [main]: No DPA found at slot: 4
9990 INFO   MOOSPortManager [main]: No DPA found at slot: 5
10025 INFO   WDTManager [main]: WDTManager constructor
10027 INFO   MOOSWDTManager [main]: MOOSWDTManager constructor
10090 INFO   SleepManager [main]: SleepManager constructor
10094 INFO   MOOSSleepManager [main]: MOOSSleepManager constructor
11794 INFO   CommsLeaseListener [main]: CommsLeaseListener() complete
11860 INFO   CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor
11876 INFO   CpuLease [main]: CpuLease() constructor
11883 INFO   CpuLease [Thread-5]: CpuLease started
13875 ERROR  NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException
13974 INFO   MOOSNodeService [main]: Last MMC reset code: 4
14297 INFO   NodeManager [main]: Starting registry... 
14336 INFO   NodeManager [main]: registry started.
14337 INFO   NodeManager [main]: binding NodeService to rmi://localhost/node
14824 INFO   NodeManager [main]: NodeService is bound to rmi://localhost/node
14849 INFO   MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer
14995 ERROR  MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!!
15181 INFO   PortManager [main]: Service jar not specified for port /dev/ttySX0
16103 INFO   PortManager [main]: Starting service...
16444 INFO   MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful
31854 INFO   BaseInstrumentService [main]: initializeInstrument() for 
33428 WARN   StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP
38464 INFO   StreamingSBE19 [main]: Event detection disabled by attribute
38530 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
46773 INFO   PortManager [main]: service started
47289 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
48001 INFO   PortManager [main]: Starting service...
68575 INFO   BaseInstrumentService [main]: initializeInstrument() for 
68577 INFO   WetLabsECO [main]: Initializing...
83977 INFO   WetLabsECO [main]: Initializing completed
83978 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
92976 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827
92977 INFO   PolledInstrumentService [main]: id 1535 slaved to 1827
93016 INFO   PortManager [main]: service started
93023 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
93045 INFO   WetLabsECO [Thread-25]: TEST: ID=1535, trigger sample at 1456614240549
95086 INFO   PortManager [main]: Starting service...
95422 INFO   WetLabsECO [Thread-25]: TEST: ID=1535, got complete sample at + 1456614242926
156051 INFO   BaseInstrumentService [main]: initializeInstrument() for 
158067 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
164245 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
164351 INFO   Aquadopp [main]: Retrieving Aquadopp state Metadata...
166336 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
174069 INFO   PortManager [main]: service started
174074 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
174579 INFO   PortManager [main]: Starting service...
176217 INFO   Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2
185434 INFO   BaseInstrumentService [main]: initializeInstrument() for 
187558 ERROR  StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command
190366 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
192406 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535
192407 INFO   PolledInstrumentService [main]: id 1524 slaved to 1535
192413 INFO   PortManager [main]: service started
192421 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
192439 INFO   AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456614339942
193481 INFO   PortManager [main]: Starting service...
228494 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
234124 INFO   BaseInstrumentService [main]: initializeInstrument() for 
234126 INFO   StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825
234136 INFO   StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes
237104 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
237143 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
237186 INFO   StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
237188 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
237474 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
237512 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
237558 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
237559 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
237561 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
237563 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1
237564 INFO   StreamingWorkhorseADCP-1825 [main]: Start pinging
237751 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
240854 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD?
240892 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
241484 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF?
241522 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
242064 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN?
242140 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
242674 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP?
242715 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243244 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS?
243283 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243804 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV?
243851 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
244394 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
244432 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
244974 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP?
245012 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245554 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS?
245592 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
246134 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA?
246221 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
246764 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB?
246802 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247374 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED?
247452 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247984 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES?
248022 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248554 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX?
248592 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
249134 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ?
249173 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
249704 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
249743 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
250284 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA?
250304 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
251104 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
251143 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
256729 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5581 ms outbuf.len=8192 avail: 119 read: 5320Request=RR?
257816 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
260090 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
261114 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
263324 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
263911 ERROR  StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V


264195 INFO   PortManager [main]: service started
264204 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
266118 INFO   PortManager [main]: Starting service...
336296 ERROR  DeviceLog [main]: readLogData: data size mismatch
336297 ERROR  DeviceLog [main]:   bytes read from file: 1173
336298 ERROR  DeviceLog [main]:   dataSize in index entry: 1927
336446 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
347104 INFO   BaseInstrumentService [main]: initializeInstrument() for 
347106 INFO   StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828
347116 INFO   StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes
349824 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
349871 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
349995 INFO   StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
349996 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
350234 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
350274 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
350319 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
350321 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
350323 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
350345 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1
350346 INFO   StreamingWorkhorseADCP-1828 [main]: Start pinging
350531 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
353494 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD?
353538 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
354084 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF?
354123 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
354684 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN?
354723 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
355284 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP?
355323 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
355866 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS?
355912 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
356454 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV?
356493 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357074 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
357113 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357714 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP?
357754 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
358294 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS?
358333 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
358914 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA?
358953 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
359494 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB?
359533 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360074 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED?
360113 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360664 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES?
360703 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361234 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX?
361273 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361836 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ?
361883 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
362444 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
362483 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363034 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA?
363055 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363634 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
363673 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
370483 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 6806 ms outbuf.len=8192 avail: 2958 read: 3656Request=RR?
373484 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
375687 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
378614 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
380825 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
381394 ERROR  StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V