1 INFO   NodeMain [main]: NodeMain.main(): portalHost = null
1377 INFO   NodeManager [main]: Starting NodeManager at 02/28/2016 17:48:24 GMT (1456681704803), version: $Name:  $
1379 INFO   NodeManager [main]: Node IP: node2/134.89.36.2
2042 INFO   NodeManager [main]: Node ID has been set to 1598
3255 INFO   PortManager [main]: Found 14 configured ports in properties file
3318 INFO   MOOSPortManager [main]: Found DPA at slot: 0
5199 INFO   MOOSPortManager [main]: Found DPA at slot: 1
6829 INFO   MOOSPortManager [main]: Found DPA at slot: 2
8419 INFO   MOOSPortManager [main]: Found DPA at slot: 3
10007 INFO   MOOSPortManager [main]: No DPA found at slot: 4
10011 INFO   MOOSPortManager [main]: No DPA found at slot: 5
10046 INFO   WDTManager [main]: WDTManager constructor
10047 INFO   MOOSWDTManager [main]: MOOSWDTManager constructor
10111 INFO   SleepManager [main]: SleepManager constructor
10114 INFO   MOOSSleepManager [main]: MOOSSleepManager constructor
11825 INFO   CommsLeaseListener [main]: CommsLeaseListener() complete
11891 INFO   CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor
11906 INFO   CpuLease [main]: CpuLease() constructor
11908 INFO   CpuLease [Thread-5]: CpuLease started
13856 ERROR  NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException
13955 INFO   MOOSNodeService [main]: Last MMC reset code: 4
14255 INFO   NodeManager [main]: Starting registry... 
14293 INFO   NodeManager [main]: registry started.
14294 INFO   NodeManager [main]: binding NodeService to rmi://localhost/node
14834 INFO   NodeManager [main]: NodeService is bound to rmi://localhost/node
14859 INFO   MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer
14929 ERROR  MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!!
15167 INFO   PortManager [main]: Service jar not specified for port /dev/ttySX0
16063 INFO   PortManager [main]: Starting service...
16337 INFO   MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful
32095 INFO   BaseInstrumentService [main]: initializeInstrument() for 
33689 WARN   StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP
38724 INFO   StreamingSBE19 [main]: Event detection disabled by attribute
38795 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
46953 INFO   PortManager [main]: service started
47419 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
48123 INFO   PortManager [main]: Starting service...
68857 INFO   BaseInstrumentService [main]: initializeInstrument() for 
68859 INFO   WetLabsECO [main]: Initializing...
84298 INFO   WetLabsECO [main]: Initializing completed
84299 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
93401 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827
93403 INFO   PolledInstrumentService [main]: id 1535 slaved to 1827
93422 INFO   PortManager [main]: service started
93429 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
93446 INFO   WetLabsECO [Thread-25]: TEST: ID=1535, trigger sample at 1456681796880
95495 INFO   PortManager [main]: Starting service...
95825 INFO   WetLabsECO [Thread-25]: TEST: ID=1535, got complete sample at + 1456681799258
156472 INFO   BaseInstrumentService [main]: initializeInstrument() for 
158478 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
164676 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
164783 INFO   Aquadopp [main]: Retrieving Aquadopp state Metadata...
166767 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
174561 INFO   PortManager [main]: service started
174565 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
175021 INFO   PortManager [main]: Starting service...
176747 INFO   Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2
185734 INFO   BaseInstrumentService [main]: initializeInstrument() for 
188099 ERROR  StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command
190817 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
192783 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535
192785 INFO   PolledInstrumentService [main]: id 1524 slaved to 1535
192789 INFO   PortManager [main]: service started
192794 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
192807 INFO   AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456681896241
193850 INFO   PortManager [main]: Starting service...
228620 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
234244 INFO   BaseInstrumentService [main]: initializeInstrument() for 
234247 INFO   StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825
234257 INFO   StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes
237355 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
237394 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
237438 INFO   StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
237439 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
237675 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
237713 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
237807 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
237808 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
237810 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
237811 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1
237812 INFO   StreamingWorkhorseADCP-1825 [main]: Start pinging
238006 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
241134 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD?
241173 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
241715 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF?
241753 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
242284 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN?
242323 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
242854 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP?
242893 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243424 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS?
243463 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243997 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV?
244037 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
244624 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
244663 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245214 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP?
245250 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245784 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS?
245823 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
246444 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA?
246483 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247014 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB?
247053 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247584 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED?
247624 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248154 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES?
248193 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248724 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX?
248767 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
249362 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ?
249406 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
249934 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
249980 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
250584 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA?
250605 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
251364 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
251403 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
256930 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5519 ms outbuf.len=8192 avail: 56 read: 5326Request=RR?
258017 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
260250 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
261315 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
263555 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
264142 ERROR  StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V


264375 INFO   PortManager [main]: service started
264385 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
266314 INFO   PortManager [main]: Starting service...
337010 ERROR  DeviceLog [main]: readLogData: data size mismatch
337011 ERROR  DeviceLog [main]:   bytes read from file: 1173
337012 ERROR  DeviceLog [main]:   dataSize in index entry: 1927
337167 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
347834 INFO   BaseInstrumentService [main]: initializeInstrument() for 
347836 INFO   StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828
347846 INFO   StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes
350616 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
350753 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
350837 INFO   StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
350839 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
351074 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
351113 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
351174 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
351175 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
351177 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
351179 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1
351180 INFO   StreamingWorkhorseADCP-1828 [main]: Start pinging
351362 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
354214 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD?
354254 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
354844 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF?
354883 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
355425 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN?
355464 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
356035 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP?
356073 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
356614 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS?
356654 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357185 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV?
357223 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357804 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
357844 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
358454 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP?
358493 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
359025 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS?
359064 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
359614 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA?
359654 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360185 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB?
360223 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360755 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED?
360793 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361324 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES?
361364 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361905 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX?
361944 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
362535 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ?
362573 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363105 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
363144 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363684 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA?
363705 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
364284 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
364324 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
371290 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 6962 ms outbuf.len=8192 avail: 3386 read: 3383Request=RR?
374014 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
376225 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
379185 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
381532 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
382115 ERROR  StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V