1 INFO   NodeMain [main]: NodeMain.main(): portalHost = null
1376 INFO   NodeManager [main]: Starting NodeManager at 02/25/2016 05:33:08 GMT (1456378388702), version: $Name:  $
1378 INFO   NodeManager [main]: Node IP: node2/134.89.36.2
2089 INFO   NodeManager [main]: Node ID has been set to 1598
3295 INFO   PortManager [main]: Found 14 configured ports in properties file
3358 INFO   MOOSPortManager [main]: Found DPA at slot: 0
5239 INFO   MOOSPortManager [main]: Found DPA at slot: 1
6849 INFO   MOOSPortManager [main]: Found DPA at slot: 2
8439 INFO   MOOSPortManager [main]: Found DPA at slot: 3
10027 INFO   MOOSPortManager [main]: No DPA found at slot: 4
10031 INFO   MOOSPortManager [main]: No DPA found at slot: 5
10066 INFO   WDTManager [main]: WDTManager constructor
10068 INFO   MOOSWDTManager [main]: MOOSWDTManager constructor
10131 INFO   SleepManager [main]: SleepManager constructor
10135 INFO   MOOSSleepManager [main]: MOOSSleepManager constructor
11835 INFO   CommsLeaseListener [main]: CommsLeaseListener() complete
11901 INFO   CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor
11916 INFO   CpuLease [main]: CpuLease() constructor
11919 INFO   CpuLease [Thread-5]: CpuLease started
13896 ERROR  NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException
13995 INFO   MOOSNodeService [main]: Last MMC reset code: 6
14205 INFO   NodeManager [main]: Starting registry... 
14243 INFO   NodeManager [main]: registry started.
14244 INFO   NodeManager [main]: binding NodeService to rmi://localhost/node
14795 INFO   NodeManager [main]: NodeService is bound to rmi://localhost/node
14819 INFO   MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer
14929 ERROR  MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!!
15122 INFO   PortManager [main]: Service jar not specified for port /dev/ttySX0
16012 INFO   PortManager [main]: Starting service...
16841 INFO   MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful
32064 INFO   BaseInstrumentService [main]: initializeInstrument() for 
33639 WARN   StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP
38674 INFO   StreamingSBE19 [main]: Event detection disabled by attribute
38735 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
46842 INFO   PortManager [main]: service started
47085 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
47696 INFO   PortManager [main]: Starting service...
68326 INFO   BaseInstrumentService [main]: initializeInstrument() for 
68328 INFO   WetLabsECO [main]: Initializing...
83698 INFO   WetLabsECO [main]: Initializing completed
83699 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
92750 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827
92752 INFO   PolledInstrumentService [main]: id 1535 slaved to 1827
92819 INFO   PortManager [main]: service started
92825 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
92862 INFO   WetLabsECO [Thread-24]: TEST: ID=1535, trigger sample at 1456378480196
94983 INFO   PortManager [main]: Starting service...
95243 INFO   WetLabsECO [Thread-24]: TEST: ID=1535, got complete sample at + 1456378482576
154692 INFO   BaseInstrumentService [main]: initializeInstrument() for 
156758 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
162936 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
163129 INFO   Aquadopp [main]: Retrieving Aquadopp state Metadata...
165107 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
172945 INFO   PortManager [main]: service started
172953 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
173401 INFO   PortManager [main]: Starting service...
175067 INFO   Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2
184374 INFO   BaseInstrumentService [main]: initializeInstrument() for 
186379 ERROR  StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command
189327 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
191261 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535
191262 INFO   PolledInstrumentService [main]: id 1524 slaved to 1535
191268 INFO   PortManager [main]: service started
191275 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
191287 INFO   AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456378578621
192446 INFO   PortManager [main]: Starting service...
227588 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
233215 INFO   BaseInstrumentService [main]: initializeInstrument() for 
233217 INFO   StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825
233227 INFO   StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes
236325 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
236364 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
236407 INFO   StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
236408 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
236644 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
236683 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
236728 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
236729 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
236731 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
236733 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1
236734 INFO   StreamingWorkhorseADCP-1825 [main]: Start pinging
236970 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
240113 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD?
240161 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
240694 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF?
240733 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
241274 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN?
241313 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
241845 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP?
241883 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
242445 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS?
242483 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243015 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV?
243053 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243584 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
243631 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
244174 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP?
244213 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
244745 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS?
244783 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245362 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA?
245414 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245944 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB?
245983 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
246525 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED?
246563 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247095 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES?
247133 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247744 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX?
247783 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248325 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ?
248363 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248895 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
248933 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
249474 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA?
249495 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
250264 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
250307 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
255881 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5568 ms outbuf.len=8192 avail: 119 read: 5311Request=RR?
256925 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
259130 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
260184 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
262396 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
262982 ERROR  StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V


263277 INFO   PortManager [main]: service started
263285 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
265200 INFO   PortManager [main]: Starting service...
336007 ERROR  DeviceLog [main]: readLogData: data size mismatch
336008 ERROR  DeviceLog [main]:   bytes read from file: 1173
336009 ERROR  DeviceLog [main]:   dataSize in index entry: 1927
336096 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
346764 INFO   BaseInstrumentService [main]: initializeInstrument() for 
346766 INFO   StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828
346778 INFO   StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes
349485 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
349525 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
349599 INFO   StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
349600 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
349854 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
349898 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
349953 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
349965 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
349967 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
349969 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1
349970 INFO   StreamingWorkhorseADCP-1828 [main]: Start pinging
350152 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
353075 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD?
353114 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
353734 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF?
353775 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
354304 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN?
354343 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
354904 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP?
354943 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
355485 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS?
355524 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
356055 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV?
356094 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
356635 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
356674 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357235 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP?
357274 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357804 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS?
357843 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
358425 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA?
358467 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
359025 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB?
359064 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
359606 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED?
359654 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360225 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES?
360265 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360795 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX?
360834 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361404 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ?
361443 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361974 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
362013 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
362595 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA?
362615 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363195 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
363234 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
370097 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 6859 ms outbuf.len=8192 avail: 2808 read: 3862Request=RR?
372964 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
375178 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
378375 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
380665 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
381235 ERROR  StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V