1 INFO   NodeMain [main]: NodeMain.main(): portalHost = null
1380 INFO   NodeManager [main]: Starting NodeManager at 02/25/2016 07:46:13 GMT (1456386373664), version: $Name:  $
1382 INFO   NodeManager [main]: Node IP: node2/134.89.36.2
2046 INFO   NodeManager [main]: Node ID has been set to 1598
3254 INFO   PortManager [main]: Found 14 configured ports in properties file
3318 INFO   MOOSPortManager [main]: Found DPA at slot: 0
5199 INFO   MOOSPortManager [main]: Found DPA at slot: 1
6809 INFO   MOOSPortManager [main]: Found DPA at slot: 2
8399 INFO   MOOSPortManager [main]: Found DPA at slot: 3
9986 INFO   MOOSPortManager [main]: No DPA found at slot: 4
9990 INFO   MOOSPortManager [main]: No DPA found at slot: 5
10026 INFO   WDTManager [main]: WDTManager constructor
10027 INFO   MOOSWDTManager [main]: MOOSWDTManager constructor
10090 INFO   SleepManager [main]: SleepManager constructor
10094 INFO   MOOSSleepManager [main]: MOOSSleepManager constructor
11774 INFO   CommsLeaseListener [main]: CommsLeaseListener() complete
11840 INFO   CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor
11856 INFO   CpuLease [main]: CpuLease() constructor
11858 INFO   CpuLease [Thread-5]: CpuLease started
13795 ERROR  NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException
13894 INFO   MOOSNodeService [main]: Last MMC reset code: 6
14104 INFO   NodeManager [main]: Starting registry... 
14145 INFO   NodeManager [main]: registry started.
14146 INFO   NodeManager [main]: binding NodeService to rmi://localhost/node
14694 INFO   NodeManager [main]: NodeService is bound to rmi://localhost/node
14719 INFO   MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer
14789 ERROR  MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!!
15023 INFO   PortManager [main]: Service jar not specified for port /dev/ttySX0
15920 INFO   PortManager [main]: Starting service...
16664 INFO   MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful
32124 INFO   BaseInstrumentService [main]: initializeInstrument() for 
33698 WARN   StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP
38734 INFO   StreamingSBE19 [main]: Event detection disabled by attribute
38798 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
47043 INFO   PortManager [main]: service started
47529 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
48256 INFO   PortManager [main]: Starting service...
68373 INFO   BaseInstrumentService [main]: initializeInstrument() for 
68375 INFO   WetLabsECO [main]: Initializing...
83748 INFO   WetLabsECO [main]: Initializing completed
83749 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
92835 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827
92837 INFO   PolledInstrumentService [main]: id 1535 slaved to 1827
92856 INFO   PortManager [main]: service started
92863 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
92919 INFO   WetLabsECO [Thread-25]: TEST: ID=1535, trigger sample at 1456386465211
94956 INFO   PortManager [main]: Starting service...
95292 INFO   WetLabsECO [Thread-25]: TEST: ID=1535, got complete sample at + 1456386467584
155422 INFO   BaseInstrumentService [main]: initializeInstrument() for 
157438 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
163595 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
163700 INFO   Aquadopp [main]: Retrieving Aquadopp state Metadata...
165677 INFO   Aquadopp [main]: sendSoftBreak(): instrument in mode 2
173378 INFO   PortManager [main]: service started
173384 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
173872 INFO   PortManager [main]: Starting service...
175497 INFO   Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2
184924 INFO   BaseInstrumentService [main]: initializeInstrument() for 
186868 ERROR  StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command
189797 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
191702 INFO   PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535
191705 INFO   PolledInstrumentService [main]: id 1524 slaved to 1535
191709 INFO   PortManager [main]: service started
191714 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
191727 INFO   AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456386564018
192780 INFO   PortManager [main]: Starting service...
226960 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
232584 INFO   BaseInstrumentService [main]: initializeInstrument() for 
232586 INFO   StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825
232596 INFO   StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes
235564 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
235603 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
235646 INFO   StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
235648 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
235914 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
235953 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
235997 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
235998 INFO   StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
236001 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
236002 INFO   StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1
236003 INFO   StreamingWorkhorseADCP-1825 [main]: Start pinging
236191 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
239364 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD?
239402 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
239944 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF?
239982 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
240514 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN?
240552 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
241104 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP?
241142 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
241674 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS?
241718 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
242274 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV?
242312 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
242844 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE?
242883 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243424 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP?
243462 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
243994 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS?
244033 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
244584 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA?
244622 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245201 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB?
245243 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
245774 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED?
245814 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
246364 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES?
246444 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
246974 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX?
247012 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
247554 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ?
247592 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248124 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF?
248163 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
248704 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA?
248725 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
249514 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
249553 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 
255070 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5511 ms outbuf.len=8192 avail: 46 read: 5328Request=RR?
256134 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
258394 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
259424 INFO   StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR?
261665 ERROR  StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
262251 ERROR  StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V


262490 INFO   PortManager [main]: service started
262495 INFO   NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks
264409 INFO   PortManager [main]: Starting service...
336601 ERROR  DeviceLog [main]: readLogData: data size mismatch
336603 ERROR  DeviceLog [main]:   bytes read from file: 1173
336604 ERROR  DeviceLog [main]:   dataSize in index entry: 1927
336719 INFO   StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600
347424 INFO   BaseInstrumentService [main]: initializeInstrument() for 
347427 INFO   StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828
347436 INFO   StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes
350179 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
350236 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
350299 INFO   StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
350301 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100)
>
350554 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
350593 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
350639 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
350640 INFO   StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>
350642 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec)
>, char 3=1
350653 INFO   StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1
350655 INFO   StreamingWorkhorseADCP-1828 [main]: Start pinging
350852 INFO   BaseInstrumentService [main]: done with initializeInstrument() for 
353674 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD?
353714 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
354264 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF?
354303 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
354834 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN?
354873 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
355424 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP?
355463 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
356054 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS?
356100 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
356644 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV?
356683 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357234 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE?
357273 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
357844 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP?
357883 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
358494 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS?
358533 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
359114 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA?
359153 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
359744 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB?
359786 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360344 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED?
360384 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
360944 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES?
360983 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
361524 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX?
361563 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
362116 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ?
362159 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
362694 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF?
362733 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363284 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA?
363305 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
363884 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
363923 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 
370935 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 6997 ms outbuf.len=8192 avail: 3312 read: 3487Request=RR?
373694 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
375905 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
379014 INFO   StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR?
381245 ERROR  StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR?
381815 ERROR  StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted
java.lang.Exception: sendRequest(RR?) - Maximum retries attempted


Stack trace:
   java/lang/Throwable.<init>()V
   java/lang/Throwable.<init>(Ljava/lang/String;)V
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String;
   org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B
   org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket;
   org/mbari/siam/core/BaseInstrumentService.prepareToRun()V
   org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V
   org/mbari/siam/core/PortManager.scanPorts()V
   org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V
   org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V