1 INFO NodeMain [main]: NodeMain.main(): portalHost = null 1380 INFO NodeManager [main]: Starting NodeManager at 02/21/2016 16:02:58 GMT (1456070578757), version: $Name: $ 1383 INFO NodeManager [main]: Node IP: node2/134.89.36.2 2080 INFO NodeManager [main]: Node ID has been set to 1598 3295 INFO PortManager [main]: Found 14 configured ports in properties file 3358 INFO MOOSPortManager [main]: Found DPA at slot: 0 5239 INFO MOOSPortManager [main]: Found DPA at slot: 1 6849 INFO MOOSPortManager [main]: Found DPA at slot: 2 8439 INFO MOOSPortManager [main]: Found DPA at slot: 3 10027 INFO MOOSPortManager [main]: No DPA found at slot: 4 10031 INFO MOOSPortManager [main]: No DPA found at slot: 5 10066 INFO WDTManager [main]: WDTManager constructor 10068 INFO MOOSWDTManager [main]: MOOSWDTManager constructor 10131 INFO SleepManager [main]: SleepManager constructor 10135 INFO MOOSSleepManager [main]: MOOSSleepManager constructor 11825 INFO CommsLeaseListener [main]: CommsLeaseListener() complete 11891 INFO CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor 11906 INFO CpuLease [main]: CpuLease() constructor 11908 INFO CpuLease [Thread-5]: CpuLease started 13886 ERROR NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException 13985 INFO MOOSNodeService [main]: Last MMC reset code: 6 14195 INFO NodeManager [main]: Starting registry... 14235 INFO NodeManager [main]: registry started. 14236 INFO NodeManager [main]: binding NodeService to rmi://localhost/node 14785 INFO NodeManager [main]: NodeService is bound to rmi://localhost/node 14913 INFO MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer 14989 ERROR MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!! 15145 INFO PortManager [main]: Service jar not specified for port /dev/ttySX0 15811 INFO MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful 16111 INFO PortManager [main]: Starting service... 32165 INFO BaseInstrumentService [main]: initializeInstrument() for 33739 WARN StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP 38764 INFO StreamingSBE19 [main]: Event detection disabled by attribute 38970 INFO BaseInstrumentService [main]: done with initializeInstrument() for 47052 INFO PortManager [main]: service started 47539 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 48252 INFO PortManager [main]: Starting service... 68755 INFO BaseInstrumentService [main]: initializeInstrument() for 68757 INFO WetLabsECO [main]: Initializing... 84218 INFO WetLabsECO [main]: Initializing completed 84219 INFO BaseInstrumentService [main]: done with initializeInstrument() for 93388 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827 93389 INFO PolledInstrumentService [main]: id 1535 slaved to 1827 93407 INFO PortManager [main]: service started 93415 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 93458 INFO WetLabsECO [Thread-25]: TEST: ID=1535, trigger sample at 1456070670842 95405 INFO PortManager [main]: Starting service... 95832 INFO WetLabsECO [Thread-25]: TEST: ID=1535, got complete sample at + 1456070673216 156124 INFO BaseInstrumentService [main]: initializeInstrument() for 158148 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 164346 INFO BaseInstrumentService [main]: done with initializeInstrument() for 164451 INFO Aquadopp [main]: Retrieving Aquadopp state Metadata... 166427 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 174278 INFO PortManager [main]: service started 174285 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 174761 INFO PortManager [main]: Starting service... 176397 INFO Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2 185464 INFO BaseInstrumentService [main]: initializeInstrument() for 187708 ERROR StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command 190377 INFO BaseInstrumentService [main]: done with initializeInstrument() for 192359 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535 192360 INFO PolledInstrumentService [main]: id 1524 slaved to 1535 192365 INFO PortManager [main]: service started 192374 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 192390 INFO AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456070769774 193531 INFO PortManager [main]: Starting service... 228767 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 234394 INFO BaseInstrumentService [main]: initializeInstrument() for 234397 INFO StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825 234407 INFO StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes 237344 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 237384 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 237427 INFO StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 237428 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 237664 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 237753 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 237788 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 237789 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 237791 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 237792 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1 237793 INFO StreamingWorkhorseADCP-1825 [main]: Start pinging 237982 INFO BaseInstrumentService [main]: done with initializeInstrument() for 241073 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD? 241121 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 241655 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF? 241693 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 242255 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN? 242331 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 242904 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP? 242943 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243474 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS? 243513 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244044 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV? 244089 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244635 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 244673 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245215 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP? 245310 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245844 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS? 245883 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 246415 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA? 246453 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 246984 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB? 247023 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 247575 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED? 247652 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248184 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES? 248223 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248754 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX? 248793 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 249335 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ? 249373 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 249904 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 249944 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 250484 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA? 250553 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 251255 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 251293 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 256859 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5558 ms outbuf.len=8192 avail: 96 read: 5326Request=RR? 257955 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 260228 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 261295 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 263515 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 264108 ERROR StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V 264382 INFO PortManager [main]: service started 264385 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 266395 INFO PortManager [main]: Starting service... 336478 ERROR DeviceLog [main]: readLogData: data size mismatch 336480 ERROR DeviceLog [main]: bytes read from file: 1173 336481 ERROR DeviceLog [main]: dataSize in index entry: 1927 336558 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 347234 INFO BaseInstrumentService [main]: initializeInstrument() for 347237 INFO StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828 347250 INFO StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes 349975 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 350015 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 350220 INFO StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 350221 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 350595 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 350637 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 350690 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 350691 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 350693 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 350705 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1 350706 INFO StreamingWorkhorseADCP-1828 [main]: Start pinging 350902 INFO BaseInstrumentService [main]: done with initializeInstrument() for 353786 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD? 353850 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 354435 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF? 354473 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 355064 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN? 355103 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 355645 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP? 355684 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356214 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS? 356255 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356774 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV? 356814 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 357365 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 357403 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 357995 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP? 358034 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 358595 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS? 358634 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359174 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA? 359214 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359744 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB? 359783 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 360334 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED? 360374 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 360925 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES? 360965 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 361515 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX? 361554 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362127 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ? 362168 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362734 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 362774 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 363344 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA? 363366 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 363944 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 363983 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 370477 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 6489 ms outbuf.len=8192 avail: 2569 read: 3749Request=RR? 373195 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 375454 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 378764 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 381031 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 381596 ERROR StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V