1 INFO NodeMain [main]: NodeMain.main(): portalHost = null 1355 INFO NodeManager [main]: Starting NodeManager at 02/27/2016 17:24:36 GMT (1456593876853), version: $Name: $ 1357 INFO NodeManager [main]: Node IP: node2/134.89.36.2 2015 INFO NodeManager [main]: Node ID has been set to 1598 3227 INFO PortManager [main]: Found 14 configured ports in properties file 3291 INFO MOOSPortManager [main]: Found DPA at slot: 0 5171 INFO MOOSPortManager [main]: Found DPA at slot: 1 6781 INFO MOOSPortManager [main]: Found DPA at slot: 2 8371 INFO MOOSPortManager [main]: Found DPA at slot: 3 9959 INFO MOOSPortManager [main]: No DPA found at slot: 4 9963 INFO MOOSPortManager [main]: No DPA found at slot: 5 9998 INFO WDTManager [main]: WDTManager constructor 9999 INFO MOOSWDTManager [main]: MOOSWDTManager constructor 10100 INFO SleepManager [main]: SleepManager constructor 10104 INFO MOOSSleepManager [main]: MOOSSleepManager constructor 11917 INFO CommsLeaseListener [main]: CommsLeaseListener() complete 11983 INFO CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor 11998 INFO CpuLease [main]: CpuLease() constructor 12001 INFO CpuLease [Thread-5]: CpuLease started 13938 ERROR NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException 14037 INFO MOOSNodeService [main]: Last MMC reset code: 4 14189 INFO NodeManager [main]: Starting registry... 14230 INFO NodeManager [main]: registry started. 14231 INFO NodeManager [main]: binding NodeService to rmi://localhost/node 14777 INFO NodeManager [main]: NodeService is bound to rmi://localhost/node 14802 INFO MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer 14901 ERROR MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!! 15095 INFO PortManager [main]: Service jar not specified for port /dev/ttySX0 15994 INFO PortManager [main]: Starting service... 16803 INFO MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful 31867 INFO BaseInstrumentService [main]: initializeInstrument() for 33441 WARN StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP 38477 INFO StreamingSBE19 [main]: Event detection disabled by attribute 38537 INFO BaseInstrumentService [main]: done with initializeInstrument() for 46614 INFO PortManager [main]: service started 46899 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 47525 INFO PortManager [main]: Starting service... 67937 INFO BaseInstrumentService [main]: initializeInstrument() for 67939 INFO WetLabsECO [main]: Initializing... 83310 INFO WetLabsECO [main]: Initializing completed 83311 INFO BaseInstrumentService [main]: done with initializeInstrument() for 92504 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827 92506 INFO PolledInstrumentService [main]: id 1535 slaved to 1827 92524 INFO PortManager [main]: service started 92527 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 92611 INFO WetLabsECO [Thread-24]: TEST: ID=1535, trigger sample at 1456593968117 94809 INFO PortManager [main]: Starting service... 95018 INFO WetLabsECO [Thread-24]: TEST: ID=1535, got complete sample at + 1456593970523 155441 INFO BaseInstrumentService [main]: initializeInstrument() for 157450 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 163608 INFO BaseInstrumentService [main]: done with initializeInstrument() for 163714 INFO Aquadopp [main]: Retrieving Aquadopp state Metadata... 165689 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 173518 INFO PortManager [main]: service started 173547 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 174033 INFO PortManager [main]: Starting service... 175679 INFO Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2 185076 INFO BaseInstrumentService [main]: initializeInstrument() for 187021 ERROR StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command 190029 INFO BaseInstrumentService [main]: done with initializeInstrument() for 191910 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535 191911 INFO PolledInstrumentService [main]: id 1524 slaved to 1535 191917 INFO PortManager [main]: service started 191926 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 191942 INFO AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456594067448 193019 INFO PortManager [main]: Starting service... 228853 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 234477 INFO BaseInstrumentService [main]: initializeInstrument() for 234479 INFO StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825 234489 INFO StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes 237477 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 237516 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 237560 INFO StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 237561 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 237797 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 237835 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 237880 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 237881 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 237883 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 237884 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1 237885 INFO StreamingWorkhorseADCP-1825 [main]: Start pinging 238114 INFO BaseInstrumentService [main]: done with initializeInstrument() for 241298 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD? 241346 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 241877 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF? 241915 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 242447 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN? 242485 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243017 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP? 243055 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243586 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS? 243625 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244157 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV? 244195 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244727 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 244765 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245354 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP? 245402 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245937 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS? 245975 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 246517 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA? 246555 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 247086 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB? 247125 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 247697 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED? 247736 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248266 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES? 248305 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248877 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX? 248915 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 249458 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ? 249583 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 250117 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 250155 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 250727 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA? 250747 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 251506 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 251549 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 257082 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5527 ms outbuf.len=8192 avail: 56 read: 5334Request=RR? 258137 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 260347 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 261418 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 263622 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 264205 ERROR StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V 264467 INFO PortManager [main]: service started 264477 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 266465 INFO PortManager [main]: Starting service... 337410 ERROR DeviceLog [main]: readLogData: data size mismatch 337411 ERROR DeviceLog [main]: bytes read from file: 1173 337412 ERROR DeviceLog [main]: dataSize in index entry: 1927 337496 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 348186 INFO BaseInstrumentService [main]: initializeInstrument() for 348188 INFO StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828 348199 INFO StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes 350947 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 350986 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 351030 INFO StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 351032 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 351277 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 351316 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 351384 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 351385 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 351400 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 351402 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1 351403 INFO StreamingWorkhorseADCP-1828 [main]: Start pinging 351584 INFO BaseInstrumentService [main]: done with initializeInstrument() for 354467 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD? 354506 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 355057 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF? 355097 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 355667 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN? 355706 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356237 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP? 356276 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356826 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS? 356865 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 357428 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV? 357474 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 358026 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 358066 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 358617 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP? 358655 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359186 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS? 359226 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359766 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA? 359805 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 360336 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB? 360375 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 360906 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED? 360945 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 361477 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES? 361515 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362066 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX? 362106 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362679 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ? 362742 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 363287 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 363326 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 363887 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA? 363908 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 364487 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 364526 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 371331 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 6801 ms outbuf.len=8192 avail: 3151 read: 3459Request=RR? 373857 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 376060 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 379068 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 381279 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 381847 ERROR StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V