1 INFO NodeMain [main]: NodeMain.main(): portalHost = null 1380 INFO NodeManager [main]: Starting NodeManager at 02/27/2016 23:20:07 GMT (1456615207717), version: $Name: $ 1383 INFO NodeManager [main]: Node IP: node2/134.89.36.2 2088 INFO NodeManager [main]: Node ID has been set to 1598 3295 INFO PortManager [main]: Found 14 configured ports in properties file 3358 INFO MOOSPortManager [main]: Found DPA at slot: 0 5239 INFO MOOSPortManager [main]: Found DPA at slot: 1 6849 INFO MOOSPortManager [main]: Found DPA at slot: 2 8439 INFO MOOSPortManager [main]: Found DPA at slot: 3 10027 INFO MOOSPortManager [main]: No DPA found at slot: 4 10031 INFO MOOSPortManager [main]: No DPA found at slot: 5 10066 INFO WDTManager [main]: WDTManager constructor 10068 INFO MOOSWDTManager [main]: MOOSWDTManager constructor 10131 INFO SleepManager [main]: SleepManager constructor 10135 INFO MOOSSleepManager [main]: MOOSSleepManager constructor 11835 INFO CommsLeaseListener [main]: CommsLeaseListener() complete 11901 INFO CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor 11916 INFO CpuLease [main]: CpuLease() constructor 11918 INFO CpuLease [Thread-5]: CpuLease started 13886 ERROR NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException 13985 INFO MOOSNodeService [main]: Last MMC reset code: 4 14195 INFO NodeManager [main]: Starting registry... 14233 INFO NodeManager [main]: registry started. 14234 INFO NodeManager [main]: binding NodeService to rmi://localhost/node 14815 INFO NodeManager [main]: NodeService is bound to rmi://localhost/node 14840 INFO MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer 14939 ERROR MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!! 15346 INFO MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful 15349 INFO PortManager [main]: Service jar not specified for port /dev/ttySX0 16179 INFO PortManager [main]: Starting service... 31985 INFO BaseInstrumentService [main]: initializeInstrument() for 33559 WARN StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP 38584 INFO StreamingSBE19 [main]: Event detection disabled by attribute 38700 INFO BaseInstrumentService [main]: done with initializeInstrument() for 46723 INFO PortManager [main]: service started 47082 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 47442 INFO PortManager [main]: Starting service... 68264 INFO BaseInstrumentService [main]: initializeInstrument() for 68266 INFO WetLabsECO [main]: Initializing... 83648 INFO WetLabsECO [main]: Initializing completed 83649 INFO BaseInstrumentService [main]: done with initializeInstrument() for 92708 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827 92709 INFO PolledInstrumentService [main]: id 1535 slaved to 1827 92727 INFO PortManager [main]: service started 92735 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 92767 INFO WetLabsECO [Thread-25]: TEST: ID=1535, trigger sample at 1456615299111 94817 INFO PortManager [main]: Starting service... 95143 INFO WetLabsECO [Thread-25]: TEST: ID=1535, got complete sample at + 1456615301486 156083 INFO BaseInstrumentService [main]: initializeInstrument() for 158138 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 164316 INFO BaseInstrumentService [main]: done with initializeInstrument() for 164423 INFO Aquadopp [main]: Retrieving Aquadopp state Metadata... 166447 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 174223 INFO PortManager [main]: service started 174225 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 174725 INFO PortManager [main]: Starting service... 176357 INFO Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2 185844 INFO BaseInstrumentService [main]: initializeInstrument() for 187718 ERROR StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command 190757 INFO BaseInstrumentService [main]: done with initializeInstrument() for 192657 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535 192658 INFO PolledInstrumentService [main]: id 1524 slaved to 1535 192663 INFO PortManager [main]: service started 192665 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 192685 INFO AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456615399027 193737 INFO PortManager [main]: Starting service... 229038 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 234684 INFO BaseInstrumentService [main]: initializeInstrument() for 234687 INFO StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825 234697 INFO StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes 237655 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 237694 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 237738 INFO StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 237739 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 238054 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 238093 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 238138 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 238139 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 238141 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 238143 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1 238144 INFO StreamingWorkhorseADCP-1825 [main]: Start pinging 238332 INFO BaseInstrumentService [main]: done with initializeInstrument() for 241384 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD? 241423 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 241964 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF? 242003 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 242584 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN? 242662 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243235 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP? 243283 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243814 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS? 243853 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244405 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV? 244443 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244974 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 245014 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245555 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP? 245602 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 246145 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS? 246184 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 246724 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA? 246763 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 247323 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB? 247365 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 247894 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED? 247972 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248544 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES? 248584 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 249115 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX? 249153 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 249694 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ? 249734 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 250264 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 250303 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 250844 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA? 250865 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 251635 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 251673 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 257198 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5517 ms outbuf.len=8192 avail: 15 read: 5359Request=RR? 258264 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 260470 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 261484 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 263700 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 264282 ERROR StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V 264511 INFO PortManager [main]: service started 264515 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 266533 INFO PortManager [main]: Starting service... 337248 ERROR DeviceLog [main]: readLogData: data size mismatch 337249 ERROR DeviceLog [main]: bytes read from file: 1173 337250 ERROR DeviceLog [main]: dataSize in index entry: 1927 337339 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 348014 INFO BaseInstrumentService [main]: initializeInstrument() for 348019 INFO StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828 348029 INFO StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes 350725 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 350826 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 350891 INFO StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 350893 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 351234 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 351273 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 351336 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 351337 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 351339 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 351340 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1 351341 INFO StreamingWorkhorseADCP-1828 [main]: Start pinging 351521 INFO BaseInstrumentService [main]: done with initializeInstrument() for 354344 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD? 354384 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 354925 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF? 354965 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 355495 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN? 355534 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356095 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP? 356134 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356665 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS? 356704 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 357245 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV? 357283 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 357835 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 357874 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 358445 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP? 358483 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359035 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS? 359084 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359664 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA? 359703 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 360264 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB? 360303 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 360885 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED? 360924 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 361514 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES? 361554 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362125 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX? 362165 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362754 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ? 362794 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 363344 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 363383 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 363974 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA? 364005 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 364584 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 364624 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 371601 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 6973 ms outbuf.len=8192 avail: 3480 read: 3295Request=RR? 374156 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 376447 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 379504 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 381814 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 382385 ERROR StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V