1 INFO NodeMain [main]: NodeMain.main(): portalHost = null 1395 INFO NodeManager [main]: Starting NodeManager at 02/26/2016 10:38:44 GMT (1456483124741), version: $Name: $ 1397 INFO NodeManager [main]: Node IP: node2/134.89.36.2 2098 INFO NodeManager [main]: Node ID has been set to 1598 3305 INFO PortManager [main]: Found 14 configured ports in properties file 3368 INFO MOOSPortManager [main]: Found DPA at slot: 0 5251 INFO MOOSPortManager [main]: Found DPA at slot: 1 6869 INFO MOOSPortManager [main]: Found DPA at slot: 2 8459 INFO MOOSPortManager [main]: Found DPA at slot: 3 10047 INFO MOOSPortManager [main]: No DPA found at slot: 4 10051 INFO MOOSPortManager [main]: No DPA found at slot: 5 10086 INFO WDTManager [main]: WDTManager constructor 10087 INFO MOOSWDTManager [main]: MOOSWDTManager constructor 10167 INFO SleepManager [main]: SleepManager constructor 10171 INFO MOOSSleepManager [main]: MOOSSleepManager constructor 11885 INFO CommsLeaseListener [main]: CommsLeaseListener() complete 11951 INFO CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor 11966 INFO CpuLease [main]: CpuLease() constructor 11975 INFO CpuLease [Thread-5]: CpuLease started 13896 ERROR NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException 13995 INFO MOOSNodeService [main]: Last MMC reset code: 6 14215 INFO NodeManager [main]: Starting registry... 14253 INFO NodeManager [main]: registry started. 14254 INFO NodeManager [main]: binding NodeService to rmi://localhost/node 14805 INFO NodeManager [main]: NodeService is bound to rmi://localhost/node 14933 INFO MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer 14988 ERROR MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!! 15162 INFO PortManager [main]: Service jar not specified for port /dev/ttySX0 16062 INFO PortManager [main]: Starting service... 17369 INFO MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful 32004 INFO BaseInstrumentService [main]: initializeInstrument() for 33579 WARN StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP 38614 INFO StreamingSBE19 [main]: Event detection disabled by attribute 38688 INFO BaseInstrumentService [main]: done with initializeInstrument() for 46832 INFO PortManager [main]: service started 47359 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 48125 INFO PortManager [main]: Starting service... 68444 INFO BaseInstrumentService [main]: initializeInstrument() for 68446 INFO WetLabsECO [main]: Initializing... 83838 INFO WetLabsECO [main]: Initializing completed 83839 INFO BaseInstrumentService [main]: done with initializeInstrument() for 92921 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827 92923 INFO PolledInstrumentService [main]: id 1535 slaved to 1827 92941 INFO PortManager [main]: service started 92944 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 93008 INFO WetLabsECO [Thread-24]: TEST: ID=1535, trigger sample at 1456483216362 95149 INFO PortManager [main]: Starting service... 95440 INFO WetLabsECO [Thread-24]: TEST: ID=1535, got complete sample at + 1456483218794 156272 INFO BaseInstrumentService [main]: initializeInstrument() for 158278 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 164436 INFO BaseInstrumentService [main]: done with initializeInstrument() for 164553 INFO Aquadopp [main]: Retrieving Aquadopp state Metadata... 166537 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 174331 INFO PortManager [main]: service started 174335 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 174831 INFO PortManager [main]: Starting service... 176497 INFO Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2 185695 INFO BaseInstrumentService [main]: initializeInstrument() for 187816 ERROR StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command 190578 INFO BaseInstrumentService [main]: done with initializeInstrument() for 192501 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535 192502 INFO PolledInstrumentService [main]: id 1524 slaved to 1535 192509 INFO PortManager [main]: service started 192514 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 192546 INFO AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456483315899 193588 INFO PortManager [main]: Starting service... 227802 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 233425 INFO BaseInstrumentService [main]: initializeInstrument() for 233427 INFO StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825 233437 INFO StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes 236405 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 236444 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 236487 INFO StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 236488 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 236725 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 236761 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 236808 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 236809 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 236811 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 236812 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1 236814 INFO StreamingWorkhorseADCP-1825 [main]: Start pinging 237002 INFO BaseInstrumentService [main]: done with initializeInstrument() for 240115 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD? 240153 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 240694 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF? 240733 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 241265 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN? 241303 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 241834 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP? 241873 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 242465 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS? 242504 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243034 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV? 243070 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243604 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 243643 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244204 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP? 244243 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244774 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS? 244813 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245345 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA? 245383 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245917 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB? 245961 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 246525 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED? 246564 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 247094 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES? 247133 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 247754 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX? 247793 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248345 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ? 248383 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248914 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 248953 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 249524 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA? 249545 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 250332 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 250388 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 255901 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5504 ms outbuf.len=8192 avail: 23 read: 5392Request=RR? 256964 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 259175 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 260265 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 262472 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 263062 ERROR StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V 263293 INFO PortManager [main]: service started 263295 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 265246 INFO PortManager [main]: Starting service... 335694 ERROR DeviceLog [main]: readLogData: data size mismatch 335695 ERROR DeviceLog [main]: bytes read from file: 1173 335696 ERROR DeviceLog [main]: dataSize in index entry: 1927 335807 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 346484 INFO BaseInstrumentService [main]: initializeInstrument() for 346486 INFO StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828 346496 INFO StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes 349195 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 349235 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 349299 INFO StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 349300 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 349555 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 349593 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 349660 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 349661 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 349663 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 349675 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1 349676 INFO StreamingWorkhorseADCP-1828 [main]: Start pinging 349862 INFO BaseInstrumentService [main]: done with initializeInstrument() for 352745 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD? 352784 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 353324 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF? 353364 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 353926 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN? 353982 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 354614 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP? 354654 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 355195 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS? 355235 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 355765 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV? 355805 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356364 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 356403 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356944 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP? 356983 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 357535 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS? 357577 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 358134 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA? 358174 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 358704 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB? 358744 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359285 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED? 359324 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359894 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES? 359952 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 360555 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX? 360593 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 361164 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ? 361203 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 361735 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 361773 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362334 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA? 362356 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362934 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 362974 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 369983 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 7005 ms outbuf.len=8192 avail: 3167 read: 3639Request=RR? 372494 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 374755 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 377755 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 380075 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 380685 ERROR StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V