1 INFO NodeMain [main]: NodeMain.main(): portalHost = null 1418 INFO NodeManager [main]: Starting NodeManager at 02/26/2016 19:04:04 GMT (1456513444779), version: $Name: $ 1420 INFO NodeManager [main]: Node IP: node2/134.89.36.2 2088 INFO NodeManager [main]: Node ID has been set to 1598 3334 INFO PortManager [main]: Found 14 configured ports in properties file 3398 INFO MOOSPortManager [main]: Found DPA at slot: 0 5279 INFO MOOSPortManager [main]: Found DPA at slot: 1 6889 INFO MOOSPortManager [main]: Found DPA at slot: 2 8478 INFO MOOSPortManager [main]: Found DPA at slot: 3 10066 INFO MOOSPortManager [main]: No DPA found at slot: 4 10070 INFO MOOSPortManager [main]: No DPA found at slot: 5 10106 INFO WDTManager [main]: WDTManager constructor 10107 INFO MOOSWDTManager [main]: MOOSWDTManager constructor 10171 INFO SleepManager [main]: SleepManager constructor 10174 INFO MOOSSleepManager [main]: MOOSSleepManager constructor 11864 INFO CommsLeaseListener [main]: CommsLeaseListener() complete 11930 INFO CpuLeaseSleepRollcallListener [main]: CpuLeaseSleepRollcallListener() constructor 11946 INFO CpuLease [main]: CpuLease() constructor 11955 INFO CpuLease [Thread-5]: CpuLease started 13885 ERROR NodeService [main]: Turbinator constructor failed: com.rbnb.sapi.SAPIException: Nesting java.net.ConnectException 13982 INFO MOOSNodeService [main]: Last MMC reset code: 6 14214 INFO NodeManager [main]: Starting registry... 14253 INFO NodeManager [main]: registry started. 14254 INFO NodeManager [main]: binding NodeService to rmi://localhost/node 14814 INFO NodeManager [main]: NodeService is bound to rmi://localhost/node 14839 INFO MOOSWDTManager [Thread-2]: WDTManager initializing watchdog timer 14908 ERROR MOOSWDTManager [Thread-2]: !!! Reboot due to watchdog reset !!! 15144 INFO PortManager [main]: Service jar not specified for port /dev/ttySX0 16041 INFO PortManager [main]: Starting service... 16785 INFO MOOSWDTManager [Thread-2]: WDTManager watchdog initialization successful 31654 INFO BaseInstrumentService [main]: initializeInstrument() for 33228 WARN StreamingSBE19 [main]: Did not receive expected confirmation prompt from command: MP 38264 INFO StreamingSBE19 [main]: Event detection disabled by attribute 38420 INFO BaseInstrumentService [main]: done with initializeInstrument() for 46561 INFO PortManager [main]: service started 46935 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 47595 INFO PortManager [main]: Starting service... 68143 INFO BaseInstrumentService [main]: initializeInstrument() for 68145 INFO WetLabsECO [main]: Initializing... 83548 INFO WetLabsECO [main]: Initializing completed 83549 INFO BaseInstrumentService [main]: done with initializeInstrument() for 92597 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1827 92599 INFO PolledInstrumentService [main]: id 1535 slaved to 1827 92669 INFO PortManager [main]: service started 92674 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 92717 INFO WetLabsECO [Thread-24]: TEST: ID=1535, trigger sample at 1456513536086 94856 INFO PortManager [main]: Starting service... 95093 INFO WetLabsECO [Thread-24]: TEST: ID=1535, got complete sample at + 1456513538462 156281 INFO BaseInstrumentService [main]: initializeInstrument() for 158288 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 164515 INFO BaseInstrumentService [main]: done with initializeInstrument() for 164623 INFO Aquadopp [main]: Retrieving Aquadopp state Metadata... 166606 INFO Aquadopp [main]: sendSoftBreak(): instrument in mode 2 174380 INFO PortManager [main]: service started 174384 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 174793 INFO PortManager [main]: Starting service... 176527 INFO Aquadopp [Thread-34]: sendSoftBreak(): instrument in mode 2 185904 INFO BaseInstrumentService [main]: initializeInstrument() for 187838 ERROR StreamingInstrumentService [Thread-34]: acquireFromStream(), tried startStreaming(): Instrument didn't acknowledge SR command 190877 INFO BaseInstrumentService [main]: done with initializeInstrument() for 192782 INFO PolledInstrumentService [main]: prepareToRun(): sampleMasterId = 1535 192783 INFO PolledInstrumentService [main]: id 1524 slaved to 1535 192788 INFO PortManager [main]: service started 192795 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 192808 INFO AanderaaO2 [Thread-38]: TT: ID=1524, trigger sample at 1456513636177 193902 INFO PortManager [main]: Starting service... 229161 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 234834 INFO BaseInstrumentService [main]: initializeInstrument() for 234836 INFO StreamingWorkhorseADCP-1825 [main]: Initializing Workhorse 1825 234846 INFO StreamingWorkhorseADCP-1825 [main]: Instrument has been pre-configured; ignore configuration attributes 237864 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 237903 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 237947 INFO StreamingWorkhorseADCP-1825 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 237949 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 238184 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 238223 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 238268 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 238270 INFO StreamingWorkhorseADCP-1825 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 238272 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 238273 INFO StreamingWorkhorseADCP-1825 [main]: initializeInstrument(): property char 3=1 238275 INFO StreamingWorkhorseADCP-1825 [main]: Start pinging 238461 INFO BaseInstrumentService [main]: done with initializeInstrument() for 241554 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WD? 241630 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 242184 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WF? 242222 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 242754 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WN? 242792 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243324 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WP? 243363 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 243894 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WS? 243933 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 244464 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request WV? 244502 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245034 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TE? 245129 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 245674 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TP? 245712 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 246274 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request TS? 246312 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 246844 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EA? 246883 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 247444 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EB? 247487 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248024 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ED? 248063 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 248594 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request ES? 248633 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 249164 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EX? 249242 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 249834 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request EZ? 249873 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 250424 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request CF? 250460 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 251004 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RA? 251025 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 251784 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 251822 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: got echo response: 257350 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 5521 ms outbuf.len=8192 avail: 56 read: 5326Request=RR? 258384 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 260615 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 261644 INFO StreamingWorkhorseADCP-1825 [main]: sendRequest: wrote request RR? 263885 ERROR StreamingWorkhorseADCP-1825 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 264471 ERROR StreamingWorkhorseADCP-1825 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V 264699 INFO PortManager [main]: service started 264705 INFO NodeManager [Thread-1]: serviceInstalled(): invoke remote callbacks 266579 INFO PortManager [main]: Starting service... 336987 ERROR DeviceLog [main]: readLogData: data size mismatch 336988 ERROR DeviceLog [main]: bytes read from file: 1173 336989 ERROR DeviceLog [main]: dataSize in index entry: 1927 337076 INFO StreamingWorkhorseADCP-0 [main]: getSerialParameters(): baud=9600 347754 INFO BaseInstrumentService [main]: initializeInstrument() for 347759 INFO StreamingWorkhorseADCP-1828 [main]: Initializing Workhorse 1828 347769 INFO StreamingWorkhorseADCP-1828 [main]: Instrument has been pre-configured; ignore configuration attributes 350476 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 350615 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 350768 INFO StreamingWorkhorseADCP-1828 [main]: TE response: TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 350769 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=TE 00:00:10.00 --------- Time per Ensemble (hrs:min:sec.sec/100) > 351094 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 351157 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 351212 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): response = CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 351213 INFO StreamingWorkhorseADCP-1828 [main]: getProperty(): response=CF = 11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) > 351264 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property=11111 --------------- Flow Ctrl (EnsCyc;PngCyc;Binry;Ser;Rec) >, char 3=1 351265 INFO StreamingWorkhorseADCP-1828 [main]: initializeInstrument(): property char 3=1 351266 INFO StreamingWorkhorseADCP-1828 [main]: Start pinging 351451 INFO BaseInstrumentService [main]: done with initializeInstrument() for 354314 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WD? 354354 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 354894 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WF? 354933 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 355486 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WN? 355533 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356164 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WP? 356203 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 356764 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WS? 356803 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 357384 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request WV? 357423 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 358004 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TE? 358043 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 358634 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TP? 358673 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359224 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request TS? 359264 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 359844 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EA? 359883 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 360424 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EB? 360474 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 361034 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ED? 361073 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 361654 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request ES? 361693 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362235 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EX? 362273 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 362824 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request EZ? 362864 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 363394 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request CF? 363433 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 364004 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RA? 364025 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 364604 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 364646 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: got echo response: 371426 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: readUntil() Timed out after 6776 ms outbuf.len=8192 avail: 2919 read: 3672Request=RR? 374464 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 376675 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 379644 INFO StreamingWorkhorseADCP-1828 [main]: sendRequest: wrote request RR? 381855 ERROR StreamingWorkhorseADCP-1828 [main]: sendRequest caught Timeout Exception: org.mbari.siam.distributed.TimeoutException: SkipUntil() Timed outRequest=RR? 382424 ERROR StreamingWorkhorseADCP-1828 [main]: getInstrumentMetadata: Exception - java.lang.Exception: sendRequest(RR?) - Maximum retries attempted java.lang.Exception: sendRequest(RR?) - Maximum retries attempted Stack trace: java/lang/Throwable.()V java/lang/Throwable.(Ljava/lang/String;)V org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.sendRequest(Ljava/lang/String;)Ljava/lang/String; org/mbari/siam/devices/workhorse/StreamingWorkhorseADCP.getInstrumentStateMetadata()[B org/mbari/siam/core/BaseInstrumentService.getMetadataPayload(I[Ljava/lang/String;)[B org/mbari/siam/core/BaseInstrumentService.getMetadata([BI[Ljava/lang/String;Z)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.getMetadata([BIZ)Lorg/mbari/siam/distributed/MetadataPacket; org/mbari/siam/core/BaseInstrumentService.prepareToRun()V org/mbari/siam/core/PortManager.scanPort(Lorg/mbari/siam/core/DevicePort;Ljava/lang/String;)V org/mbari/siam/core/PortManager.scanPorts()V org/mbari/siam/core/NodeManager.start(Ljava/lang/String;Ljava/lang/String;)V org/mbari/siam/core/NodeMain.main([Ljava/lang/String;)V