[2018-06-24 07:31:01.674470] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2018-06-25 18:01:08.781230] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2018-06-25 18:01:08.800190] I [MSGID: 114020] [client.c:2106:notify] 2-data-volume-client-0: parent translators are ready, attempting connect on transport
[2018-06-25 18:01:08.806728] I [MSGID: 114020] [client.c:2106:notify] 2-data-volume-client-1: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume data-volume-client-0
  2:     type protocol/client
  3:     option ping-timeout 42
  4:     option remote-host mseas-data2
  5:     option remote-subvolume /mnt/brick1
  6:     option transport-type socket
  7:     option username 835923d3-7335-47a1-b691-be2c42968331
  8:     option password ab0269e7-bba4-431c-b25b-821abd14dd92
  9:     option send-gids true
 10: end-volume
 11:  
 12: volume data-volume-client-1
 13:     type protocol/client
 14:     option ping-timeout 42
 15:     option remote-host mseas-data2
 16:     option remote-subvolume /mnt/brick2
 17:     option transport-type socket
 18:     option username 835923d3-7335-47a1-b691-be2c42968331
 19:     option password ab0269e7-bba4-431c-b25b-821abd14dd92
 20:     option send-gids true
 21: end-volume
 22:  
 23: volume data-volume-dht
 24:     type cluster/distribute
 25:     subvolumes data-volume-client-0 data-volume-client-1
 26: end-volume
 27:  
 28: volume data-volume-write-behind
 29:     type performance/write-behind
 30:     subvolumes data-volume-dht
 31: end-volume
 32:  
 33: volume data-volume-read-ahead
 34:     type performance/read-ahead
 35:     subvolumes data-volume-write-behind
 36: end-volume
 37:  
 38: volume data-volume-readdir-ahead
 39:     type performance/readdir-ahead
 40:     subvolumes data-volume-read-ahead
 41: end-volume
 42:  
 43: volume data-volume-io-cache
 44:     type performance/io-cache
 45:     subvolumes data-volume-readdir-ahead
 46: end-volume
 47:  
 48: volume data-volume-quick-read
 49:     type performance/quick-read
 50:     subvolumes data-volume-io-cache
 51: end-volume
 52:  
 53: volume data-volume-md-cache
 54:     type performance/md-cache
 55:     subvolumes data-volume-quick-read
 56: end-volume
 57:  
 58: volume data-volume
 59:     type debug/io-stats
 60:     option log-level INFO
 61:     option latency-measurement off
 62:     option count-fop-hits off
 63:     subvolumes data-volume-md-cache
 64: end-volume
 65:  
 66: volume meta-autoload
 67:     type meta
 68:     subvolumes data-volume
 69: end-volume
 70:  
+------------------------------------------------------------------------------+
[2018-06-25 18:01:08.841867] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 2-data-volume-client-0: changing port to 49154 (from 0)
[2018-06-25 18:01:08.842497] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 2-data-volume-client-1: changing port to 49155 (from 0)
[2018-06-25 18:01:08.854417] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 2-data-volume-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2018-06-25 18:01:08.855025] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 2-data-volume-client-1: Connected to data-volume-client-1, attached to remote volume '/mnt/brick2'.
[2018-06-25 18:01:08.855058] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 2-data-volume-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2018-06-25 18:01:08.855338] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 2-data-volume-client-1: Server lk version = 1
[2018-06-25 18:01:09.847285] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 2-data-volume-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2018-06-25 18:01:09.848075] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 2-data-volume-client-0: Connected to data-volume-client-0, attached to remote volume '/mnt/brick1'.
[2018-06-25 18:01:09.848130] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 2-data-volume-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2018-06-25 18:01:09.858245] I [fuse-bridge.c:5156:fuse_graph_setup] 0-fuse: switched to graph 2
[2018-06-25 18:01:09.858340] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 2-data-volume-client-0: Server lk version = 1
[2018-06-25 18:03:28.283882] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2018-06-25 18:03:28.297027] I [MSGID: 114020] [client.c:2106:notify] 4-data-volume-client-0: parent translators are ready, attempting connect on transport
[2018-06-25 18:03:28.301398] I [MSGID: 114020] [client.c:2106:notify] 4-data-volume-client-1: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume data-volume-client-0
  2:     type protocol/client
  3:     option ping-timeout 42
  4:     option remote-host mseas-data2
  5:     option remote-subvolume /mnt/brick1
  6:     option transport-type socket
  7:     option username 835923d3-7335-47a1-b691-be2c42968331
  8:     option password ab0269e7-bba4-431c-b25b-821abd14dd92
  9:     option send-gids true
 10: end-volume
 11:  
 12: volume data-volume-client-1
 13:     type protocol/client
 14:     option ping-timeout 42
 15:     option remote-host mseas-data2
 16:     option remote-subvolume /mnt/brick2
 17:     option transport-type socket
 18:     option username 835923d3-7335-47a1-b691-be2c42968331
 19:     option password ab0269e7-bba4-431c-b25b-821abd14dd92
 20:     option send-gids true
 21: end-volume
 22:  
 23: volume data-volume-dht
 24:     type cluster/distribute
 25:     subvolumes data-volume-client-0 data-volume-client-1
 26: end-volume
 27:  
 28: volume data-volume-write-behind
 29:     type performance/write-behind
 30:     subvolumes data-volume-dht
 31: end-volume
 32:  
 33: volume data-volume-read-ahead
 34:     type performance/read-ahead
 35:     subvolumes data-volume-write-behind
 36: end-volume
 37:  
 38: volume data-volume-readdir-ahead
 39:     type performance/readdir-ahead
 40:     subvolumes data-volume-read-ahead
 41: end-volume
 42:  
 43: volume data-volume-io-cache
 44:     type performance/io-cache
 45:     subvolumes data-volume-readdir-ahead
 46: end-volume
 47:  
 48: volume data-volume-quick-read
 49:     type performance/quick-read
 50:     subvolumes data-volume-io-cache
 51: end-volume
 52:  
 53: volume data-volume-open-behind
 54:     type performance/open-behind
 55:     subvolumes data-volume-quick-read
 56: end-volume
 57:  
 58: volume data-volume-md-cache
 59:     type performance/md-cache
 60:     subvolumes data-volume-open-behind
 61: end-volume
 62:  
 63: volume data-volume
 64:     type debug/io-stats
 65:     option log-level INFO
 66:     option latency-measurement off
 67:     option count-fop-hits off
 68:     subvolumes data-volume-md-cache
 69: end-volume
 70:  
 71: volume meta-autoload
 72:     type meta
 73:     subvolumes data-volume
 74: end-volume
 75:  
+------------------------------------------------------------------------------+
[2018-06-25 18:03:28.341298] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 4-data-volume-client-0: changing port to 49154 (from 0)
[2018-06-25 18:03:28.341769] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 4-data-volume-client-1: changing port to 49155 (from 0)
[2018-06-25 18:03:28.354582] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 4-data-volume-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2018-06-25 18:03:28.355119] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 4-data-volume-client-1: Connected to data-volume-client-1, attached to remote volume '/mnt/brick2'.
[2018-06-25 18:03:28.355160] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 4-data-volume-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2018-06-25 18:03:28.355383] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 4-data-volume-client-1: Server lk version = 1
[2018-06-25 18:03:29.345978] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 4-data-volume-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2018-06-25 18:03:29.346858] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 4-data-volume-client-0: Connected to data-volume-client-0, attached to remote volume '/mnt/brick1'.
[2018-06-25 18:03:29.346898] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 4-data-volume-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2018-06-25 18:03:29.356814] I [MSGID: 114021] [client.c:2115:notify] 2-data-volume-client-0: current graph is no longer active, destroying rpc_client 
[2018-06-25 18:03:29.356873] I [MSGID: 114021] [client.c:2115:notify] 2-data-volume-client-1: current graph is no longer active, destroying rpc_client 
[2018-06-25 18:03:29.356908] I [fuse-bridge.c:5156:fuse_graph_setup] 0-fuse: switched to graph 4
[2018-06-25 18:03:29.356903] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 2-data-volume-client-0: disconnected from data-volume-client-0. Client process will keep trying to connect to glusterd until brick's port is available
[2018-06-25 18:03:29.356949] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 2-data-volume-client-1: disconnected from data-volume-client-1. Client process will keep trying to connect to glusterd until brick's port is available
[2018-06-25 18:03:29.356994] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 4-data-volume-client-0: Server lk version = 1
[2018-06-25 18:09:28.324222] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2018-06-25 18:09:28.338445] I [MSGID: 114020] [client.c:2106:notify] 6-data-volume-client-0: parent translators are ready, attempting connect on transport
[2018-06-25 18:09:28.343458] I [MSGID: 114020] [client.c:2106:notify] 6-data-volume-client-1: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume data-volume-client-0
  2:     type protocol/client
  3:     option ping-timeout 42
  4:     option remote-host mseas-data2
  5:     option remote-subvolume /mnt/brick1
  6:     option transport-type socket
  7:     option username 835923d3-7335-47a1-b691-be2c42968331
  8:     option password ab0269e7-bba4-431c-b25b-821abd14dd92
  9:     option send-gids true
 10: end-volume
 11:  
 12: volume data-volume-client-1
 13:     type protocol/client
 14:     option ping-timeout 42
 15:     option remote-host mseas-data2
 16:     option remote-subvolume /mnt/brick2
 17:     option transport-type socket
 18:     option username 835923d3-7335-47a1-b691-be2c42968331
 19:     option password ab0269e7-bba4-431c-b25b-821abd14dd92
 20:     option send-gids true
 21: end-volume
 22:  
 23: volume data-volume-dht
 24:     type cluster/distribute
 25:     subvolumes data-volume-client-0 data-volume-client-1
 26: end-volume
 27:  
 28: volume data-volume-write-behind
 29:     type performance/write-behind
 30:     subvolumes data-volume-dht
 31: end-volume
 32:  
 33: volume data-volume-read-ahead
 34:     type performance/read-ahead
 35:     subvolumes data-volume-write-behind
 36: end-volume
 37:  
 38: volume data-volume-readdir-ahead
 39:     type performance/readdir-ahead
 40:     subvolumes data-volume-read-ahead
 41: end-volume
 42:  
 43: volume data-volume-io-cache
 44:     type performance/io-cache
 45:     subvolumes data-volume-readdir-ahead
 46: end-volume
 47:  
 48: volume data-volume-quick-read
 49:     type performance/quick-read
 50:     subvolumes data-volume-io-cache
 51: end-volume
 52:  
 53: volume data-volume-md-cache
 54:     type performance/md-cache
 55:     subvolumes data-volume-quick-read
 56: end-volume
 57:  
 58: volume data-volume
 59:     type debug/io-stats
 60:     option log-level INFO
 61:     option latency-measurement off
 62:     option count-fop-hits off
 63:     subvolumes data-volume-md-cache
 64: end-volume
 65:  
 66: volume meta-autoload
 67:     type meta
 68:     subvolumes data-volume
 69: end-volume
 70:  
+------------------------------------------------------------------------------+
[2018-06-25 18:09:28.382881] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 6-data-volume-client-0: changing port to 49154 (from 0)
[2018-06-25 18:09:28.383799] I [rpc-clnt.c:1868:rpc_clnt_reconfig] 6-data-volume-client-1: changing port to 49155 (from 0)
[2018-06-25 18:09:28.389318] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 6-data-volume-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2018-06-25 18:09:28.390503] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 6-data-volume-client-0: Connected to data-volume-client-0, attached to remote volume '/mnt/brick1'.
[2018-06-25 18:09:28.390549] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 6-data-volume-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2018-06-25 18:09:28.391090] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 6-data-volume-client-0: Server lk version = 1
[2018-06-25 18:09:28.392993] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 6-data-volume-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2018-06-25 18:09:28.393564] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 6-data-volume-client-1: Connected to data-volume-client-1, attached to remote volume '/mnt/brick2'.
[2018-06-25 18:09:28.393605] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 6-data-volume-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2018-06-25 18:09:28.402497] I [MSGID: 114021] [client.c:2115:notify] 4-data-volume-client-0: current graph is no longer active, destroying rpc_client 
[2018-06-25 18:09:28.402558] I [MSGID: 114021] [client.c:2115:notify] 4-data-volume-client-1: current graph is no longer active, destroying rpc_client 
[2018-06-25 18:09:28.402588] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 4-data-volume-client-0: disconnected from data-volume-client-0. Client process will keep trying to connect to glusterd until brick's port is available
[2018-06-25 18:09:28.402598] I [fuse-bridge.c:5156:fuse_graph_setup] 0-fuse: switched to graph 6
[2018-06-25 18:09:28.402661] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 4-data-volume-client-1: disconnected from data-volume-client-1. Client process will keep trying to connect to glusterd until brick's port is available
[2018-06-25 18:09:28.402685] I [MSGID: 114035] [client-handshake.c:193:client_set_lk_version_cbk] 6-data-volume-client-1: Server lk version = 1
[2018-06-26 07:41:01.842618] I [MSGID: 100011] [glusterfsd.c:1323:reincarnate] 0-glusterfsd: Fetching the volume file from server...
[2018-06-26 07:41:01.843246] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2018-06-26 07:41:02.464516] I [MSGID: 114021] [client.c:2115:notify] 0-data-volume-client-0: current graph is no longer active, destroying rpc_client 
[2018-06-26 07:41:02.464594] I [MSGID: 114021] [client.c:2115:notify] 0-data-volume-client-1: current graph is no longer active, destroying rpc_client 
[2018-06-26 07:41:02.464630] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 0-data-volume-client-0: disconnected from data-volume-client-0. Client process will keep trying to connect to glusterd until brick's port is available
[2018-06-26 07:41:02.464702] I [MSGID: 114018] [client.c:2030:client_rpc_notify] 0-data-volume-client-1: disconnected from data-volume-client-1. Client process will keep trying to connect to glusterd until brick's port is available
[2018-06-29 14:31:40.019182] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2018-06-29 14:32:03.350744] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2018-06-29 14:32:03.363796] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2018-06-29 16:41:05.465000] I [glusterfsd-mgmt.c:58:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2018-06-29 16:41:05.475499] T [MSGID: 0] [options.c:1229:xlator_option_reconf_str] 6-data-volume: option logger not set
[2018-06-29 16:41:05.475543] T [MSGID: 0] [options.c:1229:xlator_option_reconf_str] 6-data-volume: option log-format not set
[2018-06-29 16:41:05.475566] T [MSGID: 0] [options.c:1232:xlator_option_reconf_uint32] 6-data-volume: option log-buf-size using default value 5
[2018-06-29 16:41:05.475589] T [MSGID: 0] [options.c:1242:xlator_option_reconf_time] 6-data-volume: option log-flush-timeout using default value 120
[2018-06-29 16:41:05.475604] D [io-stats.c:2803:reconfigure] 6-data-volume: reconfigure returning 0
[2018-06-29 16:41:05.475656] D [glusterfsd-mgmt.c:1628:mgmt_getspec_cbk] 0-glusterfsd-mgmt: No need to re-load volfile, reconfigure done
[2018-06-29 16:41:27.203139] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:41:27.203190] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:43:27.224975] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:43:27.225020] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:45:27.248053] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:45:27.248102] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:47:27.271285] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:47:27.271336] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:49:27.294479] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:49:27.294522] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:51:27.318479] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:51:27.318530] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:53:27.337526] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:53:27.337596] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:55:27.361965] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:55:27.362015] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:57:27.382161] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:57:27.382211] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2018-06-29 16:59:27.397952] D [logging.c:1830:gf_log_flush_timeout_cbk] 0-logging-infra: Log timer timed out. About to flush outstanding messages if present
[2018-06-29 16:59:27.398004] D [logging.c:1792:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5