Building

Started building at 2022/12/21 01:09:45
Using pegged server, 3442 build
Calculating base
Updating mirror
Basing run on 7.5.0-3442 b26dca49b6
Updating tree for run 21.12.2022-01.09
query is at f2d99be, changes since last good build: 
 f2d99bed6 MB-54894 /admin/ping to return unhealthy status
 063ca621d MB-54898 system:nodes to return node status
 dcc24f8e1 MB-54881 Change function name to be more explicit
 806715f94 MB-54881 No need to get document count for system keyspaces
 f56e988ec MB-54881 Proper check for SYSTEM namespace in dictionary
 e5011d8a0 MB-54881 standardize system string to SYSTEM_NAMESPACE_NAME
 854fdbd94 MB-54880 Allow recommended index with leading missing key to have a WHERE clause
 dcf737b2f Upgrade to bleve@v2.3.6
 f5ef1390e MB-54879 Reset expiration when input is invalid
 e6502da5c MB-54855 Track unnested item growth
 91d45b550 MB-54871 Use dummy base for Advise
 fb69527e4 MB-54865 add quotes to throttle times
 fa7861ace Upgrade to cbauth@v0.1.5 (cbgt)
 6ab27204d MB-54858 Convert allocated values gauge to a counter
 d903ae8b9 MB-54859 Properly set exact span for index with leading missing key and a where clause
 dd6c7c964 MB-54839 Correct test function name
 6ecc5f920 MB-54824 Add plan phase sub-times.
 59783c9ee MB-54839 Fix sequential scan single key validation for collections.
 1630911ee MB-54844 Initialise GSI error patterns up front
 91d508347 Keep only latest 12 dumps (2 hours worth)
 4f76f400a MB-54836 : Fix panic in running queries when sequential scans are disabled and there is no index for said query.
 e2a670214 Dump heap when process memory usage exceeds 80%
 2fdf3cfbc MB-53985 : Add logging for changes in n1ql-feat-ctrl query parameter on query service start-up also
 84fb9c427 MB-54821 Print SSL verification warning in cbq.
 4db862908 MB-54809 Handle nested simple functions in index advisor
 3bdb5b21f MB-53985 : Add logging for changes to the n1ql-feat-ctrl parameter. Add the disabled features in controls.
 c4e5104ec Fix test failure
 840d09d04 Remove duplicated statistic
 251bf5995 MB-54804 Do not include SELF as recommended index key
 8d6ed3184 MB-54799 first cut for memory diagnostics and management
 1d029d455 MB-29131 Return index details from CREATE INDEX statement
 952ad86ea MB-54748 Correct timeout mechanism for sequential scans.
 5bde6261d MB-54782 Add values counter metric
 ca8ef91e7 Sync time on SIGCONT
 4eb2b94f4 Fix build issue
 b84279e51 go mod tidy
 1aa90c452 Periodically resync util.Time base
 90642d911 MB-30383 : Add OFFSET clause to DELETE statement
 3cc89e044 MB-54732 amend throttling error message
 db1a4ee81 MB-54277 Use operator context for deleting optimizer statistics
 1aba8d80a MB-52685 : Add authentication to the admin/stats endpoint.
 5bd1e5ace MB-54730 Cache annotated value size
 b77ae6d7c MB-54740 Address panic in advise.
 f1c3cca02 MB-54670 Change audit domain & user
 cc11e1bc1 MB-54670 Use couchbase as the domain for auditing
 b16595d3d MB-54614 Better account for Value overhead.
 e7040bde8 MB-54713 Correct curl user option processing
 ff8f01cae MB-54253 Adjustment for sample size
gometa is at 4f94ea5, changes since last good build: none
ns_server is at 626cf69, changes since last good build: 
 626cf6939 Assert that undefined is no longer used as a database_dir
 e7be9c7ec MB-52469: Log AllowUnsafe to user logger while starting failover
 eae54ea92 Add api_tests to ns-test for commit validation
 3d7a306ab MB-49447 Add bucket api tests for create and update endpoints
 dfd25e6e3 Changes to api_tests for automatic cluster creation
 c68ef5f9f MB-52349: Introduce hibernation_manager module.
 43e1c44e0 MB-54849 Retry etmpfail when setting cluster config
 f0684ed56 MB-54846: Add cbstats range-scans to cbcollect_info
 a1e2c9d70 Refactor API'es in service_manager module.
 d14dd7fad Update .gitignore for new api_tests
 b59886b21 Remove unused field "admin" in memcached.json
 fd0ac755f MB-54835: Add cluster_compat_mode checks in service_agent
 c5b60e830 MB-54016 Add tcp_user_timeout tuneable
 431fd3699 MB-54404: encal: remove x86_64 compiler flags on macOS
 1c0d38d94 MB-54677: Add cbcollect start and end events to system event log
 984d7e9f3 MB-52349: Add exit_on_first_error flag for wait_many/3.
 efe245763 Merge "Merge remote-tracking branch 'couchbase/neo'"
 4d5b27cb4 Add tests to async module.
 bad75e7df MB-52349: Refactor service_rebalancer and service_agent
 a85cd2eaf Merge remote-tracking branch 'couchbase/neo'
 1f7ad0896 Wrap authentication info in function
 8f9123bf3 MB-52261, MB-52262 when adding nodes via selective services rebalance
 39b8f3efb MB-52261, MB-52262 disallow delta recovery if custom list of services
 ba347411d MB-52261, MB-52262 error out if one of the services rebalance is
 543fcbdcf MB-54767: Call UpdateURL only for internal revrpc connections
 3ced4cab9 MB-54345: Replace http_uri:parse with misc:parse_url
 f7202af68 MB-52623: Sanitize passwords in cbauth
 a8c69ba79 MB-54764: Memcached max_client_connection_details setting
 05fd92981 Merge "Merge remote-tracking branch 'couchbase/neo'"
 8b6d790f1 MB-54582: Minor changes required for upgrade to erlang 25
 60716102a Merge remote-tracking branch 'couchbase/neo'
 fc1492843 MB-54641: Backport tuning of TCP keepalive
 32101480b MB-54649 Memcached free_connection_pool_size setting
 2f93210e5 MB-54396 [BP] Report correct stats
 38831e556 MB-54396 [BP] Make sure promQL optimizations don't change...
 18850d64d MB-53548 Merge remote-tracking branch 'couchbase/cheshire-cat'
 42bc51daf MB-52548 Merge remote-tracking branch 'couchbase/mad-hatter'
 c8f9c9607 MB-54674: Revert "Revert "MB-54624: Merge 'couchbase/cheshire-cat'..
 a03e4b129 MB-53548 [BP] Do not pass password as an arg
 417cc6980 MB-54649 Memcached connection_limit_mode setting
 863559db7 MB-54619: Make Neo branch 7.2.0 rather than 7.1.0
 6c8a29469 Revert "Revert "MB-54268 Conditionally pass '--disable-bucket-config'""
 f3bd8795b MB-52623: Make multiple admin passwords compatible with...
 186782e37 MB-52623: Add periodic int creds rotation
 dea3613f8 MB-52623: Add internal creds rotation endpoint
 189701a14 MB-52623: Update revrpc url in case of password change
 7588bdcc2 MB-52623: Add support for dynamic env vars in ns_port_server
 fd21a673e MB-52623: Add support for multiple internal passwords
 82f8705b4 MB-52623: Add support for multiple hashes for users
 8247cbc6d MB-52623: Upgrade plain auth records
 528837704 MB-52623: Fix memcached_cfg:sync/0
 32a893a3f Revert "MB-54624: Merge 'couchbase/cheshire-cat' into neo"
 81799024f MB-54624: Merge 'couchbase/cheshire-cat' into neo
 0d4491669 MB-54648: Merge 'couchbase/mad-hatter' into cheshire-cat
 2f7f5c168 MB-54674: cbcollect_info: Don't read /proc/PID/{smaps,numa_maps}
 da7902b9e MB-54674: cbcollect_info: Don't read /proc/PID/{smaps,numa_maps}
 0f5857c89 MB-53994: [BP] Upgrade all golang versions for ns_server deps
 77029bb07 MB-54134: [BP] fix secrets leak in REST api crash
 173238f03 MB-54444 Merge remote-tracking branch 'couchbase/6.6.5'
 eb05f7fc2 MB-54444:[BP] Handle ssl port when getting indexes
 c920a7bf3 MB-54249 [BP] golang component debug sweep up in cbcollect_info
 e4659ac4a MB-53540 [BP] pass PKey to ns_ssl_services_setup process as a fun
 6c916743b MB-53552 [BP] Don't leak sensitive information (complete_join)
 bfc37cde8 MB-53552 [BP] Don't leak sensitive information (engage_cluster)
 729111ce7 MB-53551 [BP] Sanitize goport env to prevent it being logged...
 da2fd33d8 MB-54349 Handle ssl port when getting indexes
 6c52c5bca MB-53891 MB-53811: [BP] Make sure rest_lhttpc_pool crash...
couchstore is at d75745b, changes since last good build: 
 d75745b Include What You Use in dbdiff.cc and compactor.cc for PRIu64
forestdb is at acba458, changes since last good build: none
kv_engine is at f0f330f, changes since last good build: 
 f0f330f7f kv_slow_ops_2_gtrace: log bucket of Slow ops
 55a36d6a8 DCP docs: Cleanup 'concepts' page
 153d7ecef MB-53053: Add EPEngineGroup type and group quota sharing engines
 8a8f69a55 Merge "Merge branch 'couchbase/neo' into 'couchbase/master'"
 b8980d8af [Cleanup] Don't document overridden functions
 8bdd6e1bf [Refactor] Use a single nlohmann::json for cookie errors
 6eb25e771 Merge branch 'couchbase/neo' into 'couchbase/master'
 72218a6a7 MB-53053: Expose the NoBucketTaskable to use in the quota sharing pager
 778636aef Add VBucketFilter method to create a filter given an offset + stride
 a411a4f8b [Cleanup] Remove debug logging of commands
 9c0fa1eac Delete Cookie() constructor
 ab15e514f [Cleanup] Don't shadow variable in Cookie::sendResponse
 9b3c3ce28 Remove unused field admin from settings parser
 61f333bcd DCP docs: Add 'design discussion' page
 7d2cbadfd MB-54829: Temp disable underflow check for PersistedStats:diskSize
 76c948ba8 Merge "Merge commit 'couchbase/neo' into 'couchbase/master'"
 b71613638 MB-53053: Extract the paging visitor scheduling logic into a virtual
 d181348ac MB-54645: Enable operation tracing by default
 91fda38ca MB-53053: Refactor pageable memory info into a virtual member
 2de4744c9 MB-52311: [9/n] Pause / Resume Bucket: Minor docs changes
 af1687c0f Merge commit 'couchbase/neo' into 'couchbase/master'
 e319caada Merge commit '13fce2855a61a7301daaac47ecb162e2889e9498' into master
 29159ae66 Merge "Merge commit 'couchbase/neo' into 'couchbase/master'"
 29d8d3ced [Refactor] Move checkPrivilege to CookieIface
 d03d815e2 Merge commit 'couchbase/neo' into 'couchbase/master'
 4212d2d94 Don't replace error context for impersonate failure
 3b47674e4 Merge "Merge commit 'couchbase/neo' into 'couchbase/master'"
 43e660b5e Merge "Merge commit 'couchbase/neo' into 'couchbase/master'"
 fd5d4b738 MB-53053: Refactor eviction ratio computation code
 ce2744750 MB-53053: Make ItemPager a base class
 b26ebc816 Fix uninitialised notified flag in CrossBucketItemFreqDecayer
 9bbd578ef MB-53053: Make ItemPager inherit from NotifiableTask
 ad9b79a98 Merge commit 'couchbase/neo' into 'couchbase/master'
 4f4b51ccd Merge commit 'couchbase/neo' into 'couchbase/master'
 bdbda6a6f Merge commit 'couchbase/neo' into 'couchbase/master'
 2081c59c5 Merge commit 'couchbase/neo' into 'couchbase/master'
 ba418ebb6 Merge commit 'couchbase/neo' into 'couchbase/master'
 37e956e68 Merge "Merge commit 'couchbase/neo' into 'couchbase/master'"
 b17380b9b Merge commit 'couchbase/neo' into 'couchbase/master'
 9632fb6bf kv_slow_ops_2_gtrace: Handle 6.6.5 slow op corruption
 6277f4cbc Cleanup: Create "unique" variable name in stat macro
 feb5cfb88 Make NotifiableTask::getSleepTime return std::chrono::duration
 e856c3e88 Merge "Merge commit 'couchbase/neo' into 'couchbase/master'"
 76305ed20 MB-53945: [linux] Add support for TCP_USER_TIMEOUT
 4aa3511da Use testPrivilege instead of checkPrivilege for XTOC
 974d43865 MB-53053: Add CrossBucketVisitorAdapter for cross-bucket visitation
 a190a66a8 Merge commit 'couchbase/neo' into 'couchbase/master'
 726a61e80 Print the last 100 log entries for failing ep_testuite tests
 6637d4986 MB-52311: [8/n] Pause / Resume Bucket: EPBucket cancellation
 260ca258a Skip more tests broken under RocksDB
 81685e8be Refactor: Rename setCollectionsPrototype to setCollectionsEnabled
 a72a13066 [Refactor] Remove boilerplate in Settings
 ded2660cb Merge "Merge commit '6b2bc5b95' into 'couchbase/master'"
 0ee9b1924 [Refactor] Use std::string_view for config validate
 c5c5b3000 Merge commit '6b2bc5b95' into 'couchbase/master'
 634a303b5 MB-52311: [7/n] Pause / Resume Bucket: Add cancellation support
 6c0873201 MB-53053: Make SingleSteppingVisitorAdapter callback after every run()
 532cbf177 Use the logger directly from cbsasl
 a5839467f MB-53719: [cbsasl] Remove old "hash" entry [2/2]
 7f4036f5d MB-54700: Reduce the size of StoredValues by 4 bytes
 ff2eb4b82 MB-54680: Fix out-of-bounds access in operator<<(ostream&, Blob)
 ed1d09dac MB-52823: Disable test of TLS1[.1] for OpenSSL 3.0
 ebf0e9e12 Merge commit 'bdaf6f97d' into 'couchbase/master'
 f181b5e80 MB-54516: Introduce the history_retention_bytes config param
 206fd0132 MB-54591: Merge branch 'mad-hatter' into cheshire-cat
 9cf288704 MB-54516: Introduce the history_retention_seconds config param
 13fce2855 MB-54386, MB-54455, MB-54452: Add ConnectionLimitMode::Recycle
 583ae1c5e MB-54516: Use VBQueueItemCtx to pass CanDeduplicate status to Item
 836e683b5 MB-54516: Add Collection's history setting to VB::Manifest
 773f5420e MB-54516: Add top-level "history" key to Collection's Manifest
 2ebc511eb MB-54516: Expose VB:Manifest flatbuffer "get" functions
 d820c4861 MB-54516: Add "history" key to Collection's Manifest
 bdaf6f97d MB-54605: [testapp] Fix raciness in MaxConnectionTest
 07294457f Merge branch 'cheshire-cat' into neo
 8d32d248d MB-54591: ActiveStream: Avoid lost wakeup due to race on itemsReady
 41c980fd9 Merge branch 'cheshire-cat' into neo
 6f767f7e5 [BP] MB-48759: End legacy DCP stream if there are no items in range [2/2]
 6b2bc5b95 [BP] MB-48759: End legacy DCP stream if there are no items in range [1/2]
Switching indexing to unstable
indexing is at 92fc82c, changes since last good build: 
 92fc82c8 MB-52931 Populate slice as argument to go-routine in cleanupIndexData
 4016c060 MB-53902 Add blob_storage_region to indexer settings
Switching plasma to unstable
plasma is at 381d86c, changes since last good build: 
fatal: Invalid revision range 4de8f38571e461e33d2939e2615f4e7fc05c5a4e..HEAD

Switching nitro to unstable
nitro is at d5f5610, changes since last good build: none
Switching gometa to master
gometa is at 4f94ea5, changes since last good build: none
Switching testrunner to master
Submodule 'gauntlet' (https://github.com/pavithra-mahamani/gauntlet) registered for path 'gauntlet'
Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client'
Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI'
Submodule 'magma_loader/DocLoader' (https://github.com/couchbaselabs/DocLoader.git) registered for path 'magma_loader/DocLoader'
Cloning into '/opt/build/testrunner/gauntlet'...
Cloning into '/opt/build/testrunner/java_sdk_client'...
Cloning into '/opt/build/testrunner/lib/capellaAPI'...
Cloning into '/opt/build/testrunner/magma_loader/DocLoader'...
Submodule path 'gauntlet': checked out '4e2424851a59c6f4b4edfdb7e36fa6a0874d6300'
Submodule path 'java_sdk_client': checked out '5dd338995c16ac2f5b187729e549b28862060732'
Submodule path 'lib/capellaAPI': checked out '9f27e756441479974568d1c0690e216ccc5ce733'
Submodule path 'magma_loader/DocLoader': checked out '997f514b43e9beef241d0b7e61c8171042d22543'
testrunner is at 57ead99, changes since last good build: none
Pulling in uncommitted change 183936 at refs/changes/36/183936/6
Total 11 (delta 6), reused 8 (delta 6)
[unstable ef77aaec] MB-52308,MB-52354 update service APIs for pause resume
 Author: Dhruvil Shah 
 Date: Sat Dec 10 18:38:14 2022 +0530
 5 files changed, 212 insertions(+), 361 deletions(-)
Pulling in uncommitted change 184266 at refs/changes/66/184266/4
Total 11 (delta 9), reused 11 (delta 9)
[unstable 79d51b76] MB-54116 Handle special characters in bucket names for tests
 Author: Varun Velamuri 
 Date: Mon Dec 19 17:18:58 2022 -0800
 4 files changed, 28 insertions(+), 29 deletions(-)
Pulling in uncommitted change 183949 at refs/changes/49/183949/2
Total 3 (delta 0), reused 0 (delta 0)
[unstable d4c433f] MB-100: Wait for copy context completion in Tests
 Author: Saptarshi Sen 
 Date: Sun Dec 11 23:13:27 2022 -0800
 1 file changed, 7 insertions(+), 5 deletions(-)
Pulling in uncommitted change 184000 at refs/changes/00/184000/5
Total 3 (delta 2), reused 3 (delta 2)
[unstable 358c069] MB-52020: Sync during RestoreFile
 Author: Saptarshi Sen 
 Date: Mon Dec 12 22:09:42 2022 -0800
 1 file changed, 6 insertions(+)
Pulling in uncommitted change 184169 at refs/changes/69/184169/5
Total 7 (delta 5), reused 7 (delta 5)
[unstable 23ccc55] MB-52020: Remove orphan paths on RestoreShard failure
 Author: Saptarshi Sen 
 Date: Thu Dec 15 17:54:47 2022 -0800
 2 files changed, 149 insertions(+), 31 deletions(-)
Building community edition
Building cmakefiles and deps [CE]
Building main product [CE]
Build CE finished
BUILD_ENTERPRISE empty. Building enterprise edition
Building Enterprise Edition
Building cmakefiles and deps [EE]
Building main product [EE]
Build EE finished

Testing

Started testing at 2022/12/21 02:04:21
Testing mode: sanity,unit,functional,serverless,integration
Using storage type: memdb
Setting ulimit to 200000

Simple Test

Dec 21 02:09:48 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Dec 21 02:13:40 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Dec 21 02:14:29 do_warmup_100k (memcapable.WarmUpMemcachedTest) ... ok
Dec 21 02:16:01 test_view_ops (view.createdeleteview.CreateDeleteViewTests) ... ok
Dec 21 02:16:54 b" 'stop_on_failure': 'True'}"
Dec 21 02:16:54 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Dec 21 02:16:54 b"{'nodes_in': '3', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 1, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Dec-21_02-04-45/test_1'}"
Dec 21 02:16:54 b'-->result: '
Dec 21 02:16:54 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0'
Dec 21 02:16:54 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,bucket_type=ephemeral,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Dec 21 02:16:54 b"{'nodes_in': '3', 'bucket_type': 'ephemeral', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 2, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Dec-21_02-04-45/test_2'}"
Dec 21 02:16:54 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Dec 21 02:16:54 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t memcapable.WarmUpMemcachedTest.do_warmup_100k,get-logs-cluster-run=True'
Dec 21 02:16:54 b"{'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 3, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Dec-21_02-04-45/test_3'}"
Dec 21 02:16:54 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Dec 21 02:16:54 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 21 02:16:54 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.createdeleteview.CreateDeleteViewTests.test_view_ops,ddoc_ops=create,test_with_view=True,num_ddocs=1,num_views_per_ddoc=10,items=1000,skip_cleanup=False,get-logs-cluster-run=True'
Dec 21 02:16:54 b"{'ddoc_ops': 'create', 'test_with_view': 'True', 'num_ddocs': '1', 'num_views_per_ddoc': '10', 'items': '1000', 'skip_cleanup': 'False', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 4, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Dec-21_02-04-45/test_4'}"
Dec 21 02:16:54 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Dec 21 02:16:54 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 21 02:16:54 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 21 02:27:18 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,num_nodes_to_add=1,skip_rebalance=true,docs-per-day=1,timeout=1200,get-logs-cluster-run=True'ok
Dec 21 02:28:00 test_simple_dataset_stale_queries_data_modification (view.viewquerytests.ViewQueryTests) ... ok
Dec 21 02:31:46 load_with_ops (xdcr.uniXDCR.unidirectional) ... ok
Dec 21 02:35:42 load_with_failover (xdcr.uniXDCR.unidirectional) ... ok
Dec 21 02:38:26 suite_tearDown (xdcr.uniXDCR.unidirectional) ... ok
Dec 21 02:38:26 b"{'num_nodes_to_add': '1', 'skip_rebalance': 'true', 'docs-per-day': '1', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 5, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Dec-21_02-04-45/test_5'}"
Dec 21 02:38:26 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Dec 21 02:38:26 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 21 02:38:26 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 21 02:38:26 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0'
Dec 21 02:38:26 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'
Dec 21 02:38:26 b"{'num-docs': '1000', 'skip_rebalance': 'true', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 6, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Dec-21_02-04-45/test_6'}"
Dec 21 02:38:26 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Dec 21 02:38:26 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 21 02:38:26 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 21 02:38:26 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Dec 21 02:38:26 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_ops,replicas=1,items=10000,value_size=128,ctopology=chain,rdirection=unidirection,doc-ops=update-delete,get-logs-cluster-run=True'
Dec 21 02:38:26 b"{'replicas': '1', 'items': '10000', 'value_size': '128', 'ctopology': 'chain', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 7, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Dec-21_02-04-45/test_7'}"
Dec 21 02:38:26 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Dec 21 02:38:26 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 21 02:38:26 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 21 02:38:26 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Dec 21 02:38:26 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0'
Dec 21 02:38:26 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Dec 21 02:38:26 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Dec-21_02-04-45/test_8'}"
Dec 21 02:38:26 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Dec 21 02:38:26 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Dec 21 02:38:26 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Dec 21 02:38:26 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Dec 21 02:38:26 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0'
Dec 21 02:38:26 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Dec 21 02:38:26 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Dec 21 02:38:26 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Dec 21 02:38:26 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' pass')"
Dec 21 02:38:26 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' pass')"
Dec 21 02:38:26 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' pass')"
Dec 21 02:38:26 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' pass')"
Dec 21 02:38:26 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' pass')"
Dec 21 02:38:26 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' pass')"

Unit tests

=== RUN   TestMerger
--- PASS: TestMerger (0.01s)
=== RUN   TestInsert
--- PASS: TestInsert (0.00s)
=== RUN   TestInsertPerf
16000000 items took 29.632099714s -> 539954.986464919 items/s conflicts 27
--- PASS: TestInsertPerf (29.64s)
=== RUN   TestGetPerf
16000000 items took 5.996379246s -> 2.668276862353746e+06 items/s
--- PASS: TestGetPerf (6.67s)
=== RUN   TestGetRangeSplitItems
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3351,
"memory_used":            37360992,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 749144,
"level1": 187776,
"level2": 47222,
"level3": 11903,
"level4": 2974,
"level5": 735,
"level6": 182,
"level7": 48,
"level8": 12,
"level9": 2,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Split range keys [35911 108875 357987 462344 598654 671258 781160]
No of items in each range [35911 72964 249112 104357 136310 72604 109902 218840]
--- PASS: TestGetRangeSplitItems (0.60s)
=== RUN   TestBuilder
{
"node_count":             50000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3333,
"memory_used":            1866650928,
"node_allocs":            50000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 37500395,
"level1": 9374070,
"level2": 2344403,
"level3": 586130,
"level4": 146617,
"level5": 36338,
"level6": 9033,
"level7": 2299,
"level8": 539,
"level9": 123,
"level10": 39,
"level11": 9,
"level12": 5,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 8.16294517s to build 50000000 items, 6.1252405e+06 items/sec
Took 407.018348ms to iterate 50000000 items
--- PASS: TestBuilder (8.57s)
=== RUN   TestNodeDCAS
--- PASS: TestNodeDCAS (0.00s)
PASS
ok  	github.com/couchbase/indexing/secondary/memdb/skiplist	45.747s
=== RUN   TestInsert
Set IO Concurrency: 716
--- PASS: TestInsert (0.01s)
=== RUN   TestInsertPerf
20000000 items took 50.982877405s -> 392288.5685937875 items/s snapshots_created 210 live_snapshots 1
--- PASS: TestInsertPerf (64.36s)
=== RUN   TestInsertDuplicates
--- PASS: TestInsertDuplicates (0.44s)
=== RUN   TestGetPerf
16000000 items took 11.524624885s -> 1.3883315213864334e+06 items/s
--- PASS: TestGetPerf (13.11s)
=== RUN   TestLoadStoreDisk
Inserting 1000000 items took 1.466139661s
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       9,
"next_pointers_per_node": 1.3330,
"memory_used":            57327868,
"node_allocs":            999999,
"node_frees":             0,
"level_node_distribution":{
"level0": 750031,
"level1": 187655,
"level2": 46819,
"level3": 11609,
"level4": 2898,
"level5": 730,
"level6": 195,
"level7": 47,
"level8": 10,
"level9": 4,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
2022-12-21T02:40:52.379+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[42252 23359 66846 35854 63966 76250 27901 54342 95957 84432 103508 41674 34748 96401 74252 78258]] total count [1000000] snap count [1000000] size per shard [[338016 186872 534768 286832 511728 610000 223208 434736 767656 675456 828064 333392 277984 771208 594016 626064]] total size [8000000] memoryInUse [57327868]
Storing to disk took 315.68286ms
Loading from disk took 273.078067ms
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3338,
"memory_used":            57341296,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 749468,
"level1": 188004,
"level2": 46896,
"level3": 11748,
"level4": 2921,
"level5": 741,
"level6": 168,
"level7": 43,
"level8": 7,
"level9": 3,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestLoadStoreDisk (3.73s)
=== RUN   TestConcurrentLoadCloseFragmentation
Done Inserting 2000000 items
frag = NaN%
2022-12-21T02:40:57.994+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[2216 6660 43168 64085 124405 11984 147048 84349 165256 226883 34220 256635 55142 126057 347929 303963]] total count [2000000] snap count [2000000] size per shard [[17728 53280 345344 512680 995240 95872 1176384 674792 1322048 1815064 273760 2053080 441136 1008456 2783432 2431704]] total size [16000000] memoryInUse [114656972]
Done Storing to disk
frag = NaN%
Done Loading from disk
Done Closing
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentation (5.49s)
=== RUN   TestConcurrentLoadCloseFragmentationSmall
Done Inserting 10 items
frag = NaN%
2022-12-21T02:40:59.666+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationSmall (0.07s)
=== RUN   TestConcurrentLoadCloseFragmentationEmpty
Done Inserting 0 items
frag = NaN%
2022-12-21T02:40:59.745+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationEmpty (0.54s)
=== RUN   TestConcurrentCloseSingleNode
A
--- PASS: TestConcurrentCloseSingleNode (0.00s)
=== RUN   TestStoreDiskShutdown
Inserting 1000000 items took 1.493808267s
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       11,
"next_pointers_per_node": 1.3339,
"memory_used":            57342064,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 749844,
"level1": 187467,
"level2": 46922,
"level3": 11802,
"level4": 2978,
"level5": 755,
"level6": 172,
"level7": 42,
"level8": 15,
"level9": 1,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
Prepare returns error:  MemDB instance has been shutdown
--- PASS: TestStoreDiskShutdown (2.35s)
=== RUN   TestDelete
{
"node_count":             10,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.2000,
"memory_used":            572,
"node_allocs":            10,
"node_frees":             0,
"level_node_distribution":{
"level0": 8,
"level1": 2,
"level2": 0,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
{
"node_count":             10,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.4000,
"memory_used":            604,
"node_allocs":            20,
"node_frees":             10,
"level_node_distribution":{
"level0": 7,
"level1": 2,
"level2": 1,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestDelete (1.00s)
=== RUN   TestGCPerf
final_node_count = 16000, average_live_node_count = 67012, wait_time_for_collection = 17ms
--- PASS: TestGCPerf (36.95s)
=== RUN   TestMemoryInUse
ItemsCount: 5000, MemoryInUse: 297952, NodesCount: 5000
ItemsCount: 0, MemoryInUse: 80, NodesCount: 0
--- PASS: TestMemoryInUse (1.01s)
=== RUN   TestFullScan
Inserting 1600000 items took 2.372276562s
{
"node_count":             1600000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       19,
"next_pointers_per_node": 1.3341,
"memory_used":            91752000,
"node_allocs":            1600000,
"node_frees":             0,
"level_node_distribution":{
"level0": 1199707,
"level1": 299789,
"level2": 75380,
"level3": 18791,
"level4": 4673,
"level5": 1225,
"level6": 320,
"level7": 86,
"level8": 23,
"level9": 5,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Full iteration of 1600000 items took 314.063184ms
--- PASS: TestFullScan (3.89s)
=== RUN   TestVisitor
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3336,
"memory_used":            57337904,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 750084,
"level1": 187322,
"level2": 46746,
"level3": 11875,
"level4": 3001,
"level5": 734,
"level6": 180,
"level7": 43,
"level8": 11,
"level9": 3,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 42.628291ms to iterate 1000000 items, 2.3458598e+07 items/s
shard - 0 count = 32241, range: 0-32240
shard - 1 count = 18405, range: 32241-50645
shard - 2 count = 14882, range: 50646-65527
shard - 3 count = 23749, range: 65528-89276
shard - 4 count = 6277, range: 89277-95553
shard - 5 count = 28399, range: 95554-123952
shard - 6 count = 9681, range: 123953-133633
shard - 7 count = 25180, range: 133634-158813
shard - 8 count = 37815, range: 158814-196628
shard - 9 count = 52116, range: 196629-248744
shard - 10 count = 31528, range: 248745-280272
shard - 11 count = 51785, range: 280273-332057
shard - 12 count = 28835, range: 332058-360892
shard - 13 count = 29818, range: 360893-390710
shard - 14 count = 43936, range: 390711-434646
shard - 15 count = 70604, range: 434647-505250
shard - 16 count = 30224, range: 505251-535474
shard - 17 count = 24377, range: 535475-559851
shard - 18 count = 73580, range: 559852-633431
shard - 19 count = 46850, range: 633432-680281
shard - 20 count = 33226, range: 680282-713507
shard - 21 count = 85685, range: 713508-799192
shard - 22 count = 7810, range: 799193-807002
shard - 23 count = 14519, range: 807003-821521
shard - 24 count = 29671, range: 821522-851192
shard - 25 count = 36886, range: 851193-888078
shard - 26 count = 60514, range: 888079-948592
shard - 27 count = 20814, range: 948593-969406
shard - 28 count = 17749, range: 969407-987155
shard - 29 count = 12844, range: 987156-999999
shard - 30 count = 0, range: 0-0
shard - 31 count = 0, range: 0-0
--- PASS: TestVisitor (1.37s)
=== RUN   TestVisitorError
--- PASS: TestVisitorError (0.16s)
=== RUN   TestLoadDeltaStoreDisk
snap count = 1000000
2022-12-21T02:41:50.640+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 7242 41740 69584 164300 77406 114468 156695 191086 147934 5981 0]] total count [976436] snap count [1000000] size per shard [[0 0 0 0 0 57936 333920 556672 1314400 619248 915744 1253560 1528688 1183472 47848 0]] total size [7811488] memoryInUse [128015788]
Storing to disk took 15.250247248s
Loading from disk took 1.053973611s
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3334,
"memory_used":            57333600,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 749908,
"level1": 187640,
"level2": 46754,
"level3": 11823,
"level4": 2932,
"level5": 728,
"level6": 162,
"level7": 37,
"level8": 10,
"level9": 6,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Restored 23564
RestoredFailed 409484
--- PASS: TestLoadDeltaStoreDisk (18.25s)
=== RUN   TestExecuteConcurrGCWorkers
--- PASS: TestExecuteConcurrGCWorkers (0.75s)
=== RUN   TestCloseWithActiveIterators
--- PASS: TestCloseWithActiveIterators (11.33s)
=== RUN   TestDiskCorruption
Inserting 100000 items took 100.909897ms
{
"node_count":             100000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       8,
"next_pointers_per_node": 1.3358,
"memory_used":            5737244,
"node_allocs":            99999,
"node_frees":             0,
"level_node_distribution":{
"level0": 74763,
"level1": 18996,
"level2": 4684,
"level3": 1156,
"level4": 293,
"level5": 80,
"level6": 21,
"level7": 5,
"level8": 2,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
2022-12-21T02:42:17.463+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[5728 14575 4182 5082 5988 3612 3177 8558 9170 1165 4120 5735 13137 2756 13015 0]] total count [100000] snap count [100000] size per shard [[45824 116600 33456 40656 47904 28896 25416 68464 73360 9320 32960 45880 105096 22048 104120 0]] total size [800000] memoryInUse [5737244]
Storing to disk took 122.973689ms
Loading from disk took 365.868953ms
--- PASS: TestDiskCorruption (0.65s)
=== RUN   TestSnapshotStats
--- PASS: TestSnapshotStats (0.01s)
=== RUN   TestInsertDeleteConcurrent
total items in snapshot: 8445598  items deleted: 1554402
{
"node_count":             8445598,
"soft_deletes":           0,
"read_conflicts":         8333,
"insert_conflicts":       123,
"next_pointers_per_node": 1.3334,
"memory_used":            484223864,
"node_allocs":            10000000,
"node_frees":             10000002,
"level_node_distribution":{
"level0": 6334133,
"level1": 1583136,
"level2": 396602,
"level3": 98628,
"level4": 24744,
"level5": 6270,
"level6": 1526,
"level7": 428,
"level8": 94,
"level9": 27,
"level10": 9,
"level11": 1,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
allocs: 20000002 frees: 20000002
--- PASS: TestInsertDeleteConcurrent (17.52s)
=== RUN   TestNodeList
--- PASS: TestNodeList (0.00s)
PASS
ok  	github.com/couchbase/indexing/secondary/memdb	183.264s
=== RUN   TestInteger
--- PASS: TestInteger (0.00s)
=== RUN   TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN   TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN   TestFloat
--- PASS: TestFloat (0.00s)
=== RUN   TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN   TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN   TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN   TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN   TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN   TestReference
--- PASS: TestReference (0.00s)
=== RUN   TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN   TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN   TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN   TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN   TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN   TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN   TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN   TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN   TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618] 
PASS 
TESTING [0] 
PASS 
TESTING [0.0] 
PASS 
TESTING [0.0000] 
PASS 
TESTING [0.0000000] 
PASS 
TESTING [-0] 
PASS 
TESTING [-0.0] 
PASS 
TESTING [-0.0000] 
PASS 
TESTING [-0.0000000] 
PASS 
TESTING [1] 
PASS 
TESTING [20] 
PASS 
TESTING [3456] 
PASS 
TESTING [7645000] 
PASS 
TESTING [9223372036854775807] 
PASS 
TESTING [9223372036854775806] 
PASS 
TESTING [9223372036854775808] 
PASS 
TESTING [92233720368547758071234000] 
PASS 
TESTING [92233720368547758071234987437653] 
PASS 
TESTING [12300000000000000000000000000000056] 
PASS 
TESTING [12300000000000000000000000000000000] 
PASS 
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000] 
PASS 
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [210690] 
PASS 
TESTING [90000] 
PASS 
TESTING [123000000] 
PASS 
TESTING [3.60e2] 
PASS 
TESTING [36e2] 
PASS 
TESTING [1.9999999999e10] 
PASS 
TESTING [1.99999e10] 
PASS 
TESTING [1.99999e5] 
PASS 
TESTING [0.00000000000012e15] 
PASS 
TESTING [7.64507352e8] 
PASS 
TESTING [9.2233720368547758071234987437653e31] 
PASS 
TESTING [2650e-1] 
PASS 
TESTING [26500e-1] 
PASS 
TESTING [-1] 
PASS 
TESTING [-20] 
PASS 
TESTING [-3456] 
PASS 
TESTING [-7645000] 
PASS 
TESTING [-9223372036854775808] 
PASS 
TESTING [-9223372036854775807] 
PASS 
TESTING [-9223372036854775806] 
PASS 
TESTING [-9223372036854775809] 
PASS 
TESTING [-92233720368547758071234000] 
PASS 
TESTING [-92233720368547758071234987437653] 
PASS 
TESTING [-12300000000000000000000000000000056] 
PASS 
TESTING [-12300000000000000000000000000000000] 
PASS 
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000] 
PASS 
TESTING [-210690] 
PASS 
TESTING [-90000] 
PASS 
TESTING [-123000000] 
PASS 
TESTING [-3.60e2] 
PASS 
TESTING [-36e2] 
PASS 
TESTING [-1.9999999999e10] 
PASS 
TESTING [-1.99999e10] 
PASS 
TESTING [-1.99999e5] 
PASS 
TESTING [-0.00000000000012e15] 
PASS 
TESTING [-2650e-1] 
PASS 
TESTING [-26500e-1] 
PASS 
TESTING [0.03] 
PASS 
TESTING [198.60] 
PASS 
TESTING [2000045.178] 
PASS 
TESTING [1.7976931348623157e+308] 
PASS 
TESTING [0.000000000000000000890] 
PASS 
TESTING [257953786.9864236576] 
PASS 
TESTING [257953786.9864236576e8] 
PASS 
TESTING [36.912e3] 
PASS 
TESTING [2761.67e0] 
PASS 
TESTING [2761.67e00] 
PASS 
TESTING [2761.67e000] 
PASS 
TESTING [7676546.67e-3] 
PASS 
TESTING [-0.03] 
PASS 
TESTING [-198.60] 
PASS 
TESTING [-2000045.178] 
PASS 
TESTING [-1.7976931348623157e+308] 
PASS 
TESTING [-0.000000000000000000890] 
PASS 
TESTING [-257953786.9864236576] 
PASS 
TESTING [-257953786.9864236576e8] 
PASS 
TESTING [-36.912e3] 
PASS 
TESTING [-2761.67e0] 
PASS 
TESTING [-2761.67e00] 
PASS 
TESTING [-2761.67e000] 
PASS 
TESTING [-7676546.67e-3] 
PASS 
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN   TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN   TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN   TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok  	github.com/couchbase/indexing/secondary/collatejson	0.034s
Initializing write barrier = 8000
=== RUN   TestForestDBIterator
2022-12-21T02:42:50.019+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 4944 us

2022-12-21T02:42:50.020+05:30 [INFO][FDB] Forestdb opened database file test
2022-12-21T02:42:50.024+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.01s)
=== RUN   TestForestDBIteratorSeek
2022-12-21T02:42:50.024+05:30 [INFO][FDB] Forestdb opened database file test
2022-12-21T02:42:50.027+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.00s)
=== RUN   TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN   TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN   TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN   TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN   TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN   TestMemDBInsertionPerf
Maximum number of file descriptors = 200000
Set IO Concurrency: 7200
Initial build: 10000000 items took 47.195062353s -> 211886.57248091 items/s
Incr build: 10000000 items took 3m6.148840637s -> 53720.452761242406 items/s
Main Index: {
"node_count":             18000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       3,
"next_pointers_per_node": 1.3333,
"memory_used":            1695887660,
"node_allocs":            18000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 13500190,
"level1": 3375550,
"level2": 843073,
"level3": 210795,
"level4": 52734,
"level5": 13347,
"level6": 3246,
"level7": 782,
"level8": 220,
"level9": 42,
"level10": 17,
"level11": 3,
"level12": 1,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (233.35s)
=== RUN   TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN   TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN   TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN   TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN   TestDequeueA
--- PASS: TestDequeueA (1.21s)
=== RUN   TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN   TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN   TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN   TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN   TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.01s)
=== RUN   TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN   TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN   TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN   TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.01s)
PASS
ok  	github.com/couchbase/indexing/secondary/indexer	257.423s
=== RUN   TestConnPoolBasicSanity
2022-12-21T02:47:10.825+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2022-12-21T02:47:11.033+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-12-21T02:47:11.826+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN   TestConnRelease
2022-12-21T02:47:15.829+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2022-12-21T02:47:55.584+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-12-21T02:47:55.843+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.76s)
=== RUN   TestLongevity
2022-12-21T02:47:59.586+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Releasing 1 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 0 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 4 conns.
Getting 1 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 3 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 2 conns.
Getting 1 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 3 conns.
Getting 3 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 0 conns.
2022-12-21T02:48:37.992+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-12-21T02:48:38.607+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.41s)
=== RUN   TestSustainedHighConns
2022-12-21T02:48:41.994+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Allocating 16 Connections
cp.curActConns = 0
Returning 3 Connections
cp.curActConns = 11
Returning 2 Connections
cp.curActConns = 11
Allocating 6 Connections
Returning 4 Connections
cp.curActConns = 13
Returning 1 Connections
Allocating 12 Connections
cp.curActConns = 22
Returning 1 Connections
cp.curActConns = 23
Allocating 10 Connections
Returning 1 Connections
cp.curActConns = 32
Returning 3 Connections
Allocating 15 Connections
cp.curActConns = 33
Returning 4 Connections
cp.curActConns = 40
Returning 3 Connections
Allocating 8 Connections
cp.curActConns = 44
Returning 2 Connections
cp.curActConns = 43
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 42
Allocating 9 Connections
Returning 3 Connections
cp.curActConns = 48
Returning 2 Connections
Allocating 21 Connections
cp.curActConns = 55
Returning 4 Connections
cp.curActConns = 63
Returning 4 Connections
Allocating 0 Connections
cp.curActConns = 59
Returning 0 Connections
Allocating 13 Connections
cp.curActConns = 66
Returning 3 Connections
cp.curActConns = 69
Returning 3 Connections
Allocating 5 Connections
cp.curActConns = 71
Returning 1 Connections
Allocating 10 Connections
cp.curActConns = 77
Returning 0 Connections
cp.curActConns = 80
Returning 1 Connections
Allocating 16 Connections
cp.curActConns = 89
Returning 3 Connections
cp.curActConns = 92
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 93
Returning 3 Connections
Allocating 21 Connections
cp.curActConns = 100
Returning 3 Connections
cp.curActConns = 108
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 109
Returning 3 Connections
Allocating 22 Connections
cp.curActConns = 111
Returning 4 Connections
cp.curActConns = 123
Returning 2 Connections
cp.curActConns = 122
Allocating 13 Connections
Returning 1 Connections
cp.curActConns = 134
Returning 0 Connections
Allocating 23 Connections
cp.curActConns = 135
Returning 3 Connections
cp.curActConns = 147
Returning 2 Connections
cp.curActConns = 152
Returning 3 Connections
Allocating 16 Connections
cp.curActConns = 159
Returning 4 Connections
cp.curActConns = 161
Returning 3 Connections
Allocating 18 Connections
cp.curActConns = 170
Returning 1 Connections
cp.curActConns = 175
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 176
Returning 1 Connections
Allocating 21 Connections
cp.curActConns = 181
Returning 2 Connections
cp.curActConns = 192
Returning 0 Connections
cp.curActConns = 194
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 193
Returning 3 Connections
Allocating 5 Connections
cp.curActConns = 195
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 192
Returning 1 Connections
Allocating 15 Connections
cp.curActConns = 204
Returning 2 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 202
Allocating 0 Connections
Returning 0 Connections
cp.curActConns = 202
Allocating 0 Connections
Returning 2 Connections
cp.curActConns = 200
Allocating 3 Connections
Returning 3 Connections
cp.curActConns = 200
Returning 1 Connections
Allocating 7 Connections
cp.curActConns = 206
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 207
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 208
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 211
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 210
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 208
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 205
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 203
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 205
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 205
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 204
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 202
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 202
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 205
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 206
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 206
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 207
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 207
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 210
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 209
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 210
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 209
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 210
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 211
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 212
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 212
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 211
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 211
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 209
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 207
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 210
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 213
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 215
Returning 0 Connections
cp.curActConns = 217
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 214
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 212
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 212
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 214
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 217
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 216
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 215
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 218
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 217
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 216
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 220
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 220
Retuning from startDeallocatorRoutine
Retuning from startAllocatorRoutine
2022-12-21T02:49:37.063+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-12-21T02:49:38.031+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.07s)
=== RUN   TestLowWM
2022-12-21T02:49:41.065+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2022-12-21T02:50:41.080+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2022-12-21T02:51:41.096+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2022-12-21T02:51:46.573+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-12-21T02:51:47.098+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.51s)
=== RUN   TestTotalConns
2022-12-21T02:51:50.575+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2022-12-21T02:52:04.765+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-12-21T02:52:05.582+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.19s)
=== RUN   TestUpdateTickRate
2022-12-21T02:52:08.766+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2022-12-21T02:52:29.619+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-12-21T02:52:29.778+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.86s)
PASS
ok  	github.com/couchbase/indexing/secondary/queryport/client	322.856s
Starting server: attempt 1

Functional tests

2022/12/21 02:54:48 In TestMain()
2022/12/21 02:54:48 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2022/12/21 02:54:48 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2022/12/21 02:54:49 Initialising web UI on node: 127.0.0.1:9000
2022/12/21 02:54:49 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2022/12/21 02:54:50 Setting data quota of 1500M and Index quota of 1500M
2022/12/21 02:54:51 Adding node: https://127.0.0.1:19001 with role: kv,index to the cluster
2022/12/21 02:54:58 AddNode: Successfully added node: 127.0.0.1:9001 (role kv,index), response: {"otpNode":"n_1@127.0.0.1"}
2022/12/21 02:55:04 Rebalance progress: 0
2022/12/21 02:55:09 Rebalance progress: 0
2022/12/21 02:55:14 Rebalance progress: 100
2022/12/21 02:55:19 Created bucket default, responseBody: 
2022/12/21 02:55:24 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2022/12/21 02:55:24 Successfully initialised cluster
2022/12/21 02:55:24 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2022/12/21 02:55:24 Changing config key queryport.client.settings.backfillLimit to value 0
2022/12/21 02:55:24 Changing config key queryport.client.log_level to value Warn
2022/12/21 02:55:24 Changing config key indexer.api.enableTestServer to value true
2022/12/21 02:55:24 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2022/12/21 02:55:24 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2022/12/21 02:55:25 Changing config key indexer.settings.log_level to value info
2022/12/21 02:55:25 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2022/12/21 02:55:25 Using memory_optimized for creating indexes
2022/12/21 02:55:25 Changing config key indexer.settings.storage_mode to value memory_optimized
2022/12/21 02:55:30 Data file exists. Skipping download
2022/12/21 02:55:30 Data file exists. Skipping download
2022/12/21 02:55:31 In DropAllSecondaryIndexes()
2022/12/21 02:55:31 Emptying the default bucket
2022/12/21 02:55:34 Flush Enabled on bucket default, responseBody: 
2022/12/21 02:56:12 Flushed the bucket default, Response body: 
2022/12/21 02:56:12 Create Index On the empty default Bucket()
2022/12/21 02:56:16 Created the secondary index index_eyeColor. Waiting for it become active
2022/12/21 02:56:16 Index is 8092118509673138834 now active
2022/12/21 02:56:16 Populating the default bucket
=== RUN   TestScanAfterBucketPopulate
2022/12/21 02:56:25 In TestScanAfterBucketPopulate()
2022/12/21 02:56:25 Create an index on empty bucket, populate the bucket and Run a scan on the index
2022/12/21 02:56:25 Using n1ql client
2022-12-21T02:56:25.921+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2022/12/21 02:56:26 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.10s)
=== RUN   TestRestartNilSnapshot
2022/12/21 02:56:26 In TestRestartNilSnapshot()
2022/12/21 02:56:30 Created the secondary index idx_age. Waiting for it become active
2022/12/21 02:56:30 Index is 6738558385240911395 now active
2022/12/21 02:56:30 Restarting indexer process ...
2022/12/21 02:56:30 []
2022-12-21T02:56:30.185+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T02:56:30.185+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-12-21T02:56:30.197+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T02:56:30.197+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/12/21 02:59:50 Using n1ql client
2022-12-21T02:59:50.143+05:30 [Error] transport error between 127.0.0.1:52064->127.0.0.1:9107: write tcp 127.0.0.1:52064->127.0.0.1:9107: write: broken pipe
2022-12-21T02:59:50.143+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -904562882449517345 request transport failed `write tcp 127.0.0.1:52064->127.0.0.1:9107: write: broken pipe`
2022-12-21T02:59:50.143+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-12-21T02:59:50.143+05:30 [Error] metadataClient:PickRandom: Replicas - [18233822368377541934], PrunedReplica - map[], FilteredReplica map[]
2022/12/21 02:59:50 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.18s)
=== RUN   TestThreeIndexCreates
2022/12/21 02:59:50 In TestThreeIndexCreates()
2022/12/21 02:59:54 Created the secondary index index_balance. Waiting for it become active
2022/12/21 02:59:54 Index is 7920905204951959249 now active
2022/12/21 02:59:54 Create docs mutations
2022/12/21 02:59:54 Using n1ql client
2022/12/21 02:59:54 Expected and Actual scan responses are the same
2022/12/21 03:00:00 Created the secondary index index_email. Waiting for it become active
2022/12/21 03:00:00 Index is 11187257342928362916 now active
2022/12/21 03:00:00 Create docs mutations
2022/12/21 03:00:00 Using n1ql client
2022/12/21 03:00:00 Expected and Actual scan responses are the same
2022/12/21 03:00:07 Created the secondary index index_pin. Waiting for it become active
2022/12/21 03:00:07 Index is 13116356151252110393 now active
2022/12/21 03:00:07 Delete docs mutations
2022/12/21 03:00:07 Using n1ql client
2022/12/21 03:00:07 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (17.26s)
=== RUN   TestMultipleIndexCreatesDropsWithMutations
2022/12/21 03:00:07 In TestThreeIndexCreates()
2022/12/21 03:00:13 Created the secondary index index_state. Waiting for it become active
2022/12/21 03:00:13 Index is 8223652524114647880 now active
2022/12/21 03:00:13 Create docs mutations
2022/12/21 03:00:13 Using n1ql client
2022/12/21 03:00:13 Expected and Actual scan responses are the same
2022/12/21 03:00:19 Created the secondary index index_registered. Waiting for it become active
2022/12/21 03:00:19 Index is 2468943482245940292 now active
2022/12/21 03:00:19 Create docs mutations
2022/12/21 03:00:20 Using n1ql client
2022/12/21 03:00:20 Expected and Actual scan responses are the same
2022/12/21 03:00:26 Created the secondary index index_gender. Waiting for it become active
2022/12/21 03:00:26 Index is 11241254476785552009 now active
2022/12/21 03:00:26 Create docs mutations
2022/12/21 03:00:26 Using n1ql client
2022/12/21 03:00:26 Expected and Actual scan responses are the same
2022/12/21 03:00:26 Dropping the secondary index index_registered
2022/12/21 03:00:26 Index dropped
2022/12/21 03:00:26 Create docs mutations
2022/12/21 03:00:26 Delete docs mutations
2022/12/21 03:00:27 Using n1ql client
2022/12/21 03:00:27 Expected and Actual scan responses are the same
2022/12/21 03:00:33 Created the secondary index index_longitude. Waiting for it become active
2022/12/21 03:00:33 Index is 12916990414258670400 now active
2022/12/21 03:00:33 Create docs mutations
2022/12/21 03:00:33 Using n1ql client
2022/12/21 03:00:33 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (26.10s)
=== RUN   TestCreateDropScan
2022/12/21 03:00:33 In TestCreateDropScan()
2022/12/21 03:00:39 Created the secondary index index_cd. Waiting for it become active
2022/12/21 03:00:39 Index is 11141721922854583630 now active
2022/12/21 03:00:39 Using n1ql client
2022/12/21 03:00:39 Expected and Actual scan responses are the same
2022/12/21 03:00:39 Dropping the secondary index index_cd
2022/12/21 03:00:39 Index dropped
2022/12/21 03:00:39 Using n1ql client
2022/12/21 03:00:39 Scan failed as expected with error: Index Not Found - cause: GSI index index_cd not found.
--- PASS: TestCreateDropScan (6.29s)
=== RUN   TestCreateDropCreate
2022/12/21 03:00:39 In TestCreateDropCreate()
2022/12/21 03:00:45 Created the secondary index index_cdc. Waiting for it become active
2022/12/21 03:00:45 Index is 9626516996983073032 now active
2022/12/21 03:00:45 Using n1ql client
2022/12/21 03:00:45 Expected and Actual scan responses are the same
2022/12/21 03:00:45 Dropping the secondary index index_cdc
2022/12/21 03:00:46 Index dropped
2022/12/21 03:00:46 Using n1ql client
2022/12/21 03:00:46 Scan 2 failed as expected with error: Index Not Found - cause: GSI index index_cdc not found.
2022/12/21 03:00:52 Created the secondary index index_cdc. Waiting for it become active
2022/12/21 03:00:52 Index is 16142321069838870785 now active
2022/12/21 03:00:52 Using n1ql client
2022/12/21 03:00:52 Expected and Actual scan responses are the same
2022/12/21 03:00:52 (Inclusion 1) Lengths of expected and actual scan results are 5075 and 5075. Num of docs in bucket = 10402
2022/12/21 03:00:52 Using n1ql client
2022/12/21 03:00:52 Expected and Actual scan responses are the same
2022/12/21 03:00:52 (Inclusion 3) Lengths of expected and actual scan results are 5075 and 5075. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (12.46s)
=== RUN   TestCreate2Drop1Scan2
2022/12/21 03:00:52 In TestCreate2Drop1Scan2()
2022/12/21 03:00:58 Created the secondary index index_i1. Waiting for it become active
2022/12/21 03:00:58 Index is 8282376793718775753 now active
2022/12/21 03:01:04 Created the secondary index index_i2. Waiting for it become active
2022/12/21 03:01:04 Index is 16685821988570080242 now active
2022/12/21 03:01:04 Using n1ql client
2022/12/21 03:01:04 Expected and Actual scan responses are the same
2022/12/21 03:01:04 Using n1ql client
2022/12/21 03:01:04 Expected and Actual scan responses are the same
2022/12/21 03:01:04 Dropping the secondary index index_i1
2022/12/21 03:01:04 Index dropped
2022/12/21 03:01:04 Using n1ql client
2022/12/21 03:01:04 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (12.41s)
=== RUN   TestIndexNameCaseSensitivity
2022/12/21 03:01:04 In TestIndexNameCaseSensitivity()
2022/12/21 03:01:10 Created the secondary index index_age. Waiting for it become active
2022/12/21 03:01:10 Index is 1990032172263985567 now active
2022/12/21 03:01:10 Using n1ql client
2022/12/21 03:01:10 Expected and Actual scan responses are the same
2022/12/21 03:01:10 Using n1ql client
2022/12/21 03:01:10 Scan failed as expected with error: Index Not Found - cause: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (6.12s)
=== RUN   TestCreateDuplicateIndex
2022/12/21 03:01:10 In TestCreateDuplicateIndex()
2022/12/21 03:01:16 Created the secondary index index_di1. Waiting for it become active
2022/12/21 03:01:16 Index is 17662160732736251624 now active
2022/12/21 03:01:16 Index found:  index_di1
2022/12/21 03:01:16 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (6.08s)
=== RUN   TestDropNonExistingIndex
2022/12/21 03:01:16 In TestDropNonExistingIndex()
2022/12/21 03:01:16 Dropping the secondary index 123456
2022/12/21 03:01:16 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.05s)
=== RUN   TestCreateIndexNonExistentBucket
2022/12/21 03:01:16 In TestCreateIndexNonExistentBucket()
2022-12-21T03:01:17.470+05:30 [Error] Encountered error during create index.  Error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2022-12-21T03:01:28.473+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2022/12/21 03:01:28 Index create failed as expected with error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- PASS: TestCreateIndexNonExistentBucket (11.51s)
=== RUN   TestScanWithNoTimeout
2022/12/21 03:01:28 Create an index on empty bucket, populate the bucket and Run a scan on the index
2022/12/21 03:01:28 Changing config key indexer.settings.scan_timeout to value 0
2022/12/21 03:01:28 Using n1ql client
2022/12/21 03:01:28 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.38s)
=== RUN   TestIndexingOnBinaryBucketMeta
2022/12/21 03:01:28 In TestIndexingOnBinaryBucketMeta()
2022/12/21 03:01:28 	 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2022/12/21 03:01:28 	 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2022/12/21 03:01:31 Modified parameters of bucket default, responseBody: 
2022/12/21 03:01:31 Created bucket binaryBucket, responseBody: 
2022/12/21 03:01:50 Created the secondary index index_binary_meta_id. Waiting for it become active
2022/12/21 03:01:50 Index is 12482057310622535224 now active
2022/12/21 03:01:55 items_count stat is 10 for index index_binary_meta_id
2022/12/21 03:01:55 Dropping the secondary index index_binary_meta_id
2022/12/21 03:01:55 Index dropped
2022/12/21 03:01:58 Created the secondary index index_binary_meta_cas. Waiting for it become active
2022/12/21 03:01:58 Index is 16362667714973416362 now active
2022/12/21 03:02:03 items_count stat is 10 for index index_binary_meta_cas
2022/12/21 03:02:03 Dropping the secondary index index_binary_meta_cas
2022/12/21 03:02:03 Index dropped
2022/12/21 03:02:07 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2022/12/21 03:02:07 Index is 9580720664725623327 now active
2022/12/21 03:02:12 items_count stat is 10 for index index_binary_meta_expiration
2022/12/21 03:02:12 Dropping the secondary index index_binary_meta_expiration
2022/12/21 03:02:12 Index dropped
2022/12/21 03:02:13 Deleted bucket binaryBucket, responseBody: 
2022/12/21 03:02:16 Modified parameters of bucket default, responseBody: 
--- PASS: TestIndexingOnBinaryBucketMeta (63.13s)
=== RUN   TestRetainDeleteXATTRBinaryDocs
2022/12/21 03:02:31 In TestRetainDeleteXATTRBinaryDocs()
2022/12/21 03:02:31 	 1. Populate a bucket with binary docs having system XATTRS
2022/12/21 03:02:31 	 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2022/12/21 03:02:31 	 3. Delete the documents in the bucket
2022/12/21 03:02:31 	 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2022/12/21 03:02:35 Modified parameters of bucket default, responseBody: 
2022/12/21 03:02:35 Created bucket binaryBucket, responseBody: 
2022/12/21 03:02:53 Created the secondary index index_system_xattr. Waiting for it become active
2022/12/21 03:02:53 Index is 15653411540888113552 now active
2022/12/21 03:02:58 Deleted all the documents in the bucket: binaryBucket successfully
2022/12/21 03:03:01 Deleted bucket binaryBucket, responseBody: 
2022/12/21 03:03:04 Modified parameters of bucket default, responseBody: 
--- PASS: TestRetainDeleteXATTRBinaryDocs (47.42s)
=== RUN   TestIndexingOnXATTRs
2022/12/21 03:03:19 In TestIndexingOnXATTRs()
2022/12/21 03:03:22 Modified parameters of bucket default, responseBody: 
2022/12/21 03:03:22 Created bucket bucket_xattrs, responseBody: 
2022/12/21 03:03:42 Created the secondary index index_sync_rev. Waiting for it become active
2022/12/21 03:03:42 Index is 7126410504460759701 now active
2022/12/21 03:03:48 Created the secondary index index_sync_channels. Waiting for it become active
2022/12/21 03:03:48 Index is 584312584988884615 now active
2022/12/21 03:03:55 Created the secondary index index_sync_sequence. Waiting for it become active
2022/12/21 03:03:55 Index is 16169140290427308063 now active
2022/12/21 03:04:00 items_count stat is 100 for index index_sync_rev
2022/12/21 03:04:00 items_count stat is 100 for index index_sync_channels
2022/12/21 03:04:00 items_count stat is 100 for index index_sync_sequence
2022/12/21 03:04:00 Using n1ql client
2022-12-21T03:04:00.372+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T03:04:00.374+05:30 [Info] GSIC[default/bucket_xattrs-_default-_default-1671572040370423525] started ...
2022/12/21 03:04:00 Dropping the secondary index index_sync_rev
2022/12/21 03:04:00 Index dropped
2022/12/21 03:04:00 Using n1ql client
2022/12/21 03:04:00 Dropping the secondary index index_sync_channels
2022/12/21 03:04:00 Index dropped
2022/12/21 03:04:00 Using n1ql client
2022/12/21 03:04:00 Dropping the secondary index index_sync_sequence
2022/12/21 03:04:00 Index dropped
2022/12/21 03:04:02 Deleted bucket bucket_xattrs, responseBody: 
2022/12/21 03:04:05 Modified parameters of bucket default, responseBody: 
--- PASS: TestIndexingOnXATTRs (61.07s)
=== RUN   TestSimpleIndex_FloatDataType
2022/12/21 03:04:20 In TestSimpleIndex_FloatDataType()
2022/12/21 03:04:20 Index found:  index_age
2022/12/21 03:04:20 Using n1ql client
2022/12/21 03:04:20 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.02s)
=== RUN   TestSimpleIndex_StringDataType
2022/12/21 03:04:20 In TestSimpleIndex_StringDataType()
2022/12/21 03:04:25 Created the secondary index index_company. Waiting for it become active
2022/12/21 03:04:25 Index is 1220364358808651009 now active
2022/12/21 03:04:25 Using n1ql client
2022/12/21 03:04:25 Expected and Actual scan responses are the same
2022/12/21 03:04:25 Using n1ql client
2022/12/21 03:04:25 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.72s)
=== RUN   TestSimpleIndex_FieldValueCaseSensitivity
2022/12/21 03:04:25 In TestSimpleIndex_StringCaseSensitivity()
2022/12/21 03:04:25 Index found:  index_company
2022/12/21 03:04:25 Using n1ql client
2022/12/21 03:04:25 Expected and Actual scan responses are the same
2022/12/21 03:04:25 Using n1ql client
2022/12/21 03:04:25 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.07s)
=== RUN   TestSimpleIndex_BoolDataType
2022/12/21 03:04:25 In TestSimpleIndex_BoolDataType()
2022/12/21 03:04:31 Created the secondary index index_isActive. Waiting for it become active
2022/12/21 03:04:31 Index is 10161125402917306337 now active
2022/12/21 03:04:31 Using n1ql client
2022/12/21 03:04:31 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (6.44s)
=== RUN   TestBasicLookup
2022/12/21 03:04:31 In TestBasicLookup()
2022/12/21 03:04:31 Index found:  index_company
2022/12/21 03:04:31 Using n1ql client
2022/12/21 03:04:31 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.01s)
=== RUN   TestIndexOnNonExistentField
2022/12/21 03:04:31 In TestIndexOnNonExistentField()
2022/12/21 03:04:38 Created the secondary index index_height. Waiting for it become active
2022/12/21 03:04:38 Index is 17545766328255422631 now active
2022/12/21 03:04:38 Using n1ql client
2022/12/21 03:04:38 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (6.47s)
=== RUN   TestIndexPartiallyMissingField
2022/12/21 03:04:38 In TestIndexPartiallyMissingField()
2022/12/21 03:04:44 Created the secondary index index_nationality. Waiting for it become active
2022/12/21 03:04:44 Index is 5233708418189403257 now active
2022/12/21 03:04:44 Using n1ql client
2022/12/21 03:04:44 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (6.47s)
=== RUN   TestScanNonMatchingDatatype
2022/12/21 03:04:44 In TestScanNonMatchingDatatype()
2022/12/21 03:04:44 Index found:  index_age
2022/12/21 03:04:44 Using n1ql client
2022/12/21 03:04:44 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.02s)
=== RUN   TestInclusionNeither
2022/12/21 03:04:44 In TestInclusionNeither()
2022/12/21 03:04:44 Index found:  index_age
2022/12/21 03:04:44 Using n1ql client
2022/12/21 03:04:44 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.04s)
=== RUN   TestInclusionLow
2022/12/21 03:04:44 In TestInclusionLow()
2022/12/21 03:04:44 Index found:  index_age
2022/12/21 03:04:44 Using n1ql client
2022/12/21 03:04:44 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.04s)
=== RUN   TestInclusionHigh
2022/12/21 03:04:44 In TestInclusionHigh()
2022/12/21 03:04:44 Index found:  index_age
2022/12/21 03:04:44 Using n1ql client
2022/12/21 03:04:44 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.03s)
=== RUN   TestInclusionBoth
2022/12/21 03:04:44 In TestInclusionBoth()
2022/12/21 03:04:44 Index found:  index_age
2022/12/21 03:04:44 Using n1ql client
2022/12/21 03:04:44 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.02s)
=== RUN   TestNestedIndex_String
2022/12/21 03:04:44 In TestNestedIndex_String()
2022/12/21 03:04:51 Created the secondary index index_streetname. Waiting for it become active
2022/12/21 03:04:51 Index is 16124934009551751307 now active
2022/12/21 03:04:51 Using n1ql client
2022/12/21 03:04:51 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (6.42s)
=== RUN   TestNestedIndex_Float
2022/12/21 03:04:51 In TestNestedIndex_Float()
2022/12/21 03:04:57 Created the secondary index index_floor. Waiting for it become active
2022/12/21 03:04:57 Index is 10567431656307738261 now active
2022/12/21 03:04:57 Using n1ql client
2022/12/21 03:04:57 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (6.51s)
=== RUN   TestNestedIndex_Bool
2022/12/21 03:04:57 In TestNestedIndex_Bool()
2022/12/21 03:05:04 Created the secondary index index_isresidential. Waiting for it become active
2022/12/21 03:05:04 Index is 1120335194600449278 now active
2022/12/21 03:05:04 Using n1ql client
2022/12/21 03:05:04 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (6.52s)
=== RUN   TestLookupJsonObject
2022/12/21 03:05:04 In TestLookupJsonObject()
2022/12/21 03:05:10 Created the secondary index index_streetaddress. Waiting for it become active
2022/12/21 03:05:10 Index is 9390894641934852624 now active
2022/12/21 03:05:10 Using n1ql client
2022/12/21 03:05:10 Count of docScanResults is 1
2022/12/21 03:05:10 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2022/12/21 03:05:10 Count of scanResults is 1
2022/12/21 03:05:10 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2022/12/21 03:05:10 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.46s)
=== RUN   TestLookupObjDifferentOrdering
2022/12/21 03:05:10 In TestLookupObjDifferentOrdering()
2022/12/21 03:05:10 Index found:  index_streetaddress
2022/12/21 03:05:10 Using n1ql client
2022/12/21 03:05:10 Count of docScanResults is 1
2022/12/21 03:05:10 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2022/12/21 03:05:10 Count of scanResults is 1
2022/12/21 03:05:10 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2022/12/21 03:05:10 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.02s)
=== RUN   TestRangeJsonObject
2022/12/21 03:05:10 In TestRangeJsonObject()
2022/12/21 03:05:10 Index found:  index_streetaddress
2022/12/21 03:05:10 Using n1ql client
2022/12/21 03:05:10 Count of scanResults is 2
2022/12/21 03:05:10 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb  Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2022/12/21 03:05:10 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2022/12/21 03:05:10 Count of docScanResults is 2
2022/12/21 03:05:10 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2022/12/21 03:05:10 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb  Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2022/12/21 03:05:10 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.00s)
=== RUN   TestLookupFloatDiffForms
2022/12/21 03:05:10 In TestLookupFloatDiffForms()
2022/12/21 03:05:17 Created the secondary index index_latitude. Waiting for it become active
2022/12/21 03:05:17 Index is 1215978615448886483 now active
2022/12/21 03:05:17 Scan 1
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 2
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 3
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 4
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 5
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 6
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (6.70s)
=== RUN   TestRangeFloatInclVariations
2022/12/21 03:05:17 In TestRangeFloatInclVariations()
2022/12/21 03:05:17 Index found:  index_latitude
2022/12/21 03:05:17 Scan 1
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 2
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 3
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 4
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 5
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
2022/12/21 03:05:17 Scan 6
2022/12/21 03:05:17 Using n1ql client
2022/12/21 03:05:17 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.04s)
=== RUN   TestScanAll
2022/12/21 03:05:17 In TestScanAll()
2022/12/21 03:05:24 Created the secondary index index_name. Waiting for it become active
2022/12/21 03:05:24 Index is 2975322951031837840 now active
2022/12/21 03:05:24 Length of docScanResults = 10502
2022/12/21 03:05:24 Using n1ql client
2022/12/21 03:05:24 Length of scanResults = 10502
2022/12/21 03:05:24 Expected and Actual scan responses are the same
--- PASS: TestScanAll (6.67s)
=== RUN   TestScanAllNestedField
2022/12/21 03:05:24 In TestScanAllNestedField()
2022/12/21 03:05:24 Index found:  index_streetname
2022/12/21 03:05:24 Length of docScanResults = 2
2022/12/21 03:05:24 Using n1ql client
2022/12/21 03:05:24 Length of scanResults = 2
2022/12/21 03:05:24 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN   TestBasicPrimaryIndex
2022/12/21 03:05:24 In TestBasicPrimaryIndex()
2022/12/21 03:05:31 Created the secondary index index_p1. Waiting for it become active
2022/12/21 03:05:31 Index is 1781925812100683595 now active
2022-12-21T03:05:31.321+05:30 [Error] transport error between 127.0.0.1:51356->127.0.0.1:9107: write tcp 127.0.0.1:51356->127.0.0.1:9107: write: broken pipe
2022-12-21T03:05:31.321+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:51356->127.0.0.1:9107: write: broken pipe`
2022-12-21T03:05:31.321+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-12-21T03:05:31.321+05:30 [Error] metadataClient:PickRandom: Replicas - [6965766310781358826], PrunedReplica - map[], FilteredReplica map[]
2022/12/21 03:05:31 Expected and Actual scan responses are the same
2022/12/21 03:05:31 CountRange() expected and actual is:  1877 and 1877
2022/12/21 03:05:31 lookupkey for CountLookup() = User1358b456-1904-4708-af23-ef023a2d79fc
2022/12/21 03:05:31 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (7.28s)
=== RUN   TestBasicNullDataType
2022/12/21 03:05:31 In TestBasicNullDataType()
2022/12/21 03:05:31 Index found:  index_email
2022/12/21 03:05:31 Using n1ql client
2022/12/21 03:05:31 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.07s)
=== RUN   TestBasicArrayDataType_ScanAll
2022/12/21 03:05:31 In TestBasicArrayDataType_ScanAll()
2022/12/21 03:05:38 Created the secondary index index_tags. Waiting for it become active
2022/12/21 03:05:38 Index is 8669761992476160524 now active
2022/12/21 03:05:38 Using n1ql client
2022/12/21 03:05:38 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (6.76s)
=== RUN   TestBasicArrayDataType_Lookup
2022/12/21 03:05:38 In TestBasicArrayDataType_Lookup()
2022/12/21 03:05:40 Index found:  index_tags
2022/12/21 03:05:40 Count of scanResults is 1
2022/12/21 03:05:40 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75  Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN   TestArrayDataType_LookupMissingArrayValue
2022/12/21 03:05:40 In TestArrayDataType_LookupMissingArrayValue()
2022/12/21 03:05:40 Index found:  index_tags
2022/12/21 03:05:40 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.00s)
=== RUN   TestArrayDataType_LookupWrongOrder
2022/12/21 03:05:40 In TestArrayDataType_LookupWrongOrder()
2022/12/21 03:05:40 Index found:  index_tags
2022/12/21 03:05:40 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN   TestArrayDataType_LookupSubset
2022/12/21 03:05:40 In TestArrayDataType_LookupSubset()
2022/12/21 03:05:40 Index found:  index_tags
2022/12/21 03:05:40 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN   TestScanLimitParameter
2022/12/21 03:05:40 In TestScanLimitParameter()
2022/12/21 03:05:40 Index found:  index_age
2022/12/21 03:05:40 Using n1ql client
2022/12/21 03:05:40 Using n1ql client
--- PASS: TestScanLimitParameter (0.01s)
=== RUN   TestCountRange
2022/12/21 03:05:40 In TestRangeCount()
2022/12/21 03:05:40 Index found:  index_age
2022/12/21 03:05:40 Count of expected and actual Range is:  2384 and 2384
2022/12/21 03:05:40 Count of expected and actual Range is: 10002 and 10002
2022/12/21 03:05:40 Count of expected and actual Range are: 0 and 0
2022/12/21 03:05:40 Count of expected and actual Range are: 473 and 473
2022/12/21 03:05:40 Testing CountRange() for key <= val
2022/12/21 03:05:40 Count of expected and actual CountRange for key <= 30 are: 5239 and 5239
2022/12/21 03:05:40 Testing CountRange() for key >= val
2022/12/21 03:05:40 Count of expected and actual CountRange for key >= 25 are: 7700 and 7700
2022/12/21 03:05:40 Testing CountRange() for null < key <= val
2022/12/21 03:05:40 Count of expected and actual CountRange for key > null && key <= 30 are: 5239 and 5239
2022/12/21 03:05:40 Testing CountRange() for val <= key < null 
2022/12/21 03:05:40 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2022/12/21 03:05:40 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.07s)
=== RUN   TestCountLookup
2022/12/21 03:05:40 In TestCountLookup()
2022/12/21 03:05:40 Index found:  index_age
2022/12/21 03:05:40 Count of expected and actual Range are: 508 and 508
2022/12/21 03:05:40 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.01s)
=== RUN   TestRangeStatistics
2022/12/21 03:05:40 In TestRangeCount()
2022/12/21 03:05:40 Index found:  index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN   TestIndexCreateWithWhere
2022/12/21 03:05:40 In TestIndexCreateWithWhere()
2022/12/21 03:05:45 Created the secondary index index_ageabove30. Waiting for it become active
2022/12/21 03:05:45 Index is 6477100953957694429 now active
2022/12/21 03:05:45 Using n1ql client
2022/12/21 03:05:45 Expected and Actual scan responses are the same
2022/12/21 03:05:45 Lengths of expected and actual scanReuslts are:  4290 and 4290
2022/12/21 03:05:52 Created the secondary index index_ageteens. Waiting for it become active
2022/12/21 03:05:52 Index is 7518287320926092547 now active
2022/12/21 03:05:52 Using n1ql client
2022/12/21 03:05:52 Expected and Actual scan responses are the same
2022/12/21 03:05:52 Lengths of expected and actual scanReuslts are:  0 and 0
2022/12/21 03:05:59 Created the secondary index index_age35to45. Waiting for it become active
2022/12/21 03:05:59 Index is 16764413222440602158 now active
2022/12/21 03:05:59 Using n1ql client
2022/12/21 03:05:59 Expected and Actual scan responses are the same
2022/12/21 03:05:59 Lengths of expected and actual scanReuslts are:  2857 and 2857
--- PASS: TestIndexCreateWithWhere (18.74s)
=== RUN   TestDeferredIndexCreate
2022/12/21 03:05:59 In TestDeferredIndexCreate()
2022/12/21 03:05:59 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2022/12/21 03:06:01 Build the deferred index index_deferred. Waiting for the index to become active
2022/12/21 03:06:01 Waiting for index 8007463896159372252 to go active ...
2022/12/21 03:06:02 Waiting for index 8007463896159372252 to go active ...
2022/12/21 03:06:03 Waiting for index 8007463896159372252 to go active ...
2022/12/21 03:06:04 Waiting for index 8007463896159372252 to go active ...
2022/12/21 03:06:05 Waiting for index 8007463896159372252 to go active ...
2022/12/21 03:06:06 Index is 8007463896159372252 now active
2022/12/21 03:06:06 Using n1ql client
2022/12/21 03:06:06 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (7.35s)
=== RUN   TestCompositeIndex_NumAndString
2022/12/21 03:06:06 In TestCompositeIndex()
2022/12/21 03:06:13 Created the secondary index index_composite1. Waiting for it become active
2022/12/21 03:06:13 Index is 8400681940566168918 now active
2022/12/21 03:06:13 Using n1ql client
2022/12/21 03:06:14 Using n1ql client
2022/12/21 03:06:14 Using n1ql client
2022/12/21 03:06:14 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (7.62s)
=== RUN   TestCompositeIndex_TwoNumberFields
2022/12/21 03:06:14 In TestCompositeIndex()
2022/12/21 03:06:19 Created the secondary index index_composite2. Waiting for it become active
2022/12/21 03:06:19 Index is 10542240039228411875 now active
2022/12/21 03:06:19 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (6.69s)
=== RUN   TestNumbers_Int64_Float64
2022/12/21 03:06:20 In TestNumbers_Int64_Float64()
2022/12/21 03:06:26 Created the secondary index idx_numbertest. Waiting for it become active
2022/12/21 03:06:26 Index is 1807156522155104810 now active
2022/12/21 03:06:26 
 ==== Int64 test #0
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Int64 test #1
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Int64 test #2
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Int64 test #3
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Int64 test #4
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Int64 test #5
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Int64 test #6
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Int64 test #7
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Int64 test #8
2022/12/21 03:06:26 Using n1ql client
2022/12/21 03:06:26 Expected and Actual scan responses are the same
2022/12/21 03:06:26 
 ==== Float64 test #0
2022/12/21 03:06:27 Using n1ql client
2022/12/21 03:06:27 Expected and Actual scan responses are the same
2022/12/21 03:06:27 
 ==== Float64 test #1
2022/12/21 03:06:27 Using n1ql client
2022/12/21 03:06:27 Expected and Actual scan responses are the same
2022/12/21 03:06:27 
 ==== Float64 test #2
2022/12/21 03:06:27 Using n1ql client
2022/12/21 03:06:27 Expected and Actual scan responses are the same
2022/12/21 03:06:27 
 ==== Float64 test #3
2022/12/21 03:06:27 Using n1ql client
2022/12/21 03:06:27 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (6.42s)
=== RUN   TestRestartIndexer
2022/12/21 03:06:27 In TestRestartIndexer()
2022/12/21 03:06:27 []
2022-12-21T03:06:27.340+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T03:06:27.340+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-12-21T03:06:27.340+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T03:06:27.340+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/12/21 03:06:47 Using n1ql client
2022-12-21T03:06:47.267+05:30 [Error] transport error between 127.0.0.1:53828->127.0.0.1:9107: write tcp 127.0.0.1:53828->127.0.0.1:9107: write: broken pipe
2022-12-21T03:06:47.267+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -3254375134133242040 request transport failed `write tcp 127.0.0.1:53828->127.0.0.1:9107: write: broken pipe`
2022/12/21 03:06:47 Len of expected and actual scan results are :  10002 and 10002
2022/12/21 03:06:47 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.10s)
=== RUN   TestCreateDocsMutation
2022/12/21 03:06:47 In TestCreateDocsMutation()
2022/12/21 03:06:47 Index found:  index_age
2022/12/21 03:06:47 Using n1ql client
2022/12/21 03:06:47 Len of expected and actual scan results are :  10002 and 10002
2022/12/21 03:06:47 Expected and Actual scan responses are the same
2022/12/21 03:06:47 Using n1ql client
2022/12/21 03:06:47 Index Scan after mutations took 47.201129ms
2022/12/21 03:06:47 Len of expected and actual scan results are :  10102 and 10102
2022/12/21 03:06:47 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.35s)
=== RUN   TestRestartProjector
2022/12/21 03:06:47 In TestRestartProjector()
2022/12/21 03:06:47 []
2022/12/21 03:07:07 Using n1ql client
2022/12/21 03:07:07 Len of expected and actual scan results are :  10102 and 10102
2022/12/21 03:07:07 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.09s)
=== RUN   TestDeleteDocsMutation
2022/12/21 03:07:07 In TestDeleteDocsMutation()
2022/12/21 03:07:07 Index found:  index_age
2022/12/21 03:07:07 Using n1ql client
2022/12/21 03:07:07 Len of expected and actual scan results are :  10102 and 10102
2022/12/21 03:07:07 Expected and Actual scan responses are the same
2022/12/21 03:07:08 Using n1ql client
2022/12/21 03:07:08 Index Scan after mutations took 41.335598ms
2022/12/21 03:07:08 Len of expected and actual scan results are :  9902 and 9902
2022/12/21 03:07:08 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (0.38s)
=== RUN   TestUpdateDocsMutation
2022/12/21 03:07:08 In TestUpdateDocsMutation()
2022/12/21 03:07:08 Index found:  index_age
2022/12/21 03:07:08 Using n1ql client
2022/12/21 03:07:08 Len of expected and actual scan results are :  9438 and 9438
2022/12/21 03:07:08 Expected and Actual scan responses are the same
2022/12/21 03:07:08 Num of keysFromMutDocs: 100
2022/12/21 03:07:08 Updating number of documents: 100
2022/12/21 03:07:08 Using n1ql client
2022/12/21 03:07:08 Index Scan after mutations took 33.648068ms
2022/12/21 03:07:08 Len of expected and actual scan results are :  9438 and 9438
2022/12/21 03:07:08 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.33s)
=== RUN   TestLargeMutations
2022/12/21 03:07:08 In TestLargeMutations()
2022/12/21 03:07:08 In DropAllSecondaryIndexes()
2022/12/21 03:07:08 Index found:  index_email
2022/12/21 03:07:08 Dropped index index_email
2022/12/21 03:07:08 Index found:  index_isActive
2022/12/21 03:07:08 Dropped index index_isActive
2022/12/21 03:07:08 Index found:  index_balance
2022/12/21 03:07:08 Dropped index index_balance
2022/12/21 03:07:08 Index found:  index_gender
2022/12/21 03:07:08 Dropped index index_gender
2022/12/21 03:07:08 Index found:  index_longitude
2022/12/21 03:07:09 Dropped index index_longitude
2022/12/21 03:07:09 Index found:  index_composite1
2022/12/21 03:07:09 Dropped index index_composite1
2022/12/21 03:07:09 Index found:  index_deferred
2022/12/21 03:07:09 Dropped index index_deferred
2022/12/21 03:07:09 Index found:  index_streetname
2022/12/21 03:07:09 Dropped index index_streetname
2022/12/21 03:07:09 Index found:  index_i2
2022/12/21 03:07:09 Dropped index index_i2
2022/12/21 03:07:09 Index found:  index_cdc
2022/12/21 03:07:09 Dropped index index_cdc
2022/12/21 03:07:09 Index found:  index_floor
2022/12/21 03:07:09 Dropped index index_floor
2022/12/21 03:07:09 Index found:  index_ageteens
2022/12/21 03:07:09 Dropped index index_ageteens
2022/12/21 03:07:09 Index found:  index_state
2022/12/21 03:07:09 Dropped index index_state
2022/12/21 03:07:09 Index found:  idx_numbertest
2022/12/21 03:07:09 Dropped index idx_numbertest
2022/12/21 03:07:09 Index found:  index_streetaddress
2022/12/21 03:07:09 Dropped index index_streetaddress
2022/12/21 03:07:09 Index found:  index_eyeColor
2022/12/21 03:07:09 Dropped index index_eyeColor
2022/12/21 03:07:09 Index found:  index_di1
2022/12/21 03:07:09 Dropped index index_di1
2022/12/21 03:07:09 Index found:  index_pin
2022/12/21 03:07:09 Dropped index index_pin
2022/12/21 03:07:09 Index found:  index_latitude
2022/12/21 03:07:10 Dropped index index_latitude
2022/12/21 03:07:10 Index found:  index_composite2
2022/12/21 03:07:10 Dropped index index_composite2
2022/12/21 03:07:10 Index found:  index_age35to45
2022/12/21 03:07:10 Dropped index index_age35to45
2022/12/21 03:07:10 Index found:  index_age
2022/12/21 03:07:10 Dropped index index_age
2022/12/21 03:07:10 Index found:  index_name
2022/12/21 03:07:10 Dropped index index_name
2022/12/21 03:07:10 Index found:  index_tags
2022/12/21 03:07:10 Dropped index index_tags
2022/12/21 03:07:10 Index found:  index_p1
2022/12/21 03:07:10 Dropped index index_p1
2022/12/21 03:07:10 Index found:  index_nationality
2022/12/21 03:07:10 Dropped index index_nationality
2022/12/21 03:07:10 Index found:  idx_age
2022/12/21 03:07:10 Dropped index idx_age
2022/12/21 03:07:10 Index found:  index_isresidential
2022/12/21 03:07:10 Dropped index index_isresidential
2022/12/21 03:07:10 Index found:  index_company
2022/12/21 03:07:10 Dropped index index_company
2022/12/21 03:07:10 Index found:  index_height
2022/12/21 03:07:10 Dropped index index_height
2022/12/21 03:07:10 Index found:  index_ageabove30
2022/12/21 03:07:10 Dropped index index_ageabove30
2022/12/21 03:07:31 Created the secondary index indexmut_1. Waiting for it become active
2022/12/21 03:07:31 Index is 12924085007041741452 now active
2022/12/21 03:07:31 Using n1ql client
2022/12/21 03:07:31 Expected and Actual scan responses are the same
2022/12/21 03:07:31 Len of expected and actual scan results are :  29902 and 29902
2022/12/21 03:07:31 ITERATION 0
2022/12/21 03:07:49 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:07:49 Index is 4263905309898432308 now active
2022/12/21 03:07:49 Using n1ql client
2022/12/21 03:07:50 Expected and Actual scan responses are the same
2022/12/21 03:07:50 Len of expected and actual scan results are :  39902 and 39902
2022/12/21 03:07:50 Using n1ql client
2022/12/21 03:07:50 Expected and Actual scan responses are the same
2022/12/21 03:07:50 Len of expected and actual scan results are :  39902 and 39902
2022/12/21 03:07:50 Dropping the secondary index indexmut_2
2022/12/21 03:07:50 Index dropped
2022/12/21 03:07:50 ITERATION 1
2022/12/21 03:08:08 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:08:08 Index is 5936279361244027234 now active
2022/12/21 03:08:08 Using n1ql client
2022/12/21 03:08:08 Expected and Actual scan responses are the same
2022/12/21 03:08:08 Len of expected and actual scan results are :  49902 and 49902
2022/12/21 03:08:08 Using n1ql client
2022/12/21 03:08:09 Expected and Actual scan responses are the same
2022/12/21 03:08:09 Len of expected and actual scan results are :  49902 and 49902
2022/12/21 03:08:09 Dropping the secondary index indexmut_2
2022/12/21 03:08:09 Index dropped
2022/12/21 03:08:09 ITERATION 2
2022/12/21 03:08:27 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:08:27 Index is 5059689885383473368 now active
2022/12/21 03:08:27 Using n1ql client
2022/12/21 03:08:27 Expected and Actual scan responses are the same
2022/12/21 03:08:27 Len of expected and actual scan results are :  59902 and 59902
2022/12/21 03:08:28 Using n1ql client
2022/12/21 03:08:28 Expected and Actual scan responses are the same
2022/12/21 03:08:28 Len of expected and actual scan results are :  59902 and 59902
2022/12/21 03:08:28 Dropping the secondary index indexmut_2
2022/12/21 03:08:28 Index dropped
2022/12/21 03:08:28 ITERATION 3
2022/12/21 03:08:48 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:08:48 Index is 9560464057859317993 now active
2022/12/21 03:08:49 Using n1ql client
2022/12/21 03:08:49 Expected and Actual scan responses are the same
2022/12/21 03:08:49 Len of expected and actual scan results are :  69902 and 69902
2022/12/21 03:08:49 Using n1ql client
2022/12/21 03:08:50 Expected and Actual scan responses are the same
2022/12/21 03:08:50 Len of expected and actual scan results are :  69902 and 69902
2022/12/21 03:08:50 Dropping the secondary index indexmut_2
2022/12/21 03:08:50 Index dropped
2022/12/21 03:08:50 ITERATION 4
2022/12/21 03:09:12 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:09:12 Index is 7148356495156822072 now active
2022/12/21 03:09:12 Using n1ql client
2022/12/21 03:09:13 Expected and Actual scan responses are the same
2022/12/21 03:09:13 Len of expected and actual scan results are :  79902 and 79902
2022/12/21 03:09:13 Using n1ql client
2022/12/21 03:09:13 Expected and Actual scan responses are the same
2022/12/21 03:09:13 Len of expected and actual scan results are :  79902 and 79902
2022/12/21 03:09:13 Dropping the secondary index indexmut_2
2022/12/21 03:09:13 Index dropped
2022/12/21 03:09:13 ITERATION 5
2022/12/21 03:09:33 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:09:33 Index is 5420133906238149550 now active
2022/12/21 03:09:34 Using n1ql client
2022/12/21 03:09:34 Expected and Actual scan responses are the same
2022/12/21 03:09:34 Len of expected and actual scan results are :  89902 and 89902
2022/12/21 03:09:35 Using n1ql client
2022/12/21 03:09:35 Expected and Actual scan responses are the same
2022/12/21 03:09:35 Len of expected and actual scan results are :  89902 and 89902
2022/12/21 03:09:35 Dropping the secondary index indexmut_2
2022/12/21 03:09:35 Index dropped
2022/12/21 03:09:35 ITERATION 6
2022/12/21 03:09:55 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:09:55 Index is 8693721781687816741 now active
2022/12/21 03:09:56 Using n1ql client
2022/12/21 03:09:56 Expected and Actual scan responses are the same
2022/12/21 03:09:56 Len of expected and actual scan results are :  99902 and 99902
2022/12/21 03:09:56 Using n1ql client
2022/12/21 03:09:57 Expected and Actual scan responses are the same
2022/12/21 03:09:57 Len of expected and actual scan results are :  99902 and 99902
2022/12/21 03:09:57 Dropping the secondary index indexmut_2
2022/12/21 03:09:57 Index dropped
2022/12/21 03:09:57 ITERATION 7
2022/12/21 03:10:20 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:10:20 Index is 9905926477729472766 now active
2022/12/21 03:10:20 Using n1ql client
2022/12/21 03:10:21 Expected and Actual scan responses are the same
2022/12/21 03:10:21 Len of expected and actual scan results are :  109902 and 109902
2022/12/21 03:10:21 Using n1ql client
2022/12/21 03:10:22 Expected and Actual scan responses are the same
2022/12/21 03:10:22 Len of expected and actual scan results are :  109902 and 109902
2022/12/21 03:10:22 Dropping the secondary index indexmut_2
2022/12/21 03:10:22 Index dropped
2022/12/21 03:10:22 ITERATION 8
2022/12/21 03:10:45 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:10:45 Index is 13541995175568273705 now active
2022/12/21 03:10:45 Using n1ql client
2022/12/21 03:10:46 Expected and Actual scan responses are the same
2022/12/21 03:10:46 Len of expected and actual scan results are :  119902 and 119902
2022/12/21 03:10:46 Using n1ql client
2022/12/21 03:10:48 Expected and Actual scan responses are the same
2022/12/21 03:10:48 Len of expected and actual scan results are :  119902 and 119902
2022/12/21 03:10:48 Dropping the secondary index indexmut_2
2022/12/21 03:10:48 Index dropped
2022/12/21 03:10:48 ITERATION 9
2022/12/21 03:11:09 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:11:09 Index is 851091791369025488 now active
2022/12/21 03:11:09 Using n1ql client
2022/12/21 03:11:10 Expected and Actual scan responses are the same
2022/12/21 03:11:10 Len of expected and actual scan results are :  129902 and 129902
2022/12/21 03:11:10 Using n1ql client
2022/12/21 03:11:11 Expected and Actual scan responses are the same
2022/12/21 03:11:11 Len of expected and actual scan results are :  129902 and 129902
2022/12/21 03:11:11 Dropping the secondary index indexmut_2
2022/12/21 03:11:11 Index dropped
2022/12/21 03:11:11 ITERATION 10
2022/12/21 03:11:36 Created the secondary index indexmut_2. Waiting for it become active
2022/12/21 03:11:36 Index is 18102267710912376471 now active
2022/12/21 03:11:37 Using n1ql client
2022/12/21 03:11:39 Expected and Actual scan responses are the same
2022/12/21 03:11:39 Len of expected and actual scan results are :  139902 and 139902
2022/12/21 03:11:39 Using n1ql client
2022/12/21 03:11:40 Expected and Actual scan responses are the same
2022/12/21 03:11:40 Len of expected and actual scan results are :  139902 and 139902
2022/12/21 03:11:40 Dropping the secondary index indexmut_2
2022/12/21 03:11:40 Index dropped
--- PASS: TestLargeMutations (272.08s)
=== RUN   TestPlanner
2022/12/21 03:11:40 In TestPlanner()
2022/12/21 03:11:40 -------------------------------------------
2022/12/21 03:11:40 initial placement - 20-50M, 10 index, 3 replica, 2x
2022-12-21T03:11:40.577+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:40.581+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-12-21T03:11:40.581+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-12-21T03:11:40.592+05:30 [Info] switched currmeta from 477 -> 478 force true 
2022-12-21T03:11:40.649+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-12-21T03:11:40.653+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-12-21T03:11:40.684+05:30 [Info] switched currmeta from 482 -> 482 force true 
2022-12-21T03:11:40.770+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-12-21T03:11:40.771+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-12-21T03:11:40.805+05:30 [Info] switched currmeta from 478 -> 478 force true 
2022-12-21T03:11:40.838+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-12-21T03:11:40.838+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-12-21T03:11:40.844+05:30 [Info] switched currmeta from 482 -> 482 force true 
2022-12-21T03:11:41.102+05:30 [Info] Score: 0.028214683614486678
2022-12-21T03:11:41.102+05:30 [Info] Memory Quota: 58059490832 (54.0721G)
2022-12-21T03:11:41.102+05:30 [Info] CPU Quota: 12
2022-12-21T03:11:41.102+05:30 [Info] Indexer Memory Mean 37577999747 (34.9972G)
2022-12-21T03:11:41.102+05:30 [Info] Indexer Memory Deviation 2120502747 (1.97487G) (5.64%)
2022-12-21T03:11:41.102+05:30 [Info] Indexer Memory Utilization 0.6472
2022-12-21T03:11:41.102+05:30 [Info] Indexer CPU Mean 8.8557
2022-12-21T03:11:41.102+05:30 [Info] Indexer CPU Deviation 3.01 (34.02%)
2022-12-21T03:11:41.102+05:30 [Info] Indexer CPU Utilization 0.7380
2022-12-21T03:11:41.102+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:41.102+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:41.102+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:41.102+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:41.102+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:41.102+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:41.102+05:30 [Info] Indexer Data Size Mean 37577999747 (34.9972G)
2022-12-21T03:11:41.102+05:30 [Info] Indexer Data Size Deviation 2120502747 (1.97487G) (5.64%)
2022-12-21T03:11:41.102+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:41.102+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:41.102+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:41.102+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:41 -------------------------------------------
2022/12/21 03:11:41 initial placement - 20-50M, 30 index, 3 replica, 2x
2022-12-21T03:11:41.103+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:41.420+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2022-12-21T03:11:41.431+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-12-21T03:11:41.432+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-12-21T03:11:41.438+05:30 [Info] switched currmeta from 482 -> 482 force true 
2022-12-21T03:11:41.441+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-12-21T03:11:41.441+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-12-21T03:11:41.445+05:30 [Info] switched currmeta from 478 -> 478 force true 
2022-12-21T03:11:42.387+05:30 [Info] Score: 0.03290720398111433
2022-12-21T03:11:42.387+05:30 [Info] Memory Quota: 64356113048 (59.9363G)
2022-12-21T03:11:42.387+05:30 [Info] CPU Quota: 12
2022-12-21T03:11:42.387+05:30 [Info] Indexer Memory Mean 40870321414 (38.0635G)
2022-12-21T03:11:42.387+05:30 [Info] Indexer Memory Deviation 2689856007 (2.50512G) (6.58%)
2022-12-21T03:11:42.387+05:30 [Info] Indexer Memory Utilization 0.6351
2022-12-21T03:11:42.387+05:30 [Info] Indexer CPU Mean 11.9989
2022-12-21T03:11:42.387+05:30 [Info] Indexer CPU Deviation 2.74 (22.87%)
2022-12-21T03:11:42.387+05:30 [Info] Indexer CPU Utilization 0.9999
2022-12-21T03:11:42.387+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:42.387+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:42.387+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:42.387+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:42.387+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:42.387+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:42.388+05:30 [Info] Indexer Data Size Mean 40870321414 (38.0635G)
2022-12-21T03:11:42.388+05:30 [Info] Indexer Data Size Deviation 2689856007 (2.50512G) (6.58%)
2022-12-21T03:11:42.388+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:42.388+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:42.388+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:42.388+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:42 -------------------------------------------
2022/12/21 03:11:42 initial placement - 20-50M, 30 index, 3 replica, 4x
2022-12-21T03:11:42.388+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:42.461+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2022-12-21T03:11:42.466+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-12-21T03:11:42.466+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-12-21T03:11:42.471+05:30 [Info] switched currmeta from 482 -> 482 force true 
2022-12-21T03:11:42.474+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-12-21T03:11:42.474+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-12-21T03:11:42.475+05:30 [Info] switched currmeta from 478 -> 478 force true 
2022-12-21T03:11:42.739+05:30 [Info] Score: 0.018612580825449133
2022-12-21T03:11:42.740+05:30 [Info] Memory Quota: 112080087308 (104.383G)
2022-12-21T03:11:42.740+05:30 [Info] CPU Quota: 24
2022-12-21T03:11:42.740+05:30 [Info] Indexer Memory Mean 74064618139 (68.9781G)
2022-12-21T03:11:42.740+05:30 [Info] Indexer Memory Deviation 2757067382 (2.56772G) (3.72%)
2022-12-21T03:11:42.740+05:30 [Info] Indexer Memory Utilization 0.6608
2022-12-21T03:11:42.740+05:30 [Info] Indexer CPU Mean 22.2469
2022-12-21T03:11:42.740+05:30 [Info] Indexer CPU Deviation 3.65 (16.42%)
2022-12-21T03:11:42.740+05:30 [Info] Indexer CPU Utilization 0.9270
2022-12-21T03:11:42.740+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:42.740+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:42.740+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:42.740+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:42.740+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:42.740+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:42.740+05:30 [Info] Indexer Data Size Mean 74064618139 (68.9781G)
2022-12-21T03:11:42.740+05:30 [Info] Indexer Data Size Deviation 2757067382 (2.56772G) (3.72%)
2022-12-21T03:11:42.740+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:42.740+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:42.740+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:42.740+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:42 -------------------------------------------
2022/12/21 03:11:42 initial placement - 200-500M, 10 index, 3 replica, 2x
2022-12-21T03:11:42.741+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:42.805+05:30 [Info] Score: 0.03448640537682099
2022-12-21T03:11:42.805+05:30 [Info] Memory Quota: 424991636882 (395.804G)
2022-12-21T03:11:42.805+05:30 [Info] CPU Quota: 12
2022-12-21T03:11:42.805+05:30 [Info] Indexer Memory Mean 305140238931 (284.184G)
2022-12-21T03:11:42.805+05:30 [Info] Indexer Memory Deviation 21046379953 (19.601G) (6.90%)
2022-12-21T03:11:42.805+05:30 [Info] Indexer Memory Utilization 0.7180
2022-12-21T03:11:42.805+05:30 [Info] Indexer CPU Mean 9.3934
2022-12-21T03:11:42.805+05:30 [Info] Indexer CPU Deviation 2.47 (26.30%)
2022-12-21T03:11:42.805+05:30 [Info] Indexer CPU Utilization 0.7828
2022-12-21T03:11:42.805+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:42.805+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:42.805+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:42.805+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:42.805+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:42.805+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:42.805+05:30 [Info] Indexer Data Size Mean 305140238931 (284.184G)
2022-12-21T03:11:42.805+05:30 [Info] Indexer Data Size Deviation 21046379953 (19.601G) (6.90%)
2022-12-21T03:11:42.805+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:42.805+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:42.805+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:42.805+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:42 -------------------------------------------
2022/12/21 03:11:42 initial placement - 200-500M, 30 index, 3 replica, 2x
2022-12-21T03:11:42.806+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:43.678+05:30 [Info] Score: 0.027268842433474418
2022-12-21T03:11:43.678+05:30 [Info] Memory Quota: 541913036758 (504.696G)
2022-12-21T03:11:43.678+05:30 [Info] CPU Quota: 12
2022-12-21T03:11:43.678+05:30 [Info] Indexer Memory Mean 429082243694 (399.614G)
2022-12-21T03:11:43.678+05:30 [Info] Indexer Memory Deviation 23401152188 (21.794G) (5.45%)
2022-12-21T03:11:43.678+05:30 [Info] Indexer Memory Utilization 0.7918
2022-12-21T03:11:43.678+05:30 [Info] Indexer CPU Mean 11.6951
2022-12-21T03:11:43.678+05:30 [Info] Indexer CPU Deviation 2.38 (20.37%)
2022-12-21T03:11:43.678+05:30 [Info] Indexer CPU Utilization 0.9746
2022-12-21T03:11:43.678+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:43.678+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:43.678+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:43.678+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:43.678+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:43.678+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:43.678+05:30 [Info] Indexer Data Size Mean 429082243694 (399.614G)
2022-12-21T03:11:43.678+05:30 [Info] Indexer Data Size Deviation 23401152188 (21.794G) (5.45%)
2022-12-21T03:11:43.678+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:43.678+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:43.678+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:43.678+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:43 -------------------------------------------
2022/12/21 03:11:43 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2022-12-21T03:11:43.679+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:43.913+05:30 [Info] Score: 0.013850554192994193
2022-12-21T03:11:43.913+05:30 [Info] Memory Quota: 311469959227 (290.079G)
2022-12-21T03:11:43.913+05:30 [Info] CPU Quota: 16
2022-12-21T03:11:43.913+05:30 [Info] Indexer Memory Mean 242935738002 (226.252G)
2022-12-21T03:11:43.913+05:30 [Info] Indexer Memory Deviation 6729589209 (6.26742G) (2.77%)
2022-12-21T03:11:43.913+05:30 [Info] Indexer Memory Utilization 0.7800
2022-12-21T03:11:43.913+05:30 [Info] Indexer CPU Mean 11.0024
2022-12-21T03:11:43.913+05:30 [Info] Indexer CPU Deviation 6.55 (59.53%)
2022-12-21T03:11:43.913+05:30 [Info] Indexer CPU Utilization 0.6877
2022-12-21T03:11:43.913+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:43.913+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:43.913+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:43.913+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:43.913+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:43.913+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:43.913+05:30 [Info] Indexer Data Size Mean 242935738002 (226.252G)
2022-12-21T03:11:43.913+05:30 [Info] Indexer Data Size Deviation 6729589209 (6.26742G) (2.77%)
2022-12-21T03:11:43.913+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:43.913+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:43.913+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:43.913+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:43 -------------------------------------------
2022/12/21 03:11:43 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2022-12-21T03:11:43.914+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:44.696+05:30 [Info] Score: 0.06762897459085547
2022-12-21T03:11:44.696+05:30 [Info] Memory Quota: 327887029684 (305.369G)
2022-12-21T03:11:44.696+05:30 [Info] CPU Quota: 24
2022-12-21T03:11:44.696+05:30 [Info] Indexer Memory Mean 234191110326 (218.107G)
2022-12-21T03:11:44.696+05:30 [Info] Indexer Memory Deviation 31676209299 (29.5008G) (13.53%)
2022-12-21T03:11:44.696+05:30 [Info] Indexer Memory Utilization 0.7142
2022-12-21T03:11:44.696+05:30 [Info] Indexer CPU Mean 7.7359
2022-12-21T03:11:44.696+05:30 [Info] Indexer CPU Deviation 2.97 (38.35%)
2022-12-21T03:11:44.696+05:30 [Info] Indexer CPU Utilization 0.3223
2022-12-21T03:11:44.696+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:44.696+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:44.696+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:44.696+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.696+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:44.696+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.696+05:30 [Info] Indexer Data Size Mean 234191110326 (218.107G)
2022-12-21T03:11:44.696+05:30 [Info] Indexer Data Size Deviation 31676209299 (29.5008G) (13.53%)
2022-12-21T03:11:44.696+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:44.696+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:44.696+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:44.696+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:44 -------------------------------------------
2022/12/21 03:11:44 initial placement - 6 2M index, 1 replica, 2x
2022-12-21T03:11:44.707+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:44.721+05:30 [Info] Score: 0
2022-12-21T03:11:44.721+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2022-12-21T03:11:44.721+05:30 [Info] CPU Quota: 2
2022-12-21T03:11:44.721+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2022-12-21T03:11:44.721+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:44.721+05:30 [Info] Indexer Memory Utilization 0.4290
2022-12-21T03:11:44.721+05:30 [Info] Indexer CPU Mean 1.2000
2022-12-21T03:11:44.721+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:44.721+05:30 [Info] Indexer CPU Utilization 0.6000
2022-12-21T03:11:44.721+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:44.721+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:44.721+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:44.721+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.721+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:44.721+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.721+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2022-12-21T03:11:44.721+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:44.721+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:44.721+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:44.721+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:44.721+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:44 -------------------------------------------
2022/12/21 03:11:44 initial placement - 5 20M primary index, 2 replica, 2x
2022-12-21T03:11:44.731+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:44.770+05:30 [Info] Score: 0
2022-12-21T03:11:44.770+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2022-12-21T03:11:44.770+05:30 [Info] CPU Quota: 2
2022-12-21T03:11:44.770+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2022-12-21T03:11:44.770+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:44.770+05:30 [Info] Indexer Memory Utilization 0.7659
2022-12-21T03:11:44.770+05:30 [Info] Indexer CPU Mean 1.2000
2022-12-21T03:11:44.770+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:44.770+05:30 [Info] Indexer CPU Utilization 0.6000
2022-12-21T03:11:44.770+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:44.770+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:44.770+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:44.770+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.770+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:44.770+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.770+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2022-12-21T03:11:44.770+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:44.770+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:44.770+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:44.770+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:44.770+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:44 -------------------------------------------
2022/12/21 03:11:44 initial placement - 5 20M array index, 2 replica, 2x
2022-12-21T03:11:44.780+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:44.821+05:30 [Info] Score: 0
2022-12-21T03:11:44.821+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2022-12-21T03:11:44.821+05:30 [Info] CPU Quota: 2
2022-12-21T03:11:44.821+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2022-12-21T03:11:44.821+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:44.821+05:30 [Info] Indexer Memory Utilization 0.8063
2022-12-21T03:11:44.821+05:30 [Info] Indexer CPU Mean 1.2000
2022-12-21T03:11:44.821+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:44.821+05:30 [Info] Indexer CPU Utilization 0.6000
2022-12-21T03:11:44.821+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:44.821+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:44.821+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:44.821+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.821+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:44.821+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.821+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2022-12-21T03:11:44.821+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:44.821+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:44.821+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:44.821+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:44.821+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:44 -------------------------------------------
2022/12/21 03:11:44 initial placement - 3 replica constraint, 2 index, 2x
2022-12-21T03:11:44.825+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:44.862+05:30 [Info] Score: 0
2022-12-21T03:11:44.862+05:30 [Info] Memory Quota: 530294000 (505.728M)
2022-12-21T03:11:44.862+05:30 [Info] CPU Quota: 2
2022-12-21T03:11:44.862+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2022-12-21T03:11:44.862+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:44.862+05:30 [Info] Indexer Memory Utilization 0.0049
2022-12-21T03:11:44.862+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:44.862+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:44.862+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:44.862+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:44.862+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:44.862+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:44.862+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.862+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:44.862+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.862+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2022-12-21T03:11:44.862+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:44.862+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:44.862+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:44.862+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:44.862+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:44 -------------------------------------------
2022/12/21 03:11:44 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2022-12-21T03:11:44.871+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.022553707154574578
2022-12-21T03:11:44.994+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:44.994+05:30 [Info] Score: 0.007189938568471697
2022-12-21T03:11:44.994+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2022-12-21T03:11:44.994+05:30 [Info] CPU Quota: 27
2022-12-21T03:11:44.994+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2022-12-21T03:11:44.994+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2022-12-21T03:11:44.994+05:30 [Info] Indexer Memory Utilization 0.5679
2022-12-21T03:11:44.994+05:30 [Info] Indexer CPU Mean 20.1734
2022-12-21T03:11:44.994+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2022-12-21T03:11:44.994+05:30 [Info] Indexer CPU Utilization 0.7472
2022-12-21T03:11:44.994+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:44.994+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:44.994+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:44.994+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.994+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:44.994+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:44.994+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2022-12-21T03:11:44.994+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2022-12-21T03:11:44.994+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:44.994+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:44.994+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:44.994+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:44 -------------------------------------------
2022/12/21 03:11:44 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2022-12-21T03:11:45.006+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0026343466348076076
2022-12-21T03:11:45.221+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:45.221+05:30 [Info] Score: 0.00043718596495524715
2022-12-21T03:11:45.221+05:30 [Info] Memory Quota: 536870912000 (500G)
2022-12-21T03:11:45.221+05:30 [Info] CPU Quota: 20
2022-12-21T03:11:45.221+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2022-12-21T03:11:45.221+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2022-12-21T03:11:45.221+05:30 [Info] Indexer Memory Utilization 0.7321
2022-12-21T03:11:45.221+05:30 [Info] Indexer CPU Mean 14.2305
2022-12-21T03:11:45.221+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2022-12-21T03:11:45.221+05:30 [Info] Indexer CPU Utilization 0.7115
2022-12-21T03:11:45.221+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:45.221+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:45.221+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:45.221+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.221+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:45.221+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.221+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2022-12-21T03:11:45.221+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2022-12-21T03:11:45.221+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:45.221+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:45.221+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:45.221+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:45 -------------------------------------------
2022/12/21 03:11:45 incr placement - 3 server group, 3 replica, 1x
2022-12-21T03:11:45.224+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:45.238+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:45.238+05:30 [Info] Score: 0
2022-12-21T03:11:45.238+05:30 [Info] Memory Quota: 530294000 (505.728M)
2022-12-21T03:11:45.238+05:30 [Info] CPU Quota: 16
2022-12-21T03:11:45.238+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2022-12-21T03:11:45.238+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:45.238+05:30 [Info] Indexer Memory Utilization 0.0049
2022-12-21T03:11:45.238+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:45.238+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:45.238+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:45.238+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:45.238+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:45.238+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:45.238+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.238+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:45.238+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.238+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2022-12-21T03:11:45.238+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:45.238+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:45.238+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:45.238+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:45.238+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:45 -------------------------------------------
2022/12/21 03:11:45 incr placement - 2 server group, 3 replica, 1x
2022-12-21T03:11:45.240+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2022-12-21T03:11:45.240+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2022-12-21T03:11:45.240+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2022-12-21T03:11:45.240+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:45.253+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:45.253+05:30 [Info] Score: 0
2022-12-21T03:11:45.253+05:30 [Info] Memory Quota: 530294000 (505.728M)
2022-12-21T03:11:45.253+05:30 [Info] CPU Quota: 16
2022-12-21T03:11:45.253+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2022-12-21T03:11:45.253+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:45.253+05:30 [Info] Indexer Memory Utilization 0.0049
2022-12-21T03:11:45.253+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:45.253+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:45.253+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:45.253+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:45.253+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:45.253+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:45.253+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.253+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:45.253+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.253+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2022-12-21T03:11:45.253+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:45.253+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:45.253+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:45.253+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:45.253+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:45 -------------------------------------------
2022/12/21 03:11:45 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2022-12-21T03:11:45.262+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.34794202224950455
2022-12-21T03:11:45.262+05:30 [Info] Planner::initial temperature: initial resource variation 0.34794202224950455 temp 0.03479420222495046
2022-12-21T03:11:45.439+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:45.439+05:30 [Info] Score: 0.15618230238412575
2022-12-21T03:11:45.439+05:30 [Info] Memory Quota: 139586437120 (130G)
2022-12-21T03:11:45.439+05:30 [Info] CPU Quota: 30
2022-12-21T03:11:45.439+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2022-12-21T03:11:45.439+05:30 [Info] Indexer Memory Deviation 4540525532 (4.22869G) (5.11%)
2022-12-21T03:11:45.439+05:30 [Info] Indexer Memory Utilization 0.6367
2022-12-21T03:11:45.439+05:30 [Info] Indexer CPU Mean 24.0538
2022-12-21T03:11:45.439+05:30 [Info] Indexer CPU Deviation 3.34 (13.88%)
2022-12-21T03:11:45.439+05:30 [Info] Indexer CPU Utilization 0.8018
2022-12-21T03:11:45.439+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:45.439+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:45.439+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:45.439+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.439+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:45.439+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.439+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2022-12-21T03:11:45.439+05:30 [Info] Indexer Data Size Deviation 4540525532 (4.22869G) (5.11%)
2022-12-21T03:11:45.439+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2022-12-21T03:11:45.439+05:30 [Info] Index Data Moved (exclude new node) 293.146G (29.51%)
2022-12-21T03:11:45.439+05:30 [Info] No. Index (from non-deleted node) 90
2022-12-21T03:11:45.439+05:30 [Info] No. Index Moved (exclude new node) 23 (25.56%)
2022/12/21 03:11:45 -------------------------------------------
2022/12/21 03:11:45 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2022-12-21T03:11:45.441+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.340834832604346
2022-12-21T03:11:45.441+05:30 [Info] Planner::initial temperature: initial resource variation 0.340834832604346 temp 0.0340834832604346
2022-12-21T03:11:45.645+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:45.645+05:30 [Info] Score: 0.19452156109726468
2022-12-21T03:11:45.645+05:30 [Info] Memory Quota: 536870912000 (500G)
2022-12-21T03:11:45.645+05:30 [Info] CPU Quota: 20
2022-12-21T03:11:45.645+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2022-12-21T03:11:45.645+05:30 [Info] Indexer Memory Deviation 24523838638 (22.8396G) (6.25%)
2022-12-21T03:11:45.645+05:30 [Info] Indexer Memory Utilization 0.7311
2022-12-21T03:11:45.645+05:30 [Info] Indexer CPU Mean 13.9305
2022-12-21T03:11:45.645+05:30 [Info] Indexer CPU Deviation 3.43 (24.64%)
2022-12-21T03:11:45.645+05:30 [Info] Indexer CPU Utilization 0.6965
2022-12-21T03:11:45.645+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:45.645+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:45.645+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:45.645+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.645+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:45.645+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.645+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2022-12-21T03:11:45.645+05:30 [Info] Indexer Data Size Deviation 24523838638 (22.8396G) (6.25%)
2022-12-21T03:11:45.645+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2022-12-21T03:11:45.645+05:30 [Info] Index Data Moved (exclude new node) 2.07995T (48.55%)
2022-12-21T03:11:45.645+05:30 [Info] No. Index (from non-deleted node) 90
2022-12-21T03:11:45.645+05:30 [Info] No. Index Moved (exclude new node) 19 (21.11%)
2022/12/21 03:11:45 -------------------------------------------
2022/12/21 03:11:45 rebalance - travel sample, 10% shuffle, 1x
2022-12-21T03:11:45.646+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.081608192724979
2022-12-21T03:11:45.646+05:30 [Info] Planner::initial temperature: initial resource variation 0.081608192724979 temp 0.0081608192724979
2022-12-21T03:11:45.655+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:45.655+05:30 [Info] Score: 0.02040204818124475
2022-12-21T03:11:45.655+05:30 [Info] Memory Quota: 536870912 (512M)
2022-12-21T03:11:45.655+05:30 [Info] CPU Quota: 8
2022-12-21T03:11:45.655+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2022-12-21T03:11:45.655+05:30 [Info] Indexer Memory Deviation 1428399 (1.36223M) (8.16%)
2022-12-21T03:11:45.655+05:30 [Info] Indexer Memory Utilization 0.0326
2022-12-21T03:11:45.655+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:45.655+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:45.655+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:45.655+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:45.655+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:45.655+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:45.655+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.655+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:45.655+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.655+05:30 [Info] Indexer Data Size Mean 0 (0)
2022-12-21T03:11:45.655+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:45.655+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:45.655+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:45.655+05:30 [Info] No. Index (from non-deleted node) 10
2022-12-21T03:11:45.655+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:45 -------------------------------------------
2022/12/21 03:11:45 rebalance - 20-50M, 90 index, swap 2, 1x
2022-12-21T03:11:45.656+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4095843409677649
2022-12-21T03:11:45.657+05:30 [Info] Planner::initial temperature: initial resource variation 0.4095843409677649 temp 0.04095843409677649
2022-12-21T03:11:45.818+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:45.818+05:30 [Info] Score: 0.013829299118030335
2022-12-21T03:11:45.818+05:30 [Info] Memory Quota: 139586437120 (130G)
2022-12-21T03:11:45.818+05:30 [Info] CPU Quota: 30
2022-12-21T03:11:45.818+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2022-12-21T03:11:45.818+05:30 [Info] Indexer Memory Deviation 2458201306 (2.28938G) (2.77%)
2022-12-21T03:11:45.818+05:30 [Info] Indexer Memory Utilization 0.6367
2022-12-21T03:11:45.818+05:30 [Info] Indexer CPU Mean 24.0538
2022-12-21T03:11:45.818+05:30 [Info] Indexer CPU Deviation 0.58 (2.42%)
2022-12-21T03:11:45.818+05:30 [Info] Indexer CPU Utilization 0.8018
2022-12-21T03:11:45.818+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:45.818+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:45.818+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:45.818+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.818+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:45.818+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.818+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2022-12-21T03:11:45.818+05:30 [Info] Indexer Data Size Deviation 2458201306 (2.28938G) (2.77%)
2022-12-21T03:11:45.818+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:45.818+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:45.818+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:45.818+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:45 -------------------------------------------
2022/12/21 03:11:45 rebalance - mixed small/medium, 90 index, swap 2, 1x
2022-12-21T03:11:45.820+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4082556623939647
2022-12-21T03:11:45.820+05:30 [Info] Planner::initial temperature: initial resource variation 0.4082556623939647 temp 0.040825566239396475
2022-12-21T03:11:45.961+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:45.961+05:30 [Info] Score: 0.0013222687073845257
2022-12-21T03:11:45.961+05:30 [Info] Memory Quota: 536870912000 (500G)
2022-12-21T03:11:45.962+05:30 [Info] CPU Quota: 20
2022-12-21T03:11:45.962+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2022-12-21T03:11:45.962+05:30 [Info] Indexer Memory Deviation 1037995750 (989.91M) (0.26%)
2022-12-21T03:11:45.962+05:30 [Info] Indexer Memory Utilization 0.7311
2022-12-21T03:11:45.962+05:30 [Info] Indexer CPU Mean 13.9305
2022-12-21T03:11:45.962+05:30 [Info] Indexer CPU Deviation 2.00 (14.34%)
2022-12-21T03:11:45.962+05:30 [Info] Indexer CPU Utilization 0.6965
2022-12-21T03:11:45.962+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:45.962+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:45.962+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:45.962+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.962+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:45.962+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:45.962+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2022-12-21T03:11:45.962+05:30 [Info] Indexer Data Size Deviation 1037995750 (989.91M) (0.26%)
2022-12-21T03:11:45.962+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:45.962+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:45.962+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:45.962+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:45 -------------------------------------------
2022/12/21 03:11:45 rebalance - travel sample, swap 2, 1x
2022-12-21T03:11:45.962+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0086622738872069
2022-12-21T03:11:45.962+05:30 [Info] Planner::initial temperature: initial resource variation 1.0086622738872069 temp 0.1008662273887207
2022-12-21T03:11:46.086+05:30 [Info] Score: 0.0003181929343700274
2022-12-21T03:11:46.086+05:30 [Info] Memory Quota: 536870912 (512M)
2022-12-21T03:11:46.086+05:30 [Info] CPU Quota: 8
2022-12-21T03:11:46.086+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2022-12-21T03:11:46.086+05:30 [Info] Indexer Memory Deviation 22277 (21.7549K) (0.13%)
2022-12-21T03:11:46.086+05:30 [Info] Indexer Memory Utilization 0.0326
2022-12-21T03:11:46.086+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:46.086+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:46.086+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:46.086+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:46.086+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:46.086+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:46.086+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.086+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:46.086+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.086+05:30 [Info] Indexer Data Size Mean 0 (0)
2022-12-21T03:11:46.086+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.086+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:46.086+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:46.086+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:46.086+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:46 -------------------------------------------
2022/12/21 03:11:46 rebalance - 8 identical index, add 4, 1x
2022-12-21T03:11:46.087+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1
2022-12-21T03:11:46.087+05:30 [Info] Planner::initial temperature: initial resource variation 1 temp 0.1
2022-12-21T03:11:46.102+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:46.102+05:30 [Info] Score: 0.0625
2022-12-21T03:11:46.102+05:30 [Info] Memory Quota: 530294000 (505.728M)
2022-12-21T03:11:46.102+05:30 [Info] CPU Quota: 2
2022-12-21T03:11:46.102+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2022-12-21T03:11:46.102+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.102+05:30 [Info] Indexer Memory Utilization 0.0049
2022-12-21T03:11:46.102+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:46.102+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:46.102+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:46.102+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:46.102+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:46.102+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:46.102+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.102+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:46.102+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.102+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2022-12-21T03:11:46.102+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.102+05:30 [Info] Total Index Data (from non-deleted node) 19.8364M
2022-12-21T03:11:46.102+05:30 [Info] Index Data Moved (exclude new node) 2.47955M (12.50%)
2022-12-21T03:11:46.102+05:30 [Info] No. Index (from non-deleted node) 8
2022-12-21T03:11:46.102+05:30 [Info] No. Index Moved (exclude new node) 1 (12.50%)
2022/12/21 03:11:46 -------------------------------------------
2022/12/21 03:11:46 rebalance - 8 identical index, delete 2, 2x
2022-12-21T03:11:46.102+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:46.102+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2022-12-21T03:11:46.147+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:46.147+05:30 [Info] Score: 0
2022-12-21T03:11:46.147+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2022-12-21T03:11:46.147+05:30 [Info] CPU Quota: 4
2022-12-21T03:11:46.147+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2022-12-21T03:11:46.147+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.147+05:30 [Info] Indexer Memory Utilization 0.0098
2022-12-21T03:11:46.148+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:46.148+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:46.148+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:46.148+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:46.148+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:46.148+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:46.148+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.148+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:46.148+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.148+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2022-12-21T03:11:46.148+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.148+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:46.148+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:46.148+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:46.148+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:46 -------------------------------------------
2022/12/21 03:11:46 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2022-12-21T03:11:46.148+05:30 [Warn] There is more replica than available nodes.  Will not move index replica (default,,,country) from ejected node 127.0.0.1:9002
2022-12-21T03:11:46.148+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2022-12-21T03:11:46.148+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2022-12-21T03:11:46.149+05:30 [Info] Score: 0
2022-12-21T03:11:46.149+05:30 [Info] Memory Quota: 536870912 (512M)
2022-12-21T03:11:46.149+05:30 [Info] CPU Quota: 16
2022-12-21T03:11:46.149+05:30 [Info] Indexer Memory Mean 0 (0)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Memory Utilization 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Data Size Mean 0 (0)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:46.149+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:46.149+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:46 -------------------------------------------
2022/12/21 03:11:46 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2022-12-21T03:11:46.149+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2022-12-21T03:11:46.149+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2022-12-21T03:11:46.149+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022-12-21T03:11:46.149+05:30 [Info] Score: 0
2022-12-21T03:11:46.149+05:30 [Info] Memory Quota: 268435456 (256M)
2022-12-21T03:11:46.149+05:30 [Info] CPU Quota: 8
2022-12-21T03:11:46.149+05:30 [Info] Indexer Memory Mean 0 (0)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Memory Utilization 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer CPU Mean 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer CPU Utilization 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer IO Mean 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-12-21T03:11:46.149+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Data Size Mean 0 (0)
2022-12-21T03:11:46.149+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-12-21T03:11:46.149+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-12-21T03:11:46.149+05:30 [Info] No. Index (from non-deleted node) 0
2022-12-21T03:11:46.149+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/12/21 03:11:46 -------------------------------------------
2022/12/21 03:11:46 Minimum memory test 1: min memory = 0
2022-12-21T03:11:46.150+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2022-12-21T03:11:46.150+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2022-12-21T03:11:46.157+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022/12/21 03:11:46 -------------------------------------------
2022/12/21 03:11:46 Minimum memory test 2: min memory > quota
2022-12-21T03:11:46.157+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=8us
2022-12-21T03:11:46.157+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=7us
2022-12-21T03:11:46.157+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=7us
2022-12-21T03:11:46.157+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2022-12-21T03:11:46.157+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2022/12/21 03:11:47 -------------------------------------------
2022/12/21 03:11:47 Minimum memory test 3: min memory < quota
2022-12-21T03:11:47.092+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2022-12-21T03:11:47.092+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Minimum memory test 4: replica repair with min memory > quota
2022-12-21T03:11:48.095+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2022-12-21T03:11:48.095+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=11us
2022-12-21T03:11:48.095+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=7us
2022-12-21T03:11:48.095+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=6us
2022-12-21T03:11:48.095+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2022-12-21T03:11:48.095+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2022-12-21T03:11:48.095+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022-12-21T03:11:48.095+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:48.095+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=361us
2022-12-21T03:11:48.095+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2022-12-21T03:11:48.095+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2022-12-21T03:11:48.095+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022-12-21T03:11:48.095+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:48.095+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=372us
2022-12-21T03:11:48.096+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster.  Will not rebuild lost replica.
2022-12-21T03:11:48.096+05:30 [Warn] 
MemoryQuota: 200
CpuQuota: 8
--- Violations for index  (mem 130, cpu 0) at node 127.0.0.1:9003 
	Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
	Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2022-12-21T03:11:48.096+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-12-21T03:11:48.096+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0 is less than threshold: 0. No nodes have been added or deleted and there are no violations observed
2022-12-21T03:11:48.096+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Minimum memory test 5: replica repair with min memory < quota
2022-12-21T03:11:48.096+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2022-12-21T03:11:48.096+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2022-12-21T03:11:48.096+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2022-12-21T03:11:48.120+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Minimum memory test 6: rebalance with min memory > quota
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=6us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=5us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=14us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=4us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=3us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=4us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7.  Elapsed Time=4us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8.  Elapsed Time=3us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9.  Elapsed Time=3us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10.  Elapsed Time=4us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11.  Elapsed Time=13us
2022-12-21T03:11:48.120+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12.  Elapsed Time=3us
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Minimum memory test 7: rebalance-out with min memory > quota
2022-12-21T03:11:48.121+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=4us
2022-12-21T03:11:48.121+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=5us
2022-12-21T03:11:48.121+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=3us
2022-12-21T03:11:48.121+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=3us
2022-12-21T03:11:48.121+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=4us
2022-12-21T03:11:48.121+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=3us
2022-12-21T03:11:48.121+05:30 [Warn] Unable to find a solution with resource constraint.  Relax resource constraint check.
2022-12-21T03:11:48.121+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2022-12-21T03:11:48.121+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2022-12-21T03:11:48.122+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Minimum memory test 8: plan with min memory > quota
2022-12-21T03:11:48.125+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2022-12-21T03:11:48.125+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022-12-21T03:11:48.125+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:48.125+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=940us
2022-12-21T03:11:48.125+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=5us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=4us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Warn] Unable to find a solution with resource constraint.  Relax resource constraint check.
2022-12-21T03:11:48.126+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2022-12-21T03:11:48.126+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Minimum memory test 9: single node rebalance with min memory > quota
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=4us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=4us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=4us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8.  Elapsed Time=6us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10.  Elapsed Time=4us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11.  Elapsed Time=3us
2022-12-21T03:11:48.126+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12.  Elapsed Time=3us
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Minimum memory test 10: plan with partitioned index on empty cluster
2022-12-21T03:11:48.129+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.7071067811865476
2022-12-21T03:11:48.171+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 iterationTest :: Remove one node - failure
2022-12-21T03:11:48.172+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.39554623419712864
2022-12-21T03:11:48.259+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:48.259+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.259+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.259+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.259+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.259+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12436231534114074).
2022-12-21T03:11:48.260+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=494us
2022-12-21T03:11:48.260+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.260+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.260+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.260+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.260+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13489889872778404).
2022-12-21T03:11:48.260+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=458us
2022-12-21T03:11:48.260+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.260+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.260+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.260+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.260+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.18164735112261915).
2022-12-21T03:11:48.261+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=443us
2022-12-21T03:11:48.261+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.261+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.261+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.261+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.261+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.18440711716377786).
2022-12-21T03:11:48.261+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=404us
2022-12-21T03:11:48.261+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.261+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.261+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.261+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.261+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13928184867829943).
2022-12-21T03:11:48.262+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=558us
2022-12-21T03:11:48.262+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.262+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.262+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.262+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.262+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.11686047735167905).
2022-12-21T03:11:48.262+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=545us
2022-12-21T03:11:48.262+05:30 [Warn] Unable to find a solution with resource constraint.  Relax resource constraint check.
2022-12-21T03:11:48.262+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.262+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.263+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.263+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.263+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.0937858479510491).
2022-12-21T03:11:48.263+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7.  Elapsed Time=582us
2022-12-21T03:11:48.263+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.263+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.263+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.263+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.263+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.18335305367566082).
2022-12-21T03:11:48.264+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8.  Elapsed Time=597us
2022-12-21T03:11:48.264+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.264+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.264+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.264+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.264+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1596781209330739).
2022-12-21T03:11:48.264+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9.  Elapsed Time=539us
2022-12-21T03:11:48.264+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.264+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.264+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.265+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.265+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.10288084069261366).
2022-12-21T03:11:48.265+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10.  Elapsed Time=560us
2022-12-21T03:11:48.265+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.265+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.265+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.265+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.265+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13375155083390172).
2022-12-21T03:11:48.265+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11.  Elapsed Time=573us
2022-12-21T03:11:48.265+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007988684004510513
2022-12-21T03:11:48.266+05:30 [Info] Planner::initial temperature: initial resource variation 0.007988684004510513 temp 0.03420113159954895
2022-12-21T03:11:48.266+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.266+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-12-21T03:11:48.266+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.15881784238211263).
2022-12-21T03:11:48.266+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12.  Elapsed Time=548us
2022-12-21T03:11:48.266+05:30 [Error] 
MemoryQuota: 5302940000000
CpuQuota: 6
--- Violations for index <12953992023739990690, bucket1, , > (mem 20.3576G, cpu 4.95948) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
--- Violations for index <8259138596394683103, bucket1, , > (mem 17.3577G, cpu 3.44668) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
--- Violations for index <4650572084464009871, bucket1, , > (mem 17.292G, cpu 2.50828) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
--- Violations for index <7602448731665941086, bucket1, , > (mem 12.6302G, cpu 4.75596) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
--- Violations for index <14975312999003158596, bucket1, , > (mem 9.61044G, cpu 3.19672) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
--- Violations for index <15313593841335807999, bucket1, , > (mem 15.1966G, cpu 2.03632) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
--- Violations for index <429633656927302716, bucket1, , > (mem 13.4556G, cpu 3.36076) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
--- Violations for index <10438044929893803071, bucket1, , > (mem 12.8491G, cpu 3.509) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
--- Violations for index <3975778150165266578, bucket1, , > (mem 10.5743G, cpu 2.6006799999999997) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.66403T, free cpu -25.696720000000003)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64106T, free cpu -34.21604)
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 iterationTest :: Remove one node - success
2022-12-21T03:11:48.267+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5474861730888005
2022-12-21T03:11:48.372+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:48.372+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01928091259066918
2022-12-21T03:11:48.372+05:30 [Info] Planner::initial temperature: initial resource variation 0.01928091259066918 temp 0.02307190874093308
2022-12-21T03:11:48.373+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-12-21T03:11:48.373+05:30 [Info] Planner::Finished planner run after 11 iterations.
2022-12-21T03:11:48.373+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.09366640894116834).
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 iterationTest :: Index rebuild - success
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i5,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i10,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i13,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i15,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i18,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i22,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i0,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i28,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i2,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i4,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i8,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i11,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i24,1)
2022-12-21T03:11:48.376+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i26,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i27,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i1,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i3,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i6,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i12,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i14,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i20,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i23,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i29,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i7,1)
2022-12-21T03:11:48.377+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i9,1)
2022-12-21T03:11:48.378+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i16,1)
2022-12-21T03:11:48.378+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i17,1)
2022-12-21T03:11:48.378+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i19,1)
2022-12-21T03:11:48.378+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i21,1)
2022-12-21T03:11:48.378+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i25,1)
2022-12-21T03:11:48.378+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5849976258261415
2022-12-21T03:11:48.378+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0.5849976258261415 is less than threshold: 0.8. No nodes have been added or deleted and there are no violations observed
2022-12-21T03:11:48.379+05:30 [Info] Planner::initial temperature: initial resource variation 0.5849976258261415 temp 0.02150023741738586
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 iterationTest :: Index rebuild - initial placement - success
2022-12-21T03:11:48.379+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1)
2022-12-21T03:11:48.379+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1)
2022-12-21T03:11:48.379+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1)
2022-12-21T03:11:48.380+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6236095644623236
2022-12-21T03:11:48.380+05:30 [Info] Planner::initial temperature: initial resource variation 0.6236095644623236 temp 0.03663904355376764
2022-12-21T03:11:48.380+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2022-12-21T03:11:48.380+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:48.380+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.6236095644623236).
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 iterationTest :: Index rebuild - initial placement - numReplica > numSG - success
2022-12-21T03:11:48.380+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1)
2022-12-21T03:11:48.380+05:30 [Info] Rebuilding lost replica for (default,,,idx1,2)
2022-12-21T03:11:48.380+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1)
2022-12-21T03:11:48.380+05:30 [Info] Rebuilding lost replica for (default,,,idx2,2)
2022-12-21T03:11:48.381+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1)
2022-12-21T03:11:48.381+05:30 [Info] Rebuilding lost replica for (default,,,idx3,2)
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2022-12-21T03:11:48.381+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3333333333333333
2022-12-21T03:11:48.381+05:30 [Info] Planner::initial temperature: initial resource variation 0.3333333333333333 temp 0.06566666666666668
2022-12-21T03:11:48.381+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2022-12-21T03:11:48.381+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-12-21T03:11:48.381+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.3333333333333333).
--- PASS: TestPlanner (7.81s)
=== RUN   TestGreedyPlanner
2022/12/21 03:11:48 In TestGreedyPlanner()
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Single Index Instance - 3 empty nodes - 1 SG
2022-12-21T03:11:48.385+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Single Index Instance - 2 empty nodes, 1 non-empty node - 1 SG
2022-12-21T03:11:48.387+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Single Index Instance - 1 empty node, 2 non-empty nodes - 1 SG
2022-12-21T03:11:48.389+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Single Index Instance - 3 non-empty nodes - 1 SG
2022-12-21T03:11:48.391+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 1 Replica - 3 empty nodes - 1 SG
2022-12-21T03:11:48.394+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 1 SG
2022-12-21T03:11:48.396+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 1 SG
2022-12-21T03:11:48.399+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 1 Replica - 3 non-empty nodes - 1 SG
2022-12-21T03:11:48.404+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 2 Replica - 3 empty nodes - 1 SG
2022-12-21T03:11:48.407+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 2 Replica - 3 non-empty nodes - 1 SG
2022-12-21T03:11:48.410+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 2 SG
2022-12-21T03:11:48.413+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 2 SG
2022-12-21T03:11:48.416+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Index With 1 Replica - 3 non-empty nodes - 2 SG
2022-12-21T03:11:48.419+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Equivalent Index Without any replica - 3 non-empty nodes - 1 SG
2022-12-21T03:11:48.422+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Skip least loaded node
2022-12-21T03:11:48.425+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Use least loaded node
2022-12-21T03:11:48.428+05:30 [Info] Using greedy index placement for index 987654
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place 60 index instaces on 3 empty nodes - 1 SG
2022-12-21T03:11:48.430+05:30 [Info] Using greedy index placement for index 1000987654
2022-12-21T03:11:48.432+05:30 [Info] Using greedy index placement for index 1001987654
2022-12-21T03:11:48.434+05:30 [Info] Using greedy index placement for index 1002987654
2022-12-21T03:11:48.436+05:30 [Info] Using greedy index placement for index 1003987654
2022-12-21T03:11:48.438+05:30 [Info] Using greedy index placement for index 1004987654
2022-12-21T03:11:48.440+05:30 [Info] Using greedy index placement for index 1005987654
2022-12-21T03:11:48.442+05:30 [Info] Using greedy index placement for index 1006987654
2022-12-21T03:11:48.445+05:30 [Info] Using greedy index placement for index 1007987654
2022-12-21T03:11:48.447+05:30 [Info] Using greedy index placement for index 1008987654
2022-12-21T03:11:48.449+05:30 [Info] Using greedy index placement for index 1009987654
2022-12-21T03:11:48.451+05:30 [Info] Using greedy index placement for index 1010987654
2022-12-21T03:11:48.453+05:30 [Info] Using greedy index placement for index 1011987654
2022-12-21T03:11:48.455+05:30 [Info] Using greedy index placement for index 1012987654
2022-12-21T03:11:48.472+05:30 [Info] Using greedy index placement for index 1013987654
2022-12-21T03:11:48.505+05:30 [Info] Using greedy index placement for index 1014987654
2022-12-21T03:11:48.562+05:30 [Info] Using greedy index placement for index 1015987654
2022-12-21T03:11:48.588+05:30 [Info] Using greedy index placement for index 1016987654
2022-12-21T03:11:48.592+05:30 [Info] Using greedy index placement for index 1017987654
2022-12-21T03:11:48.595+05:30 [Info] Using greedy index placement for index 1018987654
2022-12-21T03:11:48.598+05:30 [Info] Using greedy index placement for index 1019987654
2022-12-21T03:11:48.601+05:30 [Info] Using greedy index placement for index 1020987654
2022-12-21T03:11:48.609+05:30 [Info] Using greedy index placement for index 1021987654
2022-12-21T03:11:48.648+05:30 [Info] Using greedy index placement for index 1022987654
2022-12-21T03:11:48.652+05:30 [Info] Using greedy index placement for index 1023987654
2022-12-21T03:11:48.704+05:30 [Info] Using greedy index placement for index 1024987654
2022-12-21T03:11:48.707+05:30 [Info] Using greedy index placement for index 1025987654
2022-12-21T03:11:48.715+05:30 [Info] Using greedy index placement for index 1026987654
2022-12-21T03:11:48.737+05:30 [Info] Using greedy index placement for index 1027987654
2022-12-21T03:11:48.792+05:30 [Info] Using greedy index placement for index 1028987654
2022-12-21T03:11:48.823+05:30 [Info] Using greedy index placement for index 1029987654
2022-12-21T03:11:48.829+05:30 [Info] Using greedy index placement for index 1030987654
2022-12-21T03:11:48.833+05:30 [Info] Using greedy index placement for index 1031987654
2022-12-21T03:11:48.836+05:30 [Info] Using greedy index placement for index 1032987654
2022-12-21T03:11:48.839+05:30 [Info] Using greedy index placement for index 1033987654
2022-12-21T03:11:48.844+05:30 [Info] Using greedy index placement for index 1034987654
2022-12-21T03:11:48.846+05:30 [Info] Using greedy index placement for index 1035987654
2022-12-21T03:11:48.848+05:30 [Info] Using greedy index placement for index 1036987654
2022-12-21T03:11:48.851+05:30 [Info] Using greedy index placement for index 1037987654
2022-12-21T03:11:48.854+05:30 [Info] Using greedy index placement for index 1038987654
2022-12-21T03:11:48.856+05:30 [Info] Using greedy index placement for index 1039987654
2022-12-21T03:11:48.858+05:30 [Info] Using greedy index placement for index 1040987654
2022-12-21T03:11:48.860+05:30 [Info] Using greedy index placement for index 1041987654
2022-12-21T03:11:48.862+05:30 [Info] Using greedy index placement for index 1042987654
2022-12-21T03:11:48.865+05:30 [Info] Using greedy index placement for index 1043987654
2022-12-21T03:11:48.867+05:30 [Info] Using greedy index placement for index 1044987654
2022-12-21T03:11:48.869+05:30 [Info] Using greedy index placement for index 1045987654
2022-12-21T03:11:48.871+05:30 [Info] Using greedy index placement for index 1046987654
2022-12-21T03:11:48.873+05:30 [Info] Using greedy index placement for index 1047987654
2022-12-21T03:11:48.875+05:30 [Info] Using greedy index placement for index 1048987654
2022-12-21T03:11:48.876+05:30 [Info] Using greedy index placement for index 1049987654
2022-12-21T03:11:48.878+05:30 [Info] Using greedy index placement for index 1050987654
2022-12-21T03:11:48.880+05:30 [Info] Using greedy index placement for index 1051987654
2022-12-21T03:11:48.882+05:30 [Info] Using greedy index placement for index 1052987654
2022-12-21T03:11:48.885+05:30 [Info] Using greedy index placement for index 1053987654
2022-12-21T03:11:48.886+05:30 [Info] Using greedy index placement for index 1054987654
2022-12-21T03:11:48.888+05:30 [Info] Using greedy index placement for index 1055987654
2022-12-21T03:11:48.890+05:30 [Info] Using greedy index placement for index 1056987654
2022-12-21T03:11:48.892+05:30 [Info] Using greedy index placement for index 1057987654
2022-12-21T03:11:48.895+05:30 [Info] Using greedy index placement for index 1058987654
2022-12-21T03:11:48.901+05:30 [Info] Using greedy index placement for index 1059987654
2022-12-21T03:11:48.901+05:30 [Info] Actual variance of deferred index count across nodes is 0
2022/12/21 03:11:48 -------------------------------------------
2022/12/21 03:11:48 Place 60 index instaces on 1 empty and 1 10 percent filled node - 1 SG
2022-12-21T03:11:48.903+05:30 [Info] Using greedy index placement for index 1000987654
2022-12-21T03:11:48.905+05:30 [Info] Using greedy index placement for index 1001987654
2022-12-21T03:11:48.907+05:30 [Info] Using greedy index placement for index 1002987654
2022-12-21T03:11:48.912+05:30 [Info] Using greedy index placement for index 1003987654
2022-12-21T03:11:48.914+05:30 [Info] Using greedy index placement for index 1004987654
2022-12-21T03:11:48.916+05:30 [Info] Using greedy index placement for index 1005987654
2022-12-21T03:11:48.918+05:30 [Info] Using greedy index placement for index 1006987654
2022-12-21T03:11:48.920+05:30 [Info] Using greedy index placement for index 1007987654
2022-12-21T03:11:48.922+05:30 [Info] Using greedy index placement for index 1008987654
2022-12-21T03:11:48.925+05:30 [Info] Using greedy index placement for index 1009987654
2022-12-21T03:11:48.926+05:30 [Info] Using greedy index placement for index 1010987654
2022-12-21T03:11:48.928+05:30 [Info] Using greedy index placement for index 1011987654
2022-12-21T03:11:48.930+05:30 [Info] Using greedy index placement for index 1012987654
2022-12-21T03:11:48.932+05:30 [Info] Using greedy index placement for index 1013987654
2022-12-21T03:11:48.934+05:30 [Info] Using greedy index placement for index 1014987654
2022-12-21T03:11:48.936+05:30 [Info] Using greedy index placement for index 1015987654
2022-12-21T03:11:48.938+05:30 [Info] Using greedy index placement for index 1016987654
2022-12-21T03:11:48.939+05:30 [Info] Using greedy index placement for index 1017987654
2022-12-21T03:11:48.941+05:30 [Info] Using greedy index placement for index 1018987654
2022-12-21T03:11:48.943+05:30 [Info] Using greedy index placement for index 1019987654
2022-12-21T03:11:48.945+05:30 [Info] Using greedy index placement for index 1020987654
2022-12-21T03:11:48.947+05:30 [Info] Using greedy index placement for index 1021987654
2022-12-21T03:11:48.949+05:30 [Info] Using greedy index placement for index 1022987654
2022-12-21T03:11:48.950+05:30 [Info] Using greedy index placement for index 1023987654
2022-12-21T03:11:48.953+05:30 [Info] Using greedy index placement for index 1024987654
2022-12-21T03:11:48.954+05:30 [Info] Using greedy index placement for index 1025987654
2022-12-21T03:11:48.956+05:30 [Info] Using greedy index placement for index 1026987654
2022-12-21T03:11:48.958+05:30 [Info] Using greedy index placement for index 1027987654
2022-12-21T03:11:48.960+05:30 [Info] Using greedy index placement for index 1028987654
2022-12-21T03:11:48.962+05:30 [Info] Using greedy index placement for index 1029987654
2022-12-21T03:11:48.964+05:30 [Info] Using greedy index placement for index 1030987654
2022-12-21T03:11:48.965+05:30 [Info] Using greedy index placement for index 1031987654
2022-12-21T03:11:48.967+05:30 [Info] Using greedy index placement for index 1032987654
2022-12-21T03:11:48.969+05:30 [Info] Using greedy index placement for index 1033987654
2022-12-21T03:11:48.971+05:30 [Info] Using greedy index placement for index 1034987654
2022-12-21T03:11:48.972+05:30 [Info] Using greedy index placement for index 1035987654
2022-12-21T03:11:48.974+05:30 [Info] Using greedy index placement for index 1036987654
2022-12-21T03:11:48.976+05:30 [Info] Using greedy index placement for index 1037987654
2022-12-21T03:11:48.978+05:30 [Info] Using greedy index placement for index 1038987654
2022-12-21T03:11:48.979+05:30 [Info] Using greedy index placement for index 1039987654
2022-12-21T03:11:48.981+05:30 [Info] Using greedy index placement for index 1040987654
2022-12-21T03:11:48.983+05:30 [Info] Using greedy index placement for index 1041987654
2022-12-21T03:11:48.985+05:30 [Info] Using greedy index placement for index 1042987654
2022-12-21T03:11:48.987+05:30 [Info] Using greedy index placement for index 1043987654
2022-12-21T03:11:48.989+05:30 [Info] Using greedy index placement for index 1044987654
2022-12-21T03:11:48.990+05:30 [Info] Using greedy index placement for index 1045987654
2022-12-21T03:11:48.992+05:30 [Info] Using greedy index placement for index 1046987654
2022-12-21T03:11:48.994+05:30 [Info] Using greedy index placement for index 1047987654
2022-12-21T03:11:48.996+05:30 [Info] Using greedy index placement for index 1048987654
2022-12-21T03:11:48.998+05:30 [Info] Using greedy index placement for index 1049987654
2022-12-21T03:11:49.000+05:30 [Info] Using greedy index placement for index 1050987654
2022-12-21T03:11:49.002+05:30 [Info] Using greedy index placement for index 1051987654
2022-12-21T03:11:49.004+05:30 [Info] Using greedy index placement for index 1052987654
2022-12-21T03:11:49.006+05:30 [Info] Using greedy index placement for index 1053987654
2022-12-21T03:11:49.008+05:30 [Info] Using greedy index placement for index 1054987654
2022-12-21T03:11:49.009+05:30 [Info] Using greedy index placement for index 1055987654
2022-12-21T03:11:49.011+05:30 [Info] Using greedy index placement for index 1056987654
2022-12-21T03:11:49.013+05:30 [Info] Using greedy index placement for index 1057987654
2022-12-21T03:11:49.015+05:30 [Info] Using greedy index placement for index 1058987654
2022-12-21T03:11:49.017+05:30 [Info] Using greedy index placement for index 1059987654
2022-12-21T03:11:49.018+05:30 [Info] Actual variance of deferred index count across nodes is 8
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place 60 index instaces on 1 empty and 1 30 percent filled node - 1 SG
2022-12-21T03:11:49.020+05:30 [Info] Using greedy index placement for index 1000987654
2022-12-21T03:11:49.022+05:30 [Info] Using greedy index placement for index 1001987654
2022-12-21T03:11:49.023+05:30 [Info] Using greedy index placement for index 1002987654
2022-12-21T03:11:49.025+05:30 [Info] Using greedy index placement for index 1003987654
2022-12-21T03:11:49.027+05:30 [Info] Using greedy index placement for index 1004987654
2022-12-21T03:11:49.029+05:30 [Info] Using greedy index placement for index 1005987654
2022-12-21T03:11:49.031+05:30 [Info] Using greedy index placement for index 1006987654
2022-12-21T03:11:49.033+05:30 [Info] Using greedy index placement for index 1007987654
2022-12-21T03:11:49.034+05:30 [Info] Using greedy index placement for index 1008987654
2022-12-21T03:11:49.036+05:30 [Info] Using greedy index placement for index 1009987654
2022-12-21T03:11:49.038+05:30 [Info] Using greedy index placement for index 1010987654
2022-12-21T03:11:49.039+05:30 [Info] Using greedy index placement for index 1011987654
2022-12-21T03:11:49.041+05:30 [Info] Using greedy index placement for index 1012987654
2022-12-21T03:11:49.043+05:30 [Info] Using greedy index placement for index 1013987654
2022-12-21T03:11:49.045+05:30 [Info] Using greedy index placement for index 1014987654
2022-12-21T03:11:49.046+05:30 [Info] Using greedy index placement for index 1015987654
2022-12-21T03:11:49.048+05:30 [Info] Using greedy index placement for index 1016987654
2022-12-21T03:11:49.050+05:30 [Info] Using greedy index placement for index 1017987654
2022-12-21T03:11:49.052+05:30 [Info] Using greedy index placement for index 1018987654
2022-12-21T03:11:49.053+05:30 [Info] Using greedy index placement for index 1019987654
2022-12-21T03:11:49.055+05:30 [Info] Using greedy index placement for index 1020987654
2022-12-21T03:11:49.057+05:30 [Info] Using greedy index placement for index 1021987654
2022-12-21T03:11:49.059+05:30 [Info] Using greedy index placement for index 1022987654
2022-12-21T03:11:49.060+05:30 [Info] Using greedy index placement for index 1023987654
2022-12-21T03:11:49.062+05:30 [Info] Using greedy index placement for index 1024987654
2022-12-21T03:11:49.064+05:30 [Info] Using greedy index placement for index 1025987654
2022-12-21T03:11:49.065+05:30 [Info] Using greedy index placement for index 1026987654
2022-12-21T03:11:49.067+05:30 [Info] Using greedy index placement for index 1027987654
2022-12-21T03:11:49.069+05:30 [Info] Using greedy index placement for index 1028987654
2022-12-21T03:11:49.071+05:30 [Info] Using greedy index placement for index 1029987654
2022-12-21T03:11:49.072+05:30 [Info] Using greedy index placement for index 1030987654
2022-12-21T03:11:49.074+05:30 [Info] Using greedy index placement for index 1031987654
2022-12-21T03:11:49.076+05:30 [Info] Using greedy index placement for index 1032987654
2022-12-21T03:11:49.078+05:30 [Info] Using greedy index placement for index 1033987654
2022-12-21T03:11:49.079+05:30 [Info] Using greedy index placement for index 1034987654
2022-12-21T03:11:49.081+05:30 [Info] Using greedy index placement for index 1035987654
2022-12-21T03:11:49.083+05:30 [Info] Using greedy index placement for index 1036987654
2022-12-21T03:11:49.085+05:30 [Info] Using greedy index placement for index 1037987654
2022-12-21T03:11:49.086+05:30 [Info] Using greedy index placement for index 1038987654
2022-12-21T03:11:49.088+05:30 [Info] Using greedy index placement for index 1039987654
2022-12-21T03:11:49.090+05:30 [Info] Using greedy index placement for index 1040987654
2022-12-21T03:11:49.092+05:30 [Info] Using greedy index placement for index 1041987654
2022-12-21T03:11:49.094+05:30 [Info] Using greedy index placement for index 1042987654
2022-12-21T03:11:49.096+05:30 [Info] Using greedy index placement for index 1043987654
2022-12-21T03:11:49.097+05:30 [Info] Using greedy index placement for index 1044987654
2022-12-21T03:11:49.099+05:30 [Info] Using greedy index placement for index 1045987654
2022-12-21T03:11:49.101+05:30 [Info] Using greedy index placement for index 1046987654
2022-12-21T03:11:49.103+05:30 [Info] Using greedy index placement for index 1047987654
2022-12-21T03:11:49.105+05:30 [Info] Using greedy index placement for index 1048987654
2022-12-21T03:11:49.107+05:30 [Info] Using greedy index placement for index 1049987654
2022-12-21T03:11:49.109+05:30 [Info] Using greedy index placement for index 1050987654
2022-12-21T03:11:49.111+05:30 [Info] Using greedy index placement for index 1051987654
2022-12-21T03:11:49.113+05:30 [Info] Using greedy index placement for index 1052987654
2022-12-21T03:11:49.114+05:30 [Info] Using greedy index placement for index 1053987654
2022-12-21T03:11:49.116+05:30 [Info] Using greedy index placement for index 1054987654
2022-12-21T03:11:49.118+05:30 [Info] Using greedy index placement for index 1055987654
2022-12-21T03:11:49.120+05:30 [Info] Using greedy index placement for index 1056987654
2022-12-21T03:11:49.122+05:30 [Info] Using greedy index placement for index 1057987654
2022-12-21T03:11:49.124+05:30 [Info] Using greedy index placement for index 1058987654
2022-12-21T03:11:49.126+05:30 [Info] Using greedy index placement for index 1059987654
2022-12-21T03:11:49.126+05:30 [Info] Actual variance of deferred index count across nodes is 98
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place 5 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2022-12-21T03:11:49.129+05:30 [Info] Using greedy index placement for index 1000987654
2022-12-21T03:11:49.130+05:30 [Info] Using greedy index placement for index 1001987654
2022-12-21T03:11:49.132+05:30 [Info] Using greedy index placement for index 1002987654
2022-12-21T03:11:49.134+05:30 [Info] Using greedy index placement for index 1003987654
2022-12-21T03:11:49.135+05:30 [Info] Using greedy index placement for index 1004987654
2022-12-21T03:11:49.136+05:30 [Info] Actual variance of deferred index count across nodes is 4.5
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place 60 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2022-12-21T03:11:49.137+05:30 [Info] Using greedy index placement for index 1000987654
2022-12-21T03:11:49.139+05:30 [Info] Using greedy index placement for index 1001987654
2022-12-21T03:11:49.141+05:30 [Info] Using greedy index placement for index 1002987654
2022-12-21T03:11:49.142+05:30 [Info] Using greedy index placement for index 1003987654
2022-12-21T03:11:49.144+05:30 [Info] Using greedy index placement for index 1004987654
2022-12-21T03:11:49.146+05:30 [Info] Using greedy index placement for index 1005987654
2022-12-21T03:11:49.148+05:30 [Info] Using greedy index placement for index 1006987654
2022-12-21T03:11:49.150+05:30 [Info] Using greedy index placement for index 1007987654
2022-12-21T03:11:49.152+05:30 [Info] Using greedy index placement for index 1008987654
2022-12-21T03:11:49.154+05:30 [Info] Using greedy index placement for index 1009987654
2022-12-21T03:11:49.157+05:30 [Info] Using greedy index placement for index 1010987654
2022-12-21T03:11:49.159+05:30 [Info] Using greedy index placement for index 1011987654
2022-12-21T03:11:49.161+05:30 [Info] Using greedy index placement for index 1012987654
2022-12-21T03:11:49.163+05:30 [Info] Using greedy index placement for index 1013987654
2022-12-21T03:11:49.165+05:30 [Info] Using greedy index placement for index 1014987654
2022-12-21T03:11:49.167+05:30 [Info] Using greedy index placement for index 1015987654
2022-12-21T03:11:49.168+05:30 [Info] Using greedy index placement for index 1016987654
2022-12-21T03:11:49.171+05:30 [Info] Using greedy index placement for index 1017987654
2022-12-21T03:11:49.173+05:30 [Info] Using greedy index placement for index 1018987654
2022-12-21T03:11:49.175+05:30 [Info] Using greedy index placement for index 1019987654
2022-12-21T03:11:49.177+05:30 [Info] Using greedy index placement for index 1020987654
2022-12-21T03:11:49.179+05:30 [Info] Using greedy index placement for index 1021987654
2022-12-21T03:11:49.181+05:30 [Info] Using greedy index placement for index 1022987654
2022-12-21T03:11:49.183+05:30 [Info] Using greedy index placement for index 1023987654
2022-12-21T03:11:49.185+05:30 [Info] Using greedy index placement for index 1024987654
2022-12-21T03:11:49.187+05:30 [Info] Using greedy index placement for index 1025987654
2022-12-21T03:11:49.189+05:30 [Info] Using greedy index placement for index 1026987654
2022-12-21T03:11:49.191+05:30 [Info] Using greedy index placement for index 1027987654
2022-12-21T03:11:49.193+05:30 [Info] Using greedy index placement for index 1028987654
2022-12-21T03:11:49.194+05:30 [Info] Using greedy index placement for index 1029987654
2022-12-21T03:11:49.196+05:30 [Info] Using greedy index placement for index 1030987654
2022-12-21T03:11:49.198+05:30 [Info] Using greedy index placement for index 1031987654
2022-12-21T03:11:49.199+05:30 [Info] Using greedy index placement for index 1032987654
2022-12-21T03:11:49.201+05:30 [Info] Using greedy index placement for index 1033987654
2022-12-21T03:11:49.203+05:30 [Info] Using greedy index placement for index 1034987654
2022-12-21T03:11:49.205+05:30 [Info] Using greedy index placement for index 1035987654
2022-12-21T03:11:49.206+05:30 [Info] Using greedy index placement for index 1036987654
2022-12-21T03:11:49.208+05:30 [Info] Using greedy index placement for index 1037987654
2022-12-21T03:11:49.210+05:30 [Info] Using greedy index placement for index 1038987654
2022-12-21T03:11:49.212+05:30 [Info] Using greedy index placement for index 1039987654
2022-12-21T03:11:49.214+05:30 [Info] Using greedy index placement for index 1040987654
2022-12-21T03:11:49.215+05:30 [Info] Using greedy index placement for index 1041987654
2022-12-21T03:11:49.217+05:30 [Info] Using greedy index placement for index 1042987654
2022-12-21T03:11:49.219+05:30 [Info] Using greedy index placement for index 1043987654
2022-12-21T03:11:49.220+05:30 [Info] Using greedy index placement for index 1044987654
2022-12-21T03:11:49.222+05:30 [Info] Using greedy index placement for index 1045987654
2022-12-21T03:11:49.224+05:30 [Info] Using greedy index placement for index 1046987654
2022-12-21T03:11:49.226+05:30 [Info] Using greedy index placement for index 1047987654
2022-12-21T03:11:49.227+05:30 [Info] Using greedy index placement for index 1048987654
2022-12-21T03:11:49.229+05:30 [Info] Using greedy index placement for index 1049987654
2022-12-21T03:11:49.231+05:30 [Info] Using greedy index placement for index 1050987654
2022-12-21T03:11:49.233+05:30 [Info] Using greedy index placement for index 1051987654
2022-12-21T03:11:49.235+05:30 [Info] Using greedy index placement for index 1052987654
2022-12-21T03:11:49.237+05:30 [Info] Using greedy index placement for index 1053987654
2022-12-21T03:11:49.239+05:30 [Info] Using greedy index placement for index 1054987654
2022-12-21T03:11:49.241+05:30 [Info] Using greedy index placement for index 1055987654
2022-12-21T03:11:49.243+05:30 [Info] Using greedy index placement for index 1056987654
2022-12-21T03:11:49.244+05:30 [Info] Using greedy index placement for index 1057987654
2022-12-21T03:11:49.246+05:30 [Info] Using greedy index placement for index 1058987654
2022-12-21T03:11:49.248+05:30 [Info] Using greedy index placement for index 1059987654
2022-12-21T03:11:49.248+05:30 [Info] Actual variance of deferred index count across nodes is 648
--- PASS: TestGreedyPlanner (0.87s)
=== RUN   TestTenantAwarePlanner
2022/12/21 03:11:49 In TestTenantAwarePlanner()
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 1 empty node - 1 SG
2022-12-21T03:11:49.249+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001]]
2022-12-21T03:11:49.249+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2022-12-21T03:11:49.249+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 4 empty nodes - 2 SG
2022-12-21T03:11:49.251+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9003 127.0.0.1:9002]]
2022-12-21T03:11:49.251+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2022-12-21T03:11:49.251+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9002]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 1 node - 1 SG
2022-12-21T03:11:49.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.253+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001]]
2022-12-21T03:11:49.253+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2022-12-21T03:11:49.253+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 2 nodes - 1 SG
2022-12-21T03:11:49.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.255+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001] [127.0.0.1:9002]]
2022-12-21T03:11:49.255+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2022-12-21T03:11:49.255+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(a)
2022-12-21T03:11:49.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.257+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9004 127.0.0.1:9003]]
2022-12-21T03:11:49.257+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9002]
2022-12-21T03:11:49.257+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(b)
2022-12-21T03:11:49.259+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.259+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000
2022-12-21T03:11:49.259+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9002]]
2022-12-21T03:11:49.259+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.259+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(c)
2022-12-21T03:11:49.261+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.261+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.261+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.261+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000
2022-12-21T03:11:49.261+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2022-12-21T03:11:49.262+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.262+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Memory Above LWM
2022-12-21T03:11:49.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000
2022-12-21T03:11:49.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000
2022-12-21T03:11:49.264+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.264+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.264+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Units Above LWM
2022-12-21T03:11:49.266+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.266+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5000
2022-12-21T03:11:49.266+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.266+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5000
2022-12-21T03:11:49.266+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.266+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.266+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(a)
2022-12-21T03:11:49.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000
2022-12-21T03:11:49.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000
2022-12-21T03:11:49.268+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.268+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2022-12-21T03:11:49.268+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(b)
2022-12-21T03:11:49.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000
2022-12-21T03:11:49.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000
2022-12-21T03:11:49.270+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.270+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2022-12-21T03:11:49.270+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 2 empty nodes - 1 SG
2022-12-21T03:11:49.272+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001] [127.0.0.1:9002]]
2022-12-21T03:11:49.272+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2022-12-21T03:11:49.272+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9002]
2022-12-21T03:11:49.272+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9001]
2022-12-21T03:11:49.272+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1   987654 false [name1]  false false false false 0  0 [] 2 []   false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2022/12/21 03:11:49 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Memory HWM
2022-12-21T03:11:49.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000
2022-12-21T03:11:49.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 900000000 Units 1000
2022-12-21T03:11:49.273+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2022-12-21T03:11:49.273+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.273+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1   987654 false [name1]  false false false false 0  0 [] 2 []   false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2022/12/21 03:11:49 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Units HWM
2022-12-21T03:11:49.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 8000
2022-12-21T03:11:49.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 8000
2022-12-21T03:11:49.273+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2022-12-21T03:11:49.273+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.273+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1   987654 false [name1]  false false false false 0  0 [] 2 []   false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2022/12/21 03:11:49 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Memory Above LWM
2022-12-21T03:11:49.274+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 680000000 Units 1000
2022-12-21T03:11:49.274+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000
2022-12-21T03:11:49.274+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 680000000 Units 1000
2022-12-21T03:11:49.274+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000
2022-12-21T03:11:49.274+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.274+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2022-12-21T03:11:49.274+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7   987654 false [name1]  false false false false 0  0 [] 2 []   false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2022/12/21 03:11:49 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2022-12-21T03:11:49.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000
2022-12-21T03:11:49.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500
2022-12-21T03:11:49.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000
2022-12-21T03:11:49.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500
2022-12-21T03:11:49.275+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.275+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2022-12-21T03:11:49.275+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7   987654 false [name1]  false false false false 0  0 [] 2 []   false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2022/12/21 03:11:49 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 3 SG, 1 empty, 1 Memory Above HWM
2022-12-21T03:11:49.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2022-12-21T03:11:49.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 1000
2022-12-21T03:11:49.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 1000
2022-12-21T03:11:49.276+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.276+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.276+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.276+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500 
2022-12-21T03:11:49.276+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.276+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 3 SG, 1 empty, 1 Units Above HWM
2022-12-21T03:11:49.277+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 8000
2022-12-21T03:11:49.277+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 400000000 Units 1000
2022-12-21T03:11:49.277+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 8000
2022-12-21T03:11:49.277+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 400000000 Units 1000
2022-12-21T03:11:49.277+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.277+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.277+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.277+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000 
2022-12-21T03:11:49.277+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.277+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 3 SG, 1 empty, Both Memory/Units Above HWM
2022-12-21T03:11:49.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2022-12-21T03:11:49.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2022-12-21T03:11:49.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000
2022-12-21T03:11:49.278+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.278+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.278+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 
2022-12-21T03:11:49.278+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 3 SG, Multiple tenants to move, single source, multiple destination
2022-12-21T03:11:49.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2022-12-21T03:11:49.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2022-12-21T03:11:49.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2022-12-21T03:11:49.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2022-12-21T03:11:49.279+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.279+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.279+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.279+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000 
2022-12-21T03:11:49.279+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000 
2022-12-21T03:11:49.279+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.279+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.279+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 3 SG, Multiple tenants to move, no nodes below LWM
2022-12-21T03:11:49.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000
2022-12-21T03:11:49.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000
2022-12-21T03:11:49.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 700000000 Units 3000
2022-12-21T03:11:49.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000
2022-12-21T03:11:49.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000
2022-12-21T03:11:49.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 700000000 Units 3000
2022-12-21T03:11:49.280+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.280+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.280+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.280+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500 
2022-12-21T03:11:49.280+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500 
2022-12-21T03:11:49.280+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2022-12-21T03:11:49.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200 
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500 
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500 
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700 
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000 
2022-12-21T03:11:49.281+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.281+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.281+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.281+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.281+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.281+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.281+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.281+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.281+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2022-12-21T03:11:49.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 
2022-12-21T03:11:49.283+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.283+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.283+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.283+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.283+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.283+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.283+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.283+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.283+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 3 SG, Single Large Tenant, Nothing to move
2022-12-21T03:11:49.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000
2022-12-21T03:11:49.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 2000
2022-12-21T03:11:49.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 1000
2022-12-21T03:11:49.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 2000
2022-12-21T03:11:49.284+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.284+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.284+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.284+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000 
2022-12-21T03:11:49.284+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.284+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(zero usage tenants)
2022-12-21T03:11:49.285+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.285+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.285+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 3 SG, 1 Partial Subcluster
2022-12-21T03:11:49.288+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2022-12-21T03:11:49.288+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000
2022-12-21T03:11:49.288+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.288+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000
2022-12-21T03:11:49.288+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003]]
2022-12-21T03:11:49.288+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.288+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.288+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.288+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500 
2022-12-21T03:11:49.288+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500 
2022-12-21T03:11:49.288+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9003]
2022-12-21T03:11:49.289+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.289+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500  can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.289+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500  can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Replica Repair - 4 SG, Missing Replicas for multiple tenants in SG
2022-12-21T03:11:49.290+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2022-12-21T03:11:49.290+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.290+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.290+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.290+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.290+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.290+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.290+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2022-12-21T03:11:49.290+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2022-12-21T03:11:49.290+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2022-12-21T03:11:49.290+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2022-12-21T03:11:49.290+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over
2022-12-21T03:11:49.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2022-12-21T03:11:49.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.291+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2022-12-21T03:11:49.291+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9004
2022-12-21T03:11:49.291+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2022-12-21T03:11:49.291+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9004
2022-12-21T03:11:49.291+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2022-12-21T03:11:49.291+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2022-12-21T03:11:49.291+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.291+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over, No replacement
2022-12-21T03:11:49.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2022-12-21T03:11:49.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.292+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2022-12-21T03:11:49.292+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9001] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.292+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Replica Repair - 4 SG, Missing Replicas, one replica missing with pendingDelete true 
2022-12-21T03:11:49.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2022-12-21T03:11:49.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.293+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.293+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2022-12-21T03:11:49.293+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2022-12-21T03:11:49.293+05:30 [Info] Planner::findMissingReplicaForIndexerNode Skipping Replica Repair for 88883:81813:0. PendingDelete true
2022-12-21T03:11:49.293+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx2,1) on 127.0.0.1:9005
2022-12-21T03:11:49.293+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Replica Repair - 2 SG, Missing Replicas with Nodes over HWM
2022-12-21T03:11:49.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 7000
2022-12-21T03:11:49.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 500
2022-12-21T03:11:49.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 7000
2022-12-21T03:11:49.295+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.295+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket9,,,idx2,1) on 127.0.0.1:9005
2022-12-21T03:11:49.295+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.295+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.295+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 
2022-12-21T03:11:49.295+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700 
2022-12-21T03:11:49.295+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 
2022-12-21T03:11:49.295+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000 
2022-12-21T03:11:49.295+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.295+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.295+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.295+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.295+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes
2022-12-21T03:11:49.296+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9004]
2022-12-21T03:11:49.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9004]
2022-12-21T03:11:49.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9001]
2022-12-21T03:11:49.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006 127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9008 127.0.0.1:9006 127.0.0.1:9007]
2022-12-21T03:11:49.296+05:30 [Info] Moving index 7777:7171:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2022-12-21T03:11:49.296+05:30 [Info] Moving index 8888:8181:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2022-12-21T03:11:49.297+05:30 [Info] Moving index 9999:9191:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2022-12-21T03:11:49.297+05:30 [Info] Moving index 101010:101101:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2022-12-21T03:11:49.297+05:30 [Info] Moving index 111111:112112:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2022-12-21T03:11:49.297+05:30 [Info] Moving index 121212:121121:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2022-12-21T03:11:49.297+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.297+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.297+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.297+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.297+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.297+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.297+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2022-12-21T03:11:49.297+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2022-12-21T03:11:49.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000
2022-12-21T03:11:49.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 1100000000 Units 8100
2022-12-21T03:11:49.297+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9008] [127.0.0.1:9003 127.0.0.1:9005] [127.0.0.1:9006] [127.0.0.1:9007]]
2022-12-21T03:11:49.297+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9006] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.297+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.297+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes(different SG)
2022-12-21T03:11:49.298+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004 127.0.0.1:9005]
2022-12-21T03:11:49.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004 127.0.0.1:9005]
2022-12-21T03:11:49.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2022-12-21T03:11:49.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.298+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.298+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.298+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.298+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.298+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.298+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.298+05:30 [Info] Moving index 7777:17171:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2022-12-21T03:11:49.298+05:30 [Info] Moving index 8888:18181:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2022-12-21T03:11:49.298+05:30 [Info] Moving index 9999:19191:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2022-12-21T03:11:49.298+05:30 [Info] Moving index 101010:1101101:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2022-12-21T03:11:49.298+05:30 [Info] Moving index 111111:1112112:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2022-12-21T03:11:49.298+05:30 [Info] Moving index 121212:1121121:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2022-12-21T03:11:49.298+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2022-12-21T03:11:49.298+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2022-12-21T03:11:49.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000
2022-12-21T03:11:49.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000
2022-12-21T03:11:49.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.299+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9003] [127.0.0.1:9007 127.0.0.1:9008]]
2022-12-21T03:11:49.299+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Swap Rebalance - 4 SG, Swap 1 SG with 2 new nodes
2022-12-21T03:11:49.300+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.300+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.300+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2022-12-21T03:11:49.300+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.300+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.300+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2022-12-21T03:11:49.300+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2022-12-21T03:11:49.300+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2022-12-21T03:11:49.300+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2022-12-21T03:11:49.300+05:30 [Info] Moving index 5555:5151:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2022-12-21T03:11:49.300+05:30 [Info] Moving index 6666:6161:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2022-12-21T03:11:49.300+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.300+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.300+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.300+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.300+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.300+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.300+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2022-12-21T03:11:49.300+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2022-12-21T03:11:49.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000
2022-12-21T03:11:49.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.300+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2022-12-21T03:11:49.300+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Swap Rebalance - 4 SG, Swap 1 node with 2 new nodes
2022-12-21T03:11:49.301+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2022-12-21T03:11:49.301+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2022-12-21T03:11:49.301+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2022-12-21T03:11:49.301+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008 127.0.0.1:9006]
2022-12-21T03:11:49.301+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.301+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.301+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.301+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.301+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.301+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.301+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2022-12-21T03:11:49.301+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2022-12-21T03:11:49.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000
2022-12-21T03:11:49.301+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003] [127.0.0.1:9008] [127.0.0.1:9007]]
2022-12-21T03:11:49.301+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.301+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9008] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.301+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.301+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Swap Rebalance - 4 SG, Swap 1 empty node with 2 new nodes
2022-12-21T03:11:49.303+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2022-12-21T03:11:49.303+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2022-12-21T03:11:49.303+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.303+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.303+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.303+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.303+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.303+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.303+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2022-12-21T03:11:49.303+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9006
2022-12-21T03:11:49.303+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9006
2022-12-21T03:11:49.303+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9006
2022-12-21T03:11:49.303+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9006
2022-12-21T03:11:49.303+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9006
2022-12-21T03:11:49.303+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket6,,,idx2,1) on 127.0.0.1:9006
2022-12-21T03:11:49.303+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.303+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Swap Rebalance - 1 SG, Swap 1 node - Failed swap rebalance
2022-12-21T03:11:49.304+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2022-12-21T03:11:49.304+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2022-12-21T03:11:49.304+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2022-12-21T03:11:49.304+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.304+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2022-12-21T03:11:49.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 200000000 Units 100
2022-12-21T03:11:49.304+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9008 as replacement node for deleted node 127.0.0.1:9004.
2022-12-21T03:11:49.304+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.304+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.304+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.304+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.304+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 600000000 Units 4000
2022-12-21T03:11:49.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 500000000 Units 4100
2022-12-21T03:11:49.304+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9008]]
2022-12-21T03:11:49.304+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Swap Rebalance - 1 SG, Swap 2 node - server group mismatch
2022-12-21T03:11:49.305+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9002]
2022-12-21T03:11:49.305+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2022-12-21T03:11:49.305+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9002 127.0.0.1:9001]
2022-12-21T03:11:49.305+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9004]
2022/12/21 03:11:49 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 subcluster, Enough Capacity
2022-12-21T03:11:49.306+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000 
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000 
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2022-12-21T03:11:49.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2022-12-21T03:11:49.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.306+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2022-12-21T03:11:49.306+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.306+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.307+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.307+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.307+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.307+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.307+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.307+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.307+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2022-12-21T03:11:49.307+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2022-12-21T03:11:49.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 600000000 Units 4500
2022-12-21T03:11:49.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 600000000 Units 4500
2022-12-21T03:11:49.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 600000000 Units 4100
2022-12-21T03:11:49.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 600000000 Units 4100
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.307+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity
2022-12-21T03:11:49.308+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000 
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000 
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2022-12-21T03:11:49.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2022-12-21T03:11:49.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2022-12-21T03:11:49.308+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.308+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500  on any target
2022-12-21T03:11:49.308+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800  on any target
2022-12-21T03:11:49.308+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500  on any target
2022-12-21T03:11:49.308+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.308+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.308+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2022/12/21 03:11:49 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 node, Pair node not deleted(Failed swap rebalance of 1 node)
2022-12-21T03:11:49.310+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001]
2022-12-21T03:11:49.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001]
2022-12-21T03:11:49.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004]
2022-12-21T03:11:49.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9009 as replacement node for deleted node 127.0.0.1:9001.
2022-12-21T03:11:49.310+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2022-12-21T03:11:49.310+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2022-12-21T03:11:49.310+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2022-12-21T03:11:49.310+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2022-12-21T03:11:49.310+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 600000000 Units 4000
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 500000000 Units 4100
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9004 127.0.0.1:9009] [127.0.0.1:9007 127.0.0.1:9008]]
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9004 127.0.0.1:9009]]
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9009]
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.310+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000  can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0  can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 node, Pair node already deleted
2022-12-21T03:11:49.311+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002]
2022-12-21T03:11:49.311+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002]
2022-12-21T03:11:49.311+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes []
2022-12-21T03:11:49.311+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.311+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2022-12-21T03:11:49.311+05:30 [Info] Planner::moveTenantsFromDeletedNodes Pair node not found for deleted node 127.0.0.1:9002.
2022-12-21T03:11:49.311+05:30 [Error] Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2022/12/21 03:11:49 Expected error Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 subcluster, empty nodes
2022-12-21T03:11:49.312+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9005 127.0.0.1:9007 127.0.0.1:9008]
2022-12-21T03:11:49.312+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2022-12-21T03:11:49.312+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2022-12-21T03:11:49.312+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.312+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000
2022-12-21T03:11:49.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 800000000 Units 7000
2022-12-21T03:11:49.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2022-12-21T03:11:49.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000
2022-12-21T03:11:49.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2022-12-21T03:11:49.312+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.312+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9002] with len 1. Skipping replica repair attempt.
2022-12-21T03:11:49.312+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 subcluster, Deleted Nodes more than added nodes
2022-12-21T03:11:49.313+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.313+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.313+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2022-12-21T03:11:49.313+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2022-12-21T03:11:49.313+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 1
2022-12-21T03:11:49.313+05:30 [Error] Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2022/12/21 03:11:49 Expected error Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 node, Add 1 node in, server group mismatch
2022-12-21T03:11:49.314+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9006]
2022-12-21T03:11:49.314+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9006]
2022-12-21T03:11:49.314+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9003]
2022-12-21T03:11:49.314+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9007]
2022/12/21 03:11:49 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 node, Pair node exists
2022-12-21T03:11:49.315+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2022-12-21T03:11:49.315+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2022-12-21T03:11:49.315+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2022-12-21T03:11:49.315+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.315+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2022-12-21T03:11:49.315+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.315+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.315+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2022-12-21T03:11:49.315+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.315+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.315+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2022-12-21T03:11:49.315+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2022-12-21T03:11:49.315+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2022-12-21T03:11:49.315+05:30 [Info] Planner::moveTenantsFromDeletedNodes No replacement node found for deleted node 127.0.0.1:9004.
2022-12-21T03:11:49.315+05:30 [Error] Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2022/12/21 03:11:49 Expected error Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 subcluster, No nodes under LWM
2022-12-21T03:11:49.315+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000 
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000 
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 
2022-12-21T03:11:49.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2022-12-21T03:11:49.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2022-12-21T03:11:49.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2022-12-21T03:11:49.316+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2022/12/21 03:11:49 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity, Partial Subcluster
2022-12-21T03:11:49.316+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 100000000 UnitsUsage 500 
2022-12-21T03:11:49.316+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 500 
2022-12-21T03:11:49.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 200000000 Units 1000
2022-12-21T03:11:49.317+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2022-12-21T03:11:49.317+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 200000000 Units 1000
2022-12-21T03:11:49.317+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2022-12-21T03:11:49.317+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2022-12-21T03:11:49.317+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9006]
2022-12-21T03:11:49.317+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2022-12-21T03:11:49.317+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2022/12/21 03:11:49 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 2 SG, Move out 1 non-empty and 1 empty  node
2022-12-21T03:11:49.317+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9007 127.0.0.1:9004]
2022-12-21T03:11:49.317+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2022-12-21T03:11:49.317+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2022-12-21T03:11:49.317+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2022-12-21T03:11:49.317+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9008]
2022-12-21T03:11:49.317+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.317+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.317+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.317+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.317+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.317+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.317+05:30 [Info] Moving index 171717:1171171:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.317+05:30 [Info] Moving index 141414:1141141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2022-12-21T03:11:49.317+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 0 Units 0
2022-12-21T03:11:49.317+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2022-12-21T03:11:49.317+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 800000000 Units 8000
2022-12-21T03:11:49.317+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000
2022-12-21T03:11:49.317+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9008 127.0.0.1:9001]]
2022-12-21T03:11:49.317+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM
2022-12-21T03:11:49.319+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2022-12-21T03:11:49.319+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2022-12-21T03:11:49.319+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.319+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.319+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.319+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.319+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 
2022-12-21T03:11:49.319+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.319+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.319+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000  on any target
2022-12-21T03:11:49.319+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000
2022-12-21T03:11:49.319+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2022-12-21T03:11:49.319+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000
2022-12-21T03:11:49.319+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2022-12-21T03:11:49.319+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.319+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 2 Subclusters, 1 below LWM, 1 above HWM
2022-12-21T03:11:49.320+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2022-12-21T03:11:49.320+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.320+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2022-12-21T03:11:49.320+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000
2022-12-21T03:11:49.320+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.320+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.320+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.320+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.320+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 
2022-12-21T03:11:49.320+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.320+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.320+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000  on any target
2022-12-21T03:11:49.320+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000
2022-12-21T03:11:49.320+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 600000000 Units 4000
2022-12-21T03:11:49.320+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000
2022-12-21T03:11:49.320+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 600000000 Units 4000
2022-12-21T03:11:49.320+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.320+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 3 Subclusters, 1 empty, 1 Above HWM, 1 below LWM
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000
2022-12-21T03:11:49.321+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.321+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.321+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.321+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.321+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 
2022-12-21T03:11:49.321+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.321+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.321+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000
2022-12-21T03:11:49.321+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2022-12-21T03:11:49.321+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.321+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.321+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.321+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.322+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.322+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.322+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2022-12-21T03:11:49.322+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.322+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.322+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.322+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000
2022-12-21T03:11:49.322+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2022-12-21T03:11:49.322+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2022-12-21T03:11:49.322+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000
2022-12-21T03:11:49.322+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2022-12-21T03:11:49.322+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2022-12-21T03:11:49.322+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 2 Subclusters, 1 above LWM/below HWM, 1 empty
2022-12-21T03:11:49.322+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000
2022-12-21T03:11:49.322+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000
2022-12-21T03:11:49.322+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.322+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 2 Subclusters, Both above LWM/below HWM
2022-12-21T03:11:49.324+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000
2022-12-21T03:11:49.324+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500
2022-12-21T03:11:49.324+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000
2022-12-21T03:11:49.324+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500
2022-12-21T03:11:49.324+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.324+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022-12-21T03:11:49.324+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000
2022-12-21T03:11:49.324+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500
2022-12-21T03:11:49.324+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000
2022-12-21T03:11:49.324+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500
2022-12-21T03:11:49.324+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.324+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM (partial replica repair)
2022-12-21T03:11:49.325+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2022-12-21T03:11:49.325+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 550000000 Units 5500
2022-12-21T03:11:49.325+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.325+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2022-12-21T03:11:49.325+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2022-12-21T03:11:49.325+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.325+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.325+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.325+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 
2022-12-21T03:11:49.325+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.325+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.325+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000  on any target
2022-12-21T03:11:49.325+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000
2022-12-21T03:11:49.325+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2022-12-21T03:11:49.325+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000
2022-12-21T03:11:49.325+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2022-12-21T03:11:49.325+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.325+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM(full replica repair)
2022-12-21T03:11:49.326+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2022-12-21T03:11:49.326+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.326+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx1,1) on 127.0.0.1:9001
2022-12-21T03:11:49.326+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9001
2022-12-21T03:11:49.326+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx1,1) on 127.0.0.1:9001
2022-12-21T03:11:49.326+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9001
2022-12-21T03:11:49.326+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9001
2022-12-21T03:11:49.326+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,1) on 127.0.0.1:9001
2022-12-21T03:11:49.326+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9004 127.0.0.1:9001]]
2022-12-21T03:11:49.326+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9001]
2022-12-21T03:11:49.326+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.326+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 
2022-12-21T03:11:49.326+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.326+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.326+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000  on any target
2022-12-21T03:11:49.326+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000
2022-12-21T03:11:49.326+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2022-12-21T03:11:49.326+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000
2022-12-21T03:11:49.326+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2022-12-21T03:11:49.326+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.326+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 ScaleIn- 2 Subclusters, Both below LWM, Positive Case
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2022-12-21T03:11:49.327+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.327+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2022-12-21T03:11:49.327+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.327+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.327+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.327+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.327+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.327+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.327+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2022-12-21T03:11:49.327+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2022-12-21T03:11:49.327+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000 
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2022-12-21T03:11:49.327+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2022-12-21T03:11:49.327+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2022-12-21T03:11:49.327+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000  can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.327+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9003 SG sg1 Memory 0 Units 0
2022-12-21T03:11:49.327+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9006 SG sg3 Memory 0 Units 0
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 ScaleIn- 2 Subclusters, One below LWM/ 1 Empty
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2022-12-21T03:11:49.328+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.328+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. No ScaleIn.
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.328+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.328+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.328+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.328+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.328+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 
2022-12-21T03:11:49.328+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.328+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.328+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.328+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000
2022-12-21T03:11:49.329+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.329+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.329+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.329+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.329+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2022-12-21T03:11:49.329+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.329+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2022-12-21T03:11:49.329+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.329+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000 
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000
2022-12-21T03:11:49.329+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2022-12-21T03:11:49.329+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. ScaleIn. 
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000
2022-12-21T03:11:49.329+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.329+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.329+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.329+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.329+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 
2022-12-21T03:11:49.329+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 
2022-12-21T03:11:49.329+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2022-12-21T03:11:49.330+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.330+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000  can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000
2022-12-21T03:11:49.330+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.330+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.330+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.330+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.330+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2022-12-21T03:11:49.330+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2022-12-21T03:11:49.330+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2022-12-21T03:11:49.330+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2022-12-21T03:11:49.330+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000 
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000
2022-12-21T03:11:49.330+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2022-12-21T03:11:49.330+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000  can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2022-12-21T03:11:49.330+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2022-12-21T03:11:49.330+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2022/12/21 03:11:49 -------------------------------------------
2022/12/21 03:11:49 Rebalance - 1 Subcluster, Below HWM (partial replica repair)
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 350000000 Units 500
2022-12-21T03:11:49.330+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.330+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2022-12-21T03:11:49.330+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2022-12-21T03:11:49.330+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800
2022-12-21T03:11:49.330+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 500000000 Units 800
2022-12-21T03:11:49.330+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters  [[127.0.0.1:9001 127.0.0.1:9004]]
2022-12-21T03:11:49.330+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
--- PASS: TestTenantAwarePlanner (0.08s)
=== RUN   TestRestfulAPI
2022/12/21 03:11:49 In TestRestfulAPI()
2022/12/21 03:11:49 In DropAllSecondaryIndexes()
2022/12/21 03:11:49 Index found:  indexmut_1
2022/12/21 03:11:49 Dropped index indexmut_1
2022/12/21 03:11:49 Setting JSON docs in KV
2022/12/21 03:11:50 GET all indexes
2022/12/21 03:11:50 200 OK
2022/12/21 03:11:50 FOUND indexes: []
2022/12/21 03:11:50 DROP index: badindexid
2022/12/21 03:11:50 status: 400 Bad Request
2022/12/21 03:11:50 DROP index: 23544142
2022/12/21 03:11:50 status: 500 Internal Server Error
2022/12/21 03:11:50 TEST: malformed body
2022/12/21 03:11:50 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"

2022/12/21 03:11:50 TEST: missing field ``name``
2022/12/21 03:11:50 400 Bad Request "missing field name"
2022/12/21 03:11:50 TEST: empty field ``name``
2022/12/21 03:11:50 400 Bad Request "empty field name"
2022/12/21 03:11:50 TEST: missing field ``bucket``
2022/12/21 03:11:50 400 Bad Request "missing field bucket"
2022/12/21 03:11:50 TEST: empty field ``bucket``
2022/12/21 03:11:50 400 Bad Request "empty field bucket"
2022/12/21 03:11:50 TEST: missing field ``secExprs``
2022/12/21 03:11:50 400 Bad Request "missing field secExprs"
2022/12/21 03:11:50 TEST: empty field ``secExprs``
2022/12/21 03:11:50 400 Bad Request "empty field secExprs"
2022/12/21 03:11:50 TEST: incomplete field ``desc``
2022/12/21 03:11:50 400 Bad Request "incomplete desc information [true]"
2022/12/21 03:11:50 TEST: invalid field ``desc``
2022/12/21 03:11:50 400 Bad Request "incomplete desc information [1]"
2022/12/21 03:11:50 
2022/12/21 03:11:50 CREATE INDEX: idx1
2022/12/21 03:12:00 status : 201 Created
2022/12/21 03:12:00 {"id": "15137481694993165755"} 
2022/12/21 03:12:00 CREATE INDEX: idx2 (defer)
2022/12/21 03:12:01 status : 201 Created
2022/12/21 03:12:01 {"id": "5605142910295426861"} 
2022/12/21 03:12:01 CREATE INDEX: idx3 (defer)
2022/12/21 03:12:01 status : 201 Created
2022/12/21 03:12:01 {"id": "13730503742868180415"} 
2022/12/21 03:12:01 CREATE INDEX: idx4 (defer)
2022/12/21 03:12:01 status : 201 Created
2022/12/21 03:12:01 {"id": "10394139579983100589"} 
2022/12/21 03:12:01 CREATE INDEX: idx5
2022/12/21 03:12:14 status : 201 Created
2022/12/21 03:12:14 {"id": "14076528446766182056"} 
2022/12/21 03:12:14 BUILD single deferred index
2022/12/21 03:12:14 202 Accepted
2022/12/21 03:12:14 GET all indexes
2022/12/21 03:12:14 200 OK
2022/12/21 03:12:14 index idx1 in INDEX_STATE_ACTIVE
2022/12/21 03:12:14 GET all indexes
2022/12/21 03:12:14 200 OK
2022/12/21 03:12:14 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:15 GET all indexes
2022/12/21 03:12:15 200 OK
2022/12/21 03:12:15 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:16 GET all indexes
2022/12/21 03:12:16 200 OK
2022/12/21 03:12:16 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:17 GET all indexes
2022/12/21 03:12:17 200 OK
2022/12/21 03:12:17 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:18 GET all indexes
2022/12/21 03:12:18 200 OK
2022/12/21 03:12:18 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:19 GET all indexes
2022/12/21 03:12:19 200 OK
2022/12/21 03:12:19 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:20 GET all indexes
2022/12/21 03:12:20 200 OK
2022/12/21 03:12:20 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:21 GET all indexes
2022/12/21 03:12:21 200 OK
2022/12/21 03:12:21 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:22 GET all indexes
2022/12/21 03:12:22 200 OK
2022/12/21 03:12:22 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:23 GET all indexes
2022/12/21 03:12:23 200 OK
2022/12/21 03:12:23 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:24 GET all indexes
2022/12/21 03:12:24 200 OK
2022/12/21 03:12:24 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:25 GET all indexes
2022/12/21 03:12:25 200 OK
2022/12/21 03:12:25 index idx2 in INDEX_STATE_INITIAL
2022/12/21 03:12:26 GET all indexes
2022/12/21 03:12:26 200 OK
2022/12/21 03:12:26 index idx2 in INDEX_STATE_CATCHUP
2022/12/21 03:12:27 GET all indexes
2022/12/21 03:12:27 200 OK
2022/12/21 03:12:27 index idx2 in INDEX_STATE_ACTIVE
2022/12/21 03:12:27 BUILD many deferred index
2022/12/21 03:12:27 202 Accepted 
2022/12/21 03:12:27 GET all indexes
2022/12/21 03:12:27 200 OK
2022/12/21 03:12:27 index idx1 in INDEX_STATE_ACTIVE
2022/12/21 03:12:27 GET all indexes
2022/12/21 03:12:27 200 OK
2022/12/21 03:12:27 index idx2 in INDEX_STATE_ACTIVE
2022/12/21 03:12:27 GET all indexes
2022/12/21 03:12:27 200 OK
2022/12/21 03:12:27 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:28 GET all indexes
2022/12/21 03:12:28 200 OK
2022/12/21 03:12:28 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:29 GET all indexes
2022/12/21 03:12:29 200 OK
2022/12/21 03:12:29 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:30 GET all indexes
2022/12/21 03:12:30 200 OK
2022/12/21 03:12:30 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:32 GET all indexes
2022/12/21 03:12:32 200 OK
2022/12/21 03:12:32 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:33 GET all indexes
2022/12/21 03:12:33 200 OK
2022/12/21 03:12:33 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:34 GET all indexes
2022/12/21 03:12:34 200 OK
2022/12/21 03:12:34 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:35 GET all indexes
2022/12/21 03:12:35 200 OK
2022/12/21 03:12:35 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:36 GET all indexes
2022/12/21 03:12:36 200 OK
2022/12/21 03:12:36 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:37 GET all indexes
2022/12/21 03:12:37 200 OK
2022/12/21 03:12:37 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:38 GET all indexes
2022/12/21 03:12:38 200 OK
2022/12/21 03:12:38 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:39 GET all indexes
2022/12/21 03:12:39 200 OK
2022/12/21 03:12:39 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:40 GET all indexes
2022/12/21 03:12:40 200 OK
2022/12/21 03:12:40 index idx3 in INDEX_STATE_INITIAL
2022/12/21 03:12:41 GET all indexes
2022/12/21 03:12:41 200 OK
2022/12/21 03:12:41 index idx3 in INDEX_STATE_CATCHUP
2022/12/21 03:12:42 GET all indexes
2022/12/21 03:12:42 200 OK
2022/12/21 03:12:42 index idx3 in INDEX_STATE_ACTIVE
2022/12/21 03:12:42 GET all indexes
2022/12/21 03:12:42 200 OK
2022/12/21 03:12:42 index idx4 in INDEX_STATE_ACTIVE
2022/12/21 03:12:42 GET all indexes
2022/12/21 03:12:42 200 OK
2022/12/21 03:12:42 index idx5 in INDEX_STATE_ACTIVE
2022/12/21 03:12:42 GET all indexes
2022/12/21 03:12:42 200 OK
2022/12/21 03:12:42 CREATED indexes: [15137481694993165755 5605142910295426861 13730503742868180415 10394139579983100589 14076528446766182056]
2022/12/21 03:12:42 
2022/12/21 03:12:42 LOOKUP missing index
2022/12/21 03:12:42 status : 404 Not Found
2022/12/21 03:12:42 LOOKUP Pyongyang
2022/12/21 03:12:42 status : 200 OK
2022/12/21 03:12:42 number of entries 554
2022/12/21 03:12:42 Expected and Actual scan responses are the same
2022/12/21 03:12:42 LOOKUP with stale as false
2022/12/21 03:12:42 status : 200 OK
2022/12/21 03:12:42 number of entries 554
2022/12/21 03:12:42 Expected and Actual scan responses are the same
2022/12/21 03:12:42 LOOKUP with Rome
2022/12/21 03:12:42 status : 200 OK
2022/12/21 03:12:42 number of entries 540
2022/12/21 03:12:43 Expected and Actual scan responses are the same
2022/12/21 03:12:43 RANGE missing index
2022/12/21 03:12:43 Status : 404 Not Found
2022/12/21 03:12:43 RANGE cities - none
2022/12/21 03:12:43 Status : 200 OK
2022/12/21 03:12:48 number of entries 140902
2022/12/21 03:12:49 Expected and Actual scan responses are the same
2022/12/21 03:12:49 RANGE cities -low
2022/12/21 03:12:49 Status : 200 OK
2022/12/21 03:12:54 number of entries 140902
2022/12/21 03:12:54 Expected and Actual scan responses are the same
2022/12/21 03:12:54 RANGE cities -high
2022/12/21 03:12:55 Status : 200 OK
2022/12/21 03:12:59 number of entries 140902
2022/12/21 03:13:00 Expected and Actual scan responses are the same
2022/12/21 03:13:00 RANGE cities - both
2022/12/21 03:13:00 Status : 200 OK
2022/12/21 03:13:05 number of entries 140902
2022/12/21 03:13:06 Expected and Actual scan responses are the same
2022/12/21 03:13:06 RANGE missing cities
2022/12/21 03:13:06 Status : 200 OK
2022/12/21 03:13:06 number of entries 0
2022/12/21 03:13:06 Expected and Actual scan responses are the same
2022/12/21 03:13:06 
2022/12/21 03:13:06 SCANALL missing index
2022/12/21 03:13:06 {"limit":1000000,"stale":"ok"}
2022/12/21 03:13:06 Status : 404 Not Found
2022/12/21 03:13:06 SCANALL stale ok
2022/12/21 03:13:06 {"limit":1000000,"stale":"ok"}
2022/12/21 03:13:06 Status : 200 OK
2022/12/21 03:13:11 number of entries 140902
2022/12/21 03:13:12 Expected and Actual scan responses are the same
2022/12/21 03:13:12 SCANALL stale false
2022/12/21 03:13:12 {"limit":1000000,"stale":"false"}
2022/12/21 03:13:12 Status : 200 OK
2022/12/21 03:13:17 number of entries 140902
2022/12/21 03:13:18 Expected and Actual scan responses are the same
2022/12/21 03:13:18 
2022/12/21 03:13:18 COUNT missing index
2022/12/21 03:13:18 Status : 404 Not Found
2022/12/21 03:13:18 COUNT cities - none
2022/12/21 03:13:18 Status : 200 OK
2022/12/21 03:13:18 number of entries 140902
2022/12/21 03:13:18 COUNT cities -low
2022/12/21 03:13:18 Status : 200 OK
2022/12/21 03:13:18 number of entries 140902
2022/12/21 03:13:18 COUNT cities -high
2022/12/21 03:13:18 Status : 200 OK
2022/12/21 03:13:18 number of entries 140902
2022/12/21 03:13:19 COUNT cities - both
2022/12/21 03:13:19 Status : 200 OK
2022/12/21 03:13:19 number of entries 140902
2022/12/21 03:13:19 COUNT missing cities
2022/12/21 03:13:19 Status : 200 OK
2022/12/21 03:13:19 number of entries 0
2022/12/21 03:13:19 
2022/12/21 03:13:20 STATS: Testing URLs with valid authentication
2022/12/21 03:13:21 STATS: Testing URLs with invalid authentication
2022/12/21 03:13:21 STATS: Testing invalid URLs
2022/12/21 03:13:21 STATS: Testing unsupported methods
2022/12/21 03:13:21 
--- PASS: TestRestfulAPI (91.76s)
=== RUN   TestStatIndexInstFilter
2022/12/21 03:13:21 CREATE INDEX: statIdx1
2022/12/21 03:13:32 status : 201 Created
2022/12/21 03:13:32 {"id": "1152345583796153074"} 
2022/12/21 03:13:32 CREATE INDEX: statIdx2
2022/12/21 03:13:45 status : 201 Created
2022/12/21 03:13:45 {"id": "13660874512038798928"} 
2022/12/21 03:13:45 Instance Id for statIdx2 is 5116712289454700803, common.IndexInstId
--- PASS: TestStatIndexInstFilter (24.57s)
=== RUN   TestBucketDefaultDelete
2022-12-21T03:13:45.803+05:30 [Warn] Client:runObserveStreamingEndpoint streaming endpoint for /pools/default/bs/default returned err EOF
2022-12-21T03:13:45.803+05:30 [Warn] serviceChangeNotifier: Connection terminated for collection manifest notifier instance of http://%40query@127.0.0.1:9000, default, bucket: default, (EOF)
2022/12/21 03:13:48 Deleted bucket default, responseBody: 
2022/12/21 03:14:03 Created bucket default, responseBody: 
2022/12/21 03:14:19 Populating the default bucket
2022/12/21 03:14:27 Using n1ql client
2022-12-21T03:14:27.578+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T03:14:27.578+05:30 [Info] GSIC[default/default-_default-_default-1671572667575501913] started ...
2022/12/21 03:14:27 Scan failed as expected with error: Index Not Found - cause: GSI index index_isActive not found.
2022/12/21 03:14:27 Populating the default bucket after it was deleted
2022/12/21 03:14:37 Created the secondary index index_isActive. Waiting for it become active
2022/12/21 03:14:37 Index is 14739441858160236705 now active
2022/12/21 03:14:37 Using n1ql client
2022/12/21 03:14:37 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (52.31s)
=== RUN   TestMixedDatatypesScanAll
2022/12/21 03:14:37 In TestMixedDatatypesScanAll()
2022/12/21 03:14:37 Before test begin: Length of kv docs is 10002
2022/12/21 03:14:37 In DropAllSecondaryIndexes()
2022/12/21 03:14:37 Index found:  index_isActive
2022/12/21 03:14:38 Dropped index index_isActive
2022/12/21 03:14:38 Number of number fields is: 262
2022/12/21 03:14:38 Number of string fields is: 245
2022/12/21 03:14:38 Number of json fields is: 246
2022/12/21 03:14:38 Number of true bool fields is: 108
2022/12/21 03:14:38 Number of false bool fields is: 139
2022/12/21 03:14:38 After generate docs: Length of kv docs is 11002
2022/12/21 03:14:38 Setting mixed datatypes JSON docs in KV
2022/12/21 03:14:44 Created the secondary index index_mixeddt. Waiting for it become active
2022/12/21 03:14:44 Index is 16916572245255571985 now active
2022/12/21 03:14:44 Using n1ql client
2022/12/21 03:14:44 Expected and Actual scan responses are the same
2022/12/21 03:14:44 Lengths of expected and actual scan results are:  1000 and 1000
2022/12/21 03:14:44 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (6.18s)
=== RUN   TestMixedDatatypesRange_Float
2022/12/21 03:14:44 In TestMixedDatatypesRange_Float()
2022/12/21 03:14:44 In DropAllSecondaryIndexes()
2022/12/21 03:14:44 Index found:  index_mixeddt
2022/12/21 03:14:44 Dropped index index_mixeddt
2022/12/21 03:14:44 Number of number fields is: 241
2022/12/21 03:14:44 Number of string fields is: 256
2022/12/21 03:14:44 Number of json fields is: 261
2022/12/21 03:14:44 Number of true bool fields is: 109
2022/12/21 03:14:44 Number of false bool fields is: 133
2022/12/21 03:14:44 Setting mixed datatypes JSON docs in KV
2022/12/21 03:14:49 Created the secondary index index_mixeddt. Waiting for it become active
2022/12/21 03:14:49 Index is 18062497793569773802 now active
2022/12/21 03:14:49 Using n1ql client
2022/12/21 03:14:49 Expected and Actual scan responses are the same
2022/12/21 03:14:49 Lengths of expected and actual scan results are:  20 and 20
2022/12/21 03:14:49 Using n1ql client
2022/12/21 03:14:49 Expected and Actual scan responses are the same
2022/12/21 03:14:49 Lengths of expected and actual scan results are:  0 and 0
2022/12/21 03:14:49 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (5.70s)
=== RUN   TestMixedDatatypesRange_String
2022/12/21 03:14:49 In TestMixedDatatypesRange_String()
2022/12/21 03:14:49 In DropAllSecondaryIndexes()
2022/12/21 03:14:49 Index found:  index_mixeddt
2022/12/21 03:14:49 Dropped index index_mixeddt
2022/12/21 03:14:50 Number of number fields is: 238
2022/12/21 03:14:50 Number of string fields is: 253
2022/12/21 03:14:50 Number of json fields is: 273
2022/12/21 03:14:50 Number of true bool fields is: 121
2022/12/21 03:14:50 Number of false bool fields is: 115
2022/12/21 03:14:50 Setting mixed datatypes JSON docs in KV
2022/12/21 03:14:55 Created the secondary index index_mixeddt. Waiting for it become active
2022/12/21 03:14:55 Index is 3756014183122588437 now active
2022/12/21 03:14:55 Using n1ql client
2022/12/21 03:14:55 Expected and Actual scan responses are the same
2022/12/21 03:14:55 Lengths of expected and actual scan results are:  199 and 199
2022/12/21 03:14:55 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (5.81s)
=== RUN   TestMixedDatatypesRange_Json
2022/12/21 03:14:55 In TestMixedDatatypesRange_Json()
2022/12/21 03:14:55 In DropAllSecondaryIndexes()
2022/12/21 03:14:55 Index found:  index_mixeddt
2022/12/21 03:14:55 Dropped index index_mixeddt
2022/12/21 03:14:55 Number of number fields is: 231
2022/12/21 03:14:55 Number of string fields is: 253
2022/12/21 03:14:55 Number of json fields is: 235
2022/12/21 03:14:55 Number of true bool fields is: 136
2022/12/21 03:14:55 Number of false bool fields is: 145
2022/12/21 03:14:55 Setting mixed datatypes JSON docs in KV
2022/12/21 03:15:02 Created the secondary index index_mixeddt. Waiting for it become active
2022/12/21 03:15:02 Index is 2805065357483387018 now active
2022/12/21 03:15:02 Using n1ql client
2022/12/21 03:15:02 Expected and Actual scan responses are the same
2022/12/21 03:15:02 Lengths of expected and actual scan results are:  769 and 769
2022/12/21 03:15:02 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (6.78s)
=== RUN   TestMixedDatatypesScan_Bool
2022/12/21 03:15:02 In TestMixedDatatypesScan_Bool()
2022/12/21 03:15:02 In DropAllSecondaryIndexes()
2022/12/21 03:15:02 Index found:  index_mixeddt
2022/12/21 03:15:02 Dropped index index_mixeddt
2022/12/21 03:15:02 Number of number fields is: 236
2022/12/21 03:15:02 Number of string fields is: 263
2022/12/21 03:15:02 Number of json fields is: 251
2022/12/21 03:15:02 Number of true bool fields is: 108
2022/12/21 03:15:02 Number of false bool fields is: 142
2022/12/21 03:15:02 Setting mixed datatypes JSON docs in KV
2022/12/21 03:15:08 Created the secondary index index_mixeddt. Waiting for it become active
2022/12/21 03:15:08 Index is 1126895056797899411 now active
2022/12/21 03:15:08 Using n1ql client
2022/12/21 03:15:08 Expected and Actual scan responses are the same
2022/12/21 03:15:08 Lengths of expected and actual scan results are:  474 and 474
2022/12/21 03:15:08 Using n1ql client
2022/12/21 03:15:08 Expected and Actual scan responses are the same
2022/12/21 03:15:08 Lengths of expected and actual scan results are:  535 and 535
2022/12/21 03:15:08 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (6.22s)
=== RUN   TestLargeSecondaryKeyLength
2022/12/21 03:15:08 In TestLargeSecondaryKeyLength()
2022/12/21 03:15:08 In DropAllSecondaryIndexes()
2022/12/21 03:15:08 Index found:  index_mixeddt
2022/12/21 03:15:08 Dropped index index_mixeddt
2022/12/21 03:15:08 Setting JSON docs in KV
2022/12/21 03:15:14 Created the secondary index index_LongSecField. Waiting for it become active
2022/12/21 03:15:14 Index is 9211572839779930144 now active
2022/12/21 03:15:14 Using n1ql client
2022/12/21 03:15:14 ScanAll: Lengths of expected and actual scan results are:  1000 and 1000
2022/12/21 03:15:14 Expected and Actual scan responses are the same
2022/12/21 03:15:14 Using n1ql client
2022/12/21 03:15:15 Range: Lengths of expected and actual scan results are:  833 and 833
2022/12/21 03:15:15 Expected and Actual scan responses are the same
2022/12/21 03:15:15 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (6.35s)
=== RUN   TestLargePrimaryKeyLength
2022/12/21 03:15:15 In TestLargePrimaryKeyLength()
2022/12/21 03:15:15 In DropAllSecondaryIndexes()
2022/12/21 03:15:15 Index found:  index_LongSecField
2022/12/21 03:15:15 Dropped index index_LongSecField
2022/12/21 03:15:15 Setting JSON docs in KV
2022/12/21 03:15:21 Created the secondary index index_LongPrimaryField. Waiting for it become active
2022/12/21 03:15:21 Index is 10639841431549314563 now active
2022/12/21 03:15:21 Using n1ql client
2022/12/21 03:15:22 Lengths of num of docs and scanResults are:  17002 and 17002
2022/12/21 03:15:22 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (7.63s)
=== RUN   TestUpdateMutations_DeleteField
2022/12/21 03:15:22 In TestUpdateMutations_DeleteField()
2022/12/21 03:15:22 Setting JSON docs in KV
2022/12/21 03:15:29 Created the secondary index index_bal. Waiting for it become active
2022/12/21 03:15:29 Index is 15537883601769338318 now active
2022/12/21 03:15:29 Using n1ql client
2022/12/21 03:15:29 Expected and Actual scan responses are the same
2022/12/21 03:15:29 Using n1ql client
2022/12/21 03:15:30 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (7.42s)
=== RUN   TestUpdateMutations_AddField
2022/12/21 03:15:30 In TestUpdateMutations_AddField()
2022/12/21 03:15:30 Setting JSON docs in KV
2022/12/21 03:15:37 Created the secondary index index_newField. Waiting for it become active
2022/12/21 03:15:37 Index is 1909044505998876207 now active
2022/12/21 03:15:37 Using n1ql client
2022/12/21 03:15:37 Count of scan results before add field mutations:  0
2022/12/21 03:15:37 Expected and Actual scan responses are the same
2022/12/21 03:15:37 Using n1ql client
2022/12/21 03:15:37 Count of scan results after add field mutations:  300
2022/12/21 03:15:37 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (7.76s)
=== RUN   TestUpdateMutations_DataTypeChange
2022/12/21 03:15:37 In TestUpdateMutations_DataTypeChange()
2022/12/21 03:15:38 Setting JSON docs in KV
2022/12/21 03:15:46 Created the secondary index index_isUserActive. Waiting for it become active
2022/12/21 03:15:46 Index is 5104421010026377709 now active
2022/12/21 03:15:46 Using n1ql client
2022/12/21 03:15:46 Expected and Actual scan responses are the same
2022/12/21 03:15:46 Using n1ql client
2022/12/21 03:15:46 Expected and Actual scan responses are the same
2022/12/21 03:15:46 Using n1ql client
2022/12/21 03:15:46 Expected and Actual scan responses are the same
2022/12/21 03:15:46 Using n1ql client
2022/12/21 03:15:46 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (8.98s)
=== RUN   TestMultipleBuckets
2022/12/21 03:15:46 In TestMultipleBuckets()
2022/12/21 03:15:46 In DropAllSecondaryIndexes()
2022/12/21 03:15:46 Index found:  index_LongPrimaryField
2022/12/21 03:15:46 Dropped index index_LongPrimaryField
2022/12/21 03:15:46 Index found:  index_bal
2022/12/21 03:15:46 Dropped index index_bal
2022/12/21 03:15:46 Index found:  index_isUserActive
2022/12/21 03:15:47 Dropped index index_isUserActive
2022/12/21 03:15:47 Index found:  index_newField
2022/12/21 03:15:47 Dropped index index_newField
2022/12/21 03:16:24 Flushed the bucket default, Response body: 
2022/12/21 03:16:27 Modified parameters of bucket default, responseBody: 
2022/12/21 03:16:28 Created bucket testbucket2, responseBody: 
2022/12/21 03:16:28 Created bucket testbucket3, responseBody: 
2022/12/21 03:16:28 Created bucket testbucket4, responseBody: 
2022/12/21 03:16:43 Generating docs and Populating all the buckets
2022/12/21 03:16:47 Created the secondary index bucket1_age. Waiting for it become active
2022/12/21 03:16:47 Index is 17070939931221909318 now active
2022/12/21 03:16:53 Created the secondary index bucket2_city. Waiting for it become active
2022/12/21 03:16:53 Index is 13780196227635569131 now active
2022/12/21 03:16:59 Created the secondary index bucket3_gender. Waiting for it become active
2022/12/21 03:16:59 Index is 7077566835368217156 now active
2022/12/21 03:17:06 Created the secondary index bucket4_balance. Waiting for it become active
2022/12/21 03:17:06 Index is 2743139550271078123 now active
2022/12/21 03:17:09 Using n1ql client
2022/12/21 03:17:09 Expected and Actual scan responses are the same
2022/12/21 03:17:09 Using n1ql client
2022-12-21T03:17:09.047+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T03:17:09.048+05:30 [Info] GSIC[default/testbucket2-_default-_default-1671572829043410844] started ...
2022/12/21 03:17:09 Expected and Actual scan responses are the same
2022/12/21 03:17:09 Using n1ql client
2022-12-21T03:17:09.074+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T03:17:09.074+05:30 [Info] GSIC[default/testbucket3-_default-_default-1671572829062578304] started ...
2022/12/21 03:17:09 Expected and Actual scan responses are the same
2022/12/21 03:17:09 Using n1ql client
2022-12-21T03:17:09.098+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T03:17:09.098+05:30 [Info] GSIC[default/testbucket4-_default-_default-1671572829095095441] started ...
2022/12/21 03:17:09 Expected and Actual scan responses are the same
2022/12/21 03:17:11 Deleted bucket testbucket2, responseBody: 
2022/12/21 03:17:13 Deleted bucket testbucket3, responseBody: 
2022/12/21 03:17:16 Deleted bucket testbucket4, responseBody: 
2022/12/21 03:17:19 Modified parameters of bucket default, responseBody: 
--- PASS: TestMultipleBuckets (107.76s)
=== RUN   TestBucketFlush
2022/12/21 03:17:34 In TestBucketFlush()
2022/12/21 03:17:34 In DropAllSecondaryIndexes()
2022/12/21 03:17:34 Index found:  bucket1_age
2022/12/21 03:17:34 Dropped index bucket1_age
2022/12/21 03:18:12 Flushed the bucket default, Response body: 
2022/12/21 03:18:16 Created the secondary index index_age. Waiting for it become active
2022/12/21 03:18:16 Index is 16335875080545791097 now active
2022/12/21 03:18:16 Using n1ql client
2022/12/21 03:18:16 Expected and Actual scan responses are the same
2022/12/21 03:18:23 Created the secondary index index_gender. Waiting for it become active
2022/12/21 03:18:23 Index is 17048809457516852510 now active
2022/12/21 03:18:23 Using n1ql client
2022/12/21 03:18:24 Expected and Actual scan responses are the same
2022/12/21 03:18:29 Created the secondary index index_city. Waiting for it become active
2022/12/21 03:18:29 Index is 1510479122470559250 now active
2022/12/21 03:18:29 Using n1ql client
2022/12/21 03:18:29 Expected and Actual scan responses are the same
2022/12/21 03:19:07 Flushed the bucket default, Response body: 
2022/12/21 03:19:07 TestBucketFlush:: Flushed the bucket
2022/12/21 03:19:07 Using n1ql client
2022/12/21 03:19:07 Using n1ql client
2022/12/21 03:19:07 Using n1ql client
--- PASS: TestBucketFlush (92.68s)
=== RUN   TestLargeDocumentSize
2022/12/21 03:19:07 In TestLargeDocumentSize()
2022/12/21 03:19:07 Data file exists. Skipping download
2022/12/21 03:19:07 Length of docs and largeDocs = 200 and 200
2022/12/21 03:19:11 Created the secondary index index_userscreenname. Waiting for it become active
2022/12/21 03:19:11 Index is 1302526728464751863 now active
2022/12/21 03:19:11 Using n1ql client
2022/12/21 03:19:12 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (5.45s)
=== RUN   TestFieldsWithSpecialCharacters
2022/12/21 03:19:12 In TestFieldsWithSpecialCharacters()
2022/12/21 03:19:18 Created the secondary index index_specialchar. Waiting for it become active
2022/12/21 03:19:18 Index is 6060874360522270735 now active
2022/12/21 03:19:18 Looking up for value ƒyzŠv§™
2022/12/21 03:19:18 Using n1ql client
2022/12/21 03:19:18 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (5.33s)
=== RUN   TestLargeKeyLookup
2022/12/21 03:19:18 In TestLargeKeyLookup()
2022/12/21 03:19:24 Created the secondary index index_largeKeyLookup. Waiting for it become active
2022/12/21 03:19:24 Index is 13938473048017476542 now active
2022/12/21 03:19:24 Looking up for a large key
2022/12/21 03:19:24 Using n1ql client
2022/12/21 03:19:25 Expected and Actual scan responses are the same
--- PASS: TestLargeKeyLookup (7.45s)
=== RUN   TestIndexNameValidation
2022/12/21 03:19:25 In TestIndexNameValidation()
2022/12/21 03:19:25 Setting JSON docs in KV
2022/12/21 03:19:26 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected
2022/12/21 03:19:31 Created the secondary index #primary-Index_test. Waiting for it become active
2022/12/21 03:19:31 Index is 13716976866452129431 now active
2022/12/21 03:19:31 Using n1ql client
2022/12/21 03:19:31 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (6.02s)
=== RUN   TestSameFieldNameAtDifferentLevels
2022/12/21 03:19:31 In TestSameFieldNameAtDifferentLevels()
2022/12/21 03:19:31 Setting JSON docs in KV
2022/12/21 03:19:38 Created the secondary index cityindex. Waiting for it become active
2022/12/21 03:19:38 Index is 15409244095184855690 now active
2022/12/21 03:19:38 Using n1ql client
2022/12/21 03:19:38 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (6.97s)
=== RUN   TestSameIndexNameInTwoBuckets
2022/12/21 03:19:38 In TestSameIndexNameInTwoBuckets()
2022/12/21 03:19:38 In DropAllSecondaryIndexes()
2022/12/21 03:19:38 Index found:  index_largeKeyLookup
2022/12/21 03:19:38 Dropped index index_largeKeyLookup
2022/12/21 03:19:38 Index found:  index_gender
2022/12/21 03:19:38 Dropped index index_gender
2022/12/21 03:19:38 Index found:  index_age
2022/12/21 03:19:38 Dropped index index_age
2022/12/21 03:19:38 Index found:  #primary-Index_test
2022/12/21 03:19:38 Dropped index #primary-Index_test
2022/12/21 03:19:38 Index found:  cityindex
2022/12/21 03:19:38 Dropped index cityindex
2022/12/21 03:19:38 Index found:  index_city
2022/12/21 03:19:38 Dropped index index_city
2022/12/21 03:19:38 Index found:  index_userscreenname
2022/12/21 03:19:38 Dropped index index_userscreenname
2022/12/21 03:19:38 Index found:  index_specialchar
2022/12/21 03:19:39 Dropped index index_specialchar
2022/12/21 03:20:17 Flushed the bucket default, Response body: 
2022/12/21 03:20:20 Modified parameters of bucket default, responseBody: 
2022/12/21 03:20:20 Created bucket buck2, responseBody: 
2022/12/21 03:20:35 Generating docs and Populating all the buckets
2022/12/21 03:20:39 Created the secondary index b_idx. Waiting for it become active
2022/12/21 03:20:39 Index is 13480450435892471465 now active
2022/12/21 03:20:46 Created the secondary index b_idx. Waiting for it become active
2022/12/21 03:20:46 Index is 8880865737542624707 now active
2022/12/21 03:20:49 Using n1ql client
2022/12/21 03:20:49 Expected and Actual scan responses are the same
2022/12/21 03:20:49 Using n1ql client
2022-12-21T03:20:49.032+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T03:20:49.033+05:30 [Info] GSIC[default/buck2-_default-_default-1671573049030187304] started ...
2022/12/21 03:20:49 Expected and Actual scan responses are the same
2022/12/21 03:20:52 Modified parameters of bucket default, responseBody: 
2022/12/21 03:20:53 Deleted bucket buck2, responseBody: 
--- PASS: TestSameIndexNameInTwoBuckets (90.53s)
=== RUN   TestLargeKeysSplChars
2022/12/21 03:21:08 In TestLargeKeysSplChars()
2022/12/21 03:21:18 Created the secondary index idspl1. Waiting for it become active
2022/12/21 03:21:18 Index is 16009500057565400414 now active
2022/12/21 03:21:26 Created the secondary index idspl2. Waiting for it become active
2022/12/21 03:21:26 Index is 17344488263021024236 now active
2022/12/21 03:21:33 Created the secondary index idspl3. Waiting for it become active
2022/12/21 03:21:33 Index is 11950395454203293481 now active
2022/12/21 03:21:33 Using n1ql client
2022/12/21 03:21:33 Expected and Actual scan responses are the same
2022-12-21T03:21:33.842+05:30 [Error] transport error between 127.0.0.1:58954->127.0.0.1:9107: write tcp 127.0.0.1:58954->127.0.0.1:9107: write: broken pipe
2022-12-21T03:21:33.842+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:58954->127.0.0.1:9107: write: broken pipe`
2022-12-21T03:21:33.842+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-12-21T03:21:33.843+05:30 [Error] metadataClient:PickRandom: Replicas - [1984830487274304033], PrunedReplica - map[], FilteredReplica map[]
2022/12/21 03:21:34 Expected and Actual scan responses are the same
2022/12/21 03:21:34 Using n1ql client
2022/12/21 03:21:34 Expected and Actual scan responses are the same
--- PASS: TestLargeKeysSplChars (25.35s)
=== RUN   TestVeryLargeIndexKey
2022/12/21 03:21:34 In DropAllSecondaryIndexes()
2022/12/21 03:21:34 Index found:  idspl1
2022/12/21 03:21:34 Dropped index idspl1
2022/12/21 03:21:34 Index found:  b_idx
2022/12/21 03:21:34 Dropped index b_idx
2022/12/21 03:21:34 Index found:  idspl2
2022/12/21 03:21:34 Dropped index idspl2
2022/12/21 03:21:34 Index found:  idspl3
2022/12/21 03:21:34 Dropped index idspl3
2022/12/21 03:22:12 Flushed the bucket default, Response body: 
2022/12/21 03:22:12 TestVeryLargeIndexKey:: Flushed the bucket
2022/12/21 03:22:12 clusterconfig.KVAddress = 127.0.0.1:9000
2022/12/21 03:22:17 Created the secondary index i1. Waiting for it become active
2022/12/21 03:22:17 Index is 18338510821686893828 now active
2022/12/21 03:22:17 Using n1ql client
2022/12/21 03:22:17 Expected and Actual scan responses are the same
2022/12/21 03:22:24 Created the secondary index i2. Waiting for it become active
2022/12/21 03:22:24 Index is 17434895615938011314 now active
2022/12/21 03:22:24 Using n1ql client
2022/12/21 03:22:25 Expected and Actual scan responses are the same
2022/12/21 03:22:25 In DropAllSecondaryIndexes()
2022/12/21 03:22:25 Index found:  i1
2022/12/21 03:22:25 Dropped index i1
2022/12/21 03:22:25 Index found:  i2
2022/12/21 03:22:25 Dropped index i2
2022/12/21 03:23:03 Flushed the bucket default, Response body: 
--- PASS: TestVeryLargeIndexKey (89.59s)
=== RUN   TestTempBufScanResult
2022/12/21 03:23:03 In DropAllSecondaryIndexes()
2022/12/21 03:23:43 Flushed the bucket default, Response body: 
2022/12/21 03:23:43 TestTempBufScanResult:: Flushed the bucket
2022/12/21 03:23:46 Created the secondary index index_idxKey. Waiting for it become active
2022/12/21 03:23:46 Index is 5255015861104710885 now active
2022/12/21 03:23:46 Using n1ql client
2022/12/21 03:23:47 Expected and Actual scan responses are the same
2022/12/21 03:23:47 In DropAllSecondaryIndexes()
2022/12/21 03:23:47 Index found:  index_idxKey
2022/12/21 03:23:47 Dropped index index_idxKey
2022/12/21 03:24:25 Flushed the bucket default, Response body: 
--- PASS: TestTempBufScanResult (81.99s)
=== RUN   TestBuildDeferredAnotherBuilding
2022/12/21 03:24:25 In TestBuildDeferredAnotherBuilding()
2022/12/21 03:24:25 In DropAllSecondaryIndexes()
2022/12/21 03:25:10 Setting JSON docs in KV
2022/12/21 03:27:13 Build the deferred index id_age1. Waiting for the index to become active
2022/12/21 03:27:13 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:14 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:15 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:16 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:17 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:18 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:19 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:20 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:21 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:22 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:23 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:24 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:25 Waiting for index 7541002632112567382 to go active ...
2022/12/21 03:27:26 Index is 7541002632112567382 now active
2022/12/21 03:27:26 Build command issued for the deferred indexes [14416039055109861489]
2022/12/21 03:27:29 Build index failed as expected: Build index fails. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2022/12/21 03:27:29 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:30 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:31 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:32 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:33 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:34 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:35 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:36 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:37 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:38 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:39 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:40 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:41 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:42 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:43 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:44 Waiting for index 14416039055109861489 to go active ...
2022/12/21 03:27:45 Index is 14416039055109861489 now active
2022/12/21 03:27:45 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:46 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:47 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:48 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:49 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:50 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:51 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:52 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:53 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:54 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:55 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:56 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:57 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:58 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:27:59 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:00 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:01 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:02 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:03 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:04 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:05 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:06 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:07 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:08 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:09 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:10 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:11 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:12 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:13 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:14 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:15 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:16 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:17 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:18 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:19 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:20 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:21 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:22 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:23 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:24 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:25 Waiting for index 16326352093642496391 to go active ...
2022/12/21 03:28:26 Index is 16326352093642496391 now active
2022/12/21 03:28:26 Using n1ql client
2022/12/21 03:28:26 Expected and Actual scan responses are the same
2022/12/21 03:28:27 Using n1ql client
2022/12/21 03:28:27 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (241.48s)
=== RUN   TestMultipleBucketsDeferredBuild
2022/12/21 03:28:27 In TestMultipleBucketsDeferredBuild()
2022/12/21 03:28:27 In DropAllSecondaryIndexes()
2022/12/21 03:28:27 Index found:  id_age
2022/12/21 03:28:27 Dropped index id_age
2022/12/21 03:28:27 Index found:  id_age1
2022/12/21 03:28:27 Dropped index id_age1
2022/12/21 03:28:27 Index found:  id_company
2022/12/21 03:28:27 Dropped index id_company
2022/12/21 03:29:04 Flushed the bucket default, Response body: 
2022/12/21 03:29:08 Modified parameters of bucket default, responseBody: 
2022/12/21 03:29:08 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2022/12/21 03:29:08 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc0000460f8}
2022/12/21 03:29:08 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 20 Dec 2022 21:59:07 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00bc1b9c0 31 [] false false map[] 0xc00affab00 }
2022/12/21 03:29:08 DeleteBucket failed for bucket defertest_buck2 
2022/12/21 03:29:08 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2022/12/21 03:29:08 Created bucket defertest_buck2, responseBody: 
2022/12/21 03:29:23 Setting JSON docs in KV
2022/12/21 03:30:43 Build command issued for the deferred indexes [13872270143077057155]
2022/12/21 03:30:44 Build command issued for the deferred indexes [2014856161850240580 9450110376026680420]
2022/12/21 03:30:44 Index state of 9450110376026680420 is INDEX_STATE_READY
2022/12/21 03:30:44 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:45 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:46 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:47 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:48 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:49 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:50 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:51 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:52 Waiting for index 13872270143077057155 to go active ...
2022/12/21 03:30:53 Index is 13872270143077057155 now active
2022/12/21 03:30:53 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:30:54 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:30:55 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:30:56 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:30:57 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:30:58 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:30:59 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:00 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:01 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:02 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:03 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:04 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:05 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:06 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:07 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:08 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:09 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:10 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:11 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:12 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:13 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:14 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:15 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:16 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:17 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:18 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:19 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:20 Waiting for index 2014856161850240580 to go active ...
2022/12/21 03:31:21 Index is 2014856161850240580 now active
2022/12/21 03:31:21 Using n1ql client
2022/12/21 03:31:21 Expected and Actual scan responses are the same
2022/12/21 03:31:21 Using n1ql client
2022/12/21 03:31:21 Expected and Actual scan responses are the same
2022/12/21 03:31:21 Using n1ql client
2022-12-21T03:31:21.400+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T03:31:21.401+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1671573681398346492] started ...
2022/12/21 03:31:21 Expected and Actual scan responses are the same
2022/12/21 03:31:24 Modified parameters of bucket default, responseBody: 
2022/12/21 03:31:26 Deleted bucket defertest_buck2, responseBody: 
--- PASS: TestMultipleBucketsDeferredBuild (184.33s)
=== RUN   TestCreateDropCreateDeferredIndex
2022/12/21 03:31:31 In TestCreateDropCreateDeferredIndex()
2022/12/21 03:31:31 In DropAllSecondaryIndexes()
2022/12/21 03:31:31 Index found:  buck1_id2
2022/12/21 03:31:31 Dropped index buck1_id2
2022/12/21 03:31:31 Index found:  buck1_id1
2022/12/21 03:31:31 Dropped index buck1_id1
2022/12/21 03:31:34 Setting JSON docs in KV
2022/12/21 03:31:46 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:31:46 Index is 11099260793816444889 now active
2022/12/21 03:31:48 Dropping the secondary index id_age
2022/12/21 03:31:48 Index dropped
2022/12/21 03:31:51 Setting JSON docs in KV
2022/12/21 03:32:00 Using n1ql client
2022/12/21 03:32:00 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (28.54s)
=== RUN   TestMultipleDeferredIndexes_BuildTogether
2022/12/21 03:32:00 In TestMultipleDeferredIndexes_BuildTogether()
2022/12/21 03:32:00 In DropAllSecondaryIndexes()
2022/12/21 03:32:00 Index found:  id_company
2022/12/21 03:32:00 Dropped index id_company
2022/12/21 03:32:02 Setting JSON docs in KV
2022/12/21 03:32:16 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:32:16 Index is 13094532880964605191 now active
2022/12/21 03:32:18 Build command issued for the deferred indexes [id_age id_gender id_isActive], bucket: default, scope: _default, coll: _default
2022/12/21 03:32:18 Waiting for the index id_age to become active
2022/12/21 03:32:18 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:19 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:20 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:21 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:22 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:23 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:24 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:25 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:26 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:27 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:28 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:29 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:30 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:31 Waiting for index 3465425217934272977 to go active ...
2022/12/21 03:32:32 Index is 3465425217934272977 now active
2022/12/21 03:32:32 Waiting for the index id_gender to become active
2022/12/21 03:32:32 Index is 13717534283556649886 now active
2022/12/21 03:32:32 Waiting for the index id_isActive to become active
2022/12/21 03:32:32 Index is 8758809312886725515 now active
2022/12/21 03:32:32 Using n1ql client
2022/12/21 03:32:32 Expected and Actual scan responses are the same
2022/12/21 03:32:35 Setting JSON docs in KV
2022/12/21 03:32:45 Using n1ql client
2022/12/21 03:32:46 Expected and Actual scan responses are the same
2022/12/21 03:32:46 Using n1ql client
2022/12/21 03:32:46 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (46.34s)
=== RUN   TestMultipleDeferredIndexes_BuildOneByOne
2022/12/21 03:32:46 In TestMultipleDeferredIndexes_BuildOneByOne()
2022/12/21 03:32:46 In DropAllSecondaryIndexes()
2022/12/21 03:32:46 Index found:  id_company
2022/12/21 03:32:46 Dropped index id_company
2022/12/21 03:32:46 Index found:  id_gender
2022/12/21 03:32:46 Dropped index id_gender
2022/12/21 03:32:46 Index found:  id_age
2022/12/21 03:32:46 Dropped index id_age
2022/12/21 03:32:46 Index found:  id_isActive
2022/12/21 03:32:47 Dropped index id_isActive
2022/12/21 03:32:49 Setting JSON docs in KV
2022/12/21 03:33:04 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:33:04 Index is 8647022749214693800 now active
2022/12/21 03:33:05 Build command issued for the deferred indexes [id_age], bucket: default, scope: _default, coll: _default
2022/12/21 03:33:05 Waiting for the index id_age to become active
2022/12/21 03:33:05 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:06 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:07 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:08 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:09 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:10 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:11 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:12 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:13 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:14 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:15 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:16 Waiting for index 14203503292935773318 to go active ...
2022/12/21 03:33:17 Index is 14203503292935773318 now active
2022/12/21 03:33:17 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2022/12/21 03:33:17 Waiting for the index id_gender to become active
2022/12/21 03:33:17 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:18 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:19 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:20 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:21 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:22 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:23 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:24 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:25 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:26 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:27 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:28 Waiting for index 8173336159452347377 to go active ...
2022/12/21 03:33:29 Index is 8173336159452347377 now active
2022/12/21 03:33:29 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2022/12/21 03:33:29 Waiting for the index id_isActive to become active
2022/12/21 03:33:29 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:30 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:31 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:32 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:33 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:34 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:35 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:36 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:37 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:38 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:39 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:40 Waiting for index 14726416008014317475 to go active ...
2022/12/21 03:33:41 Index is 14726416008014317475 now active
2022/12/21 03:33:41 Using n1ql client
2022/12/21 03:33:41 Expected and Actual scan responses are the same
2022/12/21 03:33:44 Setting JSON docs in KV
2022/12/21 03:33:52 Using n1ql client
2022/12/21 03:33:53 Expected and Actual scan responses are the same
2022/12/21 03:33:53 Using n1ql client
2022/12/21 03:33:54 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (67.57s)
=== RUN   TestDropDeferredIndexWhileOthersBuilding
2022/12/21 03:33:54 In TestDropDeferredIndexWhileOthersBuilding()
2022/12/21 03:33:54 In DropAllSecondaryIndexes()
2022/12/21 03:33:54 Index found:  id_company
2022/12/21 03:33:54 Dropped index id_company
2022/12/21 03:33:54 Index found:  id_age
2022/12/21 03:33:54 Dropped index id_age
2022/12/21 03:33:54 Index found:  id_gender
2022/12/21 03:33:54 Dropped index id_gender
2022/12/21 03:33:54 Index found:  id_isActive
2022/12/21 03:33:54 Dropped index id_isActive
2022/12/21 03:33:56 Setting JSON docs in KV
2022/12/21 03:34:15 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:34:15 Index is 11973634559098209013 now active
2022/12/21 03:34:16 Build command issued for the deferred indexes [640210164660185691 1464463903902459927]
2022/12/21 03:34:18 Dropping the secondary index id_isActive
2022/12/21 03:34:18 Index dropped
2022/12/21 03:34:18 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:19 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:20 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:21 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:22 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:23 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:24 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:25 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:26 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:27 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:28 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:29 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:30 Waiting for index 640210164660185691 to go active ...
2022/12/21 03:34:31 Index is 640210164660185691 now active
2022/12/21 03:34:31 Index is 1464463903902459927 now active
2022/12/21 03:34:32 Using n1ql client
2022/12/21 03:34:33 Expected and Actual scan responses are the same
2022/12/21 03:34:33 Using n1ql client
2022/12/21 03:34:33 Expected and Actual scan responses are the same
2022/12/21 03:34:35 Setting JSON docs in KV
2022/12/21 03:34:44 Using n1ql client
2022/12/21 03:34:44 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (50.44s)
=== RUN   TestDropBuildingDeferredIndex
2022/12/21 03:34:44 In TestDropBuildingDeferredIndex()
2022/12/21 03:34:44 In DropAllSecondaryIndexes()
2022/12/21 03:34:44 Index found:  id_company
2022/12/21 03:34:44 Dropped index id_company
2022/12/21 03:34:44 Index found:  id_gender
2022/12/21 03:34:44 Dropped index id_gender
2022/12/21 03:34:44 Index found:  id_age
2022/12/21 03:34:44 Dropped index id_age
2022/12/21 03:34:47 Setting JSON docs in KV
2022/12/21 03:34:53 Build command issued for the deferred indexes [11699004983195454457 4113581692550116066]
2022/12/21 03:34:54 Dropping the secondary index id_age
2022/12/21 03:34:54 Index dropped
2022/12/21 03:34:54 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:34:55 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:34:56 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:34:57 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:34:58 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:34:59 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:35:00 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:35:01 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:35:02 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:35:03 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:35:04 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:35:05 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:35:06 Waiting for index 11699004983195454457 to go active ...
2022/12/21 03:35:07 Index is 11699004983195454457 now active
2022/12/21 03:35:07 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2022/12/21 03:35:07 Waiting for the index id_gender to become active
2022/12/21 03:35:07 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:08 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:09 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:10 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:11 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:12 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:13 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:14 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:15 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:16 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:17 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:18 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:19 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:20 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:21 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:22 Waiting for index 818080610909102978 to go active ...
2022/12/21 03:35:23 Index is 818080610909102978 now active
2022/12/21 03:35:24 Using n1ql client
2022/12/21 03:35:24 Expected and Actual scan responses are the same
2022/12/21 03:35:25 Using n1ql client
2022/12/21 03:35:25 Expected and Actual scan responses are the same
2022/12/21 03:35:27 Setting JSON docs in KV
2022/12/21 03:35:37 Using n1ql client
2022/12/21 03:35:38 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (54.35s)
=== RUN   TestDropMultipleBuildingDeferredIndexes
2022/12/21 03:35:38 In TestDropMultipleBuildingDeferredIndexes()
2022/12/21 03:35:38 In DropAllSecondaryIndexes()
2022/12/21 03:35:38 Index found:  id_company
2022/12/21 03:35:39 Dropped index id_company
2022/12/21 03:35:39 Index found:  id_gender
2022/12/21 03:35:39 Dropped index id_gender
2022/12/21 03:35:46 Setting JSON docs in KV
2022/12/21 03:36:19 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:36:19 Index is 5749192483130981689 now active
2022/12/21 03:36:21 Build command issued for the deferred indexes [2783385000582587760 14983415812964265107]
2022/12/21 03:36:22 Dropping the secondary index id_age
2022/12/21 03:36:22 Index dropped
2022/12/21 03:36:22 Dropping the secondary index id_gender
2022/12/21 03:36:38 Index dropped
2022/12/21 03:36:38 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2022/12/21 03:36:38 Waiting for the index id_isActive to become active
2022/12/21 03:36:38 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:39 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:40 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:41 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:42 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:43 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:44 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:46 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:47 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:48 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:49 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:50 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:51 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:52 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:53 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:54 Waiting for index 11814041066092187184 to go active ...
2022/12/21 03:36:55 Index is 11814041066092187184 now active
2022/12/21 03:37:05 Using n1ql client
2022/12/21 03:37:06 Expected and Actual scan responses are the same
2022/12/21 03:37:06 Number of docScanResults and scanResults = 180000 and 180000
2022/12/21 03:37:06 Using n1ql client
2022/12/21 03:37:07 Expected and Actual scan responses are the same
2022/12/21 03:37:07 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (88.40s)
=== RUN   TestDropOneIndexSecondDeferBuilding
2022/12/21 03:37:07 In TestDropOneIndexSecondDeferBuilding()
2022/12/21 03:37:07 In DropAllSecondaryIndexes()
2022/12/21 03:37:07 Index found:  id_company
2022/12/21 03:37:07 Dropped index id_company
2022/12/21 03:37:07 Index found:  id_isActive
2022/12/21 03:37:07 Dropped index id_isActive
2022/12/21 03:37:10 Setting JSON docs in KV
2022/12/21 03:37:15 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2022/12/21 03:37:15 Waiting for the index id_company to become active
2022/12/21 03:37:15 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:16 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:17 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:18 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:19 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:20 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:21 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:22 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:23 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:24 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:25 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:26 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:27 Waiting for index 7282640673202567104 to go active ...
2022/12/21 03:37:28 Index is 7282640673202567104 now active
2022/12/21 03:37:28 Build command issued for the deferred indexes [11306449520849835501]
2022/12/21 03:37:29 Dropping the secondary index id_company
2022/12/21 03:37:30 Index dropped
2022/12/21 03:37:34 Setting JSON docs in KV
2022/12/21 03:37:51 Index is 11306449520849835501 now active
2022/12/21 03:37:51 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2022/12/21 03:37:51 Waiting for the index id_gender to become active
2022/12/21 03:37:51 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:37:52 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:37:53 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:37:54 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:37:55 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:37:56 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:37:57 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:37:58 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:37:59 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:00 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:01 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:02 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:03 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:04 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:05 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:06 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:07 Waiting for index 8458205795065141222 to go active ...
2022/12/21 03:38:08 Index is 8458205795065141222 now active
2022/12/21 03:38:08 Using n1ql client
2022/12/21 03:38:09 Expected and Actual scan responses are the same
2022/12/21 03:38:09 Using n1ql client
2022/12/21 03:38:11 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (63.86s)
=== RUN   TestDropSecondIndexSecondDeferBuilding
2022/12/21 03:38:11 In TestDropSecondIndexSecondDeferBuilding()
2022/12/21 03:38:11 In DropAllSecondaryIndexes()
2022/12/21 03:38:11 Index found:  id_gender
2022/12/21 03:38:11 Dropped index id_gender
2022/12/21 03:38:11 Index found:  id_age
2022/12/21 03:38:11 Dropped index id_age
2022/12/21 03:38:13 Setting JSON docs in KV
2022/12/21 03:38:19 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2022/12/21 03:38:19 Waiting for the index id_company to become active
2022/12/21 03:38:19 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:20 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:21 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:22 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:23 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:24 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:25 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:26 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:27 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:28 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:29 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:30 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:31 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:32 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:33 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:34 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:35 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:36 Waiting for index 2468975813032659521 to go active ...
2022/12/21 03:38:37 Index is 2468975813032659521 now active
2022/12/21 03:38:37 Build command issued for the deferred indexes [9383724274913680918]
2022/12/21 03:38:38 Dropping the secondary index id_age
2022/12/21 03:38:38 Index dropped
2022/12/21 03:38:42 Setting JSON docs in KV
2022/12/21 03:38:51 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2022/12/21 03:38:51 Waiting for the index id_gender to become active
2022/12/21 03:38:51 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:38:52 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:38:53 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:38:54 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:38:55 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:38:56 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:38:57 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:38:58 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:38:59 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:39:00 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:39:01 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:39:02 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:39:03 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:39:04 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:39:05 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:39:06 Waiting for index 9354053516886368905 to go active ...
2022/12/21 03:39:07 Index is 9354053516886368905 now active
2022/12/21 03:39:07 Using n1ql client
2022/12/21 03:39:07 Expected and Actual scan responses are the same
2022/12/21 03:39:08 Using n1ql client
2022/12/21 03:39:10 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (59.05s)
=== RUN   TestCreateAfterDropWhileIndexBuilding
2022/12/21 03:39:10 In TestCreateAfterDropWhileIndexBuilding()
2022/12/21 03:39:10 In DropAllSecondaryIndexes()
2022/12/21 03:39:10 Index found:  id_gender
2022/12/21 03:39:10 Dropped index id_gender
2022/12/21 03:39:10 Index found:  id_company
2022/12/21 03:39:10 Dropped index id_company
2022/12/21 03:39:34 Setting JSON docs in KV
2022/12/21 03:40:34 Build command issued for the deferred indexes [9201390532904219874]
2022/12/21 03:40:35 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:36 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:37 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:38 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:39 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:40 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:41 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:42 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:43 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:44 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:45 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:46 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:47 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:48 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:49 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:50 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:51 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:52 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:53 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:54 Waiting for index 9201390532904219874 to go active ...
2022/12/21 03:40:55 Index is 9201390532904219874 now active
2022/12/21 03:40:56 Build command issued for the deferred indexes [11952274659481399172]
2022/12/21 03:40:57 Dropping the secondary index id_company
2022/12/21 03:40:57 Index dropped
2022/12/21 03:40:57 Dropping the secondary index id_age
2022/12/21 03:40:58 Index dropped
2022/12/21 03:41:04 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2022/12/21 03:41:04 Waiting for the index id_gender to become active
2022/12/21 03:41:04 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:05 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:06 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:07 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:08 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:09 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:10 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:11 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:12 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:13 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:14 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:15 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:16 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:17 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:18 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:19 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:20 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:21 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:22 Waiting for index 14147931301878300277 to go active ...
2022/12/21 03:41:23 Index is 14147931301878300277 now active
2022/12/21 03:41:24 Index is 14147931301878300277 now active
2022/12/21 03:41:25 Using n1ql client
2022/12/21 03:41:27 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (136.98s)
=== RUN   TestDropBuildingIndex1
2022/12/21 03:41:27 In TestDropBuildingIndex1()
2022/12/21 03:41:27 In DropAllSecondaryIndexes()
2022/12/21 03:41:27 Index found:  id_gender
2022/12/21 03:41:27 Dropped index id_gender
2022/12/21 03:41:33 Setting JSON docs in KV
2022/12/21 03:42:09 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:42:09 Index is 1472954846815994921 now active
2022/12/21 03:42:38 Dropping the secondary index id_age
2022/12/21 03:42:38 Index dropped
2022/12/21 03:43:00 Created the secondary index id_age. Waiting for it become active
2022/12/21 03:43:00 Index is 14467734431616030103 now active
2022/12/21 03:43:02 Setting JSON docs in KV
2022/12/21 03:43:11 Using n1ql client
2022/12/21 03:43:12 Expected and Actual scan responses are the same
2022/12/21 03:43:12 Using n1ql client
2022/12/21 03:43:13 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex1 (106.04s)
=== RUN   TestDropBuildingIndex2
2022/12/21 03:43:13 In TestDropBuildingIndex2()
2022/12/21 03:43:13 In DropAllSecondaryIndexes()
2022/12/21 03:43:13 Index found:  id_company
2022/12/21 03:43:13 Dropped index id_company
2022/12/21 03:43:13 Index found:  id_age
2022/12/21 03:43:13 Dropped index id_age
2022/12/21 03:43:18 Setting JSON docs in KV
2022/12/21 03:43:51 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:43:51 Index is 9253287761143216976 now active
2022/12/21 03:44:17 Dropping the secondary index id_company
2022/12/21 03:44:17 Index dropped
2022/12/21 03:44:17 Index is 16391774481984604832 now active
2022/12/21 03:44:40 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:44:40 Index is 520087089417917484 now active
2022/12/21 03:44:43 Setting JSON docs in KV
2022/12/21 03:44:52 Using n1ql client
2022/12/21 03:44:53 Expected and Actual scan responses are the same
2022/12/21 03:44:53 Using n1ql client
2022/12/21 03:44:54 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex2 (100.81s)
=== RUN   TestDropIndexWithDataLoad
2022/12/21 03:44:54 In TestDropIndexWithDataLoad()
2022/12/21 03:44:54 In DropAllSecondaryIndexes()
2022/12/21 03:44:54 Index found:  id_age
2022/12/21 03:44:54 Dropped index id_age
2022/12/21 03:44:54 Index found:  id_company
2022/12/21 03:44:54 Dropped index id_company
2022/12/21 03:44:56 Setting JSON docs in KV
2022/12/21 03:45:25 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:45:25 Index is 17770139381234474484 now active
2022/12/21 03:45:52 Created the secondary index id_age. Waiting for it become active
2022/12/21 03:45:52 Index is 6162217717978157659 now active
2022/12/21 03:46:18 Created the secondary index id_gender. Waiting for it become active
2022/12/21 03:46:18 Index is 6831680578393627191 now active
2022/12/21 03:46:45 Created the secondary index id_isActive. Waiting for it become active
2022/12/21 03:46:45 Index is 3899038363374874098 now active
2022/12/21 03:46:53 Setting JSON docs in KV
2022/12/21 03:46:53 In LoadKVBucket
2022/12/21 03:46:53 Bucket name = default
2022/12/21 03:46:53 In DropIndexWhileKVLoad
2022/12/21 03:46:54 Dropping the secondary index id_company
2022/12/21 03:46:54 Index dropped
2022/12/21 03:47:21 Using n1ql client
2022/12/21 03:47:21 Expected and Actual scan responses are the same
2022/12/21 03:47:21 Number of docScanResults and scanResults = 96712 and 96712
2022/12/21 03:47:22 Using n1ql client
2022/12/21 03:47:25 Expected and Actual scan responses are the same
2022/12/21 03:47:25 Number of docScanResults and scanResults = 420000 and 420000
--- PASS: TestDropIndexWithDataLoad (151.75s)
=== RUN   TestDropAllIndexesWithDataLoad
2022/12/21 03:47:25 In TestDropAllIndexesWithDataLoad()
2022/12/21 03:47:25 In DropAllSecondaryIndexes()
2022/12/21 03:47:25 Index found:  id_isActive
2022/12/21 03:47:25 Dropped index id_isActive
2022/12/21 03:47:25 Index found:  id_age
2022/12/21 03:47:26 Dropped index id_age
2022/12/21 03:47:26 Index found:  id_gender
2022/12/21 03:47:26 Dropped index id_gender
2022/12/21 03:47:28 Setting JSON docs in KV
2022/12/21 03:48:07 Created the secondary index id_company. Waiting for it become active
2022/12/21 03:48:07 Index is 13626139279404889169 now active
2022/12/21 03:48:34 Created the secondary index id_age. Waiting for it become active
2022/12/21 03:48:34 Index is 10942472232213915630 now active
2022/12/21 03:49:00 Created the secondary index id_gender. Waiting for it become active
2022/12/21 03:49:00 Index is 15466266002824650400 now active
2022/12/21 03:49:26 Created the secondary index id_isActive. Waiting for it become active
2022/12/21 03:49:26 Index is 4995876862142044191 now active
2022/12/21 03:49:35 Setting JSON docs in KV
2022/12/21 03:49:35 In LoadKVBucket
2022/12/21 03:49:35 In DropIndexWhileKVLoad
2022/12/21 03:49:35 In DropIndexWhileKVLoad
2022/12/21 03:49:35 Bucket name = default
2022/12/21 03:49:35 In DropIndexWhileKVLoad
2022/12/21 03:49:35 In DropIndexWhileKVLoad
2022/12/21 03:49:36 Dropping the secondary index id_age
2022/12/21 03:49:36 Dropping the secondary index id_company
2022/12/21 03:49:36 Dropping the secondary index id_gender
2022/12/21 03:49:36 Dropping the secondary index id_isActive
2022/12/21 03:49:36 Index dropped
2022/12/21 03:49:36 Index dropped
2022/12/21 03:49:36 Index dropped
2022/12/21 03:49:37 Index dropped
2022/12/21 03:49:54 Using n1ql client
2022/12/21 03:49:54 Scan failed as expected with error: Index Not Found - cause: GSI index id_company not found.
--- PASS: TestDropAllIndexesWithDataLoad (148.33s)
=== RUN   TestCreateBucket_AnotherIndexBuilding
2022/12/21 03:49:54 In TestCreateBucket_AnotherIndexBuilding()
2022/12/21 03:49:54 In DropAllSecondaryIndexes()
2022/12/21 03:50:32 Flushed the bucket default, Response body: 
2022/12/21 03:50:35 Modified parameters of bucket default, responseBody: 
2022/12/21 03:50:35 http://127.0.0.1:9000/pools/default/buckets/multi_buck2
2022/12/21 03:50:35 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc0000460f8}
2022/12/21 03:50:35 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 20 Dec 2022 22:20:34 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc028f79140 31 [] false false map[] 0xc000192d00 }
2022/12/21 03:50:35 DeleteBucket failed for bucket multi_buck2 
2022/12/21 03:50:35 Deleted bucket multi_buck2, responseBody: Requested resource not found.
2022/12/21 03:50:50 Setting JSON docs in KV
2022/12/21 03:53:02 Created bucket multi_buck2, responseBody: 
2022/12/21 03:53:26 Index is 15113709378990935870 now active
2022/12/21 03:53:26 Index is 2546290163941438451 now active
2022/12/21 03:53:26 Using n1ql client
2022-12-21T03:53:26.322+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T03:53:26.322+05:30 [Info] GSIC[default/multi_buck2-_default-_default-1671575006318451057] started ...
2022/12/21 03:53:26 Expected and Actual scan responses are the same
2022/12/21 03:53:26 Number of docScanResults and scanResults = 10000 and 10000
2022/12/21 03:53:27 Using n1ql client
2022/12/21 03:53:31 Expected and Actual scan responses are the same
2022/12/21 03:53:31 Number of docScanResults and scanResults = 200000 and 200000
2022/12/21 03:53:33 Deleted bucket multi_buck2, responseBody: 
2022/12/21 03:54:11 Flushed the bucket default, Response body: 
--- PASS: TestCreateBucket_AnotherIndexBuilding (256.83s)
=== RUN   TestDropBucket2Index_Bucket1IndexBuilding
2022/12/21 03:54:11 In TestDropBucket2Index_Bucket1IndexBuilding()
2022/12/21 03:54:11 In DropAllSecondaryIndexes()
2022/12/21 03:54:11 Index found:  buck1_idx
2022/12/21 03:54:11 Dropped index buck1_idx
2022/12/21 03:54:49 Flushed the bucket default, Response body: 
2022/12/21 03:54:52 Modified parameters of bucket default, responseBody: 
2022/12/21 03:54:52 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3
2022/12/21 03:54:52 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc0000460f8}
2022/12/21 03:54:52 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 20 Dec 2022 22:24:51 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0135a8c40 31 [] false false map[] 0xc00660c100 }
2022/12/21 03:54:52 DeleteBucket failed for bucket multibucket_test3 
2022/12/21 03:54:52 Deleted bucket multibucket_test3, responseBody: Requested resource not found.
2022/12/21 03:54:52 Created bucket multibucket_test3, responseBody: 
2022/12/21 03:55:07 Setting JSON docs in KV
2022/12/21 03:56:13 Created the secondary index buck2_idx. Waiting for it become active
2022/12/21 03:56:13 Index is 7886229050834025471 now active
2022/12/21 03:56:27 Dropping the secondary index buck2_idx
2022/12/21 03:56:27 Index dropped
2022/12/21 03:56:27 Index is 1494723969252900766 now active
2022/12/21 03:56:27 Using n1ql client
2022/12/21 03:56:30 Expected and Actual scan responses are the same
2022/12/21 03:56:30 Number of docScanResults and scanResults = 100000 and 100000
2022/12/21 03:56:32 Deleted bucket multibucket_test3, responseBody: 
2022/12/21 03:57:10 Flushed the bucket default, Response body: 
--- PASS: TestDropBucket2Index_Bucket1IndexBuilding (179.43s)
=== RUN   TestDeleteBucketWhileInitialIndexBuild
2022/12/21 03:57:10 In TestDeleteBucketWhileInitialIndexBuild()
2022/12/21 03:57:10 ============== DBG: Drop all indexes in all buckets
2022/12/21 03:57:10 In DropAllSecondaryIndexes()
2022/12/21 03:57:10 Index found:  buck1_idx
2022/12/21 03:57:10 Dropped index buck1_idx
2022/12/21 03:57:10 ============== DBG: Delete bucket default
2022/12/21 03:57:12 Deleted bucket default, responseBody: 
2022/12/21 03:57:12 ============== DBG: Create bucket default
2022/12/21 03:57:12 Created bucket default, responseBody: 
2022/12/21 03:57:15 Flush Enabled on bucket default, responseBody: 
2022/12/21 03:57:49 Flushed the bucket default, Response body: 
2022/12/21 03:57:49 ============== DBG: Delete bucket testbucket2
2022/12/21 03:57:49 http://127.0.0.1:9000/pools/default/buckets/testbucket2
2022/12/21 03:57:49 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc0000460f8}
2022/12/21 03:57:49 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 20 Dec 2022 22:27:48 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc003acdbc0 31 [] false false map[] 0xc007a92100 }
2022/12/21 03:57:49 DeleteBucket failed for bucket testbucket2 
2022/12/21 03:57:49 Deleted bucket testbucket2, responseBody: Requested resource not found.
2022/12/21 03:57:49 ============== DBG: Create bucket testbucket2
2022/12/21 03:57:49 Created bucket testbucket2, responseBody: 
2022/12/21 03:57:52 Flush Enabled on bucket testbucket2, responseBody: 
2022/12/21 03:58:26 Flushed the bucket testbucket2, Response body: 
2022/12/21 03:58:26 ============== DBG: Delete bucket testbucket3
2022/12/21 03:58:26 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2022/12/21 03:58:26 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc0000460f8}
2022/12/21 03:58:26 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 20 Dec 2022 22:28:25 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc000f621c0 31 [] false false map[] 0xc00660c100 }
2022/12/21 03:58:26 DeleteBucket failed for bucket testbucket3 
2022/12/21 03:58:26 Deleted bucket testbucket3, responseBody: Requested resource not found.
2022/12/21 03:58:26 ============== DBG: Create bucket testbucket3
2022/12/21 03:58:26 Created bucket testbucket3, responseBody: 
2022/12/21 03:58:29 Flush Enabled on bucket testbucket3, responseBody: 
2022/12/21 03:59:03 Flushed the bucket testbucket3, Response body: 
2022/12/21 03:59:03 ============== DBG: Delete bucket testbucket4
2022/12/21 03:59:03 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2022/12/21 03:59:03 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc0000460f8}
2022/12/21 03:59:03 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 20 Dec 2022 22:29:02 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc001b7e240 31 [] false false map[] 0xc01009c400 }
2022/12/21 03:59:03 DeleteBucket failed for bucket testbucket4 
2022/12/21 03:59:03 Deleted bucket testbucket4, responseBody: Requested resource not found.
2022/12/21 03:59:03 ============== DBG: Create bucket testbucket4
2022/12/21 03:59:03 Created bucket testbucket4, responseBody: 
2022/12/21 03:59:06 Flush Enabled on bucket testbucket4, responseBody: 
2022/12/21 03:59:39 Flushed the bucket testbucket4, Response body: 
2022/12/21 03:59:54 Generating docs and Populating all the buckets
2022/12/21 03:59:54 ============== DBG: Creating docs in bucket default
2022/12/21 03:59:55 ============== DBG: Creating index bucket1_age in bucket default
2022/12/21 03:59:59 Created the secondary index bucket1_age. Waiting for it become active
2022/12/21 03:59:59 Index is 14940840269272114939 now active
2022/12/21 03:59:59 ============== DBG: Creating index bucket1_gender in bucket default
2022/12/21 04:00:06 Created the secondary index bucket1_gender. Waiting for it become active
2022/12/21 04:00:06 Index is 16902642694849860771 now active
2022/12/21 04:00:06 ============== DBG: Creating docs in bucket testbucket2
2022/12/21 04:00:07 ============== DBG: Creating index bucket2_city in bucket testbucket2
2022/12/21 04:00:12 Created the secondary index bucket2_city. Waiting for it become active
2022/12/21 04:00:12 Index is 11524189143122784602 now active
2022/12/21 04:00:12 ============== DBG: Creating index bucket2_company in bucket testbucket2
2022/12/21 04:00:19 Created the secondary index bucket2_company. Waiting for it become active
2022/12/21 04:00:19 Index is 8848798916597641711 now active
2022/12/21 04:00:19 ============== DBG: Creating docs in bucket testbucket3
2022/12/21 04:00:20 ============== DBG: Creating index bucket3_gender in bucket testbucket3
2022/12/21 04:00:25 Created the secondary index bucket3_gender. Waiting for it become active
2022/12/21 04:00:25 Index is 9741451601840816510 now active
2022/12/21 04:00:25 ============== DBG: Creating index bucket3_address in bucket testbucket3
2022/12/21 04:00:33 Created the secondary index bucket3_address. Waiting for it become active
2022/12/21 04:00:33 Index is 16046629255399961403 now active
2022/12/21 04:00:33 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2022/12/21 04:00:33 Using n1ql client
2022-12-21T04:00:33.299+05:30 [Info] metadata provider version changed 1292 -> 1293
2022-12-21T04:00:33.299+05:30 [Info] switched currmeta from 1292 -> 1293 force false 
2022-12-21T04:00:33.299+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T04:00:33.299+05:30 [Info] GSIC[default/default-_default-_default-1671575433293656070] started ...
2022/12/21 04:00:33 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2022/12/21 04:00:33 Expected and Actual scan responses are the same
2022/12/21 04:00:44 ============== DBG: Creating 50K docs in bucket testbucket4
2022/12/21 04:01:13 ============== DBG: Creating index bucket4_balance asynchronously in bucket testbucket4
2022/12/21 04:01:23 ============== DBG: Deleting bucket testbucket4
2022/12/21 04:01:24 Deleted bucket testbucket4, responseBody: 
2022/12/21 04:01:24 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2022/12/21 04:01:24 Using n1ql client
2022/12/21 04:01:24 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2022/12/21 04:01:24 Expected and Actual scan responses are the same
2022/12/21 04:01:24 ============== DBG: Second bucket scan:: Scanning index bucket2_city in bucket testbucket2
2022/12/21 04:01:24 Using n1ql client
2022-12-21T04:01:24.860+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T04:01:24.861+05:30 [Info] GSIC[default/testbucket2-_default-_default-1671575484856131195] started ...
2022/12/21 04:01:24 ============== DBG: Second bucket scan:: Expected results = 392 Actual results = 392
2022/12/21 04:01:24 Expected and Actual scan responses are the same
2022/12/21 04:01:24 ============== DBG: Third bucket scan:: Scanning index bucket3_gender in bucket testbucket3
2022/12/21 04:01:24 Using n1ql client
2022-12-21T04:01:24.897+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-12-21T04:01:24.898+05:30 [Info] GSIC[default/testbucket3-_default-_default-1671575484882373559] started ...
2022/12/21 04:01:24 ============== DBG: Third bucket scan:: Expected results = 492 Actual results = 492
2022/12/21 04:01:24 Expected and Actual scan responses are the same
2022/12/21 04:01:24 ============== DBG: Deleting buckets testbucket2 testbucket3 testbucket4
2022/12/21 04:01:27 Deleted bucket testbucket2, responseBody: 
2022/12/21 04:01:30 Deleted bucket testbucket3, responseBody: 
2022/12/21 04:01:30 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2022/12/21 04:01:30 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc0000460f8}
2022/12/21 04:01:30 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 20 Dec 2022 22:31:30 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc005eeaa80 31 [] false false map[] 0xc008e21200 }
2022/12/21 04:01:30 DeleteBucket failed for bucket testbucket4 
2022/12/21 04:01:30 Deleted bucket testbucket4, responseBody: Requested resource not found.
2022/12/21 04:01:33 Modified parameters of bucket default, responseBody: 
--- PASS: TestDeleteBucketWhileInitialIndexBuild (278.50s)
=== RUN   TestWherClause_UpdateDocument
2022/12/21 04:01:48 In TestWherClause_UpdateDocument()
2022/12/21 04:01:48 In DropAllSecondaryIndexes()
2022/12/21 04:01:48 Index found:  bucket1_gender
2022/12/21 04:01:49 Dropped index bucket1_gender
2022/12/21 04:01:49 Index found:  bucket1_age
2022/12/21 04:01:49 Dropped index bucket1_age
2022/12/21 04:02:27 Flushed the bucket default, Response body: 
2022/12/21 04:02:29 Setting JSON docs in KV
2022/12/21 04:02:38 Created the secondary index id_ageGreaterThan40. Waiting for it become active
2022/12/21 04:02:38 Index is 5204324761009788425 now active
2022/12/21 04:02:38 Using n1ql client
2022/12/21 04:02:39 Expected and Actual scan responses are the same
2022/12/21 04:02:39 Number of docScanResults and scanResults = 5981 and 5981
2022/12/21 04:02:44 Using n1ql client
2022/12/21 04:02:44 Expected and Actual scan responses are the same
2022/12/21 04:02:44 Number of docScanResults and scanResults = 1981 and 1981
--- PASS: TestWherClause_UpdateDocument (55.19s)
=== RUN   TestDeferFalse
2022/12/21 04:02:44 In TestDeferFalse()
2022/12/21 04:02:46 Setting JSON docs in KV
2022/12/21 04:03:00 Created the secondary index index_deferfalse1. Waiting for it become active
2022/12/21 04:03:00 Index is 11030967498425212798 now active
2022/12/21 04:03:00 Using n1ql client
2022/12/21 04:03:00 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse (16.48s)
=== RUN   TestDeferFalse_CloseClientConnection
2022/12/21 04:03:00 In TestDeferFalse_CloseClientConnection()
2022/12/21 04:03:00 In CloseClientThread
2022/12/21 04:03:00 In CreateIndexThread
2022/12/21 04:03:02 Create Index call failed as expected due to error : Terminate Request due to client termination
2022-12-21T04:03:02.670+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:40934->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022/12/21 04:03:02 Waiting for index 3803935471059827654 to go active ...
2022/12/21 04:03:03 Waiting for index 3803935471059827654 to go active ...
2022/12/21 04:03:04 Waiting for index 3803935471059827654 to go active ...
2022/12/21 04:03:05 Waiting for index 3803935471059827654 to go active ...
2022/12/21 04:03:06 Waiting for index 3803935471059827654 to go active ...
2022/12/21 04:03:07 Waiting for index 3803935471059827654 to go active ...
2022/12/21 04:03:08 Index is 3803935471059827654 now active
2022/12/21 04:03:08 Using n1ql client
2022/12/21 04:03:08 Expected and Actual scan responses are the same
2022-12-21T04:03:08.755+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:40972->127.0.0.1:9106: use of closed network connection. Kill Pipe.
--- PASS: TestDeferFalse_CloseClientConnection (8.13s)
=== RUN   TestOrphanIndexCleanup
2022/12/21 04:03:08 In DropAllSecondaryIndexes()
2022/12/21 04:03:08 Index found:  index_deferfalse2
2022/12/21 04:03:08 Dropped index index_deferfalse2
2022/12/21 04:03:08 Index found:  index_deferfalse1
2022/12/21 04:03:08 Dropped index index_deferfalse1
2022/12/21 04:03:08 Index found:  id_ageGreaterThan40
2022/12/21 04:03:09 Dropped index id_ageGreaterThan40
2022/12/21 04:03:23 Created the secondary index idx1_age_regular. Waiting for it become active
2022/12/21 04:03:23 Index is 11577784228296539770 now active
2022/12/21 04:03:31 Created the secondary index idx2_company_regular. Waiting for it become active
2022/12/21 04:03:31 Index is 4047276212110742197 now active
2022/12/21 04:03:41 Using n1ql client
2022/12/21 04:03:41 Query on idx1_age_regular is successful
2022/12/21 04:03:41 Using n1ql client
2022/12/21 04:03:41 Query on idx2_company_regular is successful
Restarting indexer process ...
2022/12/21 04:03:41 []
2022-12-21T04:03:41.977+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:03:41.977+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-12-21T04:03:41.977+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:03:41.979+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-12-21T04:03:45.981+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:03:45.982+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41732:127.0.0.1:9106
2022-12-21T04:03:45.983+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:03:45.983+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41734:127.0.0.1:9106
2022-12-21T04:03:53.985+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:03:53.985+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41828:127.0.0.1:9106
2022-12-21T04:03:53.987+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:03:53.987+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41830:127.0.0.1:9106
2022/12/21 04:04:01 Using n1ql client
2022-12-21T04:04:01.935+05:30 [Error] transport error between 127.0.0.1:60204->127.0.0.1:9107: write tcp 127.0.0.1:60204->127.0.0.1:9107: write: broken pipe
2022-12-21T04:04:01.935+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -5978356837262783812 request transport failed `write tcp 127.0.0.1:60204->127.0.0.1:9107: write: broken pipe`
2022-12-21T04:04:01.936+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-12-21T04:04:01.936+05:30 [Error] metadataClient:PickRandom: Replicas - [1803555351526927650], PrunedReplica - map[], FilteredReplica map[]
2022/12/21 04:04:01 Query on idx1_age_regular is successful - after indexer restart.
2022/12/21 04:04:01 Using n1ql client
2022/12/21 04:04:01 Query on idx2_company_regular is successful - after indexer restart.
--- PASS: TestOrphanIndexCleanup (53.21s)
=== RUN   TestOrphanPartitionCleanup
2022-12-21T04:04:09.989+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:04:09.989+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41996:127.0.0.1:9106
2022-12-21T04:04:09.990+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:04:09.991+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41998:127.0.0.1:9106
2022-12-21T04:04:39.993+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:04:39.993+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42298:127.0.0.1:9106
2022-12-21T04:04:39.994+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:04:39.995+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42300:127.0.0.1:9106
2022-12-21T04:05:09.997+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:05:09.997+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42612:127.0.0.1:9106
2022-12-21T04:05:09.998+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:05:09.999+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42614:127.0.0.1:9106
2022-12-21T04:05:40.002+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:05:40.002+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42916:127.0.0.1:9106
2022-12-21T04:05:40.003+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:05:40.003+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42918:127.0.0.1:9106
2022-12-21T04:06:10.006+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:06:10.006+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43220:127.0.0.1:9106
2022-12-21T04:06:10.006+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:06:10.007+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43218:127.0.0.1:9106
2022-12-21T04:06:40.010+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:06:40.010+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43530:127.0.0.1:9106
2022-12-21T04:06:40.010+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:06:40.010+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43532:127.0.0.1:9106
2022-12-21T04:07:10.013+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:07:10.014+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43840:127.0.0.1:9106
2022-12-21T04:07:10.014+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:07:10.014+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43842:127.0.0.1:9106
2022-12-21T04:07:40.017+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:07:40.017+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44146:127.0.0.1:9106
2022-12-21T04:07:40.018+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:07:40.018+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44144:127.0.0.1:9106
2022-12-21T04:08:10.022+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:08:10.022+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:08:10.022+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44452:127.0.0.1:9106
2022-12-21T04:08:10.022+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44450:127.0.0.1:9106
2022-12-21T04:08:40.025+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:08:40.025+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44754:127.0.0.1:9106
2022-12-21T04:08:40.026+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:08:40.026+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44756:127.0.0.1:9106
2022-12-21T04:09:10.029+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:09:10.029+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45048:127.0.0.1:9106
2022-12-21T04:09:10.029+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:09:10.029+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45050:127.0.0.1:9106
2022-12-21T04:09:40.033+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:09:40.033+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:09:40.033+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45352:127.0.0.1:9106
2022-12-21T04:09:40.033+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45354:127.0.0.1:9106
2022-12-21T04:10:10.037+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:10:10.037+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45660:127.0.0.1:9106
2022-12-21T04:10:10.037+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:10:10.037+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45658:127.0.0.1:9106
2022-12-21T04:10:40.041+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:10:40.041+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45962:127.0.0.1:9106
2022-12-21T04:10:40.041+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:10:40.042+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45964:127.0.0.1:9106
2022-12-21T04:11:10.045+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:11:10.046+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:46264:127.0.0.1:9106
2022-12-21T04:11:10.046+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:11:10.047+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:11:10.047+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46262:127.0.0.1:9106
2022-12-21T04:11:40.049+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:11:40.050+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46576:127.0.0.1:9106
2022-12-21T04:11:40.050+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:11:40.050+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46578:127.0.0.1:9106
2022-12-21T04:12:10.054+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:12:10.054+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46884:127.0.0.1:9106
2022-12-21T04:12:10.056+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:12:10.056+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46882:127.0.0.1:9106
2022-12-21T04:12:40.058+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:12:40.059+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47188:127.0.0.1:9106
2022-12-21T04:12:40.059+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:12:40.059+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47186:127.0.0.1:9106
2022-12-21T04:13:10.062+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:13:10.063+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47498:127.0.0.1:9106
2022-12-21T04:13:10.063+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:13:10.063+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47496:127.0.0.1:9106
2022-12-21T04:13:40.067+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:13:40.067+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47804:127.0.0.1:9106
2022-12-21T04:13:40.068+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:13:40.068+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47802:127.0.0.1:9106
2022-12-21T04:14:10.071+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:14:10.071+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48120:127.0.0.1:9106
2022-12-21T04:14:10.072+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:14:10.072+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48118:127.0.0.1:9106
2022-12-21T04:14:40.074+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:14:40.075+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48422:127.0.0.1:9106
2022-12-21T04:14:40.075+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:14:40.075+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48424:127.0.0.1:9106
2022-12-21T04:15:10.078+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:15:10.079+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48732:127.0.0.1:9106
2022-12-21T04:15:10.079+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:15:10.079+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48734:127.0.0.1:9106
2022-12-21T04:15:40.082+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:15:40.082+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49040:127.0.0.1:9106
2022-12-21T04:15:40.082+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:15:40.082+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49038:127.0.0.1:9106
2022-12-21T04:16:10.087+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:16:10.087+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49344:127.0.0.1:9106
2022-12-21T04:16:10.087+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:16:10.087+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49346:127.0.0.1:9106
2022-12-21T04:16:40.091+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:16:40.091+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49656:127.0.0.1:9106
2022-12-21T04:16:40.091+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:16:40.091+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49654:127.0.0.1:9106
2022-12-21T04:17:10.134+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:17:10.139+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49956:127.0.0.1:9106
2022-12-21T04:17:10.147+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:17:10.158+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49958:127.0.0.1:9106
2022-12-21T04:17:40.143+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:17:40.143+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50260:127.0.0.1:9106
2022-12-21T04:17:40.176+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:17:40.176+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50262:127.0.0.1:9106
2022-12-21T04:18:10.147+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:18:10.147+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50566:127.0.0.1:9106
2022-12-21T04:18:10.180+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:18:10.180+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50568:127.0.0.1:9106
2022-12-21T04:18:40.151+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:18:40.151+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50864:127.0.0.1:9106
2022-12-21T04:18:40.183+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:18:40.184+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50866:127.0.0.1:9106
2022-12-21T04:19:10.155+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:19:10.155+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51180:127.0.0.1:9106
2022-12-21T04:19:10.187+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:19:10.187+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51182:127.0.0.1:9106
2022-12-21T04:19:40.158+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:19:40.158+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51484:127.0.0.1:9106
2022-12-21T04:19:40.190+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:19:40.190+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51486:127.0.0.1:9106
2022-12-21T04:20:10.161+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:20:10.161+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51790:127.0.0.1:9106
2022-12-21T04:20:10.193+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:20:10.193+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51792:127.0.0.1:9106
2022-12-21T04:20:40.165+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:20:40.165+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52094:127.0.0.1:9106
2022-12-21T04:20:40.196+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:20:40.196+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52096:127.0.0.1:9106
2022-12-21T04:21:10.168+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:21:10.168+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52400:127.0.0.1:9106
2022-12-21T04:21:10.199+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:21:10.199+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52402:127.0.0.1:9106
2022-12-21T04:21:40.171+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:21:40.172+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52710:127.0.0.1:9106
2022-12-21T04:21:40.202+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:21:40.203+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52712:127.0.0.1:9106
2022-12-21T04:22:10.174+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:22:10.175+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53016:127.0.0.1:9106
2022-12-21T04:22:10.205+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:22:10.205+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53018:127.0.0.1:9106
2022-12-21T04:22:40.178+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:22:40.178+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53318:127.0.0.1:9106
2022-12-21T04:22:40.208+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:22:40.208+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:22:40.208+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:53320:127.0.0.1:9106
2022-12-21T04:23:10.182+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:23:10.182+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53624:127.0.0.1:9106
2022-12-21T04:23:10.211+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:23:10.211+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53626:127.0.0.1:9106
2022-12-21T04:23:40.185+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:23:40.185+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53948:127.0.0.1:9106
2022-12-21T04:23:40.214+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:23:40.215+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53950:127.0.0.1:9106
2022-12-21T04:24:10.190+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:24:10.190+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54278:127.0.0.1:9106
2022-12-21T04:24:10.218+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:24:10.218+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54280:127.0.0.1:9106
2022-12-21T04:24:40.194+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:24:40.194+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54574:127.0.0.1:9106
2022-12-21T04:24:40.221+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:24:40.221+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54576:127.0.0.1:9106
2022-12-21T04:25:10.198+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:25:10.198+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54892:127.0.0.1:9106
2022-12-21T04:25:10.224+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:25:10.224+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54894:127.0.0.1:9106
2022-12-21T04:25:40.201+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:25:40.202+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55188:127.0.0.1:9106
2022-12-21T04:25:40.228+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:25:40.228+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55190:127.0.0.1:9106
2022-12-21T04:26:10.205+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:26:10.206+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55494:127.0.0.1:9106
2022-12-21T04:26:10.231+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:26:10.231+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55496:127.0.0.1:9106
2022-12-21T04:26:40.209+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:26:40.209+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55798:127.0.0.1:9106
2022-12-21T04:26:40.234+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:26:40.234+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55800:127.0.0.1:9106
2022-12-21T04:27:10.213+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:27:10.213+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56106:127.0.0.1:9106
2022-12-21T04:27:10.237+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:27:10.237+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56108:127.0.0.1:9106
2022-12-21T04:27:40.216+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:27:40.216+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56410:127.0.0.1:9106
2022-12-21T04:27:40.240+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:27:40.241+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56412:127.0.0.1:9106
2022-12-21T04:28:10.220+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:28:10.220+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56716:127.0.0.1:9106
2022-12-21T04:28:10.244+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:28:10.244+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56718:127.0.0.1:9106
2022-12-21T04:28:40.224+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:28:40.225+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57016:127.0.0.1:9106
2022-12-21T04:28:40.248+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:28:40.248+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57020:127.0.0.1:9106
2022-12-21T04:29:10.229+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:29:10.229+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57330:127.0.0.1:9106
2022-12-21T04:29:10.252+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:29:10.252+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57332:127.0.0.1:9106
2022-12-21T04:29:40.233+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:29:40.234+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57632:127.0.0.1:9106
2022-12-21T04:29:40.255+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:29:40.255+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57634:127.0.0.1:9106
2022-12-21T04:30:10.237+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:30:10.237+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57940:127.0.0.1:9106
2022-12-21T04:30:10.258+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:30:10.258+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57942:127.0.0.1:9106
2022-12-21T04:30:40.240+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:30:40.240+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58244:127.0.0.1:9106
2022-12-21T04:30:40.260+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:30:40.261+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58246:127.0.0.1:9106
2022-12-21T04:31:10.244+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:31:10.244+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58554:127.0.0.1:9106
2022-12-21T04:31:10.263+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:31:10.263+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58556:127.0.0.1:9106
2022-12-21T04:31:40.248+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:31:40.248+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:58866:127.0.0.1:9106
2022-12-21T04:31:40.248+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:31:40.266+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:31:40.266+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58868:127.0.0.1:9106
2022-12-21T04:32:10.252+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:32:10.252+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59166:127.0.0.1:9106
2022-12-21T04:32:10.270+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:32:10.270+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59168:127.0.0.1:9106
2022-12-21T04:32:40.255+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:32:40.256+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59470:127.0.0.1:9106
2022-12-21T04:32:40.273+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:32:40.274+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59472:127.0.0.1:9106
2022-12-21T04:33:10.259+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:33:10.260+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59780:127.0.0.1:9106
2022-12-21T04:33:10.277+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:33:10.277+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59782:127.0.0.1:9106
2022-12-21T04:33:40.263+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:33:40.263+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60086:127.0.0.1:9106
2022-12-21T04:33:40.280+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:33:40.280+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60088:127.0.0.1:9106
2022-12-21T04:34:10.266+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:34:10.266+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60404:127.0.0.1:9106
2022-12-21T04:34:10.283+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:34:10.283+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60406:127.0.0.1:9106
2022-12-21T04:34:40.270+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:34:40.270+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60708:127.0.0.1:9106
2022-12-21T04:34:40.286+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:34:40.287+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60710:127.0.0.1:9106
2022-12-21T04:35:10.274+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:35:10.274+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:32782:127.0.0.1:9106
2022-12-21T04:35:10.289+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:35:10.290+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:32784:127.0.0.1:9106
2022-12-21T04:35:40.278+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:35:40.278+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33086:127.0.0.1:9106
2022-12-21T04:35:40.292+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:35:40.292+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33088:127.0.0.1:9106
2022-12-21T04:36:10.282+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:36:10.282+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33394:127.0.0.1:9106
2022-12-21T04:36:10.296+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:36:10.296+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33396:127.0.0.1:9106
2022-12-21T04:36:40.285+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:36:40.285+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33706:127.0.0.1:9106
2022-12-21T04:36:40.300+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:36:40.300+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33708:127.0.0.1:9106
2022-12-21T04:37:10.289+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:37:10.289+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:37:10.289+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:34016:127.0.0.1:9106
2022-12-21T04:37:10.303+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:37:10.303+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:34018:127.0.0.1:9106
2022-12-21T04:37:10.303+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:37:40.292+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:37:40.292+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34320:127.0.0.1:9106
2022-12-21T04:37:40.306+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:37:40.306+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34322:127.0.0.1:9106
2022-12-21T04:38:10.296+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:38:10.296+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34626:127.0.0.1:9106
2022-12-21T04:38:10.309+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:38:10.309+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34628:127.0.0.1:9106
2022-12-21T04:38:40.300+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:38:40.300+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34930:127.0.0.1:9106
2022-12-21T04:38:40.311+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:38:40.312+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34932:127.0.0.1:9106
2022-12-21T04:39:10.303+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:39:10.304+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35240:127.0.0.1:9106
2022-12-21T04:39:10.315+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:39:10.315+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35246:127.0.0.1:9106
2022-12-21T04:39:40.307+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:39:40.308+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35538:127.0.0.1:9106
2022-12-21T04:39:40.318+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:39:40.318+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35542:127.0.0.1:9106
2022-12-21T04:40:10.311+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:40:10.311+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35836:127.0.0.1:9106
2022-12-21T04:40:10.322+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:40:10.323+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35838:127.0.0.1:9106
2022-12-21T04:40:40.315+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:40:40.315+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36140:127.0.0.1:9106
2022-12-21T04:40:40.326+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:40:40.326+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36142:127.0.0.1:9106
2022-12-21T04:41:10.320+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:41:10.320+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:41:10.320+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:36446:127.0.0.1:9106
2022-12-21T04:41:10.330+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:41:10.330+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36448:127.0.0.1:9106
2022-12-21T04:41:40.323+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:41:40.323+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36748:127.0.0.1:9106
2022-12-21T04:41:40.333+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:41:40.333+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36752:127.0.0.1:9106
2022-12-21T04:42:10.327+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:42:10.327+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37054:127.0.0.1:9106
2022-12-21T04:42:10.337+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:42:10.337+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37056:127.0.0.1:9106
2022-12-21T04:42:40.331+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:42:40.331+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37358:127.0.0.1:9106
2022-12-21T04:42:40.340+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:42:40.340+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37360:127.0.0.1:9106
2022-12-21T04:43:10.334+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:43:10.334+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37668:127.0.0.1:9106
2022-12-21T04:43:10.343+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:43:10.343+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37670:127.0.0.1:9106
2022-12-21T04:43:40.338+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:43:40.338+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37974:127.0.0.1:9106
2022-12-21T04:43:40.346+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:43:40.347+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37976:127.0.0.1:9106
2022-12-21T04:44:10.341+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:44:10.341+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38288:127.0.0.1:9106
2022-12-21T04:44:10.350+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:44:10.350+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38290:127.0.0.1:9106
2022-12-21T04:44:40.345+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:44:40.345+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38592:127.0.0.1:9106
2022-12-21T04:44:40.353+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:44:40.353+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38594:127.0.0.1:9106
2022-12-21T04:45:10.349+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:45:10.349+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38906:127.0.0.1:9106
2022-12-21T04:45:10.357+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:45:10.357+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38908:127.0.0.1:9106
2022-12-21T04:45:40.353+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:45:40.353+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39210:127.0.0.1:9106
2022-12-21T04:45:40.359+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:45:40.359+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39212:127.0.0.1:9106
2022-12-21T04:46:10.356+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:46:10.357+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39516:127.0.0.1:9106
2022-12-21T04:46:10.361+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:46:10.361+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:39518:127.0.0.1:9106
2022-12-21T04:46:10.362+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:46:40.390+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:46:40.391+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39828:127.0.0.1:9106
2022-12-21T04:46:40.393+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:46:40.395+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39826:127.0.0.1:9106
2022-12-21T04:47:10.394+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:47:10.394+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40128:127.0.0.1:9106
2022-12-21T04:47:10.398+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:47:10.398+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40130:127.0.0.1:9106
2022-12-21T04:47:40.398+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:47:40.398+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40432:127.0.0.1:9106
2022-12-21T04:47:40.401+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:47:40.401+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:40434:127.0.0.1:9106
2022-12-21T04:47:40.401+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:48:10.402+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:48:10.402+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40740:127.0.0.1:9106
2022-12-21T04:48:10.404+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:48:10.404+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40742:127.0.0.1:9106
2022-12-21T04:48:40.406+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:48:40.406+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41044:127.0.0.1:9106
2022-12-21T04:48:40.407+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:48:40.407+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41046:127.0.0.1:9106
2022-12-21T04:49:10.410+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:49:10.410+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:49:10.411+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41364:127.0.0.1:9106
2022-12-21T04:49:10.411+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41366:127.0.0.1:9106
2022-12-21T04:49:40.414+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:49:40.414+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41670:127.0.0.1:9106
2022-12-21T04:49:40.414+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:49:40.414+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41672:127.0.0.1:9106
2022-12-21T04:50:10.418+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:50:10.418+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41988:127.0.0.1:9106
2022-12-21T04:50:10.418+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:50:10.419+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41986:127.0.0.1:9106
2022-12-21T04:50:40.421+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:50:40.422+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42292:127.0.0.1:9106
2022-12-21T04:50:40.422+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:50:40.422+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:42290:127.0.0.1:9106
2022-12-21T04:50:40.422+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:51:10.425+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:51:10.426+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42600:127.0.0.1:9106
2022-12-21T04:51:10.426+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:51:10.426+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42602:127.0.0.1:9106
2022-12-21T04:51:40.429+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:51:40.429+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:51:40.429+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42906:127.0.0.1:9106
2022-12-21T04:51:40.429+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42904:127.0.0.1:9106
2022-12-21T04:52:10.432+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:52:10.433+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43210:127.0.0.1:9106
2022-12-21T04:52:10.433+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:52:10.433+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43212:127.0.0.1:9106
2022-12-21T04:52:40.436+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:52:40.436+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43514:127.0.0.1:9106
2022-12-21T04:52:40.436+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:52:40.437+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43516:127.0.0.1:9106
2022-12-21T04:53:10.440+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:53:10.440+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43814:127.0.0.1:9106
2022-12-21T04:53:10.440+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:53:10.440+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43816:127.0.0.1:9106
2022-12-21T04:53:40.444+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:53:40.444+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44142:127.0.0.1:9106
2022-12-21T04:53:40.445+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:53:40.445+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44140:127.0.0.1:9106
2022-12-21T04:54:10.449+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:54:10.449+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:54:10.449+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44472:127.0.0.1:9106
2022-12-21T04:54:10.449+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44470:127.0.0.1:9106
2022-12-21T04:54:40.452+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:54:40.452+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44776:127.0.0.1:9106
2022-12-21T04:54:40.452+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:54:40.453+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44774:127.0.0.1:9106
2022-12-21T04:55:10.456+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:55:10.456+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45094:127.0.0.1:9106
2022-12-21T04:55:10.456+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:55:10.457+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45096:127.0.0.1:9106
2022-12-21T04:55:40.460+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:55:40.460+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45394:127.0.0.1:9106
2022-12-21T04:55:40.461+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:55:40.461+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45392:127.0.0.1:9106
2022-12-21T04:56:10.464+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:56:10.464+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45694:127.0.0.1:9106
2022-12-21T04:56:10.464+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:56:10.465+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45696:127.0.0.1:9106
2022-12-21T04:56:40.469+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:56:40.469+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T04:56:40.469+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:46000:127.0.0.1:9106
2022-12-21T04:56:40.469+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:56:40.469+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45998:127.0.0.1:9106
2022-12-21T04:57:10.472+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:57:10.472+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46308:127.0.0.1:9106
2022-12-21T04:57:10.473+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:57:10.474+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46310:127.0.0.1:9106
2022-12-21T04:57:40.475+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:57:40.475+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46612:127.0.0.1:9106
2022-12-21T04:57:40.476+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:57:40.477+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46614:127.0.0.1:9106
2022-12-21T04:58:10.479+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:58:10.479+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46906:127.0.0.1:9106
2022-12-21T04:58:10.480+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:58:10.481+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46908:127.0.0.1:9106
2022-12-21T04:58:40.483+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:58:40.483+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47210:127.0.0.1:9106
2022-12-21T04:58:40.484+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:58:40.484+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47212:127.0.0.1:9106
2022-12-21T04:59:10.486+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:59:10.486+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47522:127.0.0.1:9106
2022-12-21T04:59:10.488+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:59:10.488+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47524:127.0.0.1:9106
2022-12-21T04:59:40.489+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:59:40.490+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47826:127.0.0.1:9106
2022-12-21T04:59:40.491+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T04:59:40.491+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47828:127.0.0.1:9106
2022-12-21T05:00:10.496+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:00:10.496+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48136:127.0.0.1:9106
2022-12-21T05:00:10.498+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:00:10.498+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48134:127.0.0.1:9106
2022-12-21T05:00:40.499+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:00:40.499+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48434:127.0.0.1:9106
2022-12-21T05:00:40.501+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:00:40.502+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48436:127.0.0.1:9106
2022-12-21T05:01:10.502+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:01:10.502+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48746:127.0.0.1:9106
2022-12-21T05:01:10.505+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:01:10.505+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:48748:127.0.0.1:9106
2022-12-21T05:01:10.505+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:01:40.506+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:01:40.506+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49056:127.0.0.1:9106
2022-12-21T05:01:40.507+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:01:40.507+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49058:127.0.0.1:9106
2022-12-21T05:02:10.510+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:02:10.510+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49362:127.0.0.1:9106
2022-12-21T05:02:10.510+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:02:10.511+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49364:127.0.0.1:9106
2022-12-21T05:02:40.514+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:02:40.514+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49668:127.0.0.1:9106
2022-12-21T05:02:40.514+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:02:40.515+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49670:127.0.0.1:9106
2022-12-21T05:03:10.518+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:03:10.518+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49980:127.0.0.1:9106
2022-12-21T05:03:10.518+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:03:10.519+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49978:127.0.0.1:9106
2022-12-21T05:03:40.522+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:03:40.522+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:03:40.522+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50284:127.0.0.1:9106
2022-12-21T05:03:40.522+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50282:127.0.0.1:9106
2022-12-21T05:04:10.526+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:04:10.526+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:50598:127.0.0.1:9106
2022-12-21T05:04:10.527+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:04:10.528+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:04:10.528+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50596:127.0.0.1:9106
2022-12-21T05:04:40.531+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:04:40.531+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50900:127.0.0.1:9106
2022-12-21T05:04:40.533+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:04:40.533+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50902:127.0.0.1:9106
2022-12-21T05:05:10.534+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:05:10.534+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51208:127.0.0.1:9106
2022-12-21T05:05:10.536+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:05:10.536+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51210:127.0.0.1:9106
2022-12-21T05:05:40.538+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:05:40.538+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51512:127.0.0.1:9106
2022-12-21T05:05:40.539+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:05:40.540+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:51514:127.0.0.1:9106
2022-12-21T05:05:40.540+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:06:10.542+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:06:10.543+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:06:10.543+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:51820:127.0.0.1:9106
2022-12-21T05:06:10.544+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:06:10.545+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51822:127.0.0.1:9106
2022-12-21T05:06:40.564+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:06:40.567+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52134:127.0.0.1:9106
2022-12-21T05:06:40.578+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:06:40.578+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52136:127.0.0.1:9106
2022-12-21T05:07:10.571+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:07:10.572+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52444:127.0.0.1:9106
2022-12-21T05:07:10.581+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:07:10.581+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52446:127.0.0.1:9106
2022-12-21T05:07:40.575+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:07:40.575+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52748:127.0.0.1:9106
2022-12-21T05:07:40.583+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:07:40.584+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52750:127.0.0.1:9106
2022-12-21T05:08:10.578+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:08:10.578+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53054:127.0.0.1:9106
2022-12-21T05:08:10.587+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:08:10.587+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53056:127.0.0.1:9106
2022-12-21T05:08:40.582+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:08:40.582+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53358:127.0.0.1:9106
2022-12-21T05:08:40.589+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:08:40.590+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53360:127.0.0.1:9106
2022-12-21T05:09:10.586+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:09:10.586+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:09:10.586+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:53674:127.0.0.1:9106
2022-12-21T05:09:10.592+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:09:10.592+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53676:127.0.0.1:9106
2022-12-21T05:09:40.588+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:09:40.589+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53974:127.0.0.1:9106
2022-12-21T05:09:40.595+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:09:40.595+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53976:127.0.0.1:9106
2022-12-21T05:10:10.592+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:10:10.592+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54280:127.0.0.1:9106
2022-12-21T05:10:10.598+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:10:10.598+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54282:127.0.0.1:9106
2022-12-21T05:10:40.596+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:10:40.596+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54584:127.0.0.1:9106
2022-12-21T05:10:40.600+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:10:40.601+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54586:127.0.0.1:9106
2022-12-21T05:11:10.600+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:11:10.600+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54890:127.0.0.1:9106
2022-12-21T05:11:10.603+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:11:10.603+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54892:127.0.0.1:9106
2022-12-21T05:11:40.603+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:11:40.603+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55192:127.0.0.1:9106
2022-12-21T05:11:40.607+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:11:40.607+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55194:127.0.0.1:9106
2022-12-21T05:12:10.606+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:12:10.606+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55500:127.0.0.1:9106
2022-12-21T05:12:10.610+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:12:10.610+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:55502:127.0.0.1:9106
2022-12-21T05:12:10.610+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:12:40.610+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:12:40.610+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55804:127.0.0.1:9106
2022-12-21T05:12:40.612+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:12:40.613+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55806:127.0.0.1:9106
2022-12-21T05:13:10.614+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:13:10.614+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56114:127.0.0.1:9106
2022-12-21T05:13:10.616+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:13:10.616+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:13:10.616+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:56116:127.0.0.1:9106
2022-12-21T05:13:40.618+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:13:40.618+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56420:127.0.0.1:9106
2022-12-21T05:13:40.619+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:13:40.619+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56422:127.0.0.1:9106
2022-12-21T05:14:10.621+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:14:10.621+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56732:127.0.0.1:9106
2022-12-21T05:14:10.622+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:14:10.623+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56734:127.0.0.1:9106
2022-12-21T05:14:40.624+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:14:40.624+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57028:127.0.0.1:9106
2022-12-21T05:14:40.626+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:14:40.626+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57030:127.0.0.1:9106
2022-12-21T05:15:10.627+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:15:10.628+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57342:127.0.0.1:9106
2022-12-21T05:15:10.628+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:15:10.629+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57344:127.0.0.1:9106
2022-12-21T05:15:40.631+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:15:40.631+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57646:127.0.0.1:9106
2022-12-21T05:15:40.632+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:15:40.632+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57648:127.0.0.1:9106
2022-12-21T05:16:10.635+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:16:10.635+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57950:127.0.0.1:9106
2022-12-21T05:16:10.637+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:16:10.637+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57952:127.0.0.1:9106
2022-12-21T05:16:40.639+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:16:40.639+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58260:127.0.0.1:9106
2022-12-21T05:16:40.640+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:16:40.640+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58262:127.0.0.1:9106
2022-12-21T05:17:10.644+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:17:10.644+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58566:127.0.0.1:9106
2022-12-21T05:17:10.644+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:17:10.644+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58568:127.0.0.1:9106
2022-12-21T05:17:40.648+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:17:40.648+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:17:40.648+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58872:127.0.0.1:9106
2022-12-21T05:17:40.649+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:17:40.649+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:58870:127.0.0.1:9106
2022-12-21T05:18:10.651+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:18:10.652+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59178:127.0.0.1:9106
2022-12-21T05:18:10.652+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:18:10.652+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59176:127.0.0.1:9106
2022-12-21T05:18:40.656+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:18:40.656+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59480:127.0.0.1:9106
2022-12-21T05:18:40.657+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:18:40.657+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59482:127.0.0.1:9106
2022-12-21T05:19:10.659+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:19:10.660+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59798:127.0.0.1:9106
2022-12-21T05:19:10.660+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:19:10.660+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59800:127.0.0.1:9106
2022-12-21T05:19:40.663+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:19:40.663+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60102:127.0.0.1:9106
2022-12-21T05:19:40.664+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:19:40.664+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60104:127.0.0.1:9106
2022-12-21T05:20:10.667+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:20:10.668+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60410:127.0.0.1:9106
2022-12-21T05:20:10.668+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:20:10.668+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:60412:127.0.0.1:9106
2022-12-21T05:20:10.669+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:20:40.672+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:20:40.672+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60714:127.0.0.1:9106
2022-12-21T05:20:40.672+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:20:40.672+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60716:127.0.0.1:9106
2022-12-21T05:21:10.677+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:21:10.678+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:32790:127.0.0.1:9106
2022-12-21T05:21:10.681+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:21:10.681+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:32788:127.0.0.1:9106
2022-12-21T05:21:40.680+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:21:40.681+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33094:127.0.0.1:9106
2022-12-21T05:21:40.685+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:21:40.685+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33096:127.0.0.1:9106
2022-12-21T05:22:10.685+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:22:10.685+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33400:127.0.0.1:9106
2022-12-21T05:22:10.688+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:22:10.688+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:33402:127.0.0.1:9106
2022-12-21T05:22:10.688+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:22:40.688+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:22:40.688+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33702:127.0.0.1:9106
2022-12-21T05:22:40.691+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:22:40.691+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33704:127.0.0.1:9106
2022-12-21T05:23:10.692+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:23:10.692+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34008:127.0.0.1:9106
2022-12-21T05:23:10.694+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:23:10.694+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34010:127.0.0.1:9106
2022-12-21T05:23:40.695+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:23:40.696+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34332:127.0.0.1:9106
2022-12-21T05:23:40.698+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:23:40.698+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34334:127.0.0.1:9106
2022-12-21T05:24:10.699+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:24:10.700+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34662:127.0.0.1:9106
2022-12-21T05:24:10.701+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:24:10.702+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34664:127.0.0.1:9106
2022-12-21T05:24:40.703+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:24:40.703+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34964:127.0.0.1:9106
2022-12-21T05:24:40.704+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:24:40.704+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34966:127.0.0.1:9106
2022-12-21T05:25:10.708+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:25:10.708+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:25:10.708+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35282:127.0.0.1:9106
2022-12-21T05:25:10.708+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:25:10.708+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:35284:127.0.0.1:9106
2022-12-21T05:25:40.711+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:25:40.711+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35588:127.0.0.1:9106
2022-12-21T05:25:40.712+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:25:40.712+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35590:127.0.0.1:9106
2022-12-21T05:26:10.715+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:26:10.715+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35896:127.0.0.1:9106
2022-12-21T05:26:10.715+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:26:10.716+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35894:127.0.0.1:9106
2022-12-21T05:26:40.718+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:26:40.719+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36200:127.0.0.1:9106
2022-12-21T05:26:40.719+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:26:40.719+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36198:127.0.0.1:9106
2022-12-21T05:27:10.722+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:27:10.722+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36504:127.0.0.1:9106
2022-12-21T05:27:10.722+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:27:10.722+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36506:127.0.0.1:9106
2022-12-21T05:27:40.726+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:27:40.726+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36800:127.0.0.1:9106
2022-12-21T05:27:40.726+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:27:40.726+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36802:127.0.0.1:9106
2022-12-21T05:28:10.729+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:28:10.729+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37108:127.0.0.1:9106
2022-12-21T05:28:10.729+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:28:10.729+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37106:127.0.0.1:9106
2022-12-21T05:28:40.733+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:28:40.733+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37410:127.0.0.1:9106
2022-12-21T05:28:40.733+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:28:40.733+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37412:127.0.0.1:9106
2022-12-21T05:29:10.737+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:29:10.737+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37722:127.0.0.1:9106
2022-12-21T05:29:10.737+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:29:10.737+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37724:127.0.0.1:9106
2022-12-21T05:29:40.740+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:29:40.740+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38026:127.0.0.1:9106
2022-12-21T05:29:40.741+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:29:40.741+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38028:127.0.0.1:9106
2022-12-21T05:30:10.744+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:30:10.744+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38334:127.0.0.1:9106
2022-12-21T05:30:10.745+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:30:10.745+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38336:127.0.0.1:9106
2022-12-21T05:30:40.749+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:30:40.749+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:30:40.749+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38630:127.0.0.1:9106
2022-12-21T05:30:40.749+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38628:127.0.0.1:9106
2022-12-21T05:31:10.753+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:31:10.753+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38938:127.0.0.1:9106
2022-12-21T05:31:10.753+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:31:10.753+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38940:127.0.0.1:9106
2022-12-21T05:31:40.757+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:31:40.757+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39248:127.0.0.1:9106
2022-12-21T05:31:40.757+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:31:40.758+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39246:127.0.0.1:9106
2022-12-21T05:32:10.761+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:32:10.761+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39550:127.0.0.1:9106
2022-12-21T05:32:10.761+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:32:10.762+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39548:127.0.0.1:9106
2022-12-21T05:32:40.765+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:32:40.765+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:32:40.765+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39852:127.0.0.1:9106
2022-12-21T05:32:40.765+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39854:127.0.0.1:9106
2022-12-21T05:33:10.769+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:33:10.769+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:33:10.769+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40162:127.0.0.1:9106
2022-12-21T05:33:10.769+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40164:127.0.0.1:9106
2022-12-21T05:33:40.774+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:33:40.774+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40468:127.0.0.1:9106
2022-12-21T05:33:40.775+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:33:40.775+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40470:127.0.0.1:9106
2022-12-21T05:34:10.778+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:34:10.779+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:34:10.779+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:40784:127.0.0.1:9106
2022-12-21T05:34:10.779+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:34:10.779+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40782:127.0.0.1:9106
2022-12-21T05:34:40.781+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:34:40.782+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41080:127.0.0.1:9106
2022-12-21T05:34:40.782+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:34:40.782+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41082:127.0.0.1:9106
2022-12-21T05:35:10.786+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:35:10.787+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41392:127.0.0.1:9106
2022-12-21T05:35:10.787+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:35:10.787+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41390:127.0.0.1:9106
2022-12-21T05:35:40.790+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:35:40.790+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41714:127.0.0.1:9106
2022-12-21T05:35:40.790+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:35:40.790+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41716:127.0.0.1:9106
2022-12-21T05:36:10.794+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:36:10.794+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42022:127.0.0.1:9106
2022-12-21T05:36:10.794+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:36:10.794+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42024:127.0.0.1:9106
2022-12-21T05:36:40.798+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:36:40.798+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42336:127.0.0.1:9106
2022-12-21T05:36:40.798+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:36:40.798+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42334:127.0.0.1:9106
2022-12-21T05:37:10.802+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:37:10.802+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42644:127.0.0.1:9106
2022-12-21T05:37:10.802+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:37:10.802+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42646:127.0.0.1:9106
2022-12-21T05:37:40.807+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:37:40.808+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42948:127.0.0.1:9106
2022-12-21T05:37:40.808+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:37:40.808+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42950:127.0.0.1:9106
2022-12-21T05:38:10.812+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:38:10.812+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43252:127.0.0.1:9106
2022-12-21T05:38:10.812+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:38:10.812+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43254:127.0.0.1:9106
2022-12-21T05:38:40.815+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:38:40.815+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43558:127.0.0.1:9106
2022-12-21T05:38:40.816+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:38:40.816+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43556:127.0.0.1:9106
2022-12-21T05:39:10.819+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:39:10.820+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43872:127.0.0.1:9106
2022-12-21T05:39:10.821+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:39:10.821+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:43874:127.0.0.1:9106
2022-12-21T05:39:10.821+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:39:40.823+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:39:40.823+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44180:127.0.0.1:9106
2022-12-21T05:39:40.823+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:39:40.823+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44178:127.0.0.1:9106
2022-12-21T05:40:10.826+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:40:10.826+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44486:127.0.0.1:9106
2022-12-21T05:40:10.827+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:40:10.827+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44488:127.0.0.1:9106
2022-12-21T05:40:40.830+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:40:40.830+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44792:127.0.0.1:9106
2022-12-21T05:40:40.831+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:40:40.831+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44790:127.0.0.1:9106
2022-12-21T05:41:10.834+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:41:10.834+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45098:127.0.0.1:9106
2022-12-21T05:41:10.834+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:41:10.835+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45096:127.0.0.1:9106
2022-12-21T05:41:40.838+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:41:40.838+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45406:127.0.0.1:9106
2022-12-21T05:41:40.839+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:41:40.839+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:41:40.839+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:45408:127.0.0.1:9106
2022-12-21T05:42:10.843+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:42:10.843+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45708:127.0.0.1:9106
2022-12-21T05:42:10.843+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:42:10.843+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45712:127.0.0.1:9106
2022-12-21T05:42:40.847+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:42:40.847+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46010:127.0.0.1:9106
2022-12-21T05:42:40.847+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:42:40.847+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46008:127.0.0.1:9106
2022-12-21T05:43:10.850+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:43:10.850+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46314:127.0.0.1:9106
2022-12-21T05:43:10.850+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:43:10.851+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46312:127.0.0.1:9106
2022-12-21T05:43:40.855+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:43:40.855+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46616:127.0.0.1:9106
2022-12-21T05:43:40.855+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:43:40.855+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46618:127.0.0.1:9106
2022-12-21T05:44:10.858+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:44:10.859+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46932:127.0.0.1:9106
2022-12-21T05:44:10.859+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:44:10.859+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46930:127.0.0.1:9106
2022-12-21T05:44:40.863+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:44:40.863+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47234:127.0.0.1:9106
2022-12-21T05:44:40.863+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:44:40.863+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:47236:127.0.0.1:9106
2022-12-21T05:44:40.864+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:45:10.866+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:45:10.866+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47548:127.0.0.1:9106
2022-12-21T05:45:10.866+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:45:10.866+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47550:127.0.0.1:9106
2022-12-21T05:45:40.869+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:45:40.870+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47854:127.0.0.1:9106
2022-12-21T05:45:40.869+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:45:40.870+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47852:127.0.0.1:9106
2022-12-21T05:46:10.873+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:46:10.873+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48158:127.0.0.1:9106
2022-12-21T05:46:10.873+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:46:10.873+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48160:127.0.0.1:9106
2022-12-21T05:46:40.877+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:46:40.878+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48470:127.0.0.1:9106
2022-12-21T05:46:40.878+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:46:40.878+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48468:127.0.0.1:9106
2022-12-21T05:47:10.881+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:47:10.882+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48766:127.0.0.1:9106
2022-12-21T05:47:10.883+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:47:10.883+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48768:127.0.0.1:9106
2022-12-21T05:47:40.886+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:47:40.886+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49070:127.0.0.1:9106
2022-12-21T05:47:40.886+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:47:40.886+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49072:127.0.0.1:9106
2022-12-21T05:48:10.889+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:48:10.890+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49380:127.0.0.1:9106
2022-12-21T05:48:10.891+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:48:10.891+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49378:127.0.0.1:9106
2022-12-21T05:48:40.893+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:48:40.893+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49680:127.0.0.1:9106
2022-12-21T05:48:40.894+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:48:40.894+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49682:127.0.0.1:9106
2022-12-21T05:49:10.898+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:49:10.898+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:49:10.898+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:49998:127.0.0.1:9106
2022-12-21T05:49:10.898+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:49:10.899+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50000:127.0.0.1:9106
2022-12-21T05:49:40.901+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:49:40.901+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50298:127.0.0.1:9106
2022-12-21T05:49:40.901+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:49:40.902+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50300:127.0.0.1:9106
2022-12-21T05:50:10.905+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:50:10.906+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50604:127.0.0.1:9106
2022-12-21T05:50:10.906+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:50:10.906+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50606:127.0.0.1:9106
2022-12-21T05:50:40.909+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:50:40.909+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50910:127.0.0.1:9106
2022-12-21T05:50:40.909+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:50:40.910+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50908:127.0.0.1:9106
2022-12-21T05:51:10.913+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:51:10.913+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:51:10.914+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51220:127.0.0.1:9106
2022-12-21T05:51:10.914+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51218:127.0.0.1:9106
2022-12-21T05:51:40.917+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:51:40.917+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51530:127.0.0.1:9106
2022-12-21T05:51:40.918+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:51:40.918+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51528:127.0.0.1:9106
2022-12-21T05:52:10.921+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:52:10.921+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51834:127.0.0.1:9106
2022-12-21T05:52:10.921+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:52:10.922+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51836:127.0.0.1:9106
2022-12-21T05:52:40.925+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:52:40.925+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52140:127.0.0.1:9106
2022-12-21T05:52:40.925+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:52:40.925+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52138:127.0.0.1:9106
2022-12-21T05:53:10.928+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:53:10.928+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52446:127.0.0.1:9106
2022-12-21T05:53:10.928+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:53:10.929+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52444:127.0.0.1:9106
2022-12-21T05:53:40.932+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:53:40.933+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52770:127.0.0.1:9106
2022-12-21T05:53:40.934+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:53:40.934+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52768:127.0.0.1:9106
2022-12-21T05:54:10.937+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:54:10.937+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:53094:127.0.0.1:9106
2022-12-21T05:54:10.937+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:54:10.938+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T05:54:10.938+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:53096:127.0.0.1:9106
2022-12-21T05:54:10.938+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:54:40.941+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:54:40.941+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53402:127.0.0.1:9106
2022-12-21T05:54:40.941+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:54:40.941+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53400:127.0.0.1:9106
2022-12-21T05:55:10.945+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:55:10.945+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53722:127.0.0.1:9106
2022-12-21T05:55:10.946+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:55:10.946+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53720:127.0.0.1:9106
2022-12-21T05:55:40.949+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:55:40.949+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54018:127.0.0.1:9106
2022-12-21T05:55:40.949+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:55:40.949+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54020:127.0.0.1:9106
2022-12-21T05:56:10.954+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:56:10.954+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54324:127.0.0.1:9106
2022-12-21T05:56:10.955+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:56:10.955+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54322:127.0.0.1:9106
2022-12-21T05:56:40.957+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:56:40.957+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54626:127.0.0.1:9106
2022-12-21T05:56:40.959+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:56:40.959+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54628:127.0.0.1:9106
2022-12-21T05:57:10.961+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:57:10.961+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54936:127.0.0.1:9106
2022-12-21T05:57:10.961+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:57:10.962+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54938:127.0.0.1:9106
2022-12-21T05:57:40.965+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:57:40.965+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:57:40.965+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55240:127.0.0.1:9106
2022-12-21T05:57:40.965+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55242:127.0.0.1:9106
2022-12-21T05:58:10.968+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:58:10.968+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55546:127.0.0.1:9106
2022-12-21T05:58:10.968+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:58:10.969+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55548:127.0.0.1:9106
2022-12-21T05:58:40.972+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:58:40.972+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55850:127.0.0.1:9106
2022-12-21T05:58:40.972+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:58:40.972+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55852:127.0.0.1:9106
2022-12-21T05:59:10.975+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:59:10.976+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56156:127.0.0.1:9106
2022-12-21T05:59:10.976+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:59:10.976+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56158:127.0.0.1:9106
2022-12-21T05:59:40.980+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:59:40.980+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T05:59:40.980+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56462:127.0.0.1:9106
2022-12-21T05:59:40.980+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56460:127.0.0.1:9106
2022-12-21T06:00:10.985+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:00:10.985+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56766:127.0.0.1:9106
2022-12-21T06:00:10.985+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:00:10.985+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56764:127.0.0.1:9106
2022-12-21T06:00:40.989+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:00:40.989+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57072:127.0.0.1:9106
2022-12-21T06:00:40.990+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:00:40.991+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57070:127.0.0.1:9106
2022-12-21T06:01:10.992+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:01:10.992+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57380:127.0.0.1:9106
2022-12-21T06:01:10.993+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:01:10.994+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57382:127.0.0.1:9106
2022-12-21T06:01:40.995+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:01:40.995+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57690:127.0.0.1:9106
2022-12-21T06:01:40.997+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:01:40.997+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57692:127.0.0.1:9106
2022-12-21T06:02:10.998+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:02:10.998+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57994:127.0.0.1:9106
2022-12-21T06:02:11.000+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:02:11.000+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57996:127.0.0.1:9106
2022-12-21T06:02:41.003+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:02:41.003+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58298:127.0.0.1:9106
2022-12-21T06:02:41.005+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:02:41.005+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58300:127.0.0.1:9106
2022-12-21T06:03:11.008+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:03:11.008+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:03:11.008+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58596:127.0.0.1:9106
2022-12-21T06:03:11.008+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58598:127.0.0.1:9106
2022-12-21T06:03:41.011+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:03:41.012+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:58902:127.0.0.1:9106
2022-12-21T06:03:41.012+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:03:41.012+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:03:41.012+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58904:127.0.0.1:9106
2022-12-21T06:04:11.016+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:04:11.016+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:59218:127.0.0.1:9106
2022-12-21T06:04:11.017+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:04:11.017+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59220:127.0.0.1:9106
2022-12-21T06:04:11.017+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:04:41.020+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:04:41.020+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59520:127.0.0.1:9106
2022-12-21T06:04:41.021+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:04:41.021+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59522:127.0.0.1:9106
2022-12-21T06:05:11.025+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:05:11.026+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59832:127.0.0.1:9106
2022-12-21T06:05:11.025+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:05:11.026+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59830:127.0.0.1:9106
2022-12-21T06:05:41.030+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:05:41.030+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:05:41.030+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60136:127.0.0.1:9106
2022-12-21T06:05:41.030+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60134:127.0.0.1:9106
2022-12-21T06:06:11.034+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:06:11.034+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60440:127.0.0.1:9106
2022-12-21T06:06:11.035+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:06:11.035+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60442:127.0.0.1:9106
2022-12-21T06:06:41.037+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:06:41.037+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60750:127.0.0.1:9106
2022-12-21T06:06:41.038+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:06:41.038+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60752:127.0.0.1:9106
2022-12-21T06:07:11.040+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:07:11.041+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:32826:127.0.0.1:9106
2022-12-21T06:07:11.042+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:07:11.042+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:32828:127.0.0.1:9106
2022-12-21T06:07:41.044+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:07:41.044+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33130:127.0.0.1:9106
2022-12-21T06:07:41.045+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:07:41.045+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33132:127.0.0.1:9106
2022-12-21T06:08:11.047+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:08:11.048+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33436:127.0.0.1:9106
2022-12-21T06:08:11.048+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:08:11.048+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33438:127.0.0.1:9106
2022-12-21T06:08:41.051+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:08:41.052+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33740:127.0.0.1:9106
2022-12-21T06:08:41.053+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:08:41.053+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:08:41.053+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:33742:127.0.0.1:9106
2022-12-21T06:09:11.055+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:09:11.055+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34058:127.0.0.1:9106
2022-12-21T06:09:11.056+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:09:11.056+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34060:127.0.0.1:9106
2022-12-21T06:09:41.059+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:09:41.059+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34360:127.0.0.1:9106
2022-12-21T06:09:41.060+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:09:41.060+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34362:127.0.0.1:9106
2022-12-21T06:10:11.062+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:10:11.063+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34668:127.0.0.1:9106
2022-12-21T06:10:11.063+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:10:11.063+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34666:127.0.0.1:9106
2022-12-21T06:10:41.066+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:10:41.067+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34972:127.0.0.1:9106
2022-12-21T06:10:41.067+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:10:41.067+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34970:127.0.0.1:9106
2022-12-21T06:11:11.070+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:11:11.070+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35276:127.0.0.1:9106
2022-12-21T06:11:11.070+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:11:11.070+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35278:127.0.0.1:9106
2022-12-21T06:11:41.074+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:11:41.074+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35582:127.0.0.1:9106
2022-12-21T06:11:41.075+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:11:41.075+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35584:127.0.0.1:9106
2022-12-21T06:12:11.077+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:12:11.077+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35890:127.0.0.1:9106
2022-12-21T06:12:11.078+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:12:11.078+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:35892:127.0.0.1:9106
2022-12-21T06:12:41.081+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:12:41.081+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:12:41.081+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36196:127.0.0.1:9106
2022-12-21T06:12:41.081+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36194:127.0.0.1:9106
2022-12-21T06:13:11.085+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:13:11.085+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36504:127.0.0.1:9106
2022-12-21T06:13:11.086+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:13:11.087+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36502:127.0.0.1:9106
2022-12-21T06:13:41.088+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:13:41.089+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36808:127.0.0.1:9106
2022-12-21T06:13:41.090+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:13:41.090+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:36810:127.0.0.1:9106
2022-12-21T06:14:11.092+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:14:11.092+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37124:127.0.0.1:9106
2022-12-21T06:14:11.094+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:14:11.094+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37126:127.0.0.1:9106
2022-12-21T06:14:41.096+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:14:41.096+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37428:127.0.0.1:9106
2022-12-21T06:14:41.098+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:14:41.098+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37430:127.0.0.1:9106
2022-12-21T06:15:11.101+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:15:11.101+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37730:127.0.0.1:9106
2022-12-21T06:15:11.102+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:15:11.103+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:37732:127.0.0.1:9106
2022-12-21T06:15:41.105+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:15:41.105+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38034:127.0.0.1:9106
2022-12-21T06:15:41.105+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:15:41.106+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38032:127.0.0.1:9106
2022-12-21T06:16:11.109+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:16:11.109+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:38340:127.0.0.1:9106
2022-12-21T06:16:11.109+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:16:11.109+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:16:11.110+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38338:127.0.0.1:9106
2022-12-21T06:16:41.113+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:16:41.114+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38644:127.0.0.1:9106
2022-12-21T06:16:41.114+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:16:41.114+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38642:127.0.0.1:9106
2022-12-21T06:17:11.116+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:17:11.116+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38946:127.0.0.1:9106
2022-12-21T06:17:11.118+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:17:11.118+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:38948:127.0.0.1:9106
2022-12-21T06:17:41.121+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:17:41.122+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:17:41.122+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39250:127.0.0.1:9106
2022-12-21T06:17:41.122+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39252:127.0.0.1:9106
2022-12-21T06:18:11.126+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:18:11.126+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39558:127.0.0.1:9106
2022-12-21T06:18:11.126+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:18:11.127+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39556:127.0.0.1:9106
2022-12-21T06:18:41.129+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:18:41.130+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39862:127.0.0.1:9106
2022-12-21T06:18:41.130+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:18:41.130+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:39860:127.0.0.1:9106
2022-12-21T06:19:11.133+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:19:11.133+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40178:127.0.0.1:9106
2022-12-21T06:19:11.133+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:19:11.134+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:19:11.134+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:40180:127.0.0.1:9106
2022-12-21T06:19:41.136+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:19:41.137+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:19:41.137+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40474:127.0.0.1:9106
2022-12-21T06:19:41.137+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40476:127.0.0.1:9106
2022-12-21T06:20:11.140+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:20:11.140+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40782:127.0.0.1:9106
2022-12-21T06:20:11.140+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:20:11.140+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:40780:127.0.0.1:9106
2022-12-21T06:20:41.144+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:20:41.144+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41084:127.0.0.1:9106
2022-12-21T06:20:41.145+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:20:41.145+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41086:127.0.0.1:9106
2022-12-21T06:21:11.148+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:21:11.149+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41394:127.0.0.1:9106
2022-12-21T06:21:11.149+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:21:11.149+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41392:127.0.0.1:9106
2022-12-21T06:21:41.153+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:21:41.153+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:41730:127.0.0.1:9106
2022-12-21T06:21:41.153+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:21:41.154+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:21:41.154+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:41732:127.0.0.1:9106
2022-12-21T06:22:11.158+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:22:11.158+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:42038:127.0.0.1:9106
2022-12-21T06:22:11.158+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:22:11.159+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:22:11.159+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:22:11.159+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:42036:127.0.0.1:9106
2022-12-21T06:22:41.161+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:22:41.162+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42342:127.0.0.1:9106
2022-12-21T06:22:41.162+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:22:41.162+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42340:127.0.0.1:9106
2022-12-21T06:23:11.166+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:23:11.166+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:23:11.166+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:42640:127.0.0.1:9106
2022-12-21T06:23:11.166+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:23:11.166+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42642:127.0.0.1:9106
2022-12-21T06:23:41.171+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:23:41.171+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:23:41.171+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42964:127.0.0.1:9106
2022-12-21T06:23:41.171+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:42966:127.0.0.1:9106
2022-12-21T06:24:11.175+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:24:11.175+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43300:127.0.0.1:9106
2022-12-21T06:24:11.175+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:24:11.175+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43298:127.0.0.1:9106
2022-12-21T06:24:41.178+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:24:41.178+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:24:41.178+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:24:41.178+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:43596:127.0.0.1:9106
2022-12-21T06:24:41.178+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43598:127.0.0.1:9106
2022-12-21T06:25:11.183+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:25:11.183+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43920:127.0.0.1:9106
2022-12-21T06:25:11.183+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:25:11.184+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:43918:127.0.0.1:9106
2022-12-21T06:25:41.188+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:25:41.188+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44220:127.0.0.1:9106
2022-12-21T06:25:41.188+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:25:41.188+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:25:41.188+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:44218:127.0.0.1:9106
2022-12-21T06:26:11.192+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:26:11.192+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:26:11.192+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44526:127.0.0.1:9106
2022-12-21T06:26:11.192+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44524:127.0.0.1:9106
2022-12-21T06:26:41.196+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:26:41.196+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44830:127.0.0.1:9106
2022-12-21T06:26:41.196+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:26:41.196+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:44828:127.0.0.1:9106
2022-12-21T06:27:11.199+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:27:11.199+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45138:127.0.0.1:9106
2022-12-21T06:27:11.199+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:27:11.200+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45140:127.0.0.1:9106
2022-12-21T06:27:41.204+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:27:41.204+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45444:127.0.0.1:9106
2022-12-21T06:27:41.204+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:27:41.204+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45442:127.0.0.1:9106
2022-12-21T06:28:11.208+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:28:11.208+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45748:127.0.0.1:9106
2022-12-21T06:28:11.208+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:28:11.208+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:45750:127.0.0.1:9106
2022-12-21T06:28:41.212+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:28:41.213+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46050:127.0.0.1:9106
2022-12-21T06:28:41.213+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:28:41.213+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46052:127.0.0.1:9106
2022-12-21T06:29:11.217+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:29:11.217+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46364:127.0.0.1:9106
2022-12-21T06:29:11.218+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:29:11.218+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46362:127.0.0.1:9106
2022-12-21T06:29:41.220+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:29:41.220+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46666:127.0.0.1:9106
2022-12-21T06:29:41.221+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:29:41.221+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46668:127.0.0.1:9106
2022-12-21T06:30:11.224+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:30:11.224+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46976:127.0.0.1:9106
2022-12-21T06:30:11.225+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:30:11.225+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:46974:127.0.0.1:9106
2022-12-21T06:30:41.227+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:30:41.227+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47278:127.0.0.1:9106
2022-12-21T06:30:41.227+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:30:41.227+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47280:127.0.0.1:9106
2022-12-21T06:31:11.231+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:31:11.231+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47584:127.0.0.1:9106
2022-12-21T06:31:11.231+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:31:11.231+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47582:127.0.0.1:9106
2022-12-21T06:31:41.235+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:31:41.235+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:31:41.236+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47894:127.0.0.1:9106
2022-12-21T06:31:41.236+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:47892:127.0.0.1:9106
2022-12-21T06:32:11.239+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:32:11.239+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48200:127.0.0.1:9106
2022-12-21T06:32:11.240+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:32:11.240+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48198:127.0.0.1:9106
2022-12-21T06:32:41.242+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:32:41.242+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48500:127.0.0.1:9106
2022-12-21T06:32:41.243+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:32:41.244+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48502:127.0.0.1:9106
2022-12-21T06:33:11.246+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:33:11.246+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48812:127.0.0.1:9106
2022-12-21T06:33:11.247+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:33:11.247+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:48810:127.0.0.1:9106
2022-12-21T06:33:41.250+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:33:41.251+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49112:127.0.0.1:9106
2022-12-21T06:33:41.251+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:33:41.251+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49114:127.0.0.1:9106
2022-12-21T06:34:11.254+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:34:11.255+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49428:127.0.0.1:9106
2022-12-21T06:34:11.255+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:34:11.255+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49430:127.0.0.1:9106
2022-12-21T06:34:41.258+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:34:41.259+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49734:127.0.0.1:9106
2022-12-21T06:34:41.259+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:34:41.259+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:49732:127.0.0.1:9106
2022-12-21T06:35:11.262+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:35:11.262+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50040:127.0.0.1:9106
2022-12-21T06:35:11.263+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:35:11.263+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50042:127.0.0.1:9106
2022-12-21T06:35:41.267+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:35:41.267+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50338:127.0.0.1:9106
2022-12-21T06:35:41.268+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:35:41.268+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50336:127.0.0.1:9106
2022-12-21T06:36:11.271+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:36:11.271+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50642:127.0.0.1:9106
2022-12-21T06:36:11.271+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:36:11.271+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50644:127.0.0.1:9106
2022-12-21T06:36:41.275+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:36:41.275+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:50952:127.0.0.1:9106
2022-12-21T06:36:41.277+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:36:41.277+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:36:41.277+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:50950:127.0.0.1:9106
2022-12-21T06:37:11.279+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:37:11.280+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51254:127.0.0.1:9106
2022-12-21T06:37:11.280+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:37:11.281+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51256:127.0.0.1:9106
2022-12-21T06:37:41.283+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:37:41.283+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:37:41.283+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:51558:127.0.0.1:9106
2022-12-21T06:37:41.284+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:37:41.285+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51560:127.0.0.1:9106
2022-12-21T06:38:11.287+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:38:11.288+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51864:127.0.0.1:9106
2022-12-21T06:38:11.288+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:38:11.288+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:51866:127.0.0.1:9106
2022-12-21T06:38:41.292+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:38:41.292+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52170:127.0.0.1:9106
2022-12-21T06:38:41.292+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:38:41.293+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52168:127.0.0.1:9106
2022-12-21T06:39:11.296+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:39:11.297+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52484:127.0.0.1:9106
2022-12-21T06:39:11.297+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:39:11.297+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52486:127.0.0.1:9106
2022-12-21T06:39:41.301+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:39:41.301+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52788:127.0.0.1:9106
2022-12-21T06:39:41.301+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:39:41.301+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:52790:127.0.0.1:9106
2022-12-21T06:40:11.305+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:40:11.305+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:53096:127.0.0.1:9106
2022-12-21T06:40:11.306+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:40:11.306+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53094:127.0.0.1:9106
2022-12-21T06:40:11.306+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:40:41.309+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:40:41.309+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53400:127.0.0.1:9106
2022-12-21T06:40:41.309+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:40:41.309+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53402:127.0.0.1:9106
2022-12-21T06:41:11.314+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:41:11.314+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53708:127.0.0.1:9106
2022-12-21T06:41:11.314+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:41:11.315+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:53706:127.0.0.1:9106
2022-12-21T06:41:41.317+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:41:41.317+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54014:127.0.0.1:9106
2022-12-21T06:41:41.318+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:41:41.318+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54016:127.0.0.1:9106
2022-12-21T06:42:11.321+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:42:11.321+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:42:11.321+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:54322:127.0.0.1:9106
2022-12-21T06:42:11.321+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:42:11.322+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54324:127.0.0.1:9106
2022-12-21T06:42:41.324+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:42:41.324+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54626:127.0.0.1:9106
2022-12-21T06:42:41.325+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:42:41.325+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54628:127.0.0.1:9106
2022-12-21T06:43:11.327+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:43:11.327+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54936:127.0.0.1:9106
2022-12-21T06:43:11.328+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:43:11.328+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:54938:127.0.0.1:9106
2022-12-21T06:43:41.331+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:43:41.331+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55244:127.0.0.1:9106
2022-12-21T06:43:41.331+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:43:41.331+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55242:127.0.0.1:9106
2022-12-21T06:44:11.335+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:44:11.335+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55558:127.0.0.1:9106
2022-12-21T06:44:11.335+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:44:11.336+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55556:127.0.0.1:9106
2022-12-21T06:44:41.339+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:44:41.339+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55856:127.0.0.1:9106
2022-12-21T06:44:41.339+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:44:41.339+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:55858:127.0.0.1:9106
2022-12-21T06:45:11.342+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:45:11.342+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56172:127.0.0.1:9106
2022-12-21T06:45:11.342+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:45:11.343+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56170:127.0.0.1:9106
2022-12-21T06:45:41.346+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:45:41.347+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56468:127.0.0.1:9106
2022-12-21T06:45:41.347+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:45:41.347+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56470:127.0.0.1:9106
2022-12-21T06:46:11.350+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:46:11.350+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56774:127.0.0.1:9106
2022-12-21T06:46:11.351+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:46:11.351+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:56776:127.0.0.1:9106
2022-12-21T06:46:41.353+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:46:41.353+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57084:127.0.0.1:9106
2022-12-21T06:46:41.354+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:46:41.354+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57086:127.0.0.1:9106
2022-12-21T06:47:11.357+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:47:11.358+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57392:127.0.0.1:9106
2022-12-21T06:47:11.358+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:47:11.358+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:57390:127.0.0.1:9106
2022-12-21T06:47:11.358+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:47:41.362+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:47:41.362+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57688:127.0.0.1:9106
2022-12-21T06:47:41.364+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:47:41.364+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57686:127.0.0.1:9106
2022-12-21T06:48:11.366+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:48:11.366+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57988:127.0.0.1:9106
2022-12-21T06:48:11.367+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:48:11.368+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:57990:127.0.0.1:9106
2022-12-21T06:48:41.370+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:48:41.370+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58292:127.0.0.1:9106
2022-12-21T06:48:41.371+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:48:41.371+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58294:127.0.0.1:9106
2022-12-21T06:49:11.373+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:49:11.373+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58610:127.0.0.1:9106
2022-12-21T06:49:11.374+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:49:11.374+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:49:11.374+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:58612:127.0.0.1:9106
2022-12-21T06:49:41.377+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:49:41.378+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58916:127.0.0.1:9106
2022-12-21T06:49:41.378+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:49:41.378+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:58914:127.0.0.1:9106
2022-12-21T06:50:11.381+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:50:11.381+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59220:127.0.0.1:9106
2022-12-21T06:50:11.381+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:50:11.381+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59222:127.0.0.1:9106
2022-12-21T06:50:41.384+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:50:41.384+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59528:127.0.0.1:9106
2022-12-21T06:50:41.385+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:50:41.385+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59526:127.0.0.1:9106
2022-12-21T06:51:11.388+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:51:11.388+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59838:127.0.0.1:9106
2022-12-21T06:51:11.388+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:51:11.388+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:59836:127.0.0.1:9106
2022-12-21T06:51:41.392+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:51:41.393+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60146:127.0.0.1:9106
2022-12-21T06:51:41.393+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:51:41.393+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60148:127.0.0.1:9106
2022-12-21T06:52:11.396+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:52:11.396+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60454:127.0.0.1:9106
2022-12-21T06:52:11.396+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:52:11.397+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60452:127.0.0.1:9106
2022-12-21T06:52:41.400+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:52:41.400+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60748:127.0.0.1:9106
2022-12-21T06:52:41.400+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:52:41.400+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:60750:127.0.0.1:9106
2022-12-21T06:53:11.426+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:53:11.428+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:32822:127.0.0.1:9106
2022-12-21T06:53:11.428+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:53:11.431+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:32824:127.0.0.1:9106
2022-12-21T06:53:41.433+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:53:41.433+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33136:127.0.0.1:9106
2022-12-21T06:53:41.435+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:53:41.435+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33138:127.0.0.1:9106
2022-12-21T06:54:11.436+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:54:11.436+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33480:127.0.0.1:9106
2022-12-21T06:54:11.439+05:30 [Error] watcher:ClientAuth Response error Unauthenticated access. Authentication failure. for 127.0.0.1:9106
2022-12-21T06:54:11.439+05:30 [Error] WatcherServer.runOnce() : error in authfn Unauthenticated access. Authentication failure. for connection 127.0.0.1:33482:127.0.0.1:9106
2022-12-21T06:54:11.439+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:54:41.439+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:54:41.440+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33782:127.0.0.1:9106
2022-12-21T06:54:41.442+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:54:41.443+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:33784:127.0.0.1:9106
2022-12-21T06:55:11.444+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:55:11.444+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34104:127.0.0.1:9106
2022-12-21T06:55:11.447+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:55:11.447+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34106:127.0.0.1:9106
2022-12-21T06:55:41.447+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:55:41.447+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34408:127.0.0.1:9106
2022-12-21T06:55:41.450+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-12-21T06:55:41.450+05:30 [Error] WatcherServer.runOnce() : error in authfn Server Error : watcher:ClientAuth: channel closed. Terminate for connection 127.0.0.1:34410:127.0.0.1:9106
SIGQUIT: quit
PC=0x470b81 m=0 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7ffc78d84318 sp=0x7ffc78d84310 pc=0x470b81
runtime.futexsleep(0x7f8433074088?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7ffc78d84368 sp=0x7ffc78d84318 pc=0x437c76
runtime.notesleep(0x1b6f828)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7ffc78d843a0 sp=0x7ffc78d84368 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7ffc78d843d0 sp=0x7ffc78d843a0 pc=0x44240d
runtime.exitsyscall0(0xc007b03860)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3937 +0x156 fp=0x7ffc78d84400 sp=0x7ffc78d843d0 pc=0x4465f6
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7ffc78d84410 sp=0x7ffc78d84400 pc=0x46ca83

goroutine 1 [chan receive, 171 minutes]:
runtime.gopark(0x1?, 0xc0001d9898?, 0x65?, 0x30?, 0xc0001d9848?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0001d9818 sp=0xc0001d97f8 pc=0x43e676
runtime.chanrecv(0xc00abbc620, 0xc0001d9917, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:577 +0x56c fp=0xc0001d98a8 sp=0xc0001d9818 pc=0x40c60c
runtime.chanrecv1(0x10d6f74?, 0x10d6f74?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:440 +0x18 fp=0xc0001d98d0 sp=0xc0001d98a8 pc=0x40c038
testing.(*T).Run(0xc006574000, {0x10d6f74?, 0x51a8c5?}, 0x113e248)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/testing/testing.go:1487 +0x37a fp=0xc0001d9970 sp=0xc0001d98d0 pc=0x51bcda
testing.runTests.func1(0xc0058137a0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/testing/testing.go:1839 +0x6e fp=0xc0001d99c0 sp=0xc0001d9970 pc=0x51dc2e
testing.tRunner(0xc006574000, 0xc0001d9ac8)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/testing/testing.go:1439 +0x102 fp=0xc0001d9a10 sp=0xc0001d99c0 pc=0x51aee2
testing.runTests(0xc000572f00?, {0x1af11a0, 0xdc, 0xdc}, {0xc0001d9b00?, 0xc0001d9b10?, 0x1b6e7c0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/testing/testing.go:1837 +0x457 fp=0xc0001d9af8 sp=0xc0001d9a10 pc=0x51dad7
testing.(*M).Run(0xc000572f00)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/testing/testing.go:1719 +0x5d9 fp=0xc0001d9cf0 sp=0xc0001d9af8 pc=0x51c5b9
github.com/couchbase/indexing/secondary/tests/functionaltests.TestMain(0x446191?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/functionaltests/common_test.go:168 +0x1276 fp=0xc0001d9ec8 sp=0xc0001d9cf0 pc=0xdab7f6
main.main()
	_testmain.go:487 +0x1d3 fp=0xc0001d9f80 sp=0xc0001d9ec8 pc=0xe8c353
runtime.main()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:250 +0x212 fp=0xc0001d9fe0 sp=0xc0001d9f80 pc=0x43e2b2
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0001d9fe8 sp=0xc0001d9fe0 pc=0x46ecc1

goroutine 2 [force gc (idle), 237 minutes]:
runtime.gopark(0x3949693588c4?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00006afb0 sp=0xc00006af90 pc=0x43e676
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:367
runtime.forcegchelper()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:301 +0xad fp=0xc00006afe0 sp=0xc00006afb0 pc=0x43e50d
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00006afe8 sp=0xc00006afe0 pc=0x46ecc1
created by runtime.init.6
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:289 +0x25

goroutine 18 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000066790 sp=0xc000066770 pc=0x43e676
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:367
runtime.bgsweep(0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgcsweep.go:297 +0xd7 fp=0xc0000667c8 sp=0xc000066790 pc=0x429757
runtime.gcenable.func1()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:177 +0x26 fp=0xc0000667e0 sp=0xc0000667c8 pc=0x41f306
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0000667e8 sp=0xc0000667e0 pc=0x46ecc1
created by runtime.gcenable
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:177 +0x6b

goroutine 19 [GC scavenge wait]:
runtime.gopark(0x1b6de00?, 0x10000?, 0xd?, 0x14?, 0x1?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000066f20 sp=0xc000066f00 pc=0x43e676
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:367
runtime.bgscavenge(0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgcscavenge.go:364 +0x2a5 fp=0xc000066fc8 sp=0xc000066f20 pc=0x427565
runtime.gcenable.func2()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:178 +0x26 fp=0xc000066fe0 sp=0xc000066fc8 pc=0x41f2a6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000066fe8 sp=0xc000066fe0 pc=0x46ecc1
created by runtime.gcenable
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:178 +0xaa

goroutine 3 [finalizer wait]:
runtime.gopark(0x0?, 0x11435d0?, 0x60?, 0x80?, 0x2000000020?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00006a630 sp=0xc00006a610 pc=0x43e676
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:367
runtime.runfinq()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mfinal.go:177 +0xb3 fp=0xc00006a7e0 sp=0xc00006a630 pc=0x41e3b3
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00006a7e8 sp=0xc00006a7e0 pc=0x46ecc1
created by runtime.createfing
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mfinal.go:157 +0x45

goroutine 20 [select, 240 minutes]:
runtime.gopark(0xc00006b798?, 0x2?, 0xa0?, 0x21?, 0xc00006b78c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00006b618 sp=0xc00006b5f8 pc=0x43e676
runtime.selectgo(0xc00006b798, 0xc00006b788, 0x40bf79?, 0x0, 0x8?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00006b758 sp=0xc00006b618 pc=0x44e0d2
github.com/couchbase/cbauth/cbauthimpl.(*tlsNotifier).loop(0xc00011e0f0)
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:405 +0x67 fp=0xc00006b7c8 sp=0xc00006b758 pc=0x794ba7
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func2()
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:565 +0x26 fp=0xc00006b7e0 sp=0xc00006b7c8 pc=0x7957e6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00006b7e8 sp=0xc00006b7e0 pc=0x46ecc1
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:565 +0x37a

goroutine 21 [select, 240 minutes]:
runtime.gopark(0xc000067798?, 0x2?, 0x0?, 0x0?, 0xc00006778c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000067608 sp=0xc0000675e8 pc=0x43e676
runtime.selectgo(0xc000067798, 0xc000067788, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000067748 sp=0xc000067608 pc=0x44e0d2
github.com/couchbase/cbauth/cbauthimpl.(*cfgChangeNotifier).loop(0xc00011e108)
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:325 +0x85 fp=0xc0000677c8 sp=0xc000067748 pc=0x7945c5
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func3()
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:566 +0x26 fp=0xc0000677e0 sp=0xc0000677c8 pc=0x795786
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0000677e8 sp=0xc0000677e0 pc=0x46ecc1
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:566 +0x3ca

goroutine 22 [IO wait, 1 minutes]:
runtime.gopark(0xc0001029c0?, 0xc00005a500?, 0xf0?, 0x97?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0000d9780 sp=0xc0000d9760 pc=0x43e676
runtime.netpollblock(0xc00022d000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc0000d97b8 sp=0xc0000d9780 pc=0x437057
internal/poll.runtime_pollWait(0x7f8448b5d068, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc0000d97d8 sp=0xc0000d97b8 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc000214180?, 0xc00022d000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc0000d9800 sp=0xc0000d97d8 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc000214180, {0xc00022d000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0000d9880 sp=0xc0000d9800 pc=0x4a34da
net.(*netFD).Read(0xc000214180, {0xc00022d000?, 0xc00ac1be60?, 0xc0000d9950?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc0000d98c8 sp=0xc0000d9880 pc=0x678249
net.(*conn).Read(0xc000208020, {0xc00022d000?, 0x11?, 0xc0000d99e8?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc0000d9910 sp=0xc0000d98c8 pc=0x6884a5
bufio.(*Reader).Read(0xc000200120, {0xc000176001, 0x5ff, 0x4538b4?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:236 +0x1b4 fp=0xc0000d9948 sp=0xc0000d9910 pc=0x521274
github.com/couchbase/cbauth/revrpc.(*minirwc).Read(0x191?, {0xc000176001?, 0x8?, 0x20?})
	/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:103 +0x25 fp=0xc0000d9978 sp=0xc0000d9948 pc=0x7fb9c5
encoding/json.(*Decoder).refill(0xc000131400)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:165 +0x17f fp=0xc0000d99c8 sp=0xc0000d9978 pc=0x57447f
encoding/json.(*Decoder).readValue(0xc000131400)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0000d9a18 sp=0xc0000d99c8 pc=0x57407b
encoding/json.(*Decoder).Decode(0xc000131400, {0xf43a80, 0xc000112440})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0000d9a48 sp=0xc0000d9a18 pc=0x573cd8
net/rpc/jsonrpc.(*serverCodec).ReadRequestHeader(0xc000112420, 0xc00011c3e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/rpc/jsonrpc/server.go:66 +0x85 fp=0xc0000d9a88 sp=0xc0000d9a48 pc=0x7fac25
github.com/couchbase/cbauth/revrpc.(*jsonServerCodec).ReadRequestHeader(0xc000124690?, 0x4cd4e8?)
	:1 +0x2a fp=0xc0000d9aa8 sp=0xc0000d9a88 pc=0x7fdbea
net/rpc.(*Server).readRequestHeader(0xc000124690, {0x1268338, 0xc00010e6d0})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/rpc/server.go:587 +0x66 fp=0xc0000d9b78 sp=0xc0000d9aa8 pc=0x7f9206
net/rpc.(*Server).readRequest(0x0?, {0x1268338, 0xc00010e6d0})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/rpc/server.go:547 +0x3b fp=0xc0000d9c50 sp=0xc0000d9b78 pc=0x7f8d5b
net/rpc.(*Server).ServeCodec(0xc000124690, {0x1268338?, 0xc00010e6d0})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/rpc/server.go:462 +0x87 fp=0xc0000d9d48 sp=0xc0000d9c50 pc=0x7f82a7
github.com/couchbase/cbauth/revrpc.(*Service).Run(0xc000067f60?, 0xc0000d5fa0)
	/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:233 +0x77c fp=0xc0000d9f38 sp=0xc0000d9d48 pc=0x7fc5bc
github.com/couchbase/cbauth/revrpc.BabysitService(0x0?, 0x0?, {0x125d960?, 0xc000204030?})
	/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:332 +0x58 fp=0xc0000d9f70 sp=0xc0000d9f38 pc=0x7fcc58
github.com/couchbase/cbauth.runRPCForSvc(0x0?, 0xc000146000)
	/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:57 +0xbd fp=0xc0000d9fc0 sp=0xc0000d9f70 pc=0x80717d
github.com/couchbase/cbauth.startDefault.func1()
	/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:66 +0x25 fp=0xc0000d9fe0 sp=0xc0000d9fc0 pc=0x807465
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0000d9fe8 sp=0xc0000d9fe0 pc=0x46ecc1
created by github.com/couchbase/cbauth.startDefault
	/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:65 +0xf9

goroutine 1000 [select, 233 minutes]:
runtime.gopark(0xc000449f68?, 0x4?, 0x3?, 0x0?, 0xc000449db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000449c00 sp=0xc000449be0 pc=0x43e676
runtime.selectgo(0xc000449f68, 0xc000449da8, 0xc0022ca300?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000449d40 sp=0xc000449c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc004eb5b00)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc000449fc8 sp=0xc000449d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc000449fe0 sp=0xc000449fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000449fe8 sp=0xc000449fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 34 [chan receive, 181 minutes]:
runtime.gopark(0xc000480000?, 0x18?, 0x68?, 0x2a?, 0x18?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000067ef8 sp=0xc000067ed8 pc=0x43e676
runtime.chanrecv(0xc000432a20, 0x0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:577 +0x56c fp=0xc000067f88 sp=0xc000067ef8 pc=0x40c60c
runtime.chanrecv1(0xc000067fd0?, 0x807465?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:440 +0x18 fp=0xc000067fb0 sp=0xc000067f88 pc=0x40c038
github.com/couchbase/regulator/utils/logging.duplicateFlushLoop()
	/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:253 +0x25 fp=0xc000067fd0 sp=0xc000067fb0 pc=0xa17265
github.com/couchbase/regulator/utils/logging.init.0.func1()
	/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:49 +0x25 fp=0xc000067fe0 sp=0xc000067fd0 pc=0xa199c5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x46ecc1
created by github.com/couchbase/regulator/utils/logging.init.0
	/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:49 +0x7e

goroutine 38 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0x2d?, 0xa7?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000584758 sp=0xc000584738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0005847e0 sp=0xc000584758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0005847e8 sp=0xc0005847e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 37 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0x67?, 0xbb?, 0x1?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000584f58 sp=0xc000584f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc000584fe0 sp=0xc000584f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000584fe8 sp=0xc000584fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 50 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0x57?, 0xc0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000580758 sp=0xc000580738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0005807e0 sp=0xc000580758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0005807e8 sp=0xc0005807e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 5 [GC worker (idle), 180 minutes]:
runtime.gopark(0x3c4edc303e75?, 0x3?, 0xed?, 0x9f?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00006bf58 sp=0xc00006bf38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00006bfe0 sp=0xc00006bf58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00006bfe8 sp=0xc00006bfe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 9 [select, 240 minutes]:
runtime.gopark(0xc00038ff68?, 0x4?, 0x3?, 0x0?, 0xc00038fdb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00038fc00 sp=0xc00038fbe0 pc=0x43e676
runtime.selectgo(0xc00038ff68, 0xc00038fda8, 0xc000110180?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00038fd40 sp=0xc00038fc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0004a8120)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00038ffc8 sp=0xc00038fd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00038ffe0 sp=0xc00038ffc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00038ffe8 sp=0xc00038ffe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 10 [select, 240 minutes]:
runtime.gopark(0xc00038ef90?, 0x2?, 0xd8?, 0xed?, 0xc00038ef24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00038ed90 sp=0xc00038ed70 pc=0x43e676
runtime.selectgo(0xc00038ef90, 0xc00038ef20, 0xc0001101c0?, 0x0, 0xc000545c50?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00038eed0 sp=0xc00038ed90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0004a8120)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00038efc8 sp=0xc00038eed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00038efe0 sp=0xc00038efc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00038efe8 sp=0xc00038efe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 33 [select, 239 minutes]:
runtime.gopark(0xc00007bf90?, 0x2?, 0xd8?, 0xbd?, 0xc00007bf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00007bd90 sp=0xc00007bd70 pc=0x43e676
runtime.selectgo(0xc00007bf90, 0xc00007bf20, 0xc000110000?, 0x0, 0xc00585a9c0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00007bed0 sp=0xc00007bd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0000e65a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00007bfc8 sp=0xc00007bed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00007bfe0 sp=0xc00007bfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00007bfe8 sp=0xc00007bfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 31 [chan receive, 240 minutes]:
runtime.gopark(0x3?, 0x754420?, 0x47?, 0x35?, 0xc00021e800?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000583678 sp=0xc000583658 pc=0x43e676
runtime.chanrecv(0xc0004803c0, 0xc000583790, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:577 +0x56c fp=0xc000583708 sp=0xc000583678 pc=0x40c60c
runtime.chanrecv2(0xc0004b0a40?, 0x16?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:445 +0x18 fp=0xc000583730 sp=0xc000583708 pc=0x40c078
github.com/couchbase/goutils/systemeventlog.(*SystemEventLoggerImpl).logEvents(0xc000514070)
	/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:186 +0xb7 fp=0xc0005837c8 sp=0xc000583730 pc=0xbe9917
github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger.func1()
	/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x26 fp=0xc0005837e0 sp=0xc0005837c8 pc=0xbe9226
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0005837e8 sp=0xc0005837e0 pc=0x46ecc1
created by github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger
	/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x1d6

goroutine 1010 [select, 233 minutes]:
runtime.gopark(0xc00044ff90?, 0x2?, 0xd8?, 0xfd?, 0xc00044ff24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00044fd90 sp=0xc00044fd70 pc=0x43e676
runtime.selectgo(0xc00044ff90, 0xc00044ff20, 0xc002bb5400?, 0x0, 0xc00a286e40?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00044fed0 sp=0xc00044fd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc004ebfe60)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00044ffc8 sp=0xc00044fed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00044ffe0 sp=0xc00044ffc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00044ffe8 sp=0xc00044ffe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 56 [select]:
runtime.gopark(0xc000069798?, 0x2?, 0x71?, 0xe4?, 0xc00006978c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000069618 sp=0xc0000695f8 pc=0x43e676
runtime.selectgo(0xc000069798, 0xc000069788, 0x0?, 0x0, 0x2?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000069758 sp=0xc000069618 pc=0x44e0d2
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc00048e750)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2394 +0x92 fp=0xc0000697c8 sp=0xc000069758 pc=0xd47112
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2187 +0x26 fp=0xc0000697e0 sp=0xc0000697c8 pc=0xd45aa6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0000697e8 sp=0xc0000697e0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2187 +0x296

goroutine 72 [select]:
runtime.gopark(0xc003859f38?, 0x2?, 0x2?, 0x30?, 0xc003859f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc003859d58 sp=0xc003859d38 pc=0x43e676
runtime.selectgo(0xc003859f38, 0xc003859f20, 0xc0004841c0?, 0x0, 0xc0001e2190?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc003859e98 sp=0xc003859d58 pc=0x44e0d2
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc000046a10, 0xe}, {0x1260d18, 0xc000496240}, {0x126e0f8, 0xc000496240}, {0x126d5e0, 0x1ba5368}, 0xc000484150, 0xc000495b60, ...)
	/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:72 +0x20e fp=0xc003859f68 sp=0xc003859e98 pc=0xc9b8ce
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4288 +0x9f fp=0xc003859fe0 sp=0xc003859f68 pc=0xd07c1f
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc003859fe8 sp=0xc003859fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4288 +0x1f8

goroutine 76 [select]:
runtime.gopark(0xc000582f90?, 0x2?, 0x9b?, 0x57?, 0xc000582f74?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000582df8 sp=0xc000582dd8 pc=0x43e676
runtime.selectgo(0xc000582f90, 0xc000582f70, 0x0?, 0x0, 0x2?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000582f38 sp=0xc000582df8 pc=0x44e0d2
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc000496240)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6495 +0xcd fp=0xc000582fc8 sp=0xc000582f38 pc=0xd15f8d
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6486 +0x26 fp=0xc000582fe0 sp=0xc000582fc8 pc=0xd15e86
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000582fe8 sp=0xc000582fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6486 +0x8a

goroutine 32 [select, 239 minutes]:
runtime.gopark(0xc000391f68?, 0x4?, 0x3?, 0x0?, 0xc000391db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000391c00 sp=0xc000391be0 pc=0x43e676
runtime.selectgo(0xc000391f68, 0xc000391da8, 0xc00570ca80?, 0x0, 0xc000068d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000391d40 sp=0xc000391c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0000e65a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc000391fc8 sp=0xc000391d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc000391fe0 sp=0xc000391fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000391fe8 sp=0xc000391fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 61 [select, 172 minutes]:
runtime.gopark(0xc0001d5ba0?, 0x3?, 0x6?, 0x30?, 0xc0001d5b1a?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0001d5978 sp=0xc0001d5958 pc=0x43e676
runtime.selectgo(0xc0001d5ba0, 0xc0001d5b14, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0001d5ab8 sp=0xc0001d5978 pc=0x44e0d2
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc000206380?, {0x10d8067, 0x1b}, 0xc0001d5e68, 0xc000494360)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc0001d5e40 sp=0xc0001d5ab8 pc=0xa0abe9
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x10d8067?, 0x0?}, 0x0?, 0x0?)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc0001d5e88 sp=0xc0001d5e40 pc=0xa0b198
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0x0?, {0x0?, 0x0?})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1579 +0xc7 fp=0xc0001d5f00 sp=0xc0001d5e88 pc=0xbee8a7
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc0001d5fa0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc0001d5f38 sp=0xc0001d5f00 pc=0xb33663
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1584 +0xdf fp=0xc0001d5fe0 sp=0xc0001d5f38 pc=0xbee75f
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0001d5fe8 sp=0xc0001d5fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1572 +0xaf

goroutine 64 [select, 240 minutes]:
runtime.gopark(0xc00007ff68?, 0x4?, 0x3?, 0x0?, 0xc00007fdb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00007fc00 sp=0xc00007fbe0 pc=0x43e676
runtime.selectgo(0xc00007ff68, 0xc00007fda8, 0xc0000f1700?, 0x0, 0xc000069d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00007fd40 sp=0xc00007fc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0000e66c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00007ffc8 sp=0xc00007fd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00007ffe0 sp=0xc00007ffc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00007ffe8 sp=0xc00007ffe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 65 [select, 240 minutes]:
runtime.gopark(0xc000078f90?, 0x2?, 0xd8?, 0x8d?, 0xc000078f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000078d90 sp=0xc000078d70 pc=0x43e676
runtime.selectgo(0xc000078f90, 0xc000078f20, 0xc0004ae500?, 0x0, 0xc00048f3b0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000078ed0 sp=0xc000078d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0000e66c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000078fc8 sp=0xc000078ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc000078fe0 sp=0xc000078fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000078fe8 sp=0xc000078fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 41 [IO wait, 172 minutes]:
runtime.gopark(0xc0004b29c0?, 0xc00005ef00?, 0x10?, 0xba?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00038b9a0 sp=0xc00038b980 pc=0x43e676
runtime.netpollblock(0xc0001b3000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc00038b9d8 sp=0xc00038b9a0 pc=0x437057
internal/poll.runtime_pollWait(0x7f8448b5ce88, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc00038b9f8 sp=0xc00038b9d8 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc0004a6500?, 0xc0001b3000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc00038ba20 sp=0xc00038b9f8 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc0004a6500, {0xc0001b3000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00038baa0 sp=0xc00038ba20 pc=0x4a34da
net.(*netFD).Read(0xc0004a6500, {0xc0001b3000?, 0xc008a7db90?, 0xc00038bb78?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc00038bae8 sp=0xc00038baa0 pc=0x678249
net.(*conn).Read(0xc0004a4100, {0xc0001b3000?, 0x6b?, 0xc00038bbb8?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc00038bb30 sp=0xc00038bae8 pc=0x6884a5
net/http.(*persistConn).Read(0xc0000e66c0, {0xc0001b3000?, 0x181?, 0xc00023e360?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1929 +0x4e fp=0xc00038bb90 sp=0xc00038bb30 pc=0x77946e
bufio.(*Reader).fill(0xc000480e40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc00038bbc8 sp=0xc00038bb90 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc000480e40, 0x81?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc00038bc18 sp=0xc00038bbc8 pc=0x52188f
net/http/internal.readChunkLine(0x5a6?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc00038bc68 sp=0xc00038bc18 pc=0x717365
net/http/internal.(*chunkedReader).beginChunk(0xc000545980)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc00038bc98 sp=0xc00038bc68 pc=0x716de8
net/http/internal.(*chunkedReader).Read(0xc000545980, {0xc00621cc00?, 0xc0058eeff0?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:98 +0x14e fp=0xc00038bd18 sp=0xc00038bc98 pc=0x7170ae
net/http.(*body).readLocked(0xc0000f1700, {0xc00621cc00?, 0x126f358?, 0xfe4fa0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:844 +0x3c fp=0xc00038bd68 sp=0xc00038bd18 pc=0x76dfdc
net/http.(*body).Read(0x0?, {0xc00621cc00?, 0x561d3e?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:836 +0x125 fp=0xc00038bde0 sp=0xc00038bd68 pc=0x76dea5
net/http.(*bodyEOFSignal).Read(0xc0000f1740, {0xc00621cc00, 0x600, 0x600})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2774 +0x142 fp=0xc00038be60 sp=0xc00038bde0 pc=0x77dba2
encoding/json.(*Decoder).refill(0xc0002383c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:165 +0x17f fp=0xc00038beb0 sp=0xc00038be60 pc=0x57447f
encoding/json.(*Decoder).readValue(0xc0002383c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:140 +0xbb fp=0xc00038bf00 sp=0xc00038beb0 pc=0x57407b
encoding/json.(*Decoder).Decode(0xc0002383c0, {0xee3c20, 0xc00023e320})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:63 +0x78 fp=0xc00038bf30 sp=0xc00038bf00 pc=0x573cd8
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc00038bfe0 sp=0xc00038bf30 pc=0xa0b08b
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00038bfe8 sp=0xc00038bfe0 pc=0x46ecc1
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb

goroutine 743 [GC worker (idle), 26 minutes]:
runtime.gopark(0x44b2f4ccc9fc?, 0x3?, 0x8f?, 0x5a?, 0xc00879c001?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b5f58 sp=0xc0003b5f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b5fe0 sp=0xc0003b5f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b5fe8 sp=0xc0003b5fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 163 [select, 1 minutes]:
runtime.gopark(0xc000580f50?, 0x2?, 0xd8?, 0xd?, 0xc000580f14?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000580d90 sp=0xc000580d70 pc=0x43e676
runtime.selectgo(0xc000580f50, 0xc000580f10, 0x10dbfbe?, 0x0, 0xc000580f20?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000580ed0 sp=0xc000580d90 pc=0x44e0d2
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc008c3ef80, 0xc000396070)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1849 +0x238 fp=0xc000580fc0 sp=0xc000580ed0 pc=0xd33b38
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2a fp=0xc000580fe0 sp=0xc000580fc0 pc=0xd337aa
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000580fe8 sp=0xc000580fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2ed

goroutine 135 [select]:
runtime.gopark(0xc00039ff38?, 0x2?, 0x2?, 0x30?, 0xc00039ff24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00039fd58 sp=0xc00039fd38 pc=0x43e676
runtime.selectgo(0xc00039ff38, 0xc00039ff20, 0xc0001442a0?, 0x0, 0xc005f38b90?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00039fe98 sp=0xc00039fd58 pc=0x44e0d2
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc0096a2680, 0xe}, {0x1260d18, 0xc00ac18240}, {0x126e0f8, 0xc00ac18240}, {0x126d5e0, 0x1ba5368}, 0xc000144150, 0xc000570f60, ...)
	/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:72 +0x20e fp=0xc00039ff68 sp=0xc00039fe98 pc=0xc9b8ce
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4288 +0x9f fp=0xc00039ffe0 sp=0xc00039ff68 pc=0xd07c1f
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00039ffe8 sp=0xc00039ffe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4288 +0x1f8

goroutine 43 [chan send, 240 minutes]:
runtime.gopark(0xb2ff08?, 0xc006504000?, 0x21?, 0x19?, 0x1102253?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00655dd60 sp=0xc00655dd40 pc=0x43e676
runtime.chansend(0xc0000506c0, 0x1258558, 0x1, 0xc0000d5d01?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:258 +0x425 fp=0xc00655dde8 sp=0xc00655dd60 pc=0x40b765
runtime.chansend1(0xc000116480?, 0x2c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:144 +0x1d fp=0xc00655de18 sp=0xc00655dde8 pc=0x40b31d
github.com/couchbase/indexing/secondary/common.(*internalVersionMonitor).notifier(0xc0001641c0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:727 +0x465 fp=0xc00655dfc8 sp=0xc00655de18 pc=0xb30665
github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:232 +0x26 fp=0xc00655dfe0 sp=0xc00655dfc8 pc=0xb2bf66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00655dfe8 sp=0xc00655dfe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:232 +0x336

goroutine 46 [chan receive, 1 minutes]:
runtime.gopark(0xc00ae928a0?, 0xc000112fb8?, 0xe?, 0x17?, 0x2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00038dec8 sp=0xc00038dea8 pc=0x43e676
runtime.chanrecv(0xc000112f60, 0x0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:577 +0x56c fp=0xc00038df58 sp=0xc00038dec8 pc=0x40c60c
runtime.chanrecv1(0xc0000cc420?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:440 +0x18 fp=0xc00038df80 sp=0xc00038df58 pc=0x40c038
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc0000cc420)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1410 +0x79 fp=0xc00038dfc8 sp=0xc00038df80 pc=0xd3fc79
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:150 +0x26 fp=0xc00038dfe0 sp=0xc00038dfc8 pc=0xd38606
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00038dfe8 sp=0xc00038dfe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:150 +0x605

goroutine 924 [select, 233 minutes]:
runtime.gopark(0xc000555f68?, 0x4?, 0x3?, 0x0?, 0xc000555db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000555c00 sp=0xc000555be0 pc=0x43e676
runtime.selectgo(0xc000555f68, 0xc000555da8, 0xc0022ca800?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000555d40 sp=0xc000555c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc00290b8c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc000555fc8 sp=0xc000555d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc000555fe0 sp=0xc000555fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000555fe8 sp=0xc000555fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 162 [select, 1 minutes]:
runtime.gopark(0xc00054ff90?, 0x2?, 0x0?, 0x0?, 0xc00054ff8c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00054fe18 sp=0xc00054fdf8 pc=0x43e676
runtime.selectgo(0xc00054ff90, 0xc00054ff88, 0xc00570ce80?, 0x0, 0x4?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00054ff58 sp=0xc00054fe18 pc=0x44e0d2
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc008c3ef80, 0xc000396070)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1830 +0x70 fp=0xc00054ffc0 sp=0xc00054ff58 pc=0xd338b0
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x2a fp=0xc00054ffe0 sp=0xc00054ffc0 pc=0xd3380a
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00054ffe8 sp=0xc00054ffe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x28a

goroutine 925 [select, 233 minutes]:
runtime.gopark(0xc000554f90?, 0x2?, 0xd8?, 0x4d?, 0xc000554f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000554d90 sp=0xc000554d70 pc=0x43e676
runtime.selectgo(0xc000554f90, 0xc000554f20, 0xc0022ca700?, 0x0, 0xc0059519e0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000554ed0 sp=0xc000554d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc00290b8c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000554fc8 sp=0xc000554ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc000554fe0 sp=0xc000554fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000554fe8 sp=0xc000554fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 101 [sleep]:
runtime.gopark(0x462186bfd5fe?, 0xc0003b7718?, 0x85?, 0xca?, 0x10?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b76e8 sp=0xc0003b76c8 pc=0x43e676
time.Sleep(0x3b9aca00)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/time.go:194 +0x12e fp=0xc0003b7728 sp=0xc0003b76e8 pc=0x46bb2e
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc0004c6840)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:457 +0xa5 fp=0xc0003b77c8 sp=0xc0003b7728 pc=0xd37d45
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc0003b77e0 sp=0xc0003b77c8 pc=0xd34fa6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b77e8 sp=0xc0003b77e0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x49b

goroutine 1259 [select, 231 minutes]:
runtime.gopark(0xc00044bf68?, 0x4?, 0x3?, 0x0?, 0xc00044bdb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00044bc00 sp=0xc00044bbe0 pc=0x43e676
runtime.selectgo(0xc00044bf68, 0xc00044bda8, 0xc0050c9000?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00044bd40 sp=0xc00044bc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc005f590e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00044bfc8 sp=0xc00044bd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00044bfe0 sp=0xc00044bfc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00044bfe8 sp=0xc00044bfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5672 [select, 222 minutes]:
runtime.gopark(0xc0065bdf90?, 0x2?, 0xd8?, 0xdd?, 0xc0065bdf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0065bdd90 sp=0xc0065bdd70 pc=0x43e676
runtime.selectgo(0xc0065bdf90, 0xc0065bdf20, 0xc00f8302c0?, 0x0, 0xc02ea6b5f0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0065bded0 sp=0xc0065bdd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0250205a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0065bdfc8 sp=0xc0065bded0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0065bdfe0 sp=0xc0065bdfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0065bdfe8 sp=0xc0065bdfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 79 [select, 1 minutes]:
runtime.gopark(0xc000550f90?, 0x2?, 0x0?, 0x0?, 0xc000550f8c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000550e18 sp=0xc000550df8 pc=0x43e676
runtime.selectgo(0xc000550f90, 0xc000550f88, 0x100000000000000?, 0x0, 0xc0004ae080?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000550f58 sp=0xc000550e18 pc=0x44e0d2
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc0004a6400, 0xc0001445b0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1830 +0x70 fp=0xc000550fc0 sp=0xc000550f58 pc=0xd338b0
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x2a fp=0xc000550fe0 sp=0xc000550fc0 pc=0xd3380a
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000550fe8 sp=0xc000550fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x28a

goroutine 80 [select, 1 minutes]:
runtime.gopark(0xc0003b2f50?, 0x2?, 0x9?, 0x18?, 0xc0003b2f14?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b2d90 sp=0xc0003b2d70 pc=0x43e676
runtime.selectgo(0xc0003b2f50, 0xc0003b2f10, 0x10dbfbe?, 0x0, 0xc0003b2f20?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0003b2ed0 sp=0xc0003b2d90 pc=0x44e0d2
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc0004a6400, 0xc0001445b0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1849 +0x238 fp=0xc0003b2fc0 sp=0xc0003b2ed0 pc=0xd33b38
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2a fp=0xc0003b2fe0 sp=0xc0003b2fc0 pc=0xd337aa
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b2fe8 sp=0xc0003b2fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2ed

goroutine 742 [GC worker (idle), 182 minutes]:
runtime.gopark(0x3c2e29f90d28?, 0x3?, 0xf9?, 0x3f?, 0xc00879d860?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b2758 sp=0xc0003b2738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b27e0 sp=0xc0003b2758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b27e8 sp=0xc0003b27e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 124 [select, 172 minutes]:
runtime.gopark(0xc00039dba0?, 0x3?, 0x6?, 0x30?, 0xc00039db1a?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00039d978 sp=0xc00039d958 pc=0x43e676
runtime.selectgo(0xc00039dba0, 0xc00039db14, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00039dab8 sp=0xc00039d978 pc=0x44e0d2
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc000206380?, {0x10d8067, 0x1b}, 0xc00039de68, 0xc000494420)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc00039de40 sp=0xc00039dab8 pc=0xa0abe9
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x10d8067?, 0xffffffffffffffff?}, 0xffffffffffffffff?, 0x730063c0065b0858?)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc00039de88 sp=0xc00039de40 pc=0xa0b198
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0xc00767e300?, {0x0?, 0x0?})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1579 +0xc7 fp=0xc00039df00 sp=0xc00039de88 pc=0xbee8a7
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc00039dfa0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc00039df38 sp=0xc00039df00 pc=0xb33663
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1584 +0xdf fp=0xc00039dfe0 sp=0xc00039df38 pc=0xbee75f
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00039dfe8 sp=0xc00039dfe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1572 +0xaf

goroutine 107 [select, 234 minutes]:
runtime.gopark(0xc0005cdbc0?, 0x3?, 0x0?, 0x0?, 0xc0005cdb3a?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008459998 sp=0xc008459978 pc=0x43e676
runtime.selectgo(0xc008459bc0, 0xc0005cdb34, 0xc008942000?, 0x0, 0xef1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc008459ad8 sp=0xc008459998 pc=0x44e0d2
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc000206380?, {0x10ccc50, 0x13}, 0xc008459e88, 0xc000570120)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc008459e60 sp=0xc008459ad8 pc=0xa0abe9
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x10ccc50?, 0xf10ac0?}, 0xc006556090?, 0xc00013f260?)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc008459ea8 sp=0xc008459e60 pc=0xa0b198
github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings.func1.1(0x3a22656d69747075?, {0x0?, 0x0?})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:85 +0xcc fp=0xc008459f28 sp=0xc008459ea8 pc=0xd6156c
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc008459fa8)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc008459f60 sp=0xc008459f28 pc=0xb33663
github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:89 +0x75 fp=0xc008459fe0 sp=0xc008459f60 pc=0xd61455
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008459fe8 sp=0xc008459fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:80 +0x1d6

goroutine 108 [select]:
runtime.gopark(0xc0003b5798?, 0x2?, 0x71?, 0xe4?, 0xc0003b578c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b5618 sp=0xc0003b55f8 pc=0x43e676
runtime.selectgo(0xc0003b5798, 0xc0003b5788, 0x0?, 0x0, 0xc00020e840?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0003b5758 sp=0xc0003b5618 pc=0x44e0d2
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc00a87fc50)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2394 +0x92 fp=0xc0003b57c8 sp=0xc0003b5758 pc=0xd47112
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2187 +0x26 fp=0xc0003b57e0 sp=0xc0003b57c8 pc=0xd45aa6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b57e8 sp=0xc0003b57e0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2187 +0x296

goroutine 129 [IO wait, 172 minutes]:
runtime.gopark(0xc006574340?, 0xc000058000?, 0x10?, 0xea?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00007e9a0 sp=0xc00007e980 pc=0x43e676
runtime.netpollblock(0xc0067d2000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc00007e9d8 sp=0xc00007e9a0 pc=0x437057
internal/poll.runtime_pollWait(0x7f8448b5cbb8, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc00007e9f8 sp=0xc00007e9d8 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc00669a900?, 0xc0067d2000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc00007ea20 sp=0xc00007e9f8 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc00669a900, {0xc0067d2000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00007eaa0 sp=0xc00007ea20 pc=0x4a34da
net.(*netFD).Read(0xc00669a900, {0xc0067d2000?, 0xc008a7db90?, 0xc00007eb78?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc00007eae8 sp=0xc00007eaa0 pc=0x678249
net.(*conn).Read(0xc0002083c0, {0xc0067d2000?, 0x6b?, 0xc00007ebb8?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc00007eb30 sp=0xc00007eae8 pc=0x6884a5
net/http.(*persistConn).Read(0xc006608120, {0xc0067d2000?, 0x181?, 0xc000124680?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1929 +0x4e fp=0xc00007eb90 sp=0xc00007eb30 pc=0x77946e
bufio.(*Reader).fill(0xc0067d01e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc00007ebc8 sp=0xc00007eb90 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc0067d01e0, 0x81?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc00007ec18 sp=0xc00007ebc8 pc=0x52188f
net/http/internal.readChunkLine(0x5a6?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc00007ec68 sp=0xc00007ec18 pc=0x717365
net/http/internal.(*chunkedReader).beginChunk(0xc0057827e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc00007ec98 sp=0xc00007ec68 pc=0x716de8
net/http/internal.(*chunkedReader).Read(0xc0057827e0, {0xc007090600?, 0xc005b75560?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:98 +0x14e fp=0xc00007ed18 sp=0xc00007ec98 pc=0x7170ae
net/http.(*body).readLocked(0xc00570cc00, {0xc007090600?, 0x126f358?, 0xfe4fa0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:844 +0x3c fp=0xc00007ed68 sp=0xc00007ed18 pc=0x76dfdc
net/http.(*body).Read(0x0?, {0xc007090600?, 0x561d3e?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:836 +0x125 fp=0xc00007ede0 sp=0xc00007ed68 pc=0x76dea5
net/http.(*bodyEOFSignal).Read(0xc00570cc80, {0xc007090600, 0x600, 0x600})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2774 +0x142 fp=0xc00007ee60 sp=0xc00007ede0 pc=0x77dba2
encoding/json.(*Decoder).refill(0xc006694780)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:165 +0x17f fp=0xc00007eeb0 sp=0xc00007ee60 pc=0x57447f
encoding/json.(*Decoder).readValue(0xc006694780)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:140 +0xbb fp=0xc00007ef00 sp=0xc00007eeb0 pc=0x57407b
encoding/json.(*Decoder).Decode(0xc006694780, {0xee3c20, 0xc000124640})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:63 +0x78 fp=0xc00007ef30 sp=0xc00007ef00 pc=0x573cd8
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc00007efe0 sp=0xc00007ef30 pc=0xa0b08b
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00007efe8 sp=0xc00007efe0 pc=0x46ecc1
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb

goroutine 127 [select, 239 minutes]:
runtime.gopark(0xc000390f68?, 0x4?, 0x3?, 0x0?, 0xc000390db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000390c00 sp=0xc000390be0 pc=0x43e676
runtime.selectgo(0xc000390f68, 0xc000390da8, 0xc00570cc00?, 0x0, 0xc000587d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000390d40 sp=0xc000390c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc006608120)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc000390fc8 sp=0xc000390d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc000390fe0 sp=0xc000390fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000390fe8 sp=0xc000390fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 128 [select, 239 minutes]:
runtime.gopark(0xc00007df90?, 0x2?, 0xd8?, 0xdd?, 0xc00007df24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00007dd90 sp=0xc00007dd70 pc=0x43e676
runtime.selectgo(0xc00007df90, 0xc00007df20, 0xc00570cb80?, 0x0, 0xc005782690?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00007ded0 sp=0xc00007dd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc006608120)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00007dfc8 sp=0xc00007ded0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00007dfe0 sp=0xc00007dfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00007dfe8 sp=0xc00007dfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 81 [IO wait, 234 minutes]:
runtime.gopark(0xc006234000?, 0xc000058000?, 0x10?, 0xea?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00054e9a0 sp=0xc00054e980 pc=0x43e676
runtime.netpollblock(0xc000276000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc00054e9d8 sp=0xc00054e9a0 pc=0x437057
internal/poll.runtime_pollWait(0x7f8448b5cca8, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc00054e9f8 sp=0xc00054e9d8 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc0004a6380?, 0xc000276000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc00054ea20 sp=0xc00054e9f8 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc0004a6380, {0xc000276000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00054eaa0 sp=0xc00054ea20 pc=0x4a34da
net.(*netFD).Read(0xc0004a6380, {0xc000276000?, 0xc005812bd0?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc00054eae8 sp=0xc00054eaa0 pc=0x678249
net.(*conn).Read(0xc000208028, {0xc000276000?, 0x14cd?, 0xc00054ebb8?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc00054eb30 sp=0xc00054eae8 pc=0x6884a5
net/http.(*persistConn).Read(0xc0000e65a0, {0xc000276000?, 0x181?, 0xc00048a040?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1929 +0x4e fp=0xc00054eb90 sp=0xc00054eb30 pc=0x77946e
bufio.(*Reader).fill(0xc000432b40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc00054ebc8 sp=0xc00054eb90 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc000432b40, 0x81?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc00054ec18 sp=0xc00054ebc8 pc=0x52188f
net/http/internal.readChunkLine(0x944?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc00054ec68 sp=0xc00054ec18 pc=0x717365
net/http/internal.(*chunkedReader).beginChunk(0xc005782420)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc00054ec98 sp=0xc00054ec68 pc=0x716de8
net/http/internal.(*chunkedReader).Read(0xc005782420, {0xc006844000?, 0xc00585b170?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:98 +0x14e fp=0xc00054ed18 sp=0xc00054ec98 pc=0x7170ae
net/http.(*body).readLocked(0xc00570ca80, {0xc006844000?, 0x126f358?, 0xfe4fa0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:844 +0x3c fp=0xc00054ed68 sp=0xc00054ed18 pc=0x76dfdc
net/http.(*body).Read(0x0?, {0xc006844000?, 0x561d3e?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:836 +0x125 fp=0xc00054ede0 sp=0xc00054ed68 pc=0x76dea5
net/http.(*bodyEOFSignal).Read(0xc00570cb00, {0xc006844000, 0x1e00, 0x1e00})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2774 +0x142 fp=0xc00054ee60 sp=0xc00054ede0 pc=0x77dba2
encoding/json.(*Decoder).refill(0xc008c272c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:165 +0x17f fp=0xc00054eeb0 sp=0xc00054ee60 pc=0x57447f
encoding/json.(*Decoder).readValue(0xc008c272c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:140 +0xbb fp=0xc00054ef00 sp=0xc00054eeb0 pc=0x57407b
encoding/json.(*Decoder).Decode(0xc008c272c0, {0xee3c20, 0xc00048a000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/encoding/json/stream.go:63 +0x78 fp=0xc00054ef30 sp=0xc00054ef00 pc=0x573cd8
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc00054efe0 sp=0xc00054ef30 pc=0xa0b08b
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00054efe8 sp=0xc00054efe0 pc=0x46ecc1
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb

goroutine 788 [GC worker (idle), 182 minutes]:
runtime.gopark(0x3c2e29f90d84?, 0x3?, 0xa2?, 0x51?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b6758 sp=0xc0003b6738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b67e0 sp=0xc0003b6758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b67e8 sp=0xc0003b67e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 18729 [select, 174 minutes]:
runtime.gopark(0xc04f5b0f68?, 0x4?, 0x3?, 0x0?, 0xc04f5b0db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc04f5b0c00 sp=0xc04f5b0be0 pc=0x43e676
runtime.selectgo(0xc04f5b0f68, 0xc04f5b0da8, 0xc01927dec0?, 0x0, 0xc038dd7e01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc04f5b0d40 sp=0xc04f5b0c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc00019fe60)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc04f5b0fc8 sp=0xc04f5b0d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc04f5b0fe0 sp=0xc04f5b0fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc04f5b0fe8 sp=0xc04f5b0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 153 [select]:
runtime.gopark(0xc0003b7f90?, 0x2?, 0x9b?, 0x57?, 0xc0003b7f74?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b7df8 sp=0xc0003b7dd8 pc=0x43e676
runtime.selectgo(0xc0003b7f90, 0xc0003b7f70, 0x0?, 0x0, 0x2?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0003b7f38 sp=0xc0003b7df8 pc=0x44e0d2
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc00ac18240)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6495 +0xcd fp=0xc0003b7fc8 sp=0xc0003b7f38 pc=0xd15f8d
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6486 +0x26 fp=0xc0003b7fe0 sp=0xc0003b7fc8 pc=0xd15e86
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b7fe8 sp=0xc0003b7fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6486 +0x8a

goroutine 1001 [select, 233 minutes]:
runtime.gopark(0xc00038cf90?, 0x2?, 0xd8?, 0xcd?, 0xc00038cf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00038cd90 sp=0xc00038cd70 pc=0x43e676
runtime.selectgo(0xc00038cf90, 0xc00038cf20, 0xc002bb4a00?, 0x0, 0xc00a286a20?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00038ced0 sp=0xc00038cd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc004eb5b00)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00038cfc8 sp=0xc00038ced0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00038cfe0 sp=0xc00038cfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00038cfe8 sp=0xc00038cfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 155 [chan receive, 1 minutes]:
runtime.gopark(0xc005545200?, 0x22202020200a2c5d?, 0x66?, 0x72?, 0x202020200a5b203a?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006a35ec8 sp=0xc006a35ea8 pc=0x43e676
runtime.chanrecv(0xc0067d0720, 0x0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:577 +0x56c fp=0xc006a35f58 sp=0xc006a35ec8 pc=0x40c60c
runtime.chanrecv1(0xc0002469a0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:440 +0x18 fp=0xc006a35f80 sp=0xc006a35f58 pc=0x40c038
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc0002469a0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1410 +0x79 fp=0xc006a35fc8 sp=0xc006a35f80 pc=0xd3fc79
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:150 +0x26 fp=0xc006a35fe0 sp=0xc006a35fc8 pc=0xd38606
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006a35fe8 sp=0xc006a35fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:150 +0x605

goroutine 109 [sleep]:
runtime.gopark(0x46219b4e0104?, 0xc0003b4f18?, 0x85?, 0xca?, 0x10?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b4ee8 sp=0xc0003b4ec8 pc=0x43e676
time.Sleep(0x3b9aca00)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/time.go:194 +0x12e fp=0xc0003b4f28 sp=0xc0003b4ee8 pc=0x46bb2e
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc000660420)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:457 +0xa5 fp=0xc0003b4fc8 sp=0xc0003b4f28 pc=0xd37d45
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc0003b4fe0 sp=0xc0003b4fc8 pc=0xd34fa6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b4fe8 sp=0xc0003b4fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x49b

goroutine 166 [chan receive]:
runtime.gopark(0x0?, 0x56?, 0x50?, 0xbe?, 0x49ad38?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006a3bda8 sp=0xc006a3bd88 pc=0x43e676
runtime.chanrecv(0xc00a845320, 0x0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:577 +0x56c fp=0xc006a3be38 sp=0xc006a3bda8 pc=0x40c60c
runtime.chanrecv1(0xc006a3bf48?, 0x56?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:440 +0x18 fp=0xc006a3be60 sp=0xc006a3be38 pc=0x40c038
github.com/couchbase/indexing/secondary/queryport/n1ql.(*monitor).backfillMonitor(0xc0065304e0, 0x0?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:91 +0x9b fp=0xc006a3bfc0 sp=0xc006a3be60 pc=0xd6f2db
github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:40 +0x2a fp=0xc006a3bfe0 sp=0xc006a3bfc0 pc=0xd6eb8a
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006a3bfe8 sp=0xc006a3bfe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:40 +0xb8

goroutine 167 [chan receive, 1 minutes]:
runtime.gopark(0xc000112fc0?, 0xc00006cde8?, 0x65?, 0x30?, 0x7f84721d25b8?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00006cd68 sp=0xc00006cd48 pc=0x43e676
runtime.chanrecv(0xc00ac3a4e0, 0x0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:577 +0x56c fp=0xc00006cdf8 sp=0xc00006cd68 pc=0x40c60c
runtime.chanrecv1(0xc00006ceb8?, 0xc00592f380?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:440 +0x18 fp=0xc00006ce20 sp=0xc00006cdf8 pc=0x40c038
github.com/couchbase/indexing/secondary/queryport/n1ql.(*monitor).logStats(0xc0065304e0, 0xc0000cc420?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:124 +0x9b fp=0xc00006cfc0 sp=0xc00006ce20 pc=0xd6f6bb
github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:41 +0x2a fp=0xc00006cfe0 sp=0xc00006cfc0 pc=0xd6eb2a
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:41 +0x10a

goroutine 735 [GC worker (idle), 1 minutes]:
runtime.gopark(0x1ba6500?, 0x1?, 0x92?, 0x12?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b8f58 sp=0xc0003b8f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b8fe0 sp=0xc0003b8f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b8fe8 sp=0xc0003b8fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 789 [GC worker (idle), 184 minutes]:
runtime.gopark(0x1ba6500?, 0x1?, 0x5c?, 0xbc?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a784f58 sp=0xc00a784f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a784fe0 sp=0xc00a784f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a784fe8 sp=0xc00a784fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 702 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1ba6500?, 0x1?, 0xc7?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008556f58 sp=0xc008556f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc008556fe0 sp=0xc008556f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008556fe8 sp=0xc008556fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 802 [GC worker (idle), 184 minutes]:
runtime.gopark(0x3c132b993072?, 0x1?, 0x6a?, 0x34?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00006df58 sp=0xc00006df38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00006dfe0 sp=0xc00006df58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00006dfe8 sp=0xc00006dfe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 786 [GC worker (idle), 182 minutes]:
runtime.gopark(0x3c2e29f912d1?, 0x3?, 0x99?, 0xcc?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b9f58 sp=0xc0003b9f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b9fe0 sp=0xc0003b9f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b9fe8 sp=0xc0003b9fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 5653 [select, 222 minutes]:
runtime.gopark(0xc007157f68?, 0x4?, 0x3?, 0x0?, 0xc007157db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc007157c00 sp=0xc007157be0 pc=0x43e676
runtime.selectgo(0xc007157f68, 0xc007157da8, 0xc00f830080?, 0x0, 0xc01a324201?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc007157d40 sp=0xc007157c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024fef200)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc007157fc8 sp=0xc007157d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc007157fe0 sp=0xc007157fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc007157fe8 sp=0xc007157fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 787 [GC worker (idle), 30 minutes]:
runtime.gopark(0x44718f636fab?, 0x3?, 0x91?, 0x61?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b3758 sp=0xc0003b3738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b37e0 sp=0xc0003b3758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b37e8 sp=0xc0003b37e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 705 [GC worker (idle)]:
runtime.gopark(0x461d569565b9?, 0x1?, 0xbe?, 0xe3?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00006d758 sp=0xc00006d738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00006d7e0 sp=0xc00006d758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00006d7e8 sp=0xc00006d7e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 736 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0xc1?, 0xe6?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b4758 sp=0xc0003b4738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b47e0 sp=0xc0003b4758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b47e8 sp=0xc0003b47e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 703 [GC worker (idle), 1 minutes]:
runtime.gopark(0x4607745c61b6?, 0x1?, 0x87?, 0x94?, 0xc00861ed01?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000582758 sp=0xc000582738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0005827e0 sp=0xc000582758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0005827e8 sp=0xc0005827e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 763 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0xec?, 0xae?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008558f58 sp=0xc008558f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc008558fe0 sp=0xc008558f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008558fe8 sp=0xc008558fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 904 [sleep]:
runtime.gopark(0x4620f470ece4?, 0xd2601f90238?, 0xc0?, 0xe7?, 0xc0e0b60640924199?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0001d3e60 sp=0xc0001d3e40 pc=0x43e676
time.Sleep(0x12a05d8d4)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/time.go:194 +0x12e fp=0xc0001d3ea0 sp=0xc0001d3e60 pc=0x46bb2e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00a02e300, {0xc0091b11e8, 0x12})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc0001d3f00 sp=0xc0001d3ea0 pc=0xbb4917
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc0091b11e8?, 0xc0054d1f01?})
	:1 +0x34 fp=0xc0001d3f28 sp=0xc0001d3f00 pc=0xbcbdd4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc0001d3f48 sp=0xc0001d3f28 pc=0xbbb165
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc00608c800)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc0001d3fc8 sp=0xc0001d3f48 pc=0xbc043b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0001d3fe0 sp=0xc0001d3fc8 pc=0xbbe886
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0001d3fe8 sp=0xc0001d3fe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91

goroutine 762 [GC worker (idle), 184 minutes]:
runtime.gopark(0x1ba6500?, 0x3?, 0x48?, 0x1a?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008558758 sp=0xc008558738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0085587e0 sp=0xc008558758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0085587e8 sp=0xc0085587e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 761 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0x26?, 0x4f?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008557f58 sp=0xc008557f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc008557fe0 sp=0xc008557f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008557fe8 sp=0xc008557fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 760 [GC worker (idle), 184 minutes]:
runtime.gopark(0x3c132b9e1da2?, 0x3?, 0xbc?, 0x12?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008557758 sp=0xc008557738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0085577e0 sp=0xc008557758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0085577e8 sp=0xc0085577e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 5754 [select, 222 minutes]:
runtime.gopark(0xc0102cff90?, 0x2?, 0xd8?, 0xfd?, 0xc0102cff24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102cfd90 sp=0xc0102cfd70 pc=0x43e676
runtime.selectgo(0xc0102cff90, 0xc0102cff20, 0xc00f9b2d80?, 0x0, 0xc02f333410?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102cfed0 sp=0xc0102cfd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0252f2b40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0102cffc8 sp=0xc0102cfed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0102cffe0 sp=0xc0102cffc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102cffe8 sp=0xc0102cffe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 790 [GC worker (idle), 180 minutes]:
runtime.gopark(0x3c4edc3da629?, 0x3?, 0xea?, 0xdd?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a785758 sp=0xc00a785738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a7857e0 sp=0xc00a785758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a7857e8 sp=0xc00a7857e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 792 [GC worker (idle), 26 minutes]:
runtime.gopark(0x44b2f4e83229?, 0x3?, 0xf8?, 0x39?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a785f58 sp=0xc00a785f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a785fe0 sp=0xc00a785f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a785fe8 sp=0xc00a785fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 793 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0x5b?, 0x30?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a786758 sp=0xc00a786738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a7867e0 sp=0xc00a786758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a7867e8 sp=0xc00a7867e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 791 [GC worker (idle), 180 minutes]:
runtime.gopark(0x3c4edc304667?, 0x3?, 0x6d?, 0x3d?, 0xc0003b86d8?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b8758 sp=0xc0003b8738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b87e0 sp=0xc0003b8758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b87e8 sp=0xc0003b87e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 1005 [select, 233 minutes]:
runtime.gopark(0xc006e27f68?, 0x4?, 0x3?, 0x0?, 0xc006e27db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006e27c00 sp=0xc006e27be0 pc=0x43e676
runtime.selectgo(0xc006e27f68, 0xc006e27da8, 0xc002bb5000?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006e27d40 sp=0xc006e27c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc004ebe120)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc006e27fc8 sp=0xc006e27d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc006e27fe0 sp=0xc006e27fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006e27fe8 sp=0xc006e27fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5728 [select, 222 minutes]:
runtime.gopark(0xc0102e2f90?, 0x2?, 0xd8?, 0x2d?, 0xc0102e2f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102e2d90 sp=0xc0102e2d70 pc=0x43e676
runtime.selectgo(0xc0102e2f90, 0xc0102e2f20, 0xc00f830c40?, 0x0, 0xc02f70aa50?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102e2ed0 sp=0xc0102e2d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0253d8240)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0102e2fc8 sp=0xc0102e2ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0102e2fe0 sp=0xc0102e2fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102e2fe8 sp=0xc0102e2fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 844 [select, 231 minutes]:
runtime.gopark(0xc006a34f68?, 0x4?, 0x3?, 0x0?, 0xc006a34db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006a34c00 sp=0xc006a34be0 pc=0x43e676
runtime.selectgo(0xc006a34f68, 0xc006a34da8, 0xc0050c8e00?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006a34d40 sp=0xc006a34c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc005f58fc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc006a34fc8 sp=0xc006a34d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc006a34fe0 sp=0xc006a34fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006a34fe8 sp=0xc006a34fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 704 [GC worker (idle), 180 minutes]:
runtime.gopark(0x3c4edc3dc199?, 0x3?, 0x27?, 0xa8?, 0x100000000000001?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000069f58 sp=0xc000069f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc000069fe0 sp=0xc000069f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 744 [GC worker (idle), 3 minutes]:
runtime.gopark(0x45f5905802ed?, 0x3?, 0x1?, 0xa6?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000587758 sp=0xc000587738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0005877e0 sp=0xc000587758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0005877e8 sp=0xc0005877e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 1009 [select, 233 minutes]:
runtime.gopark(0xc006e29f68?, 0x4?, 0x3?, 0x0?, 0xc006e29db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006e29c00 sp=0xc006e29be0 pc=0x43e676
runtime.selectgo(0xc006e29f68, 0xc006e29da8, 0xc002b55100?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006e29d40 sp=0xc006e29c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc004ebfe60)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc006e29fc8 sp=0xc006e29d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc006e29fe0 sp=0xc006e29fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006e29fe8 sp=0xc006e29fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5783 [select, 222 minutes]:
runtime.gopark(0xc0104d1f68?, 0x4?, 0x3?, 0x0?, 0xc0104d1db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104d1c00 sp=0xc0104d1be0 pc=0x43e676
runtime.selectgo(0xc0104d1f68, 0xc0104d1da8, 0xc00fb7ac40?, 0x0, 0xc01de50301?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104d1d40 sp=0xc0104d1c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0254b1440)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0104d1fc8 sp=0xc0104d1d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0104d1fe0 sp=0xc0104d1fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104d1fe8 sp=0xc0104d1fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 737 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0x1d?, 0xb9?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003b9758 sp=0xc0003b9738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0003b97e0 sp=0xc0003b9758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003b97e8 sp=0xc0003b97e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 741 [GC worker (idle), 175 minutes]:
runtime.gopark(0x3c92fcd839c3?, 0x3?, 0x4?, 0x62?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000068758 sp=0xc000068738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0000687e0 sp=0xc000068758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 765 [GC worker (idle), 184 minutes]:
runtime.gopark(0x3c132b994adf?, 0x1?, 0x11?, 0xdb?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008559f58 sp=0xc008559f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc008559fe0 sp=0xc008559f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008559fe8 sp=0xc008559fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 1260 [select, 231 minutes]:
runtime.gopark(0xc000553f90?, 0x2?, 0xd8?, 0x3d?, 0xc000553f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000553d90 sp=0xc000553d70 pc=0x43e676
runtime.selectgo(0xc000553f90, 0xc000553f20, 0xc005124280?, 0x0, 0xc006061290?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000553ed0 sp=0xc000553d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc005f590e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000553fc8 sp=0xc000553ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc000553fe0 sp=0xc000553fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000553fe8 sp=0xc000553fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 845 [select, 231 minutes]:
runtime.gopark(0xc007156f90?, 0x2?, 0xd8?, 0x6d?, 0xc007156f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc007156d90 sp=0xc007156d70 pc=0x43e676
runtime.selectgo(0xc007156f90, 0xc007156f20, 0xc0050c8d80?, 0x0, 0xc005fa39b0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc007156ed0 sp=0xc007156d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc005f58fc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007156fc8 sp=0xc007156ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc007156fe0 sp=0xc007156fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc007156fe8 sp=0xc007156fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 839 [select, 231 minutes]:
runtime.gopark(0xc0065c0f68?, 0x4?, 0x3?, 0x0?, 0xc0065c0db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0065c0c00 sp=0xc0065c0be0 pc=0x43e676
runtime.selectgo(0xc0065c0f68, 0xc0065c0da8, 0xc005124000?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0065c0d40 sp=0xc0065c0c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc005f58a20)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0065c0fc8 sp=0xc0065c0d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0065c0fe0 sp=0xc0065c0fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0065c0fe8 sp=0xc0065c0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5788 [select, 222 minutes]:
runtime.gopark(0xc0104a4f90?, 0x2?, 0xd8?, 0x4d?, 0xc0104a4f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104a4d90 sp=0xc0104a4d70 pc=0x43e676
runtime.selectgo(0xc0104a4f90, 0xc0104a4f20, 0xc00f8313c0?, 0x0, 0xc0302990b0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104a4ed0 sp=0xc0104a4d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0254b1560)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0104a4fc8 sp=0xc0104a4ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0104a4fe0 sp=0xc0104a4fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104a4fe8 sp=0xc0104a4fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 982 [select, 233 minutes]:
runtime.gopark(0xc006558f90?, 0x2?, 0xd8?, 0x8d?, 0xc006558f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006558d90 sp=0xc006558d70 pc=0x43e676
runtime.selectgo(0xc006558f90, 0xc006558f20, 0xc002b55000?, 0x0, 0xc009c7f290?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006558ed0 sp=0xc006558d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc004ba1200)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc006558fc8 sp=0xc006558ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc006558fe0 sp=0xc006558fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006558fe8 sp=0xc006558fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 764 [GC worker (idle)]:
runtime.gopark(0x461d56c84157?, 0x1?, 0xb7?, 0xf2?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008559758 sp=0xc008559738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0085597e0 sp=0xc008559758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0085597e8 sp=0xc0085597e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 1006 [select, 233 minutes]:
runtime.gopark(0xc006e28f90?, 0x2?, 0xd8?, 0x8d?, 0xc006e28f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006e28d90 sp=0xc006e28d70 pc=0x43e676
runtime.selectgo(0xc006e28f90, 0xc006e28f20, 0xc002bb4f00?, 0x0, 0xc00a286c60?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006e28ed0 sp=0xc006e28d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc004ebe120)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc006e28fc8 sp=0xc006e28ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc006e28fe0 sp=0xc006e28fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006e28fe8 sp=0xc006e28fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 766 [GC worker (idle), 180 minutes]:
runtime.gopark(0x1ba6500?, 0x1?, 0x3e?, 0xbb?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000581758 sp=0xc000581738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0005817e0 sp=0xc000581758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0005817e8 sp=0xc0005817e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 905 [sleep]:
runtime.gopark(0x4621421d5415?, 0xd264fa56d98?, 0xc0?, 0xe7?, 0xc0e0b60692a3e239?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0054d1e60 sp=0xc0054d1e40 pc=0x43e676
time.Sleep(0x12a05db59)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/time.go:194 +0x12e fp=0xc0054d1ea0 sp=0xc0054d1e60 pc=0x46bb2e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00a02e300, {0xc0071889c0, 0xf})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc0054d1f00 sp=0xc0054d1ea0 pc=0xbb4917
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc0071889c0?, 0xc00385bf01?})
	:1 +0x34 fp=0xc0054d1f28 sp=0xc0054d1f00 pc=0xbcbdd4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc0054d1f48 sp=0xc0054d1f28 pc=0xbbb165
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc00608c880)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc0054d1fc8 sp=0xc0054d1f48 pc=0xbc043b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0054d1fe0 sp=0xc0054d1fc8 pc=0xbbe886
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0054d1fe8 sp=0xc0054d1fe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91

goroutine 18730 [select, 174 minutes]:
runtime.gopark(0xc04f5b5f90?, 0x2?, 0xd8?, 0x5d?, 0xc04f5b5f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc04f5b5d90 sp=0xc04f5b5d70 pc=0x43e676
runtime.selectgo(0xc04f5b5f90, 0xc04f5b5f20, 0xc00571a100?, 0x0, 0xc0057147b0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc04f5b5ed0 sp=0xc04f5b5d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc00019fe60)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc04f5b5fc8 sp=0xc04f5b5ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc04f5b5fe0 sp=0xc04f5b5fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc04f5b5fe8 sp=0xc04f5b5fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 771 [GC worker (idle), 182 minutes]:
runtime.gopark(0x3c2e29ff673e?, 0x1?, 0x6a?, 0xce?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008552f58 sp=0xc008552f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc008552fe0 sp=0xc008552f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008552fe8 sp=0xc008552fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 772 [GC worker (idle), 154 minutes]:
runtime.gopark(0x3db61e33bb68?, 0x3?, 0xe3?, 0xf2?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008553758 sp=0xc008553738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0085537e0 sp=0xc008553758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0085537e8 sp=0xc0085537e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 773 [GC worker (idle)]:
runtime.gopark(0x461d5309b708?, 0x1?, 0x48?, 0x67?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008553f58 sp=0xc008553f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc008553fe0 sp=0xc008553f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008553fe8 sp=0xc008553fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 774 [GC worker (idle), 180 minutes]:
runtime.gopark(0x3c4edc3f65e7?, 0x3?, 0xfb?, 0x4d?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008554758 sp=0xc008554738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0085547e0 sp=0xc008554758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0085547e8 sp=0xc0085547e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 775 [GC worker (idle), 3 minutes]:
runtime.gopark(0x45f59011654f?, 0x1?, 0x18?, 0x3c?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008554f58 sp=0xc008554f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc008554fe0 sp=0xc008554f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008554fe8 sp=0xc008554fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 776 [GC worker (idle), 26 minutes]:
runtime.gopark(0x44b2f4ccb5f0?, 0x3?, 0x5e?, 0x96?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008555758 sp=0xc008555738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0085557e0 sp=0xc008555758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0085557e8 sp=0xc0085557e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 777 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1ba6500?, 0x1?, 0xc4?, 0x27?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008555f58 sp=0xc008555f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc008555fe0 sp=0xc008555f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008555fe8 sp=0xc008555fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 778 [GC worker (idle), 174 minutes]:
runtime.gopark(0x3c9959083504?, 0x3?, 0xa4?, 0xd7?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008556758 sp=0xc008556738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0085567e0 sp=0xc008556758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0085567e8 sp=0xc0085567e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 779 [GC worker (idle)]:
runtime.gopark(0x461d52ff3f2b?, 0x1?, 0xa9?, 0x4e?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a780f58 sp=0xc00a780f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a780fe0 sp=0xc00a780f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a780fe8 sp=0xc00a780fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 780 [GC worker (idle), 182 minutes]:
runtime.gopark(0x3c2e29ff7362?, 0x3?, 0x6a?, 0xd5?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a781758 sp=0xc00a781738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a7817e0 sp=0xc00a781758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a7817e8 sp=0xc00a7817e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 818 [GC worker (idle), 182 minutes]:
runtime.gopark(0x3c2e29ff5402?, 0x3?, 0xea?, 0xa9?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a78ef58 sp=0xc00a78ef38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a78efe0 sp=0xc00a78ef58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a78efe8 sp=0xc00a78efe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 819 [GC worker (idle), 3 minutes]:
runtime.gopark(0x45f59025fa55?, 0x1?, 0xa4?, 0xe5?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a78f758 sp=0xc00a78f738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a78f7e0 sp=0xc00a78f758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a78f7e8 sp=0xc00a78f7e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 820 [GC worker (idle), 179 minutes]:
runtime.gopark(0x3c54fe195747?, 0x1?, 0x3a?, 0xb6?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a78ff58 sp=0xc00a78ff38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a78ffe0 sp=0xc00a78ff58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a78ffe8 sp=0xc00a78ffe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 821 [GC worker (idle), 3 minutes]:
runtime.gopark(0x45f59025fe0d?, 0x3?, 0x3b?, 0x39?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a790758 sp=0xc00a790738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a7907e0 sp=0xc00a790758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a7907e8 sp=0xc00a7907e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 822 [GC worker (idle), 180 minutes]:
runtime.gopark(0x3c4edc304e58?, 0x1?, 0xae?, 0x2?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a790f58 sp=0xc00a790f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a790fe0 sp=0xc00a790f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a790fe8 sp=0xc00a790fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 823 [GC worker (idle), 182 minutes]:
runtime.gopark(0x3c2e29ff71b2?, 0x3?, 0xfc?, 0x4d?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a791758 sp=0xc00a791738 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a7917e0 sp=0xc00a791758 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a7917e8 sp=0xc00a7917e0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 781 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0x64?, 0x3f?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a781f58 sp=0xc00a781f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a781fe0 sp=0xc00a781f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a781fe8 sp=0xc00a781fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 824 [GC worker (idle)]:
runtime.gopark(0x1ba6500?, 0x1?, 0x8b?, 0x55?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a791f58 sp=0xc00a791f38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a791fe0 sp=0xc00a791f58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a791fe8 sp=0xc00a791fe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 834 [GC worker (idle), 174 minutes]:
runtime.gopark(0x3c995907cf75?, 0x3?, 0x60?, 0x7e?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00a78af58 sp=0xc00a78af38 pc=0x43e676
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc00a78afe0 sp=0xc00a78af58 pc=0x4213e5
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00a78afe8 sp=0xc00a78afe0 pc=0x46ecc1
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/mgc.go:1131 +0x25

goroutine 5650 [select, 222 minutes]:
runtime.gopark(0xc00853cf90?, 0x2?, 0xd8?, 0xcd?, 0xc00853cf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00853cd90 sp=0xc00853cd70 pc=0x43e676
runtime.selectgo(0xc00853cf90, 0xc00853cf20, 0xc00f9b2080?, 0x0, 0xc02e46b7d0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00853ced0 sp=0xc00853cd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024feeb40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00853cfc8 sp=0xc00853ced0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00853cfe0 sp=0xc00853cfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00853cfe8 sp=0xc00853cfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5657 [select, 222 minutes]:
runtime.gopark(0xc000552f68?, 0x4?, 0x3?, 0x0?, 0xc000552db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000552c00 sp=0xc000552be0 pc=0x43e676
runtime.selectgo(0xc000552f68, 0xc000552da8, 0xc00f9b2340?, 0x0, 0xc024a6a501?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000552d40 sp=0xc000552c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024fef320)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc000552fc8 sp=0xc000552d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc000552fe0 sp=0xc000552fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000552fe8 sp=0xc000552fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 840 [select, 231 minutes]:
runtime.gopark(0xc0065bbf90?, 0x2?, 0xd8?, 0xbd?, 0xc0065bbf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0065bbd90 sp=0xc0065bbd70 pc=0x43e676
runtime.selectgo(0xc0065bbf90, 0xc0065bbf20, 0xc0050c8a80?, 0x0, 0xc005fa30b0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0065bbed0 sp=0xc0065bbd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc005f58a20)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0065bbfc8 sp=0xc0065bbed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0065bbfe0 sp=0xc0065bbfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0065bbfe8 sp=0xc0065bbfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5713 [select, 222 minutes]:
runtime.gopark(0xc010228f68?, 0x4?, 0x3?, 0x0?, 0xc010228db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc010228c00 sp=0xc010228be0 pc=0x43e676
runtime.selectgo(0xc010228f68, 0xc010228da8, 0xc00df21e40?, 0x0, 0xc00a782d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc010228d40 sp=0xc010228c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0252f2900)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc010228fc8 sp=0xc010228d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc010228fe0 sp=0xc010228fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc010228fe8 sp=0xc010228fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5746 [select, 222 minutes]:
runtime.gopark(0xc006a37f90?, 0x2?, 0xd8?, 0x7d?, 0xc006a37f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006a37d90 sp=0xc006a37d70 pc=0x43e676
runtime.selectgo(0xc006a37f90, 0xc006a37f20, 0xc00f9b2a80?, 0x0, 0xc02f1ac120?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006a37ed0 sp=0xc006a37d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0252f2900)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc006a37fc8 sp=0xc006a37ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc006a37fe0 sp=0xc006a37fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006a37fe8 sp=0xc006a37fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 798 [select]:
runtime.gopark(0xc008540f98?, 0x2?, 0x2?, 0x30?, 0xc008540f94?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008540e20 sp=0xc008540e00 pc=0x43e676
runtime.selectgo(0xc008540f98, 0xc008540f90, 0x1b6e7c0?, 0x0, 0xd24dddc4804?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc008540f60 sp=0xc008540e20 pc=0x44e0d2
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc0066f6000)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc008540fc8 sp=0xc008540f60 pc=0xbd5185
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc008540fe0 sp=0xc008540fc8 pc=0xbd50a6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008540fe8 sp=0xc008540fe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x44a

goroutine 799 [chan send, 233 minutes]:
runtime.gopark(0x1a0000c003e5a6a0?, 0x0?, 0xe9?, 0x7b?, 0xc0065dda90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008455a50 sp=0xc008455a30 pc=0x43e676
runtime.chansend(0xc000112f00, 0xc008455b38, 0x1, 0x73613a726f746172?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:258 +0x425 fp=0xc008455ad8 sp=0xc008455a50 pc=0x40b765
runtime.chansend1(0x7473696e696d6441?, 0x73613a726f746172?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:144 +0x1d fp=0xc008455b08 sp=0xc008455ad8 pc=0x40b31d
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc009233ce0?, {0x0?, 0x10ea300?}, {0x125cc80?, 0xc00023e6e0?})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x128 fp=0xc008455b58 sp=0xc008455b08 pc=0xb9e648
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x41e fp=0xc008455c50 sp=0xc008455b58 pc=0xba2b5e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44a fp=0xc008455d48 sp=0xc008455c50 pc=0xba2b8a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00a02e300, 0xc009217c40)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x354 fp=0xc008455fc0 sp=0xc008455d48 pc=0xba1c34
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc008455fe0 sp=0xc008455fc0 pc=0xb9e4ea
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008455fe8 sp=0xc008455fe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b

goroutine 868 [select]:
runtime.gopark(0xc00038af98?, 0x2?, 0x2?, 0x30?, 0xc00038af94?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00038ae20 sp=0xc00038ae00 pc=0x43e676
runtime.selectgo(0xc00038af98, 0xc00038af90, 0x1b6e7c0?, 0x0, 0xd248aa90eb8?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00038af60 sp=0xc00038ae20 pc=0x44e0d2
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc0069b2780)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc00038afc8 sp=0xc00038af60 pc=0xbd5185
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc00038afe0 sp=0xc00038afc8 pc=0xbd50a6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00038afe8 sp=0xc00038afe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x44a

goroutine 869 [chan send, 233 minutes]:
runtime.gopark(0x6f0000c0099c8fb0?, 0x0?, 0x82?, 0x1b?, 0xc0071c5a90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0071c5a50 sp=0xc0071c5a30 pc=0x43e676
runtime.chansend(0xc00ac3b740, 0xc0071c5b38, 0x1, 0x73613a726f746172?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:258 +0x425 fp=0xc0071c5ad8 sp=0xc0071c5a50 pc=0x40b765
runtime.chansend1(0x7473696e696d6441?, 0x73613a726f746172?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:144 +0x1d fp=0xc0071c5b08 sp=0xc0071c5ad8 pc=0x40b31d
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc009caac30?, {0x0?, 0x10ea300?}, {0x125cc80?, 0xc00023e6e0?})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x128 fp=0xc0071c5b58 sp=0xc0071c5b08 pc=0xb9e648
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x41e fp=0xc0071c5c50 sp=0xc0071c5b58 pc=0xba2b5e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44a fp=0xc0071c5d48 sp=0xc0071c5c50 pc=0xba2b8a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00a3f0300, 0xc00ae231a0)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x354 fp=0xc0071c5fc0 sp=0xc0071c5d48 pc=0xba1c34
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc0071c5fe0 sp=0xc0071c5fc0 pc=0xb9e4ea
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0071c5fe8 sp=0xc0071c5fe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b

goroutine 874 [sleep]:
runtime.gopark(0x4620db1e0d3a?, 0xd25e8a61813?, 0xc0?, 0xe7?, 0xc0e0b60622da214c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0001d7e60 sp=0xc0001d7e40 pc=0x43e676
time.Sleep(0x12a05ce44)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/time.go:194 +0x12e fp=0xc0001d7ea0 sp=0xc0001d7e60 pc=0x46bb2e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00a3f0300, {0xc0083a15c0, 0x12})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc0001d7f00 sp=0xc0001d7ea0 pc=0xbb4917
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc0083a15c0?, 0xc0001d7f01?})
	:1 +0x34 fp=0xc0001d7f28 sp=0xc0001d7f00 pc=0xbcbdd4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc0001d7f48 sp=0xc0001d7f28 pc=0xbbb165
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc002968900)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc0001d7fc8 sp=0xc0001d7f48 pc=0xbc043b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0001d7fe0 sp=0xc0001d7fc8 pc=0xbbe886
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0001d7fe8 sp=0xc0001d7fe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91

goroutine 981 [select, 233 minutes]:
runtime.gopark(0xc00655ef68?, 0x4?, 0x3?, 0x0?, 0xc00655edb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00655ec00 sp=0xc00655ebe0 pc=0x43e676
runtime.selectgo(0xc00655ef68, 0xc00655eda8, 0xc002f978c0?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00655ed40 sp=0xc00655ec00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc004ba1200)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00655efc8 sp=0xc00655ed40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00655efe0 sp=0xc00655efc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00655efe8 sp=0xc00655efe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 875 [sleep]:
runtime.gopark(0x462141cd6b88?, 0xd264f557d17?, 0xc0?, 0xe7?, 0xc0e0b6069253f34b?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00385be60 sp=0xc00385be40 pc=0x43e676
time.Sleep(0x12a05d508)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/time.go:194 +0x12e fp=0xc00385bea0 sp=0xc00385be60 pc=0x46bb2e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00a3f0300, {0xc007a8aa70, 0xf})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc00385bf00 sp=0xc00385bea0 pc=0xbb4917
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc007a8aa70?, 0xc03c663f01?})
	:1 +0x34 fp=0xc00385bf28 sp=0xc00385bf00 pc=0xbcbdd4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc00385bf48 sp=0xc00385bf28 pc=0xbbb165
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc002968a00)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc00385bfc8 sp=0xc00385bf48 pc=0xbc043b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc00385bfe0 sp=0xc00385bfc8 pc=0xbbe886
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00385bfe8 sp=0xc00385bfe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91

goroutine 5749 [select, 222 minutes]:
runtime.gopark(0xc010223f68?, 0x4?, 0x3?, 0x0?, 0xc010223db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc010223c00 sp=0xc010223be0 pc=0x43e676
runtime.selectgo(0xc010223f68, 0xc010223da8, 0xc00f8308c0?, 0x0, 0xc00a782d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc010223d40 sp=0xc010223c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0252f2a20)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc010223fc8 sp=0xc010223d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc010223fe0 sp=0xc010223fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc010223fe8 sp=0xc010223fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 943 [select, 233 minutes]:
runtime.gopark(0xc000551f68?, 0x4?, 0x3?, 0x0?, 0xc000551db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000551c00 sp=0xc000551be0 pc=0x43e676
runtime.selectgo(0xc000551f68, 0xc000551da8, 0xc002bb4100?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000551d40 sp=0xc000551c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc004ead7a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc000551fc8 sp=0xc000551d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc000551fe0 sp=0xc000551fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000551fe8 sp=0xc000551fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 944 [select, 233 minutes]:
runtime.gopark(0xc006e26f90?, 0x2?, 0xd8?, 0x6d?, 0xc006e26f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006e26d90 sp=0xc006e26d70 pc=0x43e676
runtime.selectgo(0xc006e26f90, 0xc006e26f20, 0xc002bb4000?, 0x0, 0xc00a2865d0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006e26ed0 sp=0xc006e26d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc004ead7a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc006e26fc8 sp=0xc006e26ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc006e26fe0 sp=0xc006e26fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006e26fe8 sp=0xc006e26fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 1127 [select]:
runtime.gopark(0xc00655cf98?, 0x2?, 0x2?, 0x30?, 0xc00655cf94?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00655ce20 sp=0xc00655ce00 pc=0x43e676
runtime.selectgo(0xc00655cf98, 0xc00655cf90, 0x1b6e7c0?, 0x0, 0xd2699e2dc08?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00655cf60 sp=0xc00655ce20 pc=0x44e0d2
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc0000001e0)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc00655cfc8 sp=0xc00655cf60 pc=0xbd5185
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc00655cfe0 sp=0xc00655cfc8 pc=0xbd50a6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00655cfe8 sp=0xc00655cfe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x44a

goroutine 1128 [chan send, 231 minutes]:
runtime.gopark(0xac0000c007bcbc70?, 0x0?, 0x25?, 0x57?, 0xc0000d7a90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0000d7a50 sp=0xc0000d7a30 pc=0x43e676
runtime.chansend(0xc006841ec0, 0xc0000d7b38, 0x1, 0x73613a726f746172?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:258 +0x425 fp=0xc0000d7ad8 sp=0xc0000d7a50 pc=0x40b765
runtime.chansend1(0x7473696e696d6441?, 0x73613a726f746172?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/chan.go:144 +0x1d fp=0xc0000d7b08 sp=0xc0000d7ad8 pc=0x40b31d
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc0025ebfb0?, {0x0?, 0x10ea300?}, {0x125cc80?, 0xc00023e6e0?})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x128 fp=0xc0000d7b58 sp=0xc0000d7b08 pc=0xb9e648
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x41e fp=0xc0000d7c50 sp=0xc0000d7b58 pc=0xba2b5e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44a fp=0xc0000d7d48 sp=0xc0000d7c50 pc=0xba2b8a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00a02e480, 0xc00011de00)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x354 fp=0xc0000d7fc0 sp=0xc0000d7d48 pc=0xba1c34
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc0000d7fe0 sp=0xc0000d7fc0 pc=0xb9e4ea
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0000d7fe8 sp=0xc0000d7fe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b

goroutine 1133 [sleep]:
runtime.gopark(0x462163860909?, 0xd26710e1e12?, 0xc0?, 0xe7?, 0xc0e0b606b40c941a?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0071c1e60 sp=0xc0071c1e40 pc=0x43e676
time.Sleep(0x12a05d882)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/time.go:194 +0x12e fp=0xc0071c1ea0 sp=0xc0071c1e60 pc=0x46bb2e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00a02e480, {0xc007b47368, 0x12})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc0071c1f00 sp=0xc0071c1ea0 pc=0xbb4917
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc007b47368?, 0xc0001d3f01?})
	:1 +0x34 fp=0xc0071c1f28 sp=0xc0071c1f00 pc=0xbcbdd4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc0071c1f48 sp=0xc0071c1f28 pc=0xbbb165
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc0036918c0)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc0071c1fc8 sp=0xc0071c1f48 pc=0xbc043b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0071c1fe0 sp=0xc0071c1fc8 pc=0xbbe886
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0071c1fe8 sp=0xc0071c1fe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91

goroutine 1134 [sleep]:
runtime.gopark(0x4620f31f4baf?, 0xd2600a75c26?, 0xc0?, 0xe7?, 0xc0e0b6063adb657f?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00845be60 sp=0xc00845be40 pc=0x43e676
time.Sleep(0x12a05d500)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/time.go:194 +0x12e fp=0xc00845bea0 sp=0xc00845be60 pc=0x46bb2e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00a02e480, {0xc006554a30, 0xf})
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc00845bf00 sp=0xc00845bea0 pc=0xbb4917
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc006554a30?, 0xc003859f01?})
	:1 +0x34 fp=0xc00845bf28 sp=0xc00845bf00 pc=0xbcbdd4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc00845bf48 sp=0xc00845bf28 pc=0xbbb165
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc003691cc0)
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc00845bfc8 sp=0xc00845bf48 pc=0xbc043b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc00845bfe0 sp=0xc00845bfc8 pc=0xbbe886
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00845bfe8 sp=0xc00845bfe0 pc=0x46ecc1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
	/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91

goroutine 5724 [select, 222 minutes]:
runtime.gopark(0xc0102e0f90?, 0x2?, 0xd8?, 0xd?, 0xc0102e0f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102e0d90 sp=0xc0102e0d70 pc=0x43e676
runtime.selectgo(0xc0102e0f90, 0xc0102e0f20, 0xc00f830b00?, 0x0, 0xc02f5733e0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102e0ed0 sp=0xc0102e0d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc02531efc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0102e0fc8 sp=0xc0102e0ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0102e0fe0 sp=0xc0102e0fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102e0fe8 sp=0xc0102e0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5716 [select, 222 minutes]:
runtime.gopark(0xc006a38f90?, 0x2?, 0xd8?, 0x8d?, 0xc006a38f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006a38d90 sp=0xc006a38d70 pc=0x43e676
runtime.selectgo(0xc006a38f90, 0xc006a38f20, 0xc00f830840?, 0x0, 0xc02ee7e0f0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006a38ed0 sp=0xc006a38d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024e64fc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc006a38fc8 sp=0xc006a38ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc006a38fe0 sp=0xc006a38fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006a38fe8 sp=0xc006a38fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 57233 [select, 1 minutes]:
runtime.gopark(0xc007159f90?, 0x2?, 0xd8?, 0x9d?, 0xc007159f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc007159d90 sp=0xc007159d70 pc=0x43e676
runtime.selectgo(0xc007159f90, 0xc007159f20, 0xc00570c140?, 0x0, 0xc00138ecc0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc007159ed0 sp=0xc007159d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc00c10a5a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007159fc8 sp=0xc007159ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc007159fe0 sp=0xc007159fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc007159fe8 sp=0xc007159fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5719 [select, 222 minutes]:
runtime.gopark(0xc0102d2f68?, 0x4?, 0x48?, 0x2c?, 0xc0102d2db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102d2c00 sp=0xc0102d2be0 pc=0x43e676
runtime.selectgo(0xc0102d2f68, 0xc0102d2da8, 0xc00df21fc0?, 0x0, 0xc021175b01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102d2d40 sp=0xc0102d2c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc02531e900)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0102d2fc8 sp=0xc0102d2d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0102d2fe0 sp=0xc0102d2fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102d2fe8 sp=0xc0102d2fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5710 [select, 222 minutes]:
runtime.gopark(0xc010227f90?, 0x2?, 0xd8?, 0x7d?, 0xc010227f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc010227d90 sp=0xc010227d70 pc=0x43e676
runtime.selectgo(0xc010227f90, 0xc010227f20, 0xc00f9b2900?, 0x0, 0xc02e9a2de0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc010227ed0 sp=0xc010227d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0252190e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc010227fc8 sp=0xc010227ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc010227fe0 sp=0xc010227fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc010227fe8 sp=0xc010227fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5780 [select, 222 minutes]:
runtime.gopark(0xc0104d5f90?, 0x2?, 0xd8?, 0x5d?, 0xc0104d5f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104d5d90 sp=0xc0104d5d70 pc=0x43e676
runtime.selectgo(0xc0104d5f90, 0xc0104d5f20, 0xc00f831140?, 0x0, 0xc02fbe3e60?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104d5ed0 sp=0xc0104d5d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc025346ea0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0104d5fc8 sp=0xc0104d5ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0104d5fe0 sp=0xc0104d5fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104d5fe8 sp=0xc0104d5fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5658 [select, 222 minutes]:
runtime.gopark(0xc00853ef90?, 0x2?, 0xd8?, 0xed?, 0xc00853ef24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00853ed90 sp=0xc00853ed70 pc=0x43e676
runtime.selectgo(0xc00853ef90, 0xc00853ef20, 0xc00f9b2300?, 0x0, 0xc02e83b200?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00853eed0 sp=0xc00853ed90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024fef320)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00853efc8 sp=0xc00853eed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00853efe0 sp=0xc00853efc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00853efe8 sp=0xc00853efe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5699 [select, 222 minutes]:
runtime.gopark(0xc00ffe7f68?, 0x4?, 0x3?, 0x0?, 0xc00ffe7db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00ffe7c00 sp=0xc00ffe7be0 pc=0x43e676
runtime.selectgo(0xc00ffe7f68, 0xc00ffe7da8, 0xc00f9b2640?, 0x0, 0x678201?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00ffe7d40 sp=0xc00ffe7c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024e64000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00ffe7fc8 sp=0xc00ffe7d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00ffe7fe0 sp=0xc00ffe7fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00ffe7fe8 sp=0xc00ffe7fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5753 [select, 222 minutes]:
runtime.gopark(0xc0102cef68?, 0x4?, 0x3?, 0x0?, 0xc0102cedb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102cec00 sp=0xc0102cebe0 pc=0x43e676
runtime.selectgo(0xc0102cef68, 0xc0102ceda8, 0xc00fb7a100?, 0x0, 0xc0065b0501?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102ced40 sp=0xc0102cec00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0252f2b40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0102cefc8 sp=0xc0102ced40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0102cefe0 sp=0xc0102cefc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102cefe8 sp=0xc0102cefe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5723 [select, 222 minutes]:
runtime.gopark(0xc0103d7f68?, 0x4?, 0x3?, 0x0?, 0xc0103d7db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0103d7c00 sp=0xc0103d7be0 pc=0x43e676
runtime.selectgo(0xc0103d7f68, 0xc0103d7da8, 0xc00fb7a240?, 0x0, 0xc021175a01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0103d7d40 sp=0xc0103d7c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc02531efc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0103d7fc8 sp=0xc0103d7d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0103d7fe0 sp=0xc0103d7fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0103d7fe8 sp=0xc0103d7fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5779 [select, 222 minutes]:
runtime.gopark(0xc0104a1f68?, 0x4?, 0x3?, 0x0?, 0xc0104a1db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104a1c00 sp=0xc0104a1be0 pc=0x43e676
runtime.selectgo(0xc0104a1f68, 0xc0104a1da8, 0xc00f9b2f00?, 0x0, 0xc01de50301?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104a1d40 sp=0xc0104a1c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc025346ea0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0104a1fc8 sp=0xc0104a1d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0104a1fe0 sp=0xc0104a1fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104a1fe8 sp=0xc0104a1fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5787 [select, 222 minutes]:
runtime.gopark(0xc0104a3f68?, 0x4?, 0x3?, 0x0?, 0xc0104a3db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104a3c00 sp=0xc0104a3be0 pc=0x43e676
runtime.selectgo(0xc0104a3f68, 0xc0104a3da8, 0xc00fb7aec0?, 0x0, 0xc0226fec01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104a3d40 sp=0xc0104a3c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0254b1560)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0104a3fc8 sp=0xc0104a3d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0104a3fe0 sp=0xc0104a3fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104a3fe8 sp=0xc0104a3fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5601 [select, 222 minutes]:
runtime.gopark(0xc00655bf68?, 0x4?, 0x3?, 0x0?, 0xc00655bdb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00655bc00 sp=0xc00655bbe0 pc=0x43e676
runtime.selectgo(0xc00655bf68, 0xc00655bda8, 0xc00f9b20c0?, 0x0, 0xc00cb44501?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00655bd40 sp=0xc00655bc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024feeb40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00655bfc8 sp=0xc00655bd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00655bfe0 sp=0xc00655bfc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00655bfe8 sp=0xc00655bfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5654 [select, 222 minutes]:
runtime.gopark(0xc00715bf90?, 0x2?, 0xd8?, 0xbd?, 0xc00715bf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00715bd90 sp=0xc00715bd70 pc=0x43e676
runtime.selectgo(0xc00715bf90, 0xc00715bf20, 0xc00f9b21c0?, 0x0, 0xc02e5951d0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00715bed0 sp=0xc00715bd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024fef200)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00715bfc8 sp=0xc00715bed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00715bfe0 sp=0xc00715bfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00715bfe8 sp=0xc00715bfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 18742 [select, 1 minutes]:
runtime.gopark(0xc000749f68?, 0x5?, 0xa0?, 0xf7?, 0xc000749df6?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc003857c60 sp=0xc003857c40 pc=0x43e676
runtime.selectgo(0xc003857f68, 0xc000749dec, 0x10bed3f?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc003857da0 sp=0xc003857c60 pc=0x44e0d2
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges(0xc0002469a0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2086 +0x33c fp=0xc003857fc8 sp=0xc003857da0 pc=0xd4511c
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges.func1.1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2058 +0x26 fp=0xc003857fe0 sp=0xc003857fc8 pc=0xd456c6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc003857fe8 sp=0xc003857fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges.func1
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2058 +0x6a

goroutine 5680 [select, 222 minutes]:
runtime.gopark(0xc00ffe1f90?, 0x2?, 0xd8?, 0x1d?, 0xc00ffe1f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00ffe1d90 sp=0xc00ffe1d70 pc=0x43e676
runtime.selectgo(0xc00ffe1f90, 0xc00ffe1f20, 0xc00f8306c0?, 0x0, 0xc02ed74a20?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00ffe1ed0 sp=0xc00ffe1d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024e64ea0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00ffe1fc8 sp=0xc00ffe1ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00ffe1fe0 sp=0xc00ffe1fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00ffe1fe8 sp=0xc00ffe1fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5661 [select, 222 minutes]:
runtime.gopark(0xc0062ddf68?, 0x4?, 0x3?, 0x0?, 0xc0062dddb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0062ddc00 sp=0xc0062ddbe0 pc=0x43e676
runtime.selectgo(0xc0062ddf68, 0xc0062ddda8, 0xc00df215c0?, 0x0, 0xc018b06801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0062ddd40 sp=0xc0062ddc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024fef440)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0062ddfc8 sp=0xc0062ddd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0062ddfe0 sp=0xc0062ddfc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0062ddfe8 sp=0xc0062ddfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5679 [select, 222 minutes]:
runtime.gopark(0xc006a3af68?, 0x4?, 0x3?, 0x0?, 0xc006a3adb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006a3ac00 sp=0xc006a3abe0 pc=0x43e676
runtime.selectgo(0xc006a3af68, 0xc006a3ada8, 0xc00df21b40?, 0x0, 0xc006538001?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006a3ad40 sp=0xc006a3ac00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024e64ea0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc006a3afc8 sp=0xc006a3ad40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc006a3afe0 sp=0xc006a3afc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006a3afe8 sp=0xc006a3afe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5715 [select, 222 minutes]:
runtime.gopark(0xc010225f68?, 0x4?, 0x3?, 0x0?, 0xc010225db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc010225c00 sp=0xc010225be0 pc=0x43e676
runtime.selectgo(0xc010225f68, 0xc010225da8, 0xc00df21cc0?, 0x0, 0xc006538001?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc010225d40 sp=0xc010225c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024e64fc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc010225fc8 sp=0xc010225d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc010225fe0 sp=0xc010225fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc010225fe8 sp=0xc010225fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 18651 [select, 174 minutes]:
runtime.gopark(0xc00385dd80?, 0x2?, 0xc0?, 0xa?, 0xc00385dc7c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00385dae8 sp=0xc00385dac8 pc=0x43e676
runtime.selectgo(0xc00385dd80, 0xc00385dc78, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00385dc28 sp=0xc00385dae8 pc=0x44e0d2
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint(0xc00e6cf848?, {0xc006904cc0, 0x24}, 0xc00e6cf878, 0xc00e6cf848, 0xc00fec7260)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:503 +0x6da fp=0xc00385ded0 sp=0xc00385dc28 pc=0x83379a
github.com/couchbase/indexing/secondary/dcp.(*Client).RunObserveNodeServices(0xc0001467e0?, {0x10bed3f?, 0x0?}, 0xc041ec15c0?, 0x1?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:411 +0xbc fp=0xc00385df40 sp=0xc00385ded0 pc=0x832b9c
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunServicesObserver(0xc0001467e0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:156 +0x59 fp=0xc00385dfc8 sp=0xc00385df40 pc=0xb355f9
github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier.func3()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:257 +0x26 fp=0xc00385dfe0 sp=0xc00385dfc8 pc=0xb36726
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00385dfe8 sp=0xc00385dfe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:257 +0x54d

goroutine 5720 [select, 222 minutes]:
runtime.gopark(0xc0102d3f90?, 0x2?, 0xd8?, 0x3d?, 0xc0102d3f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102d3d90 sp=0xc0102d3d70 pc=0x43e676
runtime.selectgo(0xc0102d3f90, 0xc0102d3f20, 0xc00f8309c0?, 0x0, 0xc02ee7fb90?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102d3ed0 sp=0xc0102d3d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc02531e900)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0102d3fc8 sp=0xc0102d3ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0102d3fe0 sp=0xc0102d3fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102d3fe8 sp=0xc0102d3fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5705 [select, 222 minutes]:
runtime.gopark(0xc010229f68?, 0x4?, 0x3?, 0x0?, 0xc010229db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc010229c00 sp=0xc010229be0 pc=0x43e676
runtime.selectgo(0xc010229f68, 0xc010229da8, 0xc00f8305c0?, 0x0, 0xc037836601?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc010229d40 sp=0xc010229c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024e64b40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc010229fc8 sp=0xc010229d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc010229fe0 sp=0xc010229fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc010229fe8 sp=0xc010229fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5727 [select, 222 minutes]:
runtime.gopark(0xc0102e1f68?, 0x4?, 0x3?, 0x0?, 0xc0102e1db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102e1c00 sp=0xc0102e1be0 pc=0x43e676
runtime.selectgo(0xc0102e1f68, 0xc0102e1da8, 0xc00fb7a380?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102e1d40 sp=0xc0102e1c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0253d8240)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0102e1fc8 sp=0xc0102e1d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0102e1fe0 sp=0xc0102e1fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102e1fe8 sp=0xc0102e1fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5750 [select, 222 minutes]:
runtime.gopark(0xc0102e7f90?, 0x2?, 0xd8?, 0x7d?, 0xc0102e7f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102e7d90 sp=0xc0102e7d70 pc=0x43e676
runtime.selectgo(0xc0102e7f90, 0xc0102e7f20, 0xc00f9b2c00?, 0x0, 0xc02f1ada10?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102e7ed0 sp=0xc0102e7d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0252f2a20)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0102e7fc8 sp=0xc0102e7ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0102e7fe0 sp=0xc0102e7fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102e7fe8 sp=0xc0102e7fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5662 [select, 222 minutes]:
runtime.gopark(0xc00853ff90?, 0x2?, 0xd8?, 0xfd?, 0xc00853ff24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00853fd90 sp=0xc00853fd70 pc=0x43e676
runtime.selectgo(0xc00853ff90, 0xc00853ff20, 0xc00f9b2440?, 0x0, 0xc02e7a6c30?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00853fed0 sp=0xc00853fd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024fef440)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00853ffc8 sp=0xc00853fed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00853ffe0 sp=0xc00853ffc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00853ffe8 sp=0xc00853ffe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5665 [select, 222 minutes]:
runtime.gopark(0xc00044cf68?, 0x4?, 0x3?, 0x0?, 0xc00044cdb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00044cc00 sp=0xc00044cbe0 pc=0x43e676
runtime.selectgo(0xc00044cf68, 0xc00044cda8, 0xc00df21840?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00044cd40 sp=0xc00044cc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024fef560)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00044cfc8 sp=0xc00044cd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00044cfe0 sp=0xc00044cfc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00044cfe8 sp=0xc00044cfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 19555 [sync.Cond.Wait, 171 minutes]:
runtime.gopark(0xc008541c78?, 0xd16a86?, 0x30?, 0x0?, 0xc008541cd0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008541c60 sp=0xc008541c40 pc=0x43e676
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:367
sync.runtime_notifyListWait(0xc002494950, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sema.go:513 +0x13d fp=0xc008541ca8 sp=0xc008541c60 pc=0x46ad9d
sync.(*Cond).Wait(0xf03bc0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/sync/cond.go:56 +0x8c fp=0xc008541ce0 sp=0xc008541ca8 pc=0x4761ec
github.com/couchbase/indexing/secondary/manager/client.(*watcher).makeRequest(0xc000496240, 0x45, {0xc006938d98, 0x14}, {0xc0022a20d0, 0xd0, 0xd0})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6477 +0x29d fp=0xc008541db0 sp=0xc008541ce0 pc=0xd15bdd
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).makePrepareIndexRequest.func1(0x0?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:624 +0x1d8 fp=0xc008541fc8 sp=0xc008541db0 pc=0xcf1d78
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).makePrepareIndexRequest.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:663 +0x2a fp=0xc008541fe0 sp=0xc008541fc8 pc=0xcf1b6a
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008541fe8 sp=0xc008541fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).makePrepareIndexRequest
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:617 +0x373

goroutine 5709 [select, 222 minutes]:
runtime.gopark(0xc010226f68?, 0x4?, 0x3?, 0x0?, 0xc010226db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc010226c00 sp=0xc010226be0 pc=0x43e676
runtime.selectgo(0xc010226f68, 0xc010226da8, 0xc00f9b2980?, 0x0, 0xc006538001?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc010226d40 sp=0xc010226c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0252190e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc010226fc8 sp=0xc010226d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc010226fe0 sp=0xc010226fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc010226fe8 sp=0xc010226fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5784 [select, 222 minutes]:
runtime.gopark(0xc0104a2f90?, 0x2?, 0xd8?, 0x2d?, 0xc0104a2f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104a2d90 sp=0xc0104a2d70 pc=0x43e676
runtime.selectgo(0xc0104a2f90, 0xc0104a2f20, 0xc00f831280?, 0x0, 0xc03001d8c0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104a2ed0 sp=0xc0104a2d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0254b1440)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0104a2fc8 sp=0xc0104a2ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0104a2fe0 sp=0xc0104a2fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104a2fe8 sp=0xc0104a2fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5135 [select, 222 minutes]:
runtime.gopark(0xc006559f90?, 0x2?, 0xd8?, 0x9d?, 0xc006559f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006559d90 sp=0xc006559d70 pc=0x43e676
runtime.selectgo(0xc006559f90, 0xc006559f20, 0xc0132a2ec0?, 0x0, 0xc02e311fb0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006559ed0 sp=0xc006559d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc03166cea0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc006559fc8 sp=0xc006559ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc006559fe0 sp=0xc006559fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006559fe8 sp=0xc006559fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5704 [select, 222 minutes]:
runtime.gopark(0xc0065bef90?, 0x2?, 0xd8?, 0xed?, 0xc0065bef24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0065bed90 sp=0xc0065bed70 pc=0x43e676
runtime.selectgo(0xc0065bef90, 0xc0065bef20, 0xc00f9b2740?, 0x0, 0xc02eca6b10?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0065beed0 sp=0xc0065bed90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc025218fc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0065befc8 sp=0xc0065beed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0065befe0 sp=0xc0065befc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0065befe8 sp=0xc0065befe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5134 [select, 222 minutes]:
runtime.gopark(0xc00715df68?, 0x4?, 0x3?, 0x0?, 0xc00715ddb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00715dc00 sp=0xc00715dbe0 pc=0x43e676
runtime.selectgo(0xc00715df68, 0xc00715dda8, 0xc00eb85f80?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00715dd40 sp=0xc00715dc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc03166cea0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00715dfc8 sp=0xc00715dd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00715dfe0 sp=0xc00715dfc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00715dfe8 sp=0xc00715dfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5700 [select, 222 minutes]:
runtime.gopark(0xc0065bcf90?, 0x2?, 0xd8?, 0xcd?, 0xc0065bcf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0065bcd90 sp=0xc0065bcd70 pc=0x43e676
runtime.selectgo(0xc0065bcf90, 0xc0065bcf20, 0xc00f9b25c0?, 0x0, 0xc02eb2ede0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0065bced0 sp=0xc0065bcd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024e64000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0065bcfc8 sp=0xc0065bced0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0065bcfe0 sp=0xc0065bcfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0065bcfe8 sp=0xc0065bcfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5703 [select, 222 minutes]:
runtime.gopark(0xc0065baf68?, 0x4?, 0x3?, 0x0?, 0xc0065badb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0065bac00 sp=0xc0065babe0 pc=0x43e676
runtime.selectgo(0xc0065baf68, 0xc0065bada8, 0xc00df219c0?, 0x0, 0xc03c5bbd01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0065bad40 sp=0xc0065bac00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc025218fc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0065bafc8 sp=0xc0065bad40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0065bafe0 sp=0xc0065bafc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0065bafe8 sp=0xc0065bafe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5698 [select, 222 minutes]:
runtime.gopark(0xc00044df90?, 0x2?, 0xd8?, 0xdd?, 0xc00044df24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00044dd90 sp=0xc00044dd70 pc=0x43e676
runtime.selectgo(0xc00044df90, 0xc00044df20, 0xc00f9b2580?, 0x0, 0xc02eb2e4b0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00044ded0 sp=0xc00044dd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024fef560)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00044dfc8 sp=0xc00044ded0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00044dfe0 sp=0xc00044dfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00044dfe8 sp=0xc00044dfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5671 [select, 222 minutes]:
runtime.gopark(0xc00655ff68?, 0x4?, 0x3?, 0x0?, 0xc00655fdb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00655fc00 sp=0xc00655fbe0 pc=0x43e676
runtime.selectgo(0xc00655ff68, 0xc00655fda8, 0xc00f9b2480?, 0x0, 0xc000583d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00655fd40 sp=0xc00655fc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0250205a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00655ffc8 sp=0xc00655fd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00655ffe0 sp=0xc00655ffc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00655ffe8 sp=0xc00655ffe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5668 [select, 222 minutes]:
runtime.gopark(0xc0062dcf90?, 0x2?, 0xd8?, 0xcd?, 0xc0062dcf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0062dcd90 sp=0xc0062dcd70 pc=0x43e676
runtime.selectgo(0xc0062dcf90, 0xc0062dcf20, 0xc00f830180?, 0x0, 0xc02d4e3aa0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0062dced0 sp=0xc0062dcd90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc025020480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0062dcfc8 sp=0xc0062dced0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0062dcfe0 sp=0xc0062dcfc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0062dcfe8 sp=0xc0062dcfe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5667 [select, 222 minutes]:
runtime.gopark(0xc0062def68?, 0x4?, 0x3?, 0x0?, 0xc0062dedb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0062dec00 sp=0xc0062debe0 pc=0x43e676
runtime.selectgo(0xc0062def68, 0xc0062deda8, 0xc00df21480?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0062ded40 sp=0xc0062dec00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc025020480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0062defc8 sp=0xc0062ded40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0062defe0 sp=0xc0062defc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0062defe8 sp=0xc0062defe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5706 [select, 222 minutes]:
runtime.gopark(0xc00ffe0f90?, 0x2?, 0xd8?, 0xd?, 0xc00ffe0f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00ffe0d90 sp=0xc00ffe0d70 pc=0x43e676
runtime.selectgo(0xc00ffe0f90, 0xc00ffe0f20, 0xc00f9b2780?, 0x0, 0xc02eca72c0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00ffe0ed0 sp=0xc00ffe0d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024e64b40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00ffe0fc8 sp=0xc00ffe0ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00ffe0fe0 sp=0xc00ffe0fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00ffe0fe8 sp=0xc00ffe0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5642 [select, 222 minutes]:
runtime.gopark(0xc00715af68?, 0x4?, 0x3?, 0x0?, 0xc00715adb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00715ac00 sp=0xc00715abe0 pc=0x43e676
runtime.selectgo(0xc00715af68, 0xc00715ada8, 0xc00f9b2200?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00715ad40 sp=0xc00715ac00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024fbd200)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00715afc8 sp=0xc00715ad40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00715afe0 sp=0xc00715afc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00715afe8 sp=0xc00715afe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5643 [select, 222 minutes]:
runtime.gopark(0xc006a39f90?, 0x2?, 0xd8?, 0x9d?, 0xc006a39f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006a39d90 sp=0xc006a39d70 pc=0x43e676
runtime.selectgo(0xc006a39f90, 0xc006a39f20, 0xc00df21580?, 0x0, 0xc028b46420?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006a39ed0 sp=0xc006a39d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024fbd200)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc006a39fc8 sp=0xc006a39ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc006a39fe0 sp=0xc006a39fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006a39fe8 sp=0xc006a39fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5646 [select, 222 minutes]:
runtime.gopark(0xc000448f68?, 0x4?, 0x3?, 0x0?, 0xc000448db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000448c00 sp=0xc000448be0 pc=0x43e676
runtime.selectgo(0xc000448f68, 0xc000448da8, 0xc00df21700?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000448d40 sp=0xc000448c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024fbd320)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc000448fc8 sp=0xc000448d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc000448fe0 sp=0xc000448fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000448fe8 sp=0xc000448fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5647 [select, 222 minutes]:
runtime.gopark(0xc00044af90?, 0x2?, 0xd8?, 0xad?, 0xc00044af24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00044ad90 sp=0xc00044ad70 pc=0x43e676
runtime.selectgo(0xc00044af90, 0xc00044af20, 0xc00df216c0?, 0x0, 0xc028b46900?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00044aed0 sp=0xc00044ad90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024fbd320)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00044afc8 sp=0xc00044aed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00044afe0 sp=0xc00044afc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00044afe8 sp=0xc00044afe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5682 [select, 222 minutes]:
runtime.gopark(0xc006a36f68?, 0x4?, 0x3?, 0x0?, 0xc006a36db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc006a36c00 sp=0xc006a36be0 pc=0x43e676
runtime.selectgo(0xc006a36f68, 0xc006a36da8, 0xc00f8301c0?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc006a36d40 sp=0xc006a36c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0251fc5a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc006a36fc8 sp=0xc006a36d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc006a36fe0 sp=0xc006a36fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006a36fe8 sp=0xc006a36fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5683 [select, 222 minutes]:
runtime.gopark(0xc00007af90?, 0x2?, 0xd8?, 0xad?, 0xc00007af24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00007ad90 sp=0xc00007ad70 pc=0x43e676
runtime.selectgo(0xc00007af90, 0xc00007af20, 0xc00df21800?, 0x0, 0xc028b46db0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00007aed0 sp=0xc00007ad90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0251fc5a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00007afc8 sp=0xc00007aed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00007afe0 sp=0xc00007afc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00007afe8 sp=0xc00007afe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5686 [select, 222 minutes]:
runtime.gopark(0xc000079f68?, 0x4?, 0x3?, 0x0?, 0xc000079db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc000079c00 sp=0xc000079be0 pc=0x43e676
runtime.selectgo(0xc000079f68, 0xc000079da8, 0xc00f830340?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc000079d40 sp=0xc000079c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0251fc6c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc000079fc8 sp=0xc000079d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc000079fe0 sp=0xc000079fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000079fe8 sp=0xc000079fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5687 [select, 222 minutes]:
runtime.gopark(0xc008542f90?, 0x2?, 0xd8?, 0x2d?, 0xc008542f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008542d90 sp=0xc008542d70 pc=0x43e676
runtime.selectgo(0xc008542f90, 0xc008542f20, 0xc00df21940?, 0x0, 0xc028b47380?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc008542ed0 sp=0xc008542d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0251fc6c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc008542fc8 sp=0xc008542ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc008542fe0 sp=0xc008542fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008542fe8 sp=0xc008542fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5690 [select, 222 minutes]:
runtime.gopark(0xc00ffe3f68?, 0x4?, 0x3?, 0x0?, 0xc00ffe3db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00ffe3c00 sp=0xc00ffe3be0 pc=0x43e676
runtime.selectgo(0xc00ffe3f68, 0xc00ffe3da8, 0xc00f830480?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00ffe3d40 sp=0xc00ffe3c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0251fc7e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00ffe3fc8 sp=0xc00ffe3d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00ffe3fe0 sp=0xc00ffe3fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00ffe3fe8 sp=0xc00ffe3fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5691 [select, 222 minutes]:
runtime.gopark(0xc00ffe4f90?, 0x2?, 0xd8?, 0x4d?, 0xc00ffe4f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00ffe4d90 sp=0xc00ffe4d70 pc=0x43e676
runtime.selectgo(0xc00ffe4f90, 0xc00ffe4f20, 0xc00df21ac0?, 0x0, 0xc028b47830?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00ffe4ed0 sp=0xc00ffe4d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0251fc7e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00ffe4fc8 sp=0xc00ffe4ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00ffe4fe0 sp=0xc00ffe4fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00ffe4fe8 sp=0xc00ffe4fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5694 [select, 222 minutes]:
runtime.gopark(0xc00ffe5f68?, 0x4?, 0x3?, 0x0?, 0xc00ffe5db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00ffe5c00 sp=0xc00ffe5be0 pc=0x43e676
runtime.selectgo(0xc00ffe5f68, 0xc00ffe5da8, 0xc00f830740?, 0x0, 0xc007336d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00ffe5d40 sp=0xc00ffe5c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0251fd560)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00ffe5fc8 sp=0xc00ffe5d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00ffe5fe0 sp=0xc00ffe5fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00ffe5fe8 sp=0xc00ffe5fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5695 [select, 222 minutes]:
runtime.gopark(0xc00ffe2f90?, 0x2?, 0xd8?, 0x2d?, 0xc00ffe2f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00ffe2d90 sp=0xc00ffe2d70 pc=0x43e676
runtime.selectgo(0xc00ffe2f90, 0xc00ffe2f20, 0xc00df21c40?, 0x0, 0xc028b47d10?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00ffe2ed0 sp=0xc00ffe2d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0251fd560)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00ffe2fc8 sp=0xc00ffe2ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00ffe2fe0 sp=0xc00ffe2fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00ffe2fe8 sp=0xc00ffe2fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5730 [select, 222 minutes]:
runtime.gopark(0xc00ffe6f68?, 0x4?, 0x3?, 0x0?, 0xc00ffe6db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00ffe6c00 sp=0xc00ffe6be0 pc=0x43e676
runtime.selectgo(0xc00ffe6f68, 0xc00ffe6da8, 0xc00f9b2800?, 0x0, 0xc007336d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00ffe6d40 sp=0xc00ffe6c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc02239ab40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc00ffe6fc8 sp=0xc00ffe6d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc00ffe6fe0 sp=0xc00ffe6fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00ffe6fe8 sp=0xc00ffe6fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5731 [select, 222 minutes]:
runtime.gopark(0xc0102d5f90?, 0x2?, 0xd8?, 0x5d?, 0xc0102d5f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102d5d90 sp=0xc0102d5d70 pc=0x43e676
runtime.selectgo(0xc0102d5f90, 0xc0102d5f20, 0xc00df21dc0?, 0x0, 0xc02efae240?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102d5ed0 sp=0xc0102d5d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc02239ab40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0102d5fc8 sp=0xc0102d5ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0102d5fe0 sp=0xc0102d5fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102d5fe8 sp=0xc0102d5fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5734 [select, 222 minutes]:
runtime.gopark(0xc0102d1f68?, 0x4?, 0x3?, 0x0?, 0xc0102d1db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102d1c00 sp=0xc0102d1be0 pc=0x43e676
runtime.selectgo(0xc0102d1f68, 0xc0102d1da8, 0xc00f9b2b00?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102d1d40 sp=0xc0102d1c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc02239ac60)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0102d1fc8 sp=0xc0102d1d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0102d1fe0 sp=0xc0102d1fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102d1fe8 sp=0xc0102d1fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5735 [select, 222 minutes]:
runtime.gopark(0xc010222f90?, 0x2?, 0xd8?, 0x2d?, 0xc010222f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc010222d90 sp=0xc010222d70 pc=0x43e676
runtime.selectgo(0xc010222f90, 0xc010222f20, 0xc00df21f40?, 0x0, 0xc02efaf980?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc010222ed0 sp=0xc010222d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc02239ac60)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc010222fc8 sp=0xc010222ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc010222fe0 sp=0xc010222fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc010222fe8 sp=0xc010222fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5738 [select, 222 minutes]:
runtime.gopark(0xc0102d4f68?, 0x4?, 0x3?, 0x0?, 0xc0102d4db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102d4c00 sp=0xc0102d4be0 pc=0x43e676
runtime.selectgo(0xc0102d4f68, 0xc0102d4da8, 0xc00f9b2c80?, 0x0, 0xc00a782d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102d4d40 sp=0xc0102d4c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc02239ad80)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0102d4fc8 sp=0xc0102d4d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0102d4fe0 sp=0xc0102d4fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102d4fe8 sp=0xc0102d4fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5739 [select, 222 minutes]:
runtime.gopark(0xc010224f90?, 0x2?, 0xd8?, 0x4d?, 0xc010224f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc010224d90 sp=0xc010224d70 pc=0x43e676
runtime.selectgo(0xc010224f90, 0xc010224f20, 0xc00fb7a0c0?, 0x0, 0xc02f26f320?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc010224ed0 sp=0xc010224d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc02239ad80)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc010224fc8 sp=0xc010224ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc010224fe0 sp=0xc010224fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc010224fe8 sp=0xc010224fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5742 [select, 222 minutes]:
runtime.gopark(0xc0102e3f68?, 0x4?, 0x3?, 0x0?, 0xc0102e3db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102e3c00 sp=0xc0102e3be0 pc=0x43e676
runtime.selectgo(0xc0102e3f68, 0xc0102e3da8, 0xc00f9b2dc0?, 0x0, 0xc007336d01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102e3d40 sp=0xc0102e3c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc02239b8c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0102e3fc8 sp=0xc0102e3d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0102e3fe0 sp=0xc0102e3fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102e3fe8 sp=0xc0102e3fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5743 [select, 222 minutes]:
runtime.gopark(0xc0102e4f90?, 0x2?, 0xd8?, 0x4d?, 0xc0102e4f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102e4d90 sp=0xc0102e4d70 pc=0x43e676
runtime.selectgo(0xc0102e4f90, 0xc0102e4f20, 0xc00fb7a200?, 0x0, 0xc02f3e8cf0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102e4ed0 sp=0xc0102e4d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc02239b8c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0102e4fc8 sp=0xc0102e4ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0102e4fe0 sp=0xc0102e4fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102e4fe8 sp=0xc0102e4fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5757 [select, 222 minutes]:
runtime.gopark(0xc0102d0f68?, 0x4?, 0x3?, 0x0?, 0xc0102d0db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102d0c00 sp=0xc0102d0be0 pc=0x43e676
runtime.selectgo(0xc0102d0f68, 0xc0102d0da8, 0xc00f830a00?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102d0d40 sp=0xc0102d0c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0252a97a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0102d0fc8 sp=0xc0102d0d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0102d0fe0 sp=0xc0102d0fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102d0fe8 sp=0xc0102d0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5758 [select, 222 minutes]:
runtime.gopark(0xc0102e5f90?, 0x2?, 0xd8?, 0x5d?, 0xc0102e5f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102e5d90 sp=0xc0102e5d70 pc=0x43e676
runtime.selectgo(0xc0102e5f90, 0xc0102e5f20, 0xc00f9b2ec0?, 0x0, 0xc02f4bf1d0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102e5ed0 sp=0xc0102e5d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0252a97a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0102e5fc8 sp=0xc0102e5ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0102e5fe0 sp=0xc0102e5fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102e5fe8 sp=0xc0102e5fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5762 [select, 222 minutes]:
runtime.gopark(0xc0102e6f68?, 0x4?, 0x3?, 0x0?, 0xc0102e6db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0102e6c00 sp=0xc0102e6be0 pc=0x43e676
runtime.selectgo(0xc0102e6f68, 0xc0102e6da8, 0xc00f830b40?, 0x0, 0xc0065b0501?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0102e6d40 sp=0xc0102e6c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc02539a000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0102e6fc8 sp=0xc0102e6d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0102e6fe0 sp=0xc0102e6fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0102e6fe8 sp=0xc0102e6fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5763 [select, 222 minutes]:
runtime.gopark(0xc0103d3f90?, 0x2?, 0xd8?, 0x3d?, 0xc0103d3f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0103d3d90 sp=0xc0103d3d70 pc=0x43e676
runtime.selectgo(0xc0103d3f90, 0xc0103d3f20, 0xc00fb7a340?, 0x0, 0xc02f6407e0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0103d3ed0 sp=0xc0103d3d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc02539a000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0103d3fc8 sp=0xc0103d3ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0103d3fe0 sp=0xc0103d3fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0103d3fe8 sp=0xc0103d3fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5766 [select, 222 minutes]:
runtime.gopark(0xc0104a5f68?, 0x4?, 0x3?, 0x0?, 0xc0104a5db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104a5c00 sp=0xc0104a5be0 pc=0x43e676
runtime.selectgo(0xc0104a5f68, 0xc0104a5da8, 0xc00fb7a4c0?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104a5d40 sp=0xc0104a5c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc02539a6c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0104a5fc8 sp=0xc0104a5d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0104a5fe0 sp=0xc0104a5fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104a5fe8 sp=0xc0104a5fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5767 [select, 222 minutes]:
runtime.gopark(0xc0103d4f90?, 0x2?, 0xd8?, 0x4d?, 0xc0103d4f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0103d4d90 sp=0xc0103d4d70 pc=0x43e676
runtime.selectgo(0xc0103d4f90, 0xc0103d4f20, 0xc00fb7a480?, 0x0, 0xc02f0d8180?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0103d4ed0 sp=0xc0103d4d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc02539a6c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0103d4fc8 sp=0xc0103d4ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0103d4fe0 sp=0xc0103d4fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0103d4fe8 sp=0xc0103d4fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5770 [select, 222 minutes]:
runtime.gopark(0xc0103d5f68?, 0x4?, 0x3?, 0x0?, 0xc0103d5db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0103d5c00 sp=0xc0103d5be0 pc=0x43e676
runtime.selectgo(0xc0103d5f68, 0xc0103d5da8, 0xc00f831040?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0103d5d40 sp=0xc0103d5c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024c2e360)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0103d5fc8 sp=0xc0103d5d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0103d5fe0 sp=0xc0103d5fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0103d5fe8 sp=0xc0103d5fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5771 [select, 222 minutes]:
runtime.gopark(0xc0103d6f90?, 0x2?, 0xd8?, 0x6d?, 0xc0103d6f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0103d6d90 sp=0xc0103d6d70 pc=0x43e676
runtime.selectgo(0xc0103d6f90, 0xc0103d6f20, 0xc00fb7aac0?, 0x0, 0xc02fd92a20?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0103d6ed0 sp=0xc0103d6d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024c2e360)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0103d6fc8 sp=0xc0103d6ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0103d6fe0 sp=0xc0103d6fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0103d6fe8 sp=0xc0103d6fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5761 [select, 222 minutes]:
runtime.gopark(0xc0103d0f68?, 0x4?, 0x3?, 0x0?, 0xc0103d0db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0103d0c00 sp=0xc0103d0be0 pc=0x43e676
runtime.selectgo(0xc0103d0f68, 0xc0103d0da8, 0xc00fb7ab00?, 0x0, 0xc03c5bf501?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0103d0d40 sp=0xc0103d0c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0252a98c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0103d0fc8 sp=0xc0103d0d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0103d0fe0 sp=0xc0103d0fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0103d0fe8 sp=0xc0103d0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5794 [select, 222 minutes]:
runtime.gopark(0xc0103d1f90?, 0x2?, 0xd8?, 0x1d?, 0xc0103d1f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0103d1d90 sp=0xc0103d1d70 pc=0x43e676
runtime.selectgo(0xc0103d1f90, 0xc0103d1f20, 0xc00f9b3000?, 0x0, 0xc02f7ca990?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0103d1ed0 sp=0xc0103d1d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0252a98c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0103d1fc8 sp=0xc0103d1ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0103d1fe0 sp=0xc0103d1fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0103d1fe8 sp=0xc0103d1fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5774 [select, 222 minutes]:
runtime.gopark(0xc01049ef68?, 0x4?, 0x3?, 0x0?, 0xc01049edb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc01049ec00 sp=0xc01049ebe0 pc=0x43e676
runtime.selectgo(0xc01049ef68, 0xc01049eda8, 0xc00f831180?, 0x0, 0xc01f3f6501?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc01049ed40 sp=0xc01049ec00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024c2e480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc01049efc8 sp=0xc01049ed40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc01049efe0 sp=0xc01049efc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc01049efe8 sp=0xc01049efe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5775 [select, 222 minutes]:
runtime.gopark(0xc0103d2f90?, 0x2?, 0xd8?, 0x2d?, 0xc0103d2f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0103d2d90 sp=0xc0103d2d70 pc=0x43e676
runtime.selectgo(0xc0103d2f90, 0xc0103d2f20, 0xc00fb7ac00?, 0x0, 0xc02ff44210?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0103d2ed0 sp=0xc0103d2d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024c2e480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0103d2fc8 sp=0xc0103d2ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0103d2fe0 sp=0xc0103d2fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0103d2fe8 sp=0xc0103d2fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5810 [select, 222 minutes]:
runtime.gopark(0xc01049ff68?, 0x4?, 0x3?, 0x0?, 0xc01049fdb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc01049fc00 sp=0xc01049fbe0 pc=0x43e676
runtime.selectgo(0xc01049ff68, 0xc01049fda8, 0xc00f9b3040?, 0x0, 0xc01f3f6501?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc01049fd40 sp=0xc01049fc00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024c2e5a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc01049ffc8 sp=0xc01049fd40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc01049ffe0 sp=0xc01049ffc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc01049ffe8 sp=0xc01049ffe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5811 [select, 222 minutes]:
runtime.gopark(0xc0104a0f90?, 0x2?, 0xd8?, 0xd?, 0xc0104a0f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104a0d90 sp=0xc0104a0d70 pc=0x43e676
runtime.selectgo(0xc0104a0f90, 0xc0104a0f20, 0xc00fb7ad40?, 0x0, 0xc02ff45a40?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104a0ed0 sp=0xc0104a0d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024c2e5a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0104a0fc8 sp=0xc0104a0ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0104a0fe0 sp=0xc0104a0fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104a0fe8 sp=0xc0104a0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5797 [select, 222 minutes]:
runtime.gopark(0xc0104d2f68?, 0x4?, 0x48?, 0x2c?, 0xc0104d2db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104d2c00 sp=0xc0104d2be0 pc=0x43e676
runtime.selectgo(0xc0104d2f68, 0xc0104d2da8, 0xc00fb7ad80?, 0x0, 0xc01de50301?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104d2d40 sp=0xc0104d2c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0252a99e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0104d2fc8 sp=0xc0104d2d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0104d2fe0 sp=0xc0104d2fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104d2fe8 sp=0xc0104d2fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5798 [select, 222 minutes]:
runtime.gopark(0xc0104d3f90?, 0x2?, 0xd8?, 0x3d?, 0xc0104d3f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104d3d90 sp=0xc0104d3d70 pc=0x43e676
runtime.selectgo(0xc0104d3f90, 0xc0104d3f20, 0xc00f9b3140?, 0x0, 0xc0300ec630?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104d3ed0 sp=0xc0104d3d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0252a99e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0104d3fc8 sp=0xc0104d3ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0104d3fe0 sp=0xc0104d3fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104d3fe8 sp=0xc0104d3fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 5814 [select, 222 minutes]:
runtime.gopark(0xc0104d4f68?, 0x4?, 0x3?, 0x0?, 0xc0104d4db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104d4c00 sp=0xc0104d4be0 pc=0x43e676
runtime.selectgo(0xc0104d4f68, 0xc0104d4da8, 0xc00f8312c0?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104d4d40 sp=0xc0104d4c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc024c2ed80)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0104d4fc8 sp=0xc0104d4d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0104d4fe0 sp=0xc0104d4fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104d4fe8 sp=0xc0104d4fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 5815 [select, 222 minutes]:
runtime.gopark(0xc0115c7f90?, 0x2?, 0xd8?, 0x7d?, 0xc0115c7f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0115c7d90 sp=0xc0115c7d70 pc=0x43e676
runtime.selectgo(0xc0115c7f90, 0xc0115c7f20, 0xc00fb7ae80?, 0x0, 0xc0301bd200?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0115c7ed0 sp=0xc0115c7d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc024c2ed80)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0115c7fc8 sp=0xc0115c7ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0115c7fe0 sp=0xc0115c7fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0115c7fe8 sp=0xc0115c7fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 18734 [IO wait, 172 minutes]:
runtime.gopark(0xc0104e7520?, 0xc00005ca00?, 0x90?, 0x19?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003a1920 sp=0xc0003a1900 pc=0x43e676
runtime.netpollblock(0xc005a54000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc0003a1958 sp=0xc0003a1920 pc=0x437057
internal/poll.runtime_pollWait(0x7f83b068b740, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc0003a1978 sp=0xc0003a1958 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc005260f80?, 0xc005a54000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc0003a19a0 sp=0xc0003a1978 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc005260f80, {0xc005a54000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0003a1a20 sp=0xc0003a19a0 pc=0x4a34da
net.(*netFD).Read(0xc005260f80, {0xc005a54000?, 0x57184f?, 0xc0003a1aa0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc0003a1a68 sp=0xc0003a1a20 pc=0x678249
net.(*conn).Read(0xc028a3c4e0, {0xc005a54000?, 0xc0003a1b08?, 0x561c7b?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc0003a1ab0 sp=0xc0003a1a68 pc=0x6884a5
net/http.(*persistConn).Read(0xc01940dc20, {0xc005a54000?, 0xc001215937?, 0x28?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1929 +0x4e fp=0xc0003a1b10 sp=0xc0003a1ab0 pc=0x77946e
bufio.(*Reader).fill(0xc083ef1a40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc0003a1b48 sp=0xc0003a1b10 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc083ef1a40, 0xf?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc0003a1b98 sp=0xc0003a1b48 pc=0x52188f
net/http/internal.readChunkLine(0x44d813?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0003a1be8 sp=0xc0003a1b98 pc=0x717365
net/http/internal.(*chunkedReader).beginChunk(0xc005714c60)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0003a1c18 sp=0xc0003a1be8 pc=0x716de8
net/http/internal.(*chunkedReader).Read(0xc005714c60, {0xc005745000?, 0x2?, 0x60?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:98 +0x14e fp=0xc0003a1c98 sp=0xc0003a1c18 pc=0x7170ae
net/http.(*body).readLocked(0xc00571b580, {0xc005745000?, 0x7f83adf66368?, 0x18?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:844 +0x3c fp=0xc0003a1ce8 sp=0xc0003a1c98 pc=0x76dfdc
net/http.(*body).Read(0xc0072f8420?, {0xc005745000?, 0xc00c23a9b8?, 0xffffffffffffffff?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:836 +0x125 fp=0xc0003a1d60 sp=0xc0003a1ce8 pc=0x76dea5
net/http.(*bodyEOFSignal).Read(0xc00571b5c0, {0xc005745000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2774 +0x142 fp=0xc0003a1de0 sp=0xc0003a1d60 pc=0x77dba2
bufio.(*Reader).fill(0xc08e8f7380)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc0003a1e18 sp=0xc0003a1de0 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc08e8f7380, 0x65?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc0003a1e68 sp=0xc0003a1e18 pc=0x52188f
bufio.(*Reader).collectFragments(0xc006e3e540?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:446 +0x74 fp=0xc0003a1f18 sp=0xc0003a1e68 pc=0x521cd4
bufio.(*Reader).ReadBytes(0x10227a0?, 0x40?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:474 +0x1d fp=0xc0003a1f98 sp=0xc0003a1f18 pc=0x521e7d
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:477 +0x4d fp=0xc0003a1fe0 sp=0xc0003a1f98 pc=0x833bcd
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003a1fe8 sp=0xc0003a1fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:475 +0x665

goroutine 18649 [select, 174 minutes]:
runtime.gopark(0xc00655af90?, 0x2?, 0xd8?, 0xad?, 0xc00655af24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00655ad90 sp=0xc00655ad70 pc=0x43e676
runtime.selectgo(0xc00655af90, 0xc00655af20, 0xc0059abfc0?, 0x0, 0xc005a4bc50?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc00655aed0 sp=0xc00655ad90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc01940dc20)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00655afc8 sp=0xc00655aed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc00655afe0 sp=0xc00655afc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00655afe8 sp=0xc00655afe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 18749 [select, 174 minutes]:
runtime.gopark(0xc04f5b1f90?, 0x2?, 0xd8?, 0x1d?, 0xc04f5b1f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc04f5b1d90 sp=0xc04f5b1d70 pc=0x43e676
runtime.selectgo(0xc04f5b1f90, 0xc04f5b1f20, 0xc005ce46c0?, 0x0, 0xc005cfd050?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc04f5b1ed0 sp=0xc04f5b1d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc0191a2480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc04f5b1fc8 sp=0xc04f5b1ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc04f5b1fe0 sp=0xc04f5b1fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc04f5b1fe8 sp=0xc04f5b1fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 19541 [semacquire, 171 minutes]:
runtime.gopark(0xc00a2e6800?, 0x7f84721dd5c0?, 0xa0?, 0xf7?, 0x413065?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc00059eea8 sp=0xc00059ee88 pc=0x43e676
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:367
runtime.semacquire1(0xc0097dc378, 0x50?, 0x1, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sema.go:144 +0x1f3 fp=0xc00059ef10 sp=0xc00059eea8 pc=0x44f1b3
sync.runtime_Semacquire(0xc005fd1050?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sema.go:56 +0x25 fp=0xc00059ef40 sp=0xc00059ef10 pc=0x46aaa5
sync.(*WaitGroup).Wait(0xf4e5e0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/sync/waitgroup.go:136 +0x52 fp=0xc00059ef68 sp=0xc00059ef40 pc=0x479932
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).makePrepareIndexRequest(0xc0004c0180, 0x8bdfee4ecf75439d, {0x10c9b71, 0x10}, {0x10bed3f, 0x7}, {0x10c0184, 0x8}, {0x10c0184, 0x8}, ...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:666 +0x68f fp=0xc00059f038 sp=0xc00059ef68 pc=0xcf19af
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).recoverableCreateIndex(0xc0004c0180, 0xc005726a00, 0x10bb308?, 0x1, 0x0?, 0x0?, 0x0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:1284 +0x425 fp=0xc00059f580 sp=0xc00059f038 pc=0xcf6205
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).CreateIndexWithPlan(0xc0004c0180, {0x10c9b71, 0x10}, {0x10bed3f, 0x7}, {0x10c0184, 0x8}, {0x10c0184, 0x8}, {0xc000212d90, ...}, ...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:510 +0x637 fp=0xc00059f798 sp=0xc00059f580 pc=0xcf04d7
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).CreateIndex(0xc0000cc420, {0x10c9b71, 0x10}, {0x10bed3f, 0x7}, {0x10c0184, 0x8}, {0x10c0184, 0x8}, {0xc000212d90, ...}, ...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:330 +0x289 fp=0xc00059f8c0 sp=0xc00059f798 pc=0xd39ae9
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).CreateIndex4(0xc0004a6400, {0x10c9b71, 0x10}, {0x10bed3f, 0x7}, {0x10c0184, 0x8}, {0x10c0184, 0x8}, {0xc000212d90, ...}, ...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:574 +0x37a fp=0xc00059fbb0 sp=0xc00059f8c0 pc=0xd283da
github.com/couchbase/indexing/secondary/tests/framework/secondaryindex.CreateSecondaryIndex3({0x10c9b71, 0x10}, {0x10bed3f, 0x7}, {0x10c0184, 0x8}, {0x10c0184, 0x8}, {0xc000212d60, 0xe}, ...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/framework/secondaryindex/secondaryindexmanagement.go:189 +0x32f fp=0xc00059fdb8 sp=0xc00059fbb0 pc=0xd8b4cf
github.com/couchbase/indexing/secondary/tests/framework/secondaryindex.CreateSecondaryIndex2(...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/framework/secondaryindex/secondaryindexmanagement.go:132
github.com/couchbase/indexing/secondary/tests/functionaltests.TestOrphanPartitionCleanup(0xc008f9e680)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/functionaltests/set07_system_test.go:1518 +0x22e fp=0xc00059ff70 sp=0xc00059fdb8 pc=0xe138ce
testing.tRunner(0xc008f9e680, 0x113e248)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/testing/testing.go:1439 +0x102 fp=0xc00059ffc0 sp=0xc00059ff70 pc=0x51aee2
testing.(*T).Run.func1()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/testing/testing.go:1486 +0x2a fp=0xc00059ffe0 sp=0xc00059ffc0 pc=0x51bd8a
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00059ffe8 sp=0xc00059ffe0 pc=0x46ecc1
created by testing.(*T).Run
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/testing/testing.go:1486 +0x35f

goroutine 18748 [select, 174 minutes]:
runtime.gopark(0xc0062daf68?, 0x4?, 0x3?, 0x0?, 0xc0062dadb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0062dac00 sp=0xc0062dabe0 pc=0x43e676
runtime.selectgo(0xc0062daf68, 0xc0062dada8, 0xc00571bcc0?, 0x0, 0x44d801?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0062dad40 sp=0xc0062dac00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc0191a2480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0062dafc8 sp=0xc0062dad40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0062dafe0 sp=0xc0062dafc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0062dafe8 sp=0xc0062dafe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 18735 [IO wait, 1 minutes]:
runtime.gopark(0xc003e209c0?, 0xc000058000?, 0x90?, 0x59?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0054d5920 sp=0xc0054d5900 pc=0x43e676
runtime.netpollblock(0xc005dad000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc0054d5958 sp=0xc0054d5920 pc=0x437057
internal/poll.runtime_pollWait(0x7f84339eff80, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc0054d5978 sp=0xc0054d5958 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc005261f80?, 0xc005dad000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc0054d59a0 sp=0xc0054d5978 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc005261f80, {0xc005dad000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0054d5a20 sp=0xc0054d59a0 pc=0x4a34da
net.(*netFD).Read(0xc005261f80, {0xc005dad000?, 0xc0054d5ae8?, 0x57184f?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc0054d5a68 sp=0xc0054d5a20 pc=0x678249
net.(*conn).Read(0xc0004a4840, {0xc005dad000?, 0xc0054d5b08?, 0x561c7b?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc0054d5ab0 sp=0xc0054d5a68 pc=0x6884a5
net/http.(*persistConn).Read(0xc0191a2480, {0xc005dad000?, 0x13?, 0xc007221d00?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1929 +0x4e fp=0xc0054d5b10 sp=0xc0054d5ab0 pc=0x77946e
bufio.(*Reader).fill(0xc019063680)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc0054d5b48 sp=0xc0054d5b10 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc019063680, 0x68?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc0054d5b98 sp=0xc0054d5b48 pc=0x52188f
net/http/internal.readChunkLine(0xc005dadead?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0054d5be8 sp=0xc0054d5b98 pc=0x717365
net/http/internal.(*chunkedReader).beginChunk(0xc005d5a450)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0054d5c18 sp=0xc0054d5be8 pc=0x716de8
net/http/internal.(*chunkedReader).Read(0xc005d5a450, {0xc005d7e000?, 0x2?, 0x60?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:98 +0x14e fp=0xc0054d5c98 sp=0xc0054d5c18 pc=0x7170ae
net/http.(*body).readLocked(0xc00571bcc0, {0xc005d7e000?, 0x7f83aac92118?, 0x18?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:844 +0x3c fp=0xc0054d5ce8 sp=0xc0054d5c98 pc=0x76dfdc
net/http.(*body).Read(0xc0072f8420?, {0xc005d7e000?, 0xc0090cd098?, 0xffffffffffffffff?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:836 +0x125 fp=0xc0054d5d60 sp=0xc0054d5ce8 pc=0x76dea5
net/http.(*bodyEOFSignal).Read(0xc00571bd00, {0xc005d7e000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2774 +0x142 fp=0xc0054d5de0 sp=0xc0054d5d60 pc=0x77dba2
bufio.(*Reader).fill(0xc08e8f7920)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc0054d5e18 sp=0xc0054d5de0 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc08e8f7920, 0x65?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc0054d5e68 sp=0xc0054d5e18 pc=0x52188f
bufio.(*Reader).collectFragments(0xc00c11aeb0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:446 +0x74 fp=0xc0054d5f18 sp=0xc0054d5e68 pc=0x521cd4
bufio.(*Reader).ReadBytes(0x1092e40?, 0xa0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:474 +0x1d fp=0xc0054d5f98 sp=0xc0054d5f18 pc=0x521e7d
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:477 +0x4d fp=0xc0054d5fe0 sp=0xc0054d5f98 pc=0x833bcd
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0054d5fe8 sp=0xc0054d5fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:475 +0x665

goroutine 18744 [IO wait, 1 minutes]:
runtime.gopark(0xc0125ee000?, 0xc00005a500?, 0x90?, 0x79?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc008457920 sp=0xc008457900 pc=0x43e676
runtime.netpollblock(0xc005740000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc008457958 sp=0xc008457920 pc=0x437057
internal/poll.runtime_pollWait(0x7f83b2b3e868, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc008457978 sp=0xc008457958 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc004eaae00?, 0xc005740000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc0084579a0 sp=0xc008457978 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc004eaae00, {0xc005740000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc008457a20 sp=0xc0084579a0 pc=0x4a34da
net.(*netFD).Read(0xc004eaae00, {0xc005740000?, 0x57184f?, 0xc008457aa0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc008457a68 sp=0xc008457a20 pc=0x678249
net.(*conn).Read(0xc00aea06f8, {0xc005740000?, 0xc008457b08?, 0x561c7b?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc008457ab0 sp=0xc008457a68 pc=0x6884a5
net/http.(*persistConn).Read(0xc00019fe60, {0xc005740000?, 0x8?, 0xc006940888?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1929 +0x4e fp=0xc008457b10 sp=0xc008457ab0 pc=0x77946e
bufio.(*Reader).fill(0xc08e8f70e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc008457b48 sp=0xc008457b10 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc08e8f70e0, 0x72?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc008457b98 sp=0xc008457b48 pc=0x52188f
net/http/internal.readChunkLine(0x44d813?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc008457be8 sp=0xc008457b98 pc=0x717365
net/http/internal.(*chunkedReader).beginChunk(0xc005c85500)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc008457c18 sp=0xc008457be8 pc=0x716de8
net/http/internal.(*chunkedReader).Read(0xc005c85500, {0xc005add000?, 0x2?, 0x60?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/internal/chunked.go:98 +0x14e fp=0xc008457c98 sp=0xc008457c18 pc=0x7170ae
net/http.(*body).readLocked(0xc01927dec0, {0xc005add000?, 0x7f84300dbbf8?, 0x18?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:844 +0x3c fp=0xc008457ce8 sp=0xc008457c98 pc=0x76dfdc
net/http.(*body).Read(0xc0072f8420?, {0xc005add000?, 0xc00ac6ec88?, 0xffffffffffffffff?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transfer.go:836 +0x125 fp=0xc008457d60 sp=0xc008457ce8 pc=0x76dea5
net/http.(*bodyEOFSignal).Read(0xc01927df00, {0xc005add000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2774 +0x142 fp=0xc008457de0 sp=0xc008457d60 pc=0x77dba2
bufio.(*Reader).fill(0xc019062cc0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc008457e18 sp=0xc008457de0 pc=0x520ca3
bufio.(*Reader).ReadSlice(0xc019062cc0, 0x65?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:371 +0x2f fp=0xc008457e68 sp=0xc008457e18 pc=0x52188f
bufio.(*Reader).collectFragments(0xc006940880?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:446 +0x74 fp=0xc008457f18 sp=0xc008457e68 pc=0x521cd4
bufio.(*Reader).ReadBytes(0xee56e0?, 0x80?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:474 +0x1d fp=0xc008457f98 sp=0xc008457f18 pc=0x521e7d
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:477 +0x4d fp=0xc008457fe0 sp=0xc008457f98 pc=0x833bcd
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc008457fe8 sp=0xc008457fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:475 +0x665

goroutine 18743 [select, 1 minutes]:
runtime.gopark(0xc00059bf68?, 0x5?, 0xc0?, 0xf8?, 0xc00059bdf6?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0054d3c60 sp=0xc0054d3c40 pc=0x43e676
runtime.selectgo(0xc0054d3f68, 0xc00059bdec, 0x10bed3f?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0054d3da0 sp=0xc0054d3c60 pc=0x44e0d2
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges(0xc0000cc420)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2086 +0x33c fp=0xc0054d3fc8 sp=0xc0054d3da0 pc=0xd4511c
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges.func1.1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2058 +0x26 fp=0xc0054d3fe0 sp=0xc0054d3fc8 pc=0xd456c6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0054d3fe8 sp=0xc0054d3fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges.func1
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2058 +0x6a

goroutine 57631 [IO wait, 1 minutes]:
runtime.gopark(0xc04a5fe820?, 0xc00005a500?, 0x68?, 0xb?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0062e0af8 sp=0xc0062e0ad8 pc=0x43e676
runtime.netpollblock(0xc00074f000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc0062e0b30 sp=0xc0062e0af8 pc=0x437057
internal/poll.runtime_pollWait(0x7f84339f0700, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc0062e0b50 sp=0xc0062e0b30 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc001c67780?, 0xc00074f000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc0062e0b78 sp=0xc0062e0b50 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc001c67780, {0xc00074f000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0062e0bf8 sp=0xc0062e0b78 pc=0x4a34da
net.(*netFD).Read(0xc001c67780, {0xc00074f000?, 0x40baa9?, 0x4?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc0062e0c40 sp=0xc0062e0bf8 pc=0x678249
net.(*conn).Read(0xc00af0c228, {0xc00074f000?, 0x0?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc0062e0c88 sp=0xc0062e0c40 pc=0x6884a5
net/http.(*persistConn).Read(0xc00c10a480, {0xc00074f000?, 0xc00f85de60?, 0xc0062e0d30?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1929 +0x4e fp=0xc0062e0ce8 sp=0xc0062e0c88 pc=0x77946e
bufio.(*Reader).fill(0xc0072f9ce0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc0062e0d20 sp=0xc0062e0ce8 pc=0x520ca3
bufio.(*Reader).Peek(0xc0072f9ce0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:144 +0x5d fp=0xc0062e0d40 sp=0xc0062e0d20 pc=0x520dfd
net/http.(*persistConn).readLoop(0xc00c10a480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2093 +0x1ac fp=0xc0062e0fc8 sp=0xc0062e0d40 pc=0x77a28c
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0062e0fe0 sp=0xc0062e0fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0062e0fe8 sp=0xc0062e0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 18745 [select, 174 minutes]:
runtime.gopark(0xc0003a3d50?, 0x2?, 0x0?, 0x3b?, 0xc0003a3c4c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0003a3ab8 sp=0xc0003a3a98 pc=0x43e676
runtime.selectgo(0xc0003a3d50, 0xc0003a3c48, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0003a3bf8 sp=0xc0003a3ab8 pc=0x44e0d2
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint(0x18?, {0xc00a9a6ea0, 0x19}, 0xc00f924ea0, 0xc00f924e88, 0xc00fec7260)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:503 +0x6da fp=0xc0003a3ea0 sp=0xc0003a3bf8 pc=0x83379a
github.com/couchbase/indexing/secondary/dcp.(*Client).RunObserveCollectionManifestChanges(0xc0001467e0?, {0x10bed3f?, 0xf?}, {0xc014639358?, 0xc005cec990?}, 0xc064464fb0?, 0x0?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:426 +0xc7 fp=0xc0003a3f20 sp=0xc0003a3ea0 pc=0x832e87
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunObserveCollectionManifestChanges(0xc0001467e0, {0xc014639358, 0x7})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:165 +0x85 fp=0xc0003a3fb8 sp=0xc0003a3f20 pc=0xb35785
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:137 +0x2e fp=0xc0003a3fe0 sp=0xc0003a3fb8 pc=0xb3540e
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0003a3fe8 sp=0xc0003a3fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:137 +0x2a5

goroutine 57632 [select, 1 minutes]:
runtime.gopark(0xc0104d0f90?, 0x2?, 0xd8?, 0xd?, 0xc0104d0f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0104d0d90 sp=0xc0104d0d70 pc=0x43e676
runtime.selectgo(0xc0104d0f90, 0xc0104d0f20, 0xc0105a7b00?, 0x0, 0xc034c70ae0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0104d0ed0 sp=0xc0104d0d90 pc=0x44e0d2
net/http.(*persistConn).writeLoop(0xc00c10a480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0104d0fc8 sp=0xc0104d0ed0 pc=0x77bf75
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x26 fp=0xc0104d0fe0 sp=0xc0104d0fc8 pc=0x778a06
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0104d0fe8 sp=0xc0104d0fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1751 +0x1791

goroutine 57232 [IO wait, 1 minutes]:
runtime.gopark(0xc0233cc1a0?, 0xc00005a500?, 0x68?, 0x1b?, 0x4845e2?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0065c1af8 sp=0xc0065c1ad8 pc=0x43e676
runtime.netpollblock(0xc00078e000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc0065c1b30 sp=0xc0065c1af8 pc=0x437057
internal/poll.runtime_pollWait(0x7f83b2b3ea48, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/netpoll.go:302 +0x89 fp=0xc0065c1b50 sp=0xc0065c1b30 pc=0x4692a9
internal/poll.(*pollDesc).wait(0xc001c67900?, 0xc00078e000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc0065c1b78 sp=0xc0065c1b50 pc=0x4a2172
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc001c67900, {0xc00078e000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0065c1bf8 sp=0xc0065c1b78 pc=0x4a34da
net.(*netFD).Read(0xc001c67900, {0xc00078e000?, 0x40baa9?, 0x4?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/fd_posix.go:55 +0x29 fp=0xc0065c1c40 sp=0xc0065c1bf8 pc=0x678249
net.(*conn).Read(0xc043b98070, {0xc00078e000?, 0x0?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/net.go:183 +0x45 fp=0xc0065c1c88 sp=0xc0065c1c40 pc=0x6884a5
net/http.(*persistConn).Read(0xc00c10a5a0, {0xc00078e000?, 0xc006d9af00?, 0xc0065c1d30?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1929 +0x4e fp=0xc0065c1ce8 sp=0xc0065c1c88 pc=0x77946e
bufio.(*Reader).fill(0xc00838eae0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:106 +0x103 fp=0xc0065c1d20 sp=0xc0065c1ce8 pc=0x520ca3
bufio.(*Reader).Peek(0xc00838eae0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/bufio/bufio.go:144 +0x5d fp=0xc0065c1d40 sp=0xc0065c1d20 pc=0x520dfd
net/http.(*persistConn).readLoop(0xc00c10a5a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2093 +0x1ac fp=0xc0065c1fc8 sp=0xc0065c1d40 pc=0x77a28c
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0065c1fe0 sp=0xc0065c1fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0065c1fe8 sp=0xc0065c1fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 18648 [select, 174 minutes]:
runtime.gopark(0xc0115c2f68?, 0x4?, 0x3?, 0x0?, 0xc0115c2db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc0115c2c00 sp=0xc0115c2be0 pc=0x43e676
runtime.selectgo(0xc0115c2f68, 0xc0115c2da8, 0xc00571b580?, 0x0, 0xc005954f01?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc0115c2d40 sp=0xc0115c2c00 pc=0x44e0d2
net/http.(*persistConn).readLoop(0xc01940dc20)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:2213 +0xd99 fp=0xc0115c2fc8 sp=0xc0115c2d40 pc=0x77ae79
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x26 fp=0xc0115c2fe0 sp=0xc0115c2fc8 pc=0x778a66
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0115c2fe8 sp=0xc0115c2fe0 pc=0x46ecc1
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/net/http/transport.go:1750 +0x173e

goroutine 18650 [select, 174 minutes]:
runtime.gopark(0xc03c667d88?, 0x2?, 0xc0?, 0xa?, 0xc03c667c84?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:361 +0xd6 fp=0xc03c667af0 sp=0xc03c667ad0 pc=0x43e676
runtime.selectgo(0xc03c667d88, 0xc03c667c80, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/select.go:328 +0x772 fp=0xc03c667c30 sp=0xc03c667af0 pc=0x44e0d2
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint(0x0?, {0xc00db44258, 0x17}, 0xc00e6cf818, 0xc00e6cf800, 0xc00fec7260)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:503 +0x6da fp=0xc03c667ed8 sp=0xc03c667c30 pc=0x83379a
github.com/couchbase/indexing/secondary/dcp.(*Client).RunObservePool(0xc0001467e0?, {0x10bed3f?, 0xc000571da0?}, 0xbd5107?, 0x1?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:395 +0xb2 fp=0xc03c667f40 sp=0xc03c667ed8 pc=0x8328d2
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunPoolObserver(0xc0001467e0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:147 +0x5c fp=0xc03c667fc8 sp=0xc03c667f40 pc=0xb3549c
github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:256 +0x26 fp=0xc03c667fe0 sp=0xc03c667fc8 pc=0xb36786
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc03c667fe8 sp=0xc03c667fe0 pc=0x46ecc1
created by github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:256 +0x50a

rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0x1b6f828
rsi    0x80
rbp    0x7ffc78d84358
rsp    0x7ffc78d84310
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x4464a0
r13    0x0
r14    0x1b6ed80
r15    0xb0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x47057d m=2 sigcode=0

goroutine 0 [idle]:
runtime.usleep()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:149 +0x3d fp=0x7f844b57fda0 sp=0x7f844b57fd80 pc=0x47057d
runtime.sysmon()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:5066 +0xa5 fp=0x7f844b57fe08 sp=0x7f844b57fda0 pc=0x449205
runtime.mstart1()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1418 +0x93 fp=0x7f844b57fe30 sp=0x7f844b57fe08 pc=0x440ef3
runtime.mstart0()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1376 +0x79 fp=0x7f844b57fe60 sp=0x7f844b57fe30 pc=0x440e39
runtime.mstart()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:367 +0x5 fp=0x7f844b57fe68 sp=0x7f844b57fe60 pc=0x46ca05
rax    0xfffffffffffffffc
rbx    0x2710
rcx    0x47057d
rdx    0x0
rdi    0x7f844b57fd80
rsi    0x0
rbp    0x7f844b57fd90
rsp    0x7f844b57fd80
r8     0x0
r9     0x0
r10    0x0
r11    0x202
r12    0x7f844b57f7c0
r13    0x178
r14    0xc0000029c0
r15    0x7f83e004f19c
rip    0x47057d
rflags 0x202
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=3 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f844abdec08 sp=0x7f844abdec00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x7f844abdec90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f844abdec58 sp=0x7f844abdec08 pc=0x437c76
runtime.notesleep(0xc00006e948)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f844abdec90 sp=0x7f844abdec58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f844abdecc0 sp=0x7f844abdec90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f844abdedb0 sp=0x7f844abdecc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f844abdedf8 sp=0x7f844abdedb0 pc=0x444819
runtime.park_m(0xc0000c4820?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f844abdee28 sp=0x7f844abdedf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f844abdee38 sp=0x7f844abdee28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00006e948
rsi    0x80
rbp    0x7f844abdec48
rsp    0x7f844abdec00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x7
r13    0x18
r14    0xc000002ea0
r15    0x7f83aaac8903
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=4 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f844a3ddc08 sp=0x7f844a3ddc00 pc=0x470b81
runtime.futexsleep(0x10000000004?, 0x4a3ddc88?, 0x7f844a3ddc90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f844a3ddc58 sp=0x7f844a3ddc08 pc=0x437c76
runtime.notesleep(0xc00006ed48)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f844a3ddc90 sp=0x7f844a3ddc58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f844a3ddcc0 sp=0x7f844a3ddc90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f844a3dddb0 sp=0x7f844a3ddcc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f844a3dddf8 sp=0x7f844a3dddb0 pc=0x444819
runtime.park_m(0xc0065a9860?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f844a3dde28 sp=0x7f844a3dddf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f844a3dde38 sp=0x7f844a3dde28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00006ed48
rsi    0x80
rbp    0x7f844a3ddc48
rsp    0x7f844a3ddc00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x4
r13    0x29
r14    0xc0000031e0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=5 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8449b9cc08 sp=0x7f8449b9cc00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x49b9cc88?, 0x7f8449b9cc90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8449b9cc58 sp=0x7f8449b9cc08 pc=0x437c76
runtime.notesleep(0xc000100148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8449b9cc90 sp=0x7f8449b9cc58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8449b9ccc0 sp=0x7f8449b9cc90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8449b9cdb0 sp=0x7f8449b9ccc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8449b9cdf8 sp=0x7f8449b9cdb0 pc=0x444819
runtime.park_m(0xc00a3e4680?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8449b9ce28 sp=0x7f8449b9cdf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8449b9ce38 sp=0x7f8449b9ce28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc000100148
rsi    0x80
rbp    0x7f8449b9cc48
rsp    0x7f8449b9cc00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x11
r13    0x27
r14    0xc0001021a0
r15    0x3c11bb37dd05
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=6 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f844939bd60 sp=0x7f844939bd58 pc=0x470b81
runtime.futexsleep(0x7f844939bdc8?, 0x0?, 0x8?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f844939bdb0 sp=0x7f844939bd60 pc=0x437c76
runtime.notesleep(0x1ba5918)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f844939bde8 sp=0x7f844939bdb0 pc=0x411807
runtime.templateThread()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2206 +0x71 fp=0x7f844939be08 sp=0x7f844939bde8 pc=0x4422f1
runtime.mstart1()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1418 +0x93 fp=0x7f844939be30 sp=0x7f844939be08 pc=0x440ef3
runtime.mstart0()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1376 +0x79 fp=0x7f844939be60 sp=0x7f844939be30 pc=0x440e39
runtime.mstart()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:367 +0x5 fp=0x7f844939be68 sp=0x7f844939be60 pc=0x46ca05
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0x1ba5918
rsi    0x80
rbp    0x7f844939bda0
rsp    0x7f844939bd58
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0xc000003520
r13    0x7ffc78d8416f
r14    0xc000003520
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=7 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8448b5ac08 sp=0x7f8448b5ac00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x4?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8448b5ac58 sp=0x7f8448b5ac08 pc=0x437c76
runtime.notesleep(0xc00006f548)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8448b5ac90 sp=0x7f8448b5ac58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8448b5acc0 sp=0x7f8448b5ac90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8448b5adb0 sp=0x7f8448b5acc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8448b5adf8 sp=0x7f8448b5adb0 pc=0x444819
runtime.park_m(0xc00a2e9a00?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8448b5ae28 sp=0x7f8448b5adf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8448b5ae38 sp=0x7f8448b5ae28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00006f548
rsi    0x80
rbp    0x7f8448b5ac48
rsp    0x7f8448b5ac00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x1ab
r13    0x28
r14    0xc0000c5520
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=8 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f84339a8c08 sp=0x7f84339a8c00 pc=0x470b81
runtime.futexsleep(0x10000000003?, 0x0?, 0x7f84339a8c90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f84339a8c58 sp=0x7f84339a8c08 pc=0x437c76
runtime.notesleep(0xc0001d1148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f84339a8c90 sp=0x7f84339a8c58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f84339a8cc0 sp=0x7f84339a8c90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f84339a8db0 sp=0x7f84339a8cc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f84339a8df8 sp=0x7f84339a8db0 pc=0x444819
runtime.park_m(0xc000440ea0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f84339a8e28 sp=0x7f84339a8df8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f84339a8e38 sp=0x7f84339a8e28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc0001d1148
rsi    0x80
rbp    0x7f84339a8c48
rsp    0x7f84339a8c00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x1ab
r13    0x21
r14    0xc0064ed1e0
r15    0x462a26c67505
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=9 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8433047be0 sp=0x7f8433047bd8 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x3?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8433047c30 sp=0x7f8433047be0 pc=0x437c76
runtime.notesleep(0xc00a2e6d48)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8433047c68 sp=0x7f8433047c30 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8433047c98 sp=0x7f8433047c68 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8433047d88 sp=0x7f8433047c98 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8433047dd0 sp=0x7f8433047d88 pc=0x444819
runtime.goschedImpl(0xc000102340)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3351 +0xc5 fp=0x7f8433047e08 sp=0x7f8433047dd0 pc=0x444e65
runtime.gosched_m(0xc000102340?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3359 +0x31 fp=0x7f8433047e28 sp=0x7f8433047e08 pc=0x444ff1
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8433047e38 sp=0x7f8433047e28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00a2e6d48
rsi    0x80
rbp    0x7f8433047c20
rsp    0x7f8433047bd8
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x39d
r13    0x17
r14    0xc00a2e96c0
r15    0x7f8448151d38
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=10 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8432846c08 sp=0x7f8432846c00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x32846c80?, 0x411653?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8432846c58 sp=0x7f8432846c08 pc=0x437c76
runtime.notesleep(0xc00a1a8d48)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8432846c90 sp=0x7f8432846c58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8432846cc0 sp=0x7f8432846c90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8432846db0 sp=0x7f8432846cc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8432846df8 sp=0x7f8432846db0 pc=0x444819
runtime.park_m(0xc0062341a0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8432846e28 sp=0x7f8432846df8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8432846e38 sp=0x7f8432846e28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00a1a8d48
rsi    0x80
rbp    0x7f8432846c48
rsp    0x7f8432846c00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x4
r13    0x11
r14    0xc00a1be820
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=11 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8432045c08 sp=0x7f8432045c00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x7f8432045c90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8432045c58 sp=0x7f8432045c08 pc=0x437c76
runtime.notesleep(0xc00ae10148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8432045c90 sp=0x7f8432045c58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8432045cc0 sp=0x7f8432045c90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8432045db0 sp=0x7f8432045cc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8432045df8 sp=0x7f8432045db0 pc=0x444819
runtime.park_m(0xc00929ed00?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8432045e28 sp=0x7f8432045df8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8432045e38 sp=0x7f8432045e28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00ae10148
rsi    0x80
rbp    0x7f8432045c48
rsp    0x7f8432045c00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x16
r13    0x1
r14    0xc00ae121a0
r15    0x7f83ad8f9f36
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=12 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8431844be0 sp=0x7f8431844bd8 pc=0x470b81
runtime.futexsleep(0x0?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8431844c30 sp=0x7f8431844be0 pc=0x437c76
runtime.notesleep(0xc00af00148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8431844c68 sp=0x7f8431844c30 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8431844c98 sp=0x7f8431844c68 pc=0x44240d
runtime.gcstopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2478 +0xaa fp=0x7f8431844cc0 sp=0x7f8431844c98 pc=0x442eaa
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2535 +0x4f fp=0x7f8431844db0 sp=0x7f8431844cc0 pc=0x4430cf
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8431844df8 sp=0x7f8431844db0 pc=0x444819
runtime.park_m(0xc006235040?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8431844e28 sp=0x7f8431844df8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8431844e38 sp=0x7f8431844e28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00af00148
rsi    0x80
rbp    0x7f8431844c20
rsp    0x7f8431844bd8
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x7f8431844ca0
r13    0x10
r14    0xc00af021a0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=13 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8431043c08 sp=0x7f8431043c00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x7f8431043c90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8431043c58 sp=0x7f8431043c08 pc=0x437c76
runtime.notesleep(0xc00af80148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8431043c90 sp=0x7f8431043c58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8431043cc0 sp=0x7f8431043c90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8431043db0 sp=0x7f8431043cc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8431043df8 sp=0x7f8431043db0 pc=0x444819
runtime.park_m(0xc00929ed00?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8431043e28 sp=0x7f8431043df8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8431043e38 sp=0x7f8431043e28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00af80148
rsi    0x80
rbp    0x7f8431043c48
rsp    0x7f8431043c00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x11
r13    0xc
r14    0xc00af821a0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=14 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8417ffec08 sp=0x7f8417ffec00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x4?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8417ffec58 sp=0x7f8417ffec08 pc=0x437c76
runtime.notesleep(0xc007480148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8417ffec90 sp=0x7f8417ffec58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8417ffecc0 sp=0x7f8417ffec90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8417ffedb0 sp=0x7f8417ffecc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8417ffedf8 sp=0x7f8417ffedb0 pc=0x444819
runtime.park_m(0xc0000c4820?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8417ffee28 sp=0x7f8417ffedf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8417ffee38 sp=0x7f8417ffee28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc007480148
rsi    0x80
rbp    0x7f8417ffec48
rsp    0x7f8417ffec00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x4
r13    0x2
r14    0xc0074821a0
r15    0x7f8433ed0aa8
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=15 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f84177fdc08 sp=0x7f84177fdc00 pc=0x470b81
runtime.futexsleep(0x1?, 0x0?, 0xc00af8c000?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f84177fdc58 sp=0x7f84177fdc08 pc=0x437c76
runtime.notesleep(0xc00af8c148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f84177fdc90 sp=0x7f84177fdc58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f84177fdcc0 sp=0x7f84177fdc90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f84177fddb0 sp=0x7f84177fdcc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f84177fddf8 sp=0x7f84177fddb0 pc=0x444819
runtime.park_m(0xc0065a9040?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f84177fde28 sp=0x7f84177fddf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f84177fde38 sp=0x7f84177fde28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00af8c148
rsi    0x80
rbp    0x7f84177fdc48
rsp    0x7f84177fdc00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x7f84177fdca0
r13    0x24
r14    0xc00af8e1a0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=16 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8416ffcc08 sp=0x7f8416ffcc00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x7f8416ffcc90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8416ffcc58 sp=0x7f8416ffcc08 pc=0x437c76
runtime.notesleep(0xc007500148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8416ffcc90 sp=0x7f8416ffcc58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8416ffccc0 sp=0x7f8416ffcc90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8416ffcdb0 sp=0x7f8416ffccc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8416ffcdf8 sp=0x7f8416ffcdb0 pc=0x444819
runtime.park_m(0xc006235860?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8416ffce28 sp=0x7f8416ffcdf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8416ffce38 sp=0x7f8416ffce28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc007500148
rsi    0x80
rbp    0x7f8416ffcc48
rsp    0x7f8416ffcc00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x1ab
r13    0xf
r14    0xc0075021a0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=17 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f84167fbc08 sp=0x7f84167fbc00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x167fbc88?, 0x7f84167fbc90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f84167fbc58 sp=0x7f84167fbc08 pc=0x437c76
runtime.notesleep(0xc00af3e148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f84167fbc90 sp=0x7f84167fbc58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f84167fbcc0 sp=0x7f84167fbc90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f84167fbdb0 sp=0x7f84167fbcc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f84167fbdf8 sp=0x7f84167fbdb0 pc=0x444819
runtime.park_m(0xc00a2e9ba0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f84167fbe28 sp=0x7f84167fbdf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f84167fbe38 sp=0x7f84167fbe28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00af3e148
rsi    0x80
rbp    0x7f84167fbc48
rsp    0x7f84167fbc00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x11
r13    0x2a
r14    0xc00af284e0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=18 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8415ffac08 sp=0x7f8415ffac00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x15ffac88?, 0x7f8415ffac90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8415ffac58 sp=0x7f8415ffac08 pc=0x437c76
runtime.notesleep(0xc007618148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8415ffac90 sp=0x7f8415ffac58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8415ffacc0 sp=0x7f8415ffac90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8415ffadb0 sp=0x7f8415ffacc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8415ffadf8 sp=0x7f8415ffadb0 pc=0x444819
runtime.park_m(0xc008335ba0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8415ffae28 sp=0x7f8415ffadf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8415ffae38 sp=0x7f8415ffae28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc007618148
rsi    0x80
rbp    0x7f8415ffac48
rsp    0x7f8415ffac00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x16
r13    0x9
r14    0xc00761a1a0
r15    0x7f8433c59803
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=19 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f84157f9c08 sp=0x7f84157f9c00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x7f84157f9c90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f84157f9c58 sp=0x7f84157f9c08 pc=0x437c76
runtime.notesleep(0xc0075e4148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f84157f9c90 sp=0x7f84157f9c58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f84157f9cc0 sp=0x7f84157f9c90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f84157f9db0 sp=0x7f84157f9cc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f84157f9df8 sp=0x7f84157f9db0 pc=0x444819
runtime.park_m(0xc0004b2000?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f84157f9e28 sp=0x7f84157f9df8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f84157f9e38 sp=0x7f84157f9e28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc0075e4148
rsi    0x80
rbp    0x7f84157f9c48
rsp    0x7f84157f9c00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x1ab
r13    0x28
r14    0xc007dba9c0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=21 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f83fbffec08 sp=0x7f83fbffec00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0xfbffec88?, 0x7f83fbffec90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f83fbffec58 sp=0x7f83fbffec08 pc=0x437c76
runtime.notesleep(0xc007b64948)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f83fbffec90 sp=0x7f83fbffec58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f83fbffecc0 sp=0x7f83fbffec90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f83fbffedb0 sp=0x7f83fbffecc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f83fbffedf8 sp=0x7f83fbffedb0 pc=0x444819
runtime.park_m(0xc00a788000?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f83fbffee28 sp=0x7f83fbffedf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f83fbffee38 sp=0x7f83fbffee28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc007b64948
rsi    0x80
rbp    0x7f83fbffec48
rsp    0x7f83fbffec00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x4
r13    0xf
r14    0xc0064edba0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=20 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f8414ff8c08 sp=0x7f8414ff8c00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x7f8414ff8c90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f8414ff8c58 sp=0x7f8414ff8c08 pc=0x437c76
runtime.notesleep(0xc00a2e6948)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f8414ff8c90 sp=0x7f8414ff8c58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f8414ff8cc0 sp=0x7f8414ff8c90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f8414ff8db0 sp=0x7f8414ff8cc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f8414ff8df8 sp=0x7f8414ff8db0 pc=0x444819
runtime.park_m(0xc0062356c0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f8414ff8e28 sp=0x7f8414ff8df8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f8414ff8e38 sp=0x7f8414ff8e28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc00a2e6948
rsi    0x80
rbp    0x7f8414ff8c48
rsp    0x7f8414ff8c00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x46
r13    0x5
r14    0xc007482d00
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=22 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f83fb7fdc08 sp=0x7f83fb7fdc00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0xfb7fdc88?, 0x7f83fb7fdc90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f83fb7fdc58 sp=0x7f83fb7fdc08 pc=0x437c76
runtime.notesleep(0xc0089d2148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f83fb7fdc90 sp=0x7f83fb7fdc58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f83fb7fdcc0 sp=0x7f83fb7fdc90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f83fb7fddb0 sp=0x7f83fb7fdcc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f83fb7fddf8 sp=0x7f83fb7fddb0 pc=0x444819
runtime.park_m(0xc00a788680?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f83fb7fde28 sp=0x7f83fb7fddf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f83fb7fde38 sp=0x7f83fb7fde28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc0089d2148
rsi    0x80
rbp    0x7f83fb7fdc48
rsp    0x7f83fb7fdc00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x16
r13    0x1f
r14    0xc007b031e0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=23 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f83faffcc08 sp=0x7f83faffcc00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x3?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f83faffcc58 sp=0x7f83faffcc08 pc=0x437c76
runtime.notesleep(0xc008a32148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f83faffcc90 sp=0x7f83faffcc58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f83faffccc0 sp=0x7f83faffcc90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f83faffcdb0 sp=0x7f83faffccc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f83faffcdf8 sp=0x7f83faffcdb0 pc=0x444819
runtime.park_m(0xc00a788b60?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3336 +0x14d fp=0x7f83faffce28 sp=0x7f83faffcdf8 pc=0x444d6d
runtime.mcall()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/asm_amd64.s:425 +0x43 fp=0x7f83faffce38 sp=0x7f83faffce28 pc=0x46ca83
rax    0xca
rbx    0x0
rcx    0x470b83
rdx    0x0
rdi    0xc008a32148
rsi    0x80
rbp    0x7f83faffcc48
rsp    0x7f83faffcc00
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x23dd
r13    0x2
r14    0xc008d184e0
r15    0x0
rip    0x470b81
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

-----

SIGQUIT: quit
PC=0x470b81 m=24 sigcode=0

goroutine 0 [idle]:
runtime.futex()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/sys_linux_amd64.s:552 +0x21 fp=0x7f83fa7fbc08 sp=0x7f83fa7fbc00 pc=0x470b81
runtime.futexsleep(0x10000000000?, 0x0?, 0x7f83fa7fbc90?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/os_linux.go:66 +0x36 fp=0x7f83fa7fbc58 sp=0x7f83fa7fbc08 pc=0x437c76
runtime.notesleep(0xc008a80148)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/lock_futex.go:159 +0x87 fp=0x7f83fa7fbc90 sp=0x7f83fa7fbc58 pc=0x411807
runtime.mPark(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:1449
runtime.stopm()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2228 +0x8d fp=0x7f83fa7fbcc0 sp=0x7f83fa7fbc90 pc=0x44240d
runtime.findrunnable()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:2804 +0x865 fp=0x7f83fa7fbdb0 sp=0x7f83fa7fbcc0 pc=0x4438e5
runtime.schedule()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/proc.go:3187 +0x239 fp=0x7f83fa7fbdf8 sp=0x7f83fa7fbdb0 pc=0x444819
runtime.park_m(0xc0000c41a0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.7/go/src/runtime/p