Building
Started building at 2023/08/06 20:55:48
Using pegged server, 4386 build
Calculating base
Updating mirror
Basing run on 7.5.0-4386 ab963b2e38
Updating tree for run 06.08.2023-20.55
query is at e9ebf9f, changes since last good build: none
gometa is at 96e745a, changes since last good build: none
ns_server is at 40f6134, changes since last good build: none
couchstore is at 75801f2, changes since last good build: none
forestdb is at acba458, changes since last good build: none
kv_engine is at 03c9956, changes since last good build: none
Switching indexing to unstable
indexing is at 415ce4a, changes since last good build: none
Switching plasma to unstable
plasma is at 5148ffa, changes since last good build:
fatal: Invalid revision range b26d1b87c78b624a6573611445a93f595df9a3bd..HEAD
Switching nitro to unstable
nitro is at d5f5610, changes since last good build: none
Switching gometa to master
gometa is at 96e745a, changes since last good build: none
Switching testrunner to master
Submodule 'gauntlet' (https://github.com/pavithra-mahamani/gauntlet) registered for path 'gauntlet'
Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client'
Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI'
Submodule 'magma_loader/DocLoader' (https://github.com/couchbaselabs/DocLoader.git) registered for path 'magma_loader/DocLoader'
Cloning into '/opt/build/testrunner/gauntlet'...
Cloning into '/opt/build/testrunner/java_sdk_client'...
Cloning into '/opt/build/testrunner/lib/capellaAPI'...
Cloning into '/opt/build/testrunner/magma_loader/DocLoader'...
Submodule path 'gauntlet': checked out '4e2424851a59c6f4b4edfdb7e36fa6a0874d6300'
Submodule path 'java_sdk_client': checked out 'de89b059ce28567dbac18afb032271a4eaa674ff'
Submodule path 'lib/capellaAPI': checked out 'ac7ea6a1ba8030fc644c429fdd3e2f1038a3bd73'
Submodule path 'magma_loader/DocLoader': checked out '0f32672eea77681939c9b26d43f60bd4b3478936'
testrunner is at b0ce3f5, changes since last good build: none
Pulling in uncommitted change 191342 at refs/changes/42/191342/9
Total 8 (delta 5), reused 5 (delta 5)
[unstable c680d5bd] MB-57427: disable array index tests
Author: Dhruvil Shah
Date: Mon May 22 10:24:11 2023 +0530
2 files changed, 7 insertions(+), 1 deletion(-)
Pulling in uncommitted change 193825 at refs/changes/25/193825/1
Total 6 (delta 5), reused 6 (delta 5)
[unstable 70c5601a] MB100: CIFail - Enable info level client logs after TestScheduleIndexBasic
Author: Sai Krishna Teja Kommaraju
Date: Fri Jul 14 00:58:44 2023 +0530
1 file changed, 3 insertions(+)
Pulling in uncommitted change 194620 at refs/changes/20/194620/8
Total 22 (delta 17), reused 22 (delta 17)
[unstable 8c651259] MB-57375 Pass on shard affinity flag to planner
Author: Varun Velamuri
Date: Tue Aug 1 12:29:28 2023 -0700
7 files changed, 126 insertions(+), 132 deletions(-)
Pulling in uncommitted change 194661 at refs/changes/61/194661/2
Total 6 (delta 4), reused 6 (delta 4)
[unstable 14fd0fb2] MB-57816: Add error errStoragePathNotFound during plasma recovery
Author: jineshparakh
Date: Tue Aug 1 17:23:16 2023 +0530
2 files changed, 12 insertions(+), 3 deletions(-)
Pulling in uncommitted change 194850 at refs/changes/50/194850/3
Total 7 (delta 6), reused 7 (delta 6)
[unstable ccdbfa0c] MB-58151 Set sliceBufSize based on memory quota
Author: Deepkaran
Date: Thu Aug 3 20:47:19 2023 -0700
2 files changed, 18 insertions(+), 2 deletions(-)
Pulling in uncommitted change 194852 at refs/changes/52/194852/3
Total 5 (delta 4), reused 4 (delta 4)
[unstable 943c2c51] MB-57970 Fixed shouldExcludeIndex check to use NodeId
Author: Shivansh Rustagi
Date: Fri Aug 4 12:51:36 2023 +0530
1 file changed, 1 insertion(+), 1 deletion(-)
Pulling in uncommitted change 188695 at refs/changes/95/188695/49
Total 21 (delta 11), reused 12 (delta 11)
[unstable c473374] MB-55994 Make all disk calls throught env.File
Author: Dmitriy Kalugin-Balashov
Date: Thu Mar 23 15:49:07 2023 -0700
18 files changed, 326 insertions(+), 201 deletions(-)
Pulling in uncommitted change 191290 at refs/changes/90/191290/17
Total 62 (delta 38), reused 48 (delta 38)
[unstable 7e7da84] MB-54663: Add concurrency in LSS transfer
Author: Saptarshi Sen
Date: Sat May 13 08:56:10 2023 -0700
7 files changed, 398 insertions(+), 78 deletions(-)
Pulling in uncommitted change 194498 at refs/changes/98/194498/1
Total 3 (delta 2), reused 3 (delta 2)
[unstable f936826] MB-57780: Add test verify OnPrem vs Serverless with LSSSegmentSize
Author: Saptarshi Sen
Date: Thu Jul 27 20:39:32 2023 -0700
1 file changed, 75 insertions(+)
Pulling in uncommitted change 194557 at refs/changes/57/194557/3
[unstable b8cb941] MB-57303: Include server/client configs in CopyConfig (refactor)
Author: Saptarshi Sen
Date: Fri Jul 28 18:37:43 2023 -0700
3 files changed, 128 insertions(+), 143 deletions(-)
Pulling in uncommitted change 194558 at refs/changes/58/194558/4
[unstable 36c96da] MB-57303: Update MakeRPCServerHTTP for TLS/Auth configuration
Author: Saptarshi Sen
Date: Fri Jul 28 19:46:02 2023 -0700
4 files changed, 351 insertions(+), 97 deletions(-)
Pulling in uncommitted change 194559 at refs/changes/59/194559/4
[unstable cb71520] MB-57303: Update RPCHTTPClientConfig for TLS/Auth config
Author: Saptarshi Sen
Date: Sat Jul 29 12:14:37 2023 -0700
4 files changed, 187 insertions(+), 46 deletions(-)
Pulling in uncommitted change 194560 at refs/changes/60/194560/4
[unstable f7f69a6] MB-57303: Add TLS/Auth meta args in TransferShard
Author: Saptarshi Sen
Date: Sat Jul 29 13:48:41 2023 -0700
3 files changed, 77 insertions(+), 9 deletions(-)
Pulling in uncommitted change 194561 at refs/changes/61/194561/4
[unstable 5bcd70a] MB-57303: Purge cached client on node credentials refresh
Author: Saptarshi Sen
Date: Sat Jul 29 17:49:22 2023 -0700
2 files changed, 54 insertions(+), 14 deletions(-)
Pulling in uncommitted change 194660 at refs/changes/60/194660/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable ecb479e] MB-57816: Provide IsErrorRecoveryInstPathNotFound check for fatal errors
Author: jineshparakh
Date: Tue Aug 1 17:21:24 2023 +0530
2 files changed, 60 insertions(+), 6 deletions(-)
Pulling in uncommitted change 194771 at refs/changes/71/194771/4
[unstable 8b15e84] MB-57303: Add client credentials in RestoreShard & DoCleanup api
Author: Saptarshi Sen
Date: Wed Aug 2 12:18:03 2023 -0700
3 files changed, 44 insertions(+), 31 deletions(-)
Pulling in uncommitted change 194772 at refs/changes/72/194772/5
[unstable ac77abd] MB-57301: Fix missing remote close and return appropriate error
Author: Saptarshi Sen
Date: Wed Aug 2 12:12:02 2023 -0700
1 file changed, 18 insertions(+), 3 deletions(-)
Pulling in uncommitted change 194833 at refs/changes/33/194833/2
[unstable 55d8d38] MB-57301: Fix node copier cleanup path
Author: Saptarshi Sen
Date: Thu Aug 3 09:34:48 2023 -0700
2 files changed, 11 insertions(+), 3 deletions(-)
Pulling in uncommitted change 194923 at refs/changes/23/194923/2
[unstable 04c38df] MB-57299: Fix remote write hang on early context cancel
Author: Saptarshi Sen
Date: Fri Aug 4 13:34:19 2023 -0700
1 file changed, 9 insertions(+), 3 deletions(-)
Pulling in uncommitted change 194926 at refs/changes/26/194926/1
Total 60 (delta 39), reused 49 (delta 39)
[unstable f2bc80a] MB-100: Fix CI build issue (temporary)
Author: Saptarshi Sen
Date: Sat Aug 5 15:28:40 2023 -0700
1 file changed, 1 insertion(+), 1 deletion(-)
Building community edition
Building cmakefiles and deps [CE]
Building main product [CE]
Build CE finished
BUILD_ENTERPRISE empty. Building enterprise edition
Building Enterprise Edition
Building cmakefiles and deps [EE]
Building main product [EE]
Build EE finished
Testing
Started testing at 2023/08/06 21:56:53
Testing mode: sanity,unit,functional,serverless,integration
Using storage type: plasma
Setting ulimit to 200000
Simple Test
Aug 06 21:58:34 suite_setUp (rebalance.rebalancein.RebalanceInTests) ... ok
Aug 06 22:03:00 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Aug 06 22:07:26 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Aug 06 22:08:33 do_warmup_100k (memcapable.WarmUpMemcachedTest) ... ok
Aug 06 22:10:07 b" 'stop_on_failure': 'True'}"
Aug 06 22:10:07 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=50000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True,doc_ops=create;update;delete'
Aug 06 22:10:07 b"{'nodes_in': '3', 'replicas': '1', 'items': '50000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 1, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Aug-06_21-57-17/test_1'}"
Aug 06 22:10:07 b'-->result: '
Aug 06 22:10:07 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0'
Aug 06 22:10:07 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,bucket_type=ephemeral,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Aug 06 22:10:07 b"{'nodes_in': '3', 'bucket_type': 'ephemeral', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 2, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Aug-06_21-57-17/test_2'}"
Aug 06 22:10:07 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Aug 06 22:10:07 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t memcapable.WarmUpMemcachedTest.do_warmup_100k,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True'
Aug 06 22:10:07 b"{'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 3, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Aug-06_21-57-17/test_3'}"
Aug 06 22:10:07 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Aug 06 22:10:07 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Aug 06 22:10:07 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.createdeleteview.CreateDeleteViewTests.test_view_ops,ddoc_ops=create,test_with_view=True,num_ddocs=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,num_views_per_ddoc=10,items=1000,skip_cleanup=False,get-logs-cluster-run=True'
Aug 06 22:10:07 b"{'ddoc_ops': 'create', 'test_with_view': 'True', 'num_ddocs': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'num_views_per_ddoc': '10', 'items': '1000', 'skip_cleanup': 'False', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 4, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Aug-06_21-57-17/test_4'}"
Aug 06 22:10:07 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'ok
Aug 06 22:20:41 test_employee_dataset_startkey_endkey_queries_rebalance_in (view.viewquerytests.ViewQueryTests) ... ok
Aug 06 22:21:29 test_simple_dataset_stale_queries_data_modification (view.viewquerytests.ViewQueryTests) ... ok
Aug 06 22:25:39 load_with_ops (xdcr.uniXDCR.unidirectional) ... ok
Aug 06 22:29:56 load_with_failover (xdcr.uniXDCR.unidirectional) ... ok
Aug 06 22:32:47 suite_tearDown (xdcr.uniXDCR.unidirectional) ... ok
Aug 06 22:32:47 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Aug 06 22:32:47 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Aug 06 22:32:47 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,num_nodes_to_add=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,docs-per-day=1,timeout=1200,get-logs-cluster-run=True'
Aug 06 22:32:47 b"{'num_nodes_to_add': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'docs-per-day': '1', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 5, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Aug-06_21-57-17/test_5'}"
Aug 06 22:32:47 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Aug 06 22:32:47 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Aug 06 22:32:47 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Aug 06 22:32:47 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0'
Aug 06 22:32:47 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'
Aug 06 22:32:47 b"{'num-docs': '1000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 6, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Aug-06_21-57-17/test_6'}"
Aug 06 22:32:47 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Aug 06 22:32:47 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Aug 06 22:32:47 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Aug 06 22:32:47 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Aug 06 22:32:47 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_ops,replicas=1,items=10000,value_size=128,ctopology=chain,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,rdirection=unidirection,doc-ops=update-delete,get-logs-cluster-run=True'
Aug 06 22:32:47 b"{'replicas': '1', 'items': '10000', 'value_size': '128', 'ctopology': 'chain', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 7, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Aug-06_21-57-17/test_7'}"
Aug 06 22:32:47 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Aug 06 22:32:47 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Aug 06 22:32:47 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Aug 06 22:32:47 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Aug 06 22:32:47 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0'
Aug 06 22:32:47 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Aug 06 22:32:47 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Aug-06_21-57-17/test_8'}"
Aug 06 22:32:48 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Aug 06 22:32:48 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Aug 06 22:32:48 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Aug 06 22:32:48 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Aug 06 22:32:48 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0'
Aug 06 22:32:48 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Aug 06 22:32:48 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Aug 06 22:32:48 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Aug 06 22:32:48 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' pass')"
Aug 06 22:32:48 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' pass')"
Aug 06 22:32:48 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' pass')"
Aug 06 22:32:48 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' pass')"
Aug 06 22:32:48 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' pass')"
Aug 06 22:32:48 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' pass')"
Unit tests
=== RUN TestMerger
--- PASS: TestMerger (0.02s)
=== RUN TestInsert
--- PASS: TestInsert (0.00s)
=== RUN TestInsertPerf
16000 items took 17.666313ms -> 905678.5080169247 items/s conflicts 3
--- PASS: TestInsertPerf (0.02s)
=== RUN TestGetPerf
16000 items took 2.627665ms -> 6.089056253365631e+06 items/s
--- PASS: TestGetPerf (0.01s)
=== RUN TestGetRangeSplitItems
{
"node_count": 1000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3350,
"memory_used": 45360,
"node_allocs": 1000,
"node_frees": 0,
"level_node_distribution":{
"level0": 752,
"level1": 190,
"level2": 40,
"level3": 11,
"level4": 4,
"level5": 2,
"level6": 1,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Split range keys [42 118 160 288 386 506 538]
No of items in each range [42 76 42 128 98 120 32 462]
--- PASS: TestGetRangeSplitItems (0.00s)
=== RUN TestBuilder
{
"node_count": 50000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3379,
"memory_used": 2270288,
"node_allocs": 50000,
"node_frees": 0,
"level_node_distribution":{
"level0": 37504,
"level1": 9245,
"level2": 2408,
"level3": 611,
"level4": 177,
"level5": 40,
"level6": 14,
"level7": 1,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 7.889438ms to build 50000 items, 6.3375865e+06 items/sec
Took 2.871344ms to iterate 50000 items
--- PASS: TestBuilder (0.01s)
=== RUN TestNodeDCAS
--- PASS: TestNodeDCAS (0.00s)
PASS
ok github.com/couchbase/nitro/skiplist 0.076s
=== RUN TestZstdSimple
--- PASS: TestZstdSimple (0.00s)
=== RUN TestZstdCompressBound
--- PASS: TestZstdCompressBound (3.13s)
=== RUN TestZstdErrors
--- PASS: TestZstdErrors (0.00s)
=== RUN TestZstdCompressLevels
--- PASS: TestZstdCompressLevels (0.77s)
=== RUN TestZstdEmptySrc
--- PASS: TestZstdEmptySrc (0.00s)
=== RUN TestZstdLargeSrc
--- PASS: TestZstdLargeSrc (0.00s)
PASS
ok github.com/couchbase/plasma/zstd 3.908s
go: downloading github.com/aws/aws-sdk-go-v2 v1.18.0
go: downloading github.com/aws/aws-sdk-go-v2/config v1.18.22
go: downloading github.com/aws/aws-sdk-go-v2/service/s3 v1.33.0
go: downloading github.com/aws/smithy-go v1.13.5
go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.13.3
go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.13.21
go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.3.34
go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.12.9
go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.14.9
go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.18.10
go: downloading github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.4.10
go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.9.11
go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.1.33
go: downloading github.com/aws/aws-sdk-go-v2/internal/v4a v1.0.25
go: downloading github.com/aws/aws-sdk-go-v2/service/internal/checksum v1.1.28
go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.9.27
go: downloading github.com/aws/aws-sdk-go-v2/service/internal/s3shared v1.14.2
go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.4.27
=== RUN TestAutoTunerWriteUsageStats
--- PASS: TestAutoTunerWriteUsageStats (11.66s)
=== RUN TestAutoTunerReadUsageStats
--- PASS: TestAutoTunerReadUsageStats (8.37s)
=== RUN TestAutoTunerCleanerUsageStats
--- PASS: TestAutoTunerCleanerUsageStats (9.28s)
=== RUN TestAutoTunerDiskStats
--- PASS: TestAutoTunerDiskStats (2.50s)
=== RUN TestAutoTunerTargetFragRatio
--- PASS: TestAutoTunerTargetFragRatio (0.00s)
=== RUN TestAutoTunerExcessUsedSpace
--- PASS: TestAutoTunerExcessUsedSpace (0.00s)
=== RUN TestAutoTunerUsedSpaceRatio
--- PASS: TestAutoTunerUsedSpaceRatio (0.00s)
=== RUN TestAutoTunerAdjustFragRatio
--- PASS: TestAutoTunerAdjustFragRatio (0.00s)
=== RUN TestAutoTuneFlushBufferAdjustMemQuotaSingleShard
--- PASS: TestAutoTuneFlushBufferAdjustMemQuotaSingleShard (17.09s)
=== RUN TestAutoTuneFlushBufferAdjustMemQuotaManyShards
--- PASS: TestAutoTuneFlushBufferAdjustMemQuotaManyShards (17.04s)
=== RUN TestAutoTuneFlushBufferRebalanceIdleShards
--- PASS: TestAutoTuneFlushBufferRebalanceIdleShards (15.43s)
=== RUN TestAutoTuneFlushBufferGetUsedMemory
--- PASS: TestAutoTuneFlushBufferGetUsedMemory (27.67s)
=== RUN TestBloom
--- PASS: TestBloom (6.61s)
=== RUN TestBloomDisableEnable
--- PASS: TestBloomDisableEnable (3.85s)
=== RUN TestBloomDisable
--- PASS: TestBloomDisable (0.05s)
=== RUN TestBloomFreeDuringLookup
--- PASS: TestBloomFreeDuringLookup (0.04s)
=== RUN TestBloomRecoveryFreeDuringLookup
--- PASS: TestBloomRecoveryFreeDuringLookup (0.10s)
=== RUN TestBloomRecoverySwapInLookup
--- PASS: TestBloomRecoverySwapInLookup (0.09s)
=== RUN TestBloomRecoverySwapOutLookup
--- PASS: TestBloomRecoverySwapOutLookup (0.11s)
=== RUN TestBloomRecoveryInserts
--- PASS: TestBloomRecoveryInserts (0.09s)
=== RUN TestBloomRecovery
--- PASS: TestBloomRecovery (0.15s)
=== RUN TestBloomStats
--- PASS: TestBloomStats (3.82s)
=== RUN TestBloomStatsRecovery
--- PASS: TestBloomStatsRecovery (1.37s)
=== RUN TestBloomFilterSimple
--- PASS: TestBloomFilterSimple (0.00s)
=== RUN TestBloomFilterConcurrent
--- PASS: TestBloomFilterConcurrent (21.93s)
=== RUN TestBitArrayConcurrent
--- PASS: TestBitArrayConcurrent (1.02s)
=== RUN TestBloomCapacity
--- PASS: TestBloomCapacity (0.00s)
=== RUN TestBloomNumHashFuncs
--- PASS: TestBloomNumHashFuncs (0.00s)
=== RUN TestBloomTestAndAdd
--- PASS: TestBloomTestAndAdd (0.22s)
=== RUN TestBloomReset
--- PASS: TestBloomReset (0.00s)
=== RUN TestLFSCopier
--- PASS: TestLFSCopier (0.00s)
=== RUN TestNodeCopier
--- PASS: TestNodeCopier (0.02s)
=== RUN TestLFSCopierNumBytes
--- PASS: TestLFSCopierNumBytes (0.00s)
=== RUN TestNodeCopierNumBytes
--- PASS: TestNodeCopierNumBytes (0.04s)
=== RUN TestCopierRestoreFile
--- PASS: TestCopierRestoreFile (0.00s)
=== RUN TestCopierUploadDownloadBytes
--- PASS: TestCopierUploadDownloadBytes (0.02s)
=== RUN TestCopierKeyEncoding
--- PASS: TestCopierKeyEncoding (0.23s)
=== RUN TestS3CopierWithRetry
--- PASS: TestS3CopierWithRetry (0.00s)
=== RUN TestS3RateLimitUnsignedPayload
--- PASS: TestS3RateLimitUnsignedPayload (0.00s)
=== RUN TestSBCopyConcurrent
--- PASS: TestSBCopyConcurrent (1.33s)
=== RUN TestSBCopyCorrupt
--- PASS: TestSBCopyCorrupt (0.02s)
=== RUN TestLSSCopyHeadTailSingleSegment
--- PASS: TestLSSCopyHeadTailSingleSegment (0.06s)
=== RUN TestLSSCopyFullSegments
--- PASS: TestLSSCopyFullSegments (0.78s)
=== RUN TestLSSCopyPartialSegments
--- PASS: TestLSSCopyPartialSegments (6.54s)
=== RUN TestLSSCopyHolePunching
--- PASS: TestLSSCopyHolePunching (0.71s)
=== RUN TestLSSCopyConcurrent
--- PASS: TestLSSCopyConcurrent (0.99s)
=== RUN TestLSSCopyHeapUsage
--- PASS: TestLSSCopyHeapUsage (18.24s)
=== RUN TestLSSCopyWithError
--- PASS: TestLSSCopyWithError (0.00s)
=== RUN TestRateLimitReaderSeekOff
--- PASS: TestRateLimitReaderSeekOff (11.80s)
=== RUN TestRateLimitMaxIOPS
--- PASS: TestRateLimitMaxIOPS (15.54s)
=== RUN TestRateLimitConcurrentLSSCopy
--- PASS: TestRateLimitConcurrentLSSCopy (16.16s)
=== RUN TestRateLimitDynamicConcurrentLSSCopy
--- PASS: TestRateLimitDynamicConcurrentLSSCopy (12.89s)
=== RUN TestShardCopySimple
--- PASS: TestShardCopySimple (0.57s)
=== RUN TestShardCopyWithCancel
--- PASS: TestShardCopyWithCancel (10.61s)
=== RUN TestShardCopyNoRP
--- PASS: TestShardCopyNoRP (0.27s)
=== RUN TestShardCopyMetadataCorrupted
--- PASS: TestShardCopyMetadataCorrupted (0.05s)
=== RUN TestShardCopyMetadataCorruptedII
--- PASS: TestShardCopyMetadataCorruptedII (0.17s)
=== RUN TestShardCopyLSSMetadataCorrupted
--- PASS: TestShardCopyLSSMetadataCorrupted (0.12s)
=== RUN TestShardCopyBeforeRecovery
--- PASS: TestShardCopyBeforeRecovery (0.00s)
=== RUN TestShardCopySkipLog
--- PASS: TestShardCopySkipLog (1.17s)
=== RUN TestShardCopyAddInstance
--- PASS: TestShardCopyAddInstance (2.41s)
=== RUN TestShardCopyDestroyInstance
--- PASS: TestShardCopyDestroyInstance (0.46s)
=== RUN TestShardCopyRestoreShard
--- PASS: TestShardCopyRestoreShard (18.17s)
=== RUN TestShardCopyRestoreManyShards
--- PASS: TestShardCopyRestoreManyShards (10.53s)
=== RUN TestShardCopyRestoreConcurrentLogCleaning
--- PASS: TestShardCopyRestoreConcurrentLogCleaning (20.97s)
=== RUN TestShardCopyRestorePartialRollback
--- PASS: TestShardCopyRestorePartialRollback (24.21s)
=== RUN TestInvalidMVCCRollback
--- PASS: TestInvalidMVCCRollback (0.37s)
=== RUN TestShardCopyRestoreConcurrentPurges
--- PASS: TestShardCopyRestoreConcurrentPurges (20.05s)
=== RUN TestShardCopyRestoreRepairHdr
--- PASS: TestShardCopyRestoreRepairHdr (96.42s)
=== RUN TestShardCopyDuplicateIndex
--- PASS: TestShardCopyDuplicateIndex (0.29s)
=== RUN TestShardCopyEmptyIndex
--- PASS: TestShardCopyEmptyIndex (0.20s)
=== RUN TestTenantCopy
--- PASS: TestTenantCopy (6.83s)
=== RUN TestLockShardAddInstance
--- PASS: TestLockShardAddInstance (0.34s)
=== RUN TestLockShardAddInstanceMapping
--- PASS: TestLockShardAddInstanceMapping (0.27s)
=== RUN TestLockShardCloseInstance
--- PASS: TestLockShardCloseInstance (0.47s)
=== RUN TestLockShardEmptyShard
--- PASS: TestLockShardEmptyShard (0.21s)
=== RUN TestLockShardUseShardId
--- PASS: TestLockShardUseShardId (0.28s)
=== RUN TestLockShardUseShardIdII
--- PASS: TestLockShardUseShardIdII (0.05s)
=== RUN TestDestroyShardID
--- PASS: TestDestroyShardID (1.21s)
=== RUN TestDestroyShardIDConcurrent
--- PASS: TestDestroyShardIDConcurrent (0.18s)
=== RUN TestDestroyShardIDNumTenants
--- PASS: TestDestroyShardIDNumTenants (0.57s)
=== RUN TestDestroyShardIDTenantAddRemove
--- PASS: TestDestroyShardIDTenantAddRemove (0.25s)
=== RUN TestDestroyShardIDOnRestoreFailure
--- PASS: TestDestroyShardIDOnRestoreFailure (0.75s)
=== RUN TestDestroyShardIDOnRestoreFailure2
--- PASS: TestDestroyShardIDOnRestoreFailure2 (0.99s)
=== RUN TestTransferShardAPI
--- PASS: TestTransferShardAPI (284.03s)
=== RUN TestTransferShardAPICreateIndexes
--- PASS: TestTransferShardAPICreateIndexes (19.25s)
=== RUN TestTransferShardAPIWithDropIndexes
--- PASS: TestTransferShardAPIWithDropIndexes (6.33s)
=== RUN TestTransferShardAPIWithCancel
--- PASS: TestTransferShardAPIWithCancel (6.84s)
=== RUN TestTransferShardAPIWithCleanup
--- PASS: TestTransferShardAPIWithCleanup (88.73s)
=== RUN TestRestoreShardAPI
--- PASS: TestRestoreShardAPI (6.61s)
=== RUN TestRestoreShardNumShards
--- PASS: TestRestoreShardNumShards (0.37s)
=== RUN TestRestoreShardInvalidLocation
--- PASS: TestRestoreShardInvalidLocation (0.12s)
=== RUN TestRestoreShardReplicaRepair
--- PASS: TestRestoreShardReplicaRepair (19.60s)
=== RUN TestRestoreShardDone
--- PASS: TestRestoreShardDone (0.95s)
=== RUN TestRestoreShardDoneConcurrent
--- PASS: TestRestoreShardDoneConcurrent (1.79s)
=== RUN TestRestoreShardDoneDroppedInstances
--- PASS: TestRestoreShardDoneDroppedInstances (1.29s)
=== RUN TestShardDoCleanupAPI
--- PASS: TestShardDoCleanupAPI (1.23s)
=== RUN TestShardDoCleanupAPI2
--- PASS: TestShardDoCleanupAPI2 (25.29s)
=== RUN TestRestoreShardPauseResume
--- PASS: TestRestoreShardPauseResume (13.20s)
=== RUN TestRateLimitConcurrentTransferRestoreShard
--- PASS: TestRateLimitConcurrentTransferRestoreShard (388.34s)
=== RUN TestDiag
--- PASS: TestDiag (0.70s)
=== RUN TestDumpLog
--- PASS: TestDumpLog (0.11s)
=== RUN TestExtrasN1
=== RUN TestExtrasN2
=== RUN TestExtrasN3
=== RUN TestGMRecovery
--- PASS: TestGMRecovery (13.29s)
=== RUN TestIteratorSimple
--- PASS: TestIteratorSimple (4.67s)
=== RUN TestIteratorSeek
--- PASS: TestIteratorSeek (5.84s)
=== RUN TestPlasmaIteratorSeekFirst
--- PASS: TestPlasmaIteratorSeekFirst (0.56s)
=== RUN TestPlasmaIteratorSwapin
--- PASS: TestPlasmaIteratorSwapin (4.96s)
=== RUN TestIteratorSetEnd
--- PASS: TestIteratorSetEnd (0.77s)
=== RUN TestIterHiItm
--- PASS: TestIterHiItm (2.73s)
=== RUN TestIterDeleteSplitMerge
--- PASS: TestIterDeleteSplitMerge (0.07s)
=== RUN TestKeySamplingSingle
--- PASS: TestKeySamplingSingle (0.15s)
=== RUN TestKeySamplingAll
--- PASS: TestKeySamplingAll (0.16s)
=== RUN TestKeySamplingEmpty
--- PASS: TestKeySamplingEmpty (0.04s)
=== RUN TestKeySamplingExceed
--- PASS: TestKeySamplingExceed (0.17s)
=== RUN TestLogOperation
--- PASS: TestLogOperation (60.06s)
=== RUN TestLogLargeSize
--- PASS: TestLogLargeSize (0.16s)
=== RUN TestLogTrim
--- PASS: TestLogTrim (60.62s)
=== RUN TestLogSuperblockCorruption
--- PASS: TestLogSuperblockCorruption (59.20s)
=== RUN TestLogTrimHolePunch
--- PASS: TestLogTrimHolePunch (49.89s)
=== RUN TestLogMissingAndTruncatedSegments
--- PASS: TestLogMissingAndTruncatedSegments (0.07s)
=== RUN TestLogReadBeyondMaxFileIndex
--- PASS: TestLogReadBeyondMaxFileIndex (2.65s)
=== RUN TestLogReadEOFWithMMap
--- PASS: TestLogReadEOFWithMMap (0.00s)
=== RUN TestLogLargeTrim
--- PASS: TestLogLargeTrim (0.01s)
=== RUN TestLSSCleaningRewrite
--- PASS: TestLSSCleaningRewrite (0.66s)
=== RUN TestShardLSSCleaning
--- PASS: TestShardLSSCleaning (0.27s)
=== RUN TestShardLSSCleaningDeleteInstance
--- PASS: TestShardLSSCleaningDeleteInstance (0.29s)
=== RUN TestShardLSSCleaningCorruptInstance
--- PASS: TestShardLSSCleaningCorruptInstance (0.28s)
=== RUN TestPlasmaLSSCleaner
--- PASS: TestPlasmaLSSCleaner (218.53s)
=== RUN TestPlasmaLSSCleanerMinSize
--- PASS: TestPlasmaLSSCleanerMinSize (12.16s)
=== RUN TestSharedLSSCleanerAllDestroyedInstances
--- PASS: TestSharedLSSCleanerAllDestroyedInstances (255.61s)
=== RUN TestLSSCleanerSyncWithConcurrentWriterRecovery
--- PASS: TestLSSCleanerSyncWithConcurrentWriterRecovery (257.34s)
=== RUN TestLSSCleanerSyncWithConcurrentWriterRecoveryDGM
--- PASS: TestLSSCleanerSyncWithConcurrentWriterRecoveryDGM (336.93s)
=== RUN TestLSSCleanerSyncWithMultiWriterRecovery
--- PASS: TestLSSCleanerSyncWithMultiWriterRecovery (109.58s)
=== RUN TestLSSCleanerSyncWithMultiWriterRecoveryBigKeys
--- PASS: TestLSSCleanerSyncWithMultiWriterRecoveryBigKeys (90.87s)
=== RUN TestLSSBasic
--- PASS: TestLSSBasic (0.10s)
=== RUN TestLSSConcurrent
--- PASS: TestLSSConcurrent (0.84s)
=== RUN TestLSSCleaner
--- PASS: TestLSSCleaner (12.22s)
=== RUN TestLSSSuperBlock
--- PASS: TestLSSSuperBlock (1.12s)
=== RUN TestLSSLargeSinglePayload
--- PASS: TestLSSLargeSinglePayload (0.85s)
=== RUN TestLSSUnstableEnvironment
--- PASS: TestLSSUnstableEnvironment (10.21s)
=== RUN TestLSSSmallFlushBuffer
--- PASS: TestLSSSmallFlushBuffer (0.01s)
=== RUN TestLSSTrimFlushBufferGC
--- PASS: TestLSSTrimFlushBufferGC (1.59s)
=== RUN TestLSSTrimFlushBufferNoIO
--- PASS: TestLSSTrimFlushBufferNoIO (30.01s)
=== RUN TestLSSTrimFlushBufferWithIO
--- PASS: TestLSSTrimFlushBufferWithIO (33.22s)
=== RUN TestLSSExtendFlushBufferWithIO
--- PASS: TestLSSExtendFlushBufferWithIO (30.01s)
=== RUN TestLSSCtxTrimFlushBuffer
--- PASS: TestLSSCtxTrimFlushBuffer (5.49s)
=== RUN TestLSSNegativeGetFlushBufferMemory
--- PASS: TestLSSNegativeGetFlushBufferMemory (0.02s)
=== RUN TestLSSNegativeGetFlushBufferMemoryII
--- PASS: TestLSSNegativeGetFlushBufferMemoryII (0.03s)
=== RUN TestMem
Plasma: Adaptive memory quota tuning (decrementing): RSS:6854148096, freePercent:53.81273724837173, currentQuota=1099511627776, newQuota=1073741824, netGrowth=0, percent=99Plasma: Adaptive memory quota tuning (incrementing): RSS:6853685248, freePercent: 53.8139819168212, currentQuota=0, newQuota=10995116277--- PASS: TestMem (15.02s)
=== RUN TestCpu
--- PASS: TestCpu (14.47s)
=== RUN TestTopTen20
--- PASS: TestTopTen20 (0.98s)
=== RUN TestTopTen5
--- PASS: TestTopTen5 (0.24s)
=== RUN TestMVCCSimple
--- PASS: TestMVCCSimple (0.29s)
=== RUN TestMVCCLookup
--- PASS: TestMVCCLookup (0.19s)
=== RUN TestMVCCIteratorRefresh
--- PASS: TestMVCCIteratorRefresh (5.32s)
=== RUN TestMVCCIteratorRefreshEveryRow
--- PASS: TestMVCCIteratorRefreshEveryRow (1.28s)
=== RUN TestMVCCGarbageCollection
--- PASS: TestMVCCGarbageCollection (0.13s)
=== RUN TestMVCCRecoveryPoint
--- PASS: TestMVCCRecoveryPoint (2.84s)
=== RUN TestMVCCRollbackMergeSibling
--- PASS: TestMVCCRollbackMergeSibling (0.09s)
=== RUN TestMVCCRollbackCompact
--- PASS: TestMVCCRollbackCompact (0.08s)
=== RUN TestMVCCRollbackSplit
--- PASS: TestMVCCRollbackSplit (0.09s)
=== RUN TestMVCCRollbackItemsNotInSnapshot
--- PASS: TestMVCCRollbackItemsNotInSnapshot (0.21s)
=== RUN TestMVCCRecoveryPointRollbackedSnapshot
--- PASS: TestMVCCRecoveryPointRollbackedSnapshot (1.39s)
=== RUN TestMVCCRollbackBetweenRecoveryPoint
--- PASS: TestMVCCRollbackBetweenRecoveryPoint (1.40s)
=== RUN TestMVCCRecoveryPointCrash
--- PASS: TestMVCCRecoveryPointCrash (0.11s)
=== RUN TestMVCCIntervalGC
--- PASS: TestMVCCIntervalGC (0.28s)
=== RUN TestMVCCItemsCount
--- PASS: TestMVCCItemsCount (0.50s)
=== RUN TestLargeItems
--- PASS: TestLargeItems (112.82s)
=== RUN TestTooLargeKey
--- PASS: TestTooLargeKey (3.55s)
=== RUN TestMVCCItemUpdateSize
--- PASS: TestMVCCItemUpdateSize (0.31s)
=== RUN TestEvictionStats
--- PASS: TestEvictionStats (0.68s)
=== RUN TestReaderCacheStats
--- PASS: TestReaderCacheStats (1.18s)
=== RUN TestInvalidSnapshot
--- PASS: TestInvalidSnapshot (1.38s)
=== RUN TestEmptyKeyInsert
--- PASS: TestEmptyKeyInsert (0.04s)
=== RUN TestMVCCRecoveryPointError
--- PASS: TestMVCCRecoveryPointError (0.07s)
=== RUN TestMVCCReaderPurgeSequential
--- PASS: TestMVCCReaderPurgeSequential (0.31s)
=== RUN TestMVCCReaderNoPurge
--- PASS: TestMVCCReaderNoPurge (0.29s)
=== RUN TestMVCCReaderPurgeAfterUpdate
--- PASS: TestMVCCReaderPurgeAfterUpdate (0.31s)
=== RUN TestMVCCReaderPurgeAfterRollback
--- PASS: TestMVCCReaderPurgeAfterRollback (0.33s)
=== RUN TestMVCCReaderPurgeSimple
--- PASS: TestMVCCReaderPurgeSimple (0.08s)
=== RUN TestMVCCReaderPurgeRandom
--- PASS: TestMVCCReaderPurgeRandom (0.29s)
=== RUN TestMVCCReaderPurgePageFlag
--- PASS: TestMVCCReaderPurgePageFlag (0.17s)
=== RUN TestMVCCPurgeRatioWithRollback
--- PASS: TestMVCCPurgeRatioWithRollback (16.34s)
=== RUN TestComputeItemsCountMVCCWithRollbackI
--- PASS: TestComputeItemsCountMVCCWithRollbackI (0.09s)
=== RUN TestComputeItemsCountMVCCWithRollbackII
--- PASS: TestComputeItemsCountMVCCWithRollbackII (0.09s)
=== RUN TestComputeItemsCountMVCCWithRollbackIII
--- PASS: TestComputeItemsCountMVCCWithRollbackIII (0.06s)
=== RUN TestComputeItemsCountMVCCWithRollbackIV
--- PASS: TestComputeItemsCountMVCCWithRollbackIV (0.13s)
=== RUN TestMVCCPurgedRecordsWithCompactFullMarshalAndCascadedEmptyPagesMerge
--- PASS: TestMVCCPurgedRecordsWithCompactFullMarshalAndCascadedEmptyPagesMerge (2.75s)
=== RUN TestMaxDeltaChainLenWithCascadedEmptyPagesMerge
--- PASS: TestMaxDeltaChainLenWithCascadedEmptyPagesMerge (2.49s)
=== RUN TestAutoHoleCleaner
--- PASS: TestAutoHoleCleaner (48.31s)
=== RUN TestAutoHoleCleaner5Indexes
--- PASS: TestAutoHoleCleaner5Indexes (279.26s)
=== RUN TestIteratorReportedHoleRegionBoundary
--- PASS: TestIteratorReportedHoleRegionBoundary (0.16s)
=== RUN TestFullRangeHoleScans
--- PASS: TestFullRangeHoleScans (0.51s)
=== RUN TestOverlappingRangeHoleScans
--- PASS: TestOverlappingRangeHoleScans (0.53s)
=== RUN TestMVCCIteratorSMRRefreshOnHoleScan
--- PASS: TestMVCCIteratorSMRRefreshOnHoleScan (12.19s)
=== RUN TestAutoHoleCleanerWithRecovery
--- PASS: TestAutoHoleCleanerWithRecovery (2.41s)
=== RUN TestPageMergeCorrectness2
--- PASS: TestPageMergeCorrectness2 (0.00s)
=== RUN TestPageMergeCorrectness
--- PASS: TestPageMergeCorrectness (0.01s)
=== RUN TestPageMarshalFull
--- PASS: TestPageMarshalFull (0.01s)
=== RUN TestPageMergeMarshal
--- PASS: TestPageMergeMarshal (0.00s)
=== RUN TestPageOperations
--- PASS: TestPageOperations (0.03s)
=== RUN TestPageIterator
--- PASS: TestPageIterator (0.00s)
=== RUN TestPageMarshal
--- PASS: TestPageMarshal (0.02s)
=== RUN TestPageMergeCorrectness3
--- PASS: TestPageMergeCorrectness3 (0.00s)
=== RUN TestPageHasDataRecords
--- PASS: TestPageHasDataRecords (0.00s)
=== RUN TestPlasmaPageVisitor
--- PASS: TestPlasmaPageVisitor (4.54s)
=== RUN TestPageRingVisitor
--- PASS: TestPageRingVisitor (4.33s)
=== RUN TestPauseVisitorOnLowMemory
--- PASS: TestPauseVisitorOnLowMemory (1.17s)
=== RUN TestCheckpointRecovery
--- PASS: TestCheckpointRecovery (12.60s)
=== RUN TestPageCorruption
--- PASS: TestPageCorruption (1.30s)
=== RUN TestCheckPointRecoveryFollowCleaning
--- PASS: TestCheckPointRecoveryFollowCleaning (0.11s)
=== RUN TestFragmentationWithZeroItems
--- PASS: TestFragmentationWithZeroItems (1.14s)
=== RUN TestEvictOnPersist
--- PASS: TestEvictOnPersist (0.24s)
=== RUN TestPlasmaSimple
--- PASS: TestPlasmaSimple (13.63s)
=== RUN TestPlasmaCompression
--- PASS: TestPlasmaCompression (0.03s)
=== RUN TestPlasmaCompressionWrong
--- PASS: TestPlasmaCompressionWrong (0.05s)
=== RUN TestPlasmaInMemCompression
--- PASS: TestPlasmaInMemCompression (0.04s)
=== RUN TestPlasmaInMemCompressionZstd
--- PASS: TestPlasmaInMemCompressionZstd (0.03s)
=== RUN TestPlasmaInMemCompressionWrong
--- PASS: TestPlasmaInMemCompressionWrong (0.03s)
=== RUN TestSpoiledConfig
--- PASS: TestSpoiledConfig (0.07s)
=== RUN TestPlasmaErrorFile
--- PASS: TestPlasmaErrorFile (0.04s)
=== RUN TestPlasmaPersistor
--- PASS: TestPlasmaPersistor (9.92s)
=== RUN TestPlasmaEvictionLSSDataSize
--- PASS: TestPlasmaEvictionLSSDataSize (0.04s)
=== RUN TestPlasmaEviction
--- PASS: TestPlasmaEviction (29.49s)
=== RUN TestConcurrDelOps
--- PASS: TestConcurrDelOps (73.94s)
=== RUN TestPlasmaDataSize
--- PASS: TestPlasmaDataSize (0.05s)
=== RUN TestLargeBasePage
--- PASS: TestLargeBasePage (41.37s)
=== RUN TestLargeValue
--- PASS: TestLargeValue (102.14s)
=== RUN TestPlasmaTooLargeKey
--- PASS: TestPlasmaTooLargeKey (3.56s)
=== RUN TestEvictAfterMerge
--- PASS: TestEvictAfterMerge (0.18s)
=== RUN TestEvictDirty
--- PASS: TestEvictDirty (0.21s)
=== RUN TestEvictUnderQuota
--- PASS: TestEvictUnderQuota (60.16s)
=== RUN TestEvictSetting
--- PASS: TestEvictSetting (1.26s)
=== RUN TestBasePageAfterCompaction
--- PASS: TestBasePageAfterCompaction (0.18s)
=== RUN TestSwapout
--- PASS: TestSwapout (0.05s)
=== RUN TestSwapoutSplitBasePage
--- PASS: TestSwapoutSplitBasePage (0.04s)
=== RUN TestCompactFullMarshal
--- PASS: TestCompactFullMarshal (0.08s)
=== RUN TestPageStats
--- PASS: TestPageStats (2.99s)
=== RUN TestPageStatsTinyIndex
--- PASS: TestPageStatsTinyIndex (0.14s)
=== RUN TestPageStatsTinyIndexOnRecovery
--- PASS: TestPageStatsTinyIndexOnRecovery (0.10s)
=== RUN TestPageStatsTinyIndexOnSplitAndMerge
--- PASS: TestPageStatsTinyIndexOnSplitAndMerge (0.06s)
=== RUN TestPageCompress
--- PASS: TestPageCompress (0.04s)
=== RUN TestPageCompressSwapin
--- PASS: TestPageCompressSwapin (0.09s)
=== RUN TestPageCompressStats
--- PASS: TestPageCompressStats (1.13s)
=== RUN TestPageDecompressStats
--- PASS: TestPageDecompressStats (0.08s)
=== RUN TestSharedDedicatedDataSize
--- PASS: TestSharedDedicatedDataSize (5.17s)
=== RUN TestLastRpSns
--- PASS: TestLastRpSns (0.07s)
=== RUN TestPageCompressState
--- PASS: TestPageCompressState (0.04s)
=== RUN TestPageCompressDuringBurst
--- PASS: TestPageCompressDuringBurst (0.07s)
=== RUN TestPageDontDecompressDuringScan
--- PASS: TestPageDontDecompressDuringScan (0.16s)
=== RUN TestPageDecompressAndCompressSwapin
--- PASS: TestPageDecompressAndCompressSwapin (2.06s)
=== RUN TestPageCompressibleStat
--- PASS: TestPageCompressibleStat (0.60s)
=== RUN TestPageCompressibleStatRecovery
--- PASS: TestPageCompressibleStatRecovery (0.20s)
=== RUN TestPageCompressBeforeEvictPercent
--- PASS: TestPageCompressBeforeEvictPercent (1.19s)
=== RUN TestPageCompressDecompressAfterDisable
--- PASS: TestPageCompressDecompressAfterDisable (1.18s)
=== RUN TestPageKeepSwapinChainCompressed
--- PASS: TestPageKeepSwapinChainCompressed (0.08s)
=== RUN TestEnforceSameCompressionAlgo
--- PASS: TestEnforceSameCompressionAlgo (0.24s)
=== RUN TestPageCompressChangeAlgo
--- PASS: TestPageCompressChangeAlgo (0.75s)
=== RUN TestPageCompressAlgoMixedWithScan
--- PASS: TestPageCompressAlgoMixedWithScan (6.21s)
=== RUN TestWrittenDataSz
--- PASS: TestWrittenDataSz (3.92s)
=== RUN TestWrittenDataSzAfterRecoveryCleaning
--- PASS: TestWrittenDataSzAfterRecoveryCleaning (4.51s)
=== RUN TestWrittenHdrSz
--- PASS: TestWrittenHdrSz (3.91s)
=== RUN TestPersistConfigUpgrade
--- PASS: TestPersistConfigUpgrade (0.01s)
=== RUN TestLSSSegmentSize
--- PASS: TestLSSSegmentSize (0.20s)
=== RUN TestPlasmaFlushBufferSzCfg
--- PASS: TestPlasmaFlushBufferSzCfg (0.15s)
=== RUN TestCompactionCountwithCompactFullMarshal
--- PASS: TestCompactionCountwithCompactFullMarshal (0.12s)
=== RUN TestCompactionCountwithCompactFullMarshalSMO
--- PASS: TestCompactionCountwithCompactFullMarshalSMO (0.03s)
=== RUN TestPageHasDataRecordsOnCompactFullMarshal
--- PASS: TestPageHasDataRecordsOnCompactFullMarshal (0.11s)
=== RUN TestPauseReaderOnLowMemory
--- PASS: TestPauseReaderOnLowMemory (1.05s)
=== RUN TestRecoveryCleanerFragRatio
--- PASS: TestRecoveryCleanerFragRatio (224.63s)
=== RUN TestRecoveryCleanerRelocation
--- PASS: TestRecoveryCleanerRelocation (224.69s)
=== RUN TestRecoveryCleanerDataSize
--- PASS: TestRecoveryCleanerDataSize (224.77s)
=== RUN TestRecoveryCleanerDeleteInstance
--- PASS: TestRecoveryCleanerDeleteInstance (435.34s)
=== RUN TestRecoveryCleanerRecoveryPoint
--- PASS: TestRecoveryCleanerRecoveryPoint (40.85s)
=== RUN TestRecoveryCleanerCorruptInstance
--- PASS: TestRecoveryCleanerCorruptInstance (0.26s)
=== RUN TestRecoveryCleanerAhead
--- PASS: TestRecoveryCleanerAhead (4.24s)
=== RUN TestRecoveryCleanerAheadAfterRecovery
--- PASS: TestRecoveryCleanerAheadAfterRecovery (2.24s)
=== RUN TestCleaningUncommittedData
--- PASS: TestCleaningUncommittedData (0.06s)
=== RUN TestPlasmaRecoverySimple
--- PASS: TestPlasmaRecoverySimple (0.05s)
=== RUN TestPlasmaRecovery
--- PASS: TestPlasmaRecovery (30.58s)
=== RUN TestRecoverDedicatedAsShared
--- PASS: TestRecoverDedicatedAsShared (0.10s)
=== RUN TestRecoverDedicatedAsSharedDeleteShardMeta
--- PASS: TestRecoverDedicatedAsSharedDeleteShardMeta (0.13s)
=== RUN TestRecoverDedicatedAsSharedCorruptDataLog
--- PASS: TestRecoverDedicatedAsSharedCorruptDataLog (0.07s)
=== RUN TestShardRecoveryShared
--- PASS: TestShardRecoveryShared (15.83s)
=== RUN TestShardRecoveryRecoveryLogAhead
--- PASS: TestShardRecoveryRecoveryLogAhead (48.25s)
=== RUN TestShardRecoveryDataLogAhead
--- PASS: TestShardRecoveryDataLogAhead (31.96s)
=== RUN TestShardRecoveryDestroyBlksInDataLog
--- PASS: TestShardRecoveryDestroyBlksInDataLog (14.84s)
=== RUN TestShardRecoveryDestroyBlksInRecoveryLog
--- PASS: TestShardRecoveryDestroyBlksInRecoveryLog (15.18s)
=== RUN TestShardRecoveryDestroyBlksInBothLog
--- PASS: TestShardRecoveryDestroyBlksInBothLog (14.83s)
=== RUN TestShardRecoveryRecoveryLogCorruption
--- PASS: TestShardRecoveryRecoveryLogCorruption (14.55s)
=== RUN TestShardRecoveryRecoveryLogCorruptionServerless
--- PASS: TestShardRecoveryRecoveryLogCorruptionServerless (14.70s)
=== RUN TestShardRecoveryDataLogCorruption
--- PASS: TestShardRecoveryDataLogCorruption (15.37s)
=== RUN TestShardRecoveryDataLogCorruptionServerless
--- PASS: TestShardRecoveryDataLogCorruptionServerless (15.84s)
=== RUN TestShardRecoverySharedNoRP
--- PASS: TestShardRecoverySharedNoRP (15.15s)
=== RUN TestShardRecoveryNotEnoughMem
--- PASS: TestShardRecoveryNotEnoughMem (39.64s)
=== RUN TestShardRecoveryCleanup
--- PASS: TestShardRecoveryCleanup (0.51s)
=== RUN TestShardRecoveryRebuildSharedLog
--- PASS: TestShardRecoveryRebuildSharedLog (1.80s)
=== RUN TestShardRecoveryUpgradeWithCheckpoint
--- PASS: TestShardRecoveryUpgradeWithCheckpoint (0.63s)
=== RUN TestShardRecoveryUpgradeWithLogReplay
--- PASS: TestShardRecoveryUpgradeWithLogReplay (0.60s)
=== RUN TestShardRecoveryRebuildAfterError
--- PASS: TestShardRecoveryRebuildAfterError (1.80s)
=== RUN TestShardRecoveryRebuildAfterConcurrentDelete
--- PASS: TestShardRecoveryRebuildAfterConcurrentDelete (2.60s)
=== RUN TestShardRecoveryAfterDeleteInstance
--- PASS: TestShardRecoveryAfterDeleteInstance (0.15s)
=== RUN TestShardRecoveryDestroyShard
--- PASS: TestShardRecoveryDestroyShard (0.27s)
=== RUN TestHeaderRepair
--- PASS: TestHeaderRepair (0.07s)
=== RUN TestCheckpointWithWriter
--- PASS: TestCheckpointWithWriter (4.87s)
=== RUN TestPlasmaRecoveryWithRepairFullReplay
--- PASS: TestPlasmaRecoveryWithRepairFullReplay (28.05s)
=== RUN TestPlasmaRecoveryWithInsertRepairCheckpoint
--- PASS: TestPlasmaRecoveryWithInsertRepairCheckpoint (32.06s)
=== RUN TestPlasmaRecoveryWithDeleteRepairCheckpoint
--- PASS: TestPlasmaRecoveryWithDeleteRepairCheckpoint (20.19s)
=== RUN TestShardRecoverySharedFullReplayOnError
--- PASS: TestShardRecoverySharedFullReplayOnError (17.00s)
=== RUN TestShardRecoverySharedFullReplayOnErrorServerless
--- PASS: TestShardRecoverySharedFullReplayOnErrorServerless (17.91s)
=== RUN TestShardRecoveryDedicatedFullReplayOnError
--- PASS: TestShardRecoveryDedicatedFullReplayOnError (16.92s)
=== RUN TestShardRecoveryDedicatedFullReplayOnErrorServerless
--- PASS: TestShardRecoveryDedicatedFullReplayOnErrorServerless (17.83s)
=== RUN TestShardRecoverySharedFullReplayOnErrorWithRepair
--- PASS: TestShardRecoverySharedFullReplayOnErrorWithRepair (19.52s)
=== RUN TestGlobalWorkContextForRecovery
--- PASS: TestGlobalWorkContextForRecovery (0.48s)
=== RUN TestShardRecoveryPartialMetadata
--- PASS: TestShardRecoveryPartialMetadata (0.12s)
=== RUN TestShardRecoveryPartialLSSMetadata
--- PASS: TestShardRecoveryPartialLSSMetadata (0.09s)
=== RUN TestShardRecoveryPartialSkiplog
--- PASS: TestShardRecoveryPartialSkiplog (0.12s)
=== RUN TestShardRecoveryTempSkiplog
--- PASS: TestShardRecoveryTempSkiplog (0.24s)
=== RUN TestPageRemovalLargeKey
--- PASS: TestPageRemovalLargeKey (0.04s)
=== RUN TestRpVersionOverflow
--- PASS: TestRpVersionOverflow (0.10s)
=== RUN TestRecoveryCancelHeaderReplay
--- PASS: TestRecoveryCancelHeaderReplay (2.41s)
=== RUN TestRecoveryCancelWithDelay
--- PASS: TestRecoveryCancelWithDelay (2.50s)
=== RUN TestRecoveryCancelWithDataReplay
--- PASS: TestRecoveryCancelWithDataReplay (0.35s)
=== RUN TestShardRecoveryInstPathErrorString
--- PASS: TestShardRecoveryInstPathErrorString (0.03s)
=== RUN TestSkipLogSimple
--- PASS: TestSkipLogSimple (0.00s)
=== RUN TestSkipLogLoadStore
--- PASS: TestSkipLogLoadStore (0.03s)
=== RUN TestRPCSimple
--- PASS: TestRPCSimple (0.02s)
=== RUN TestRPCOpenClose
--- PASS: TestRPCOpenClose (4.05s)
=== RUN TestRPCWritePartialPart
--- PASS: TestRPCWritePartialPart (0.03s)
=== RUN TestRPCWriteMultiPart
--- PASS: TestRPCWriteMultiPart (18.55s)
=== RUN TestRPCWriteUnAlignedHeadTailWithChecksum
--- PASS: TestRPCWriteUnAlignedHeadTailWithChecksum (11.57s)
=== RUN TestRPCDoubleOpenWithStaleWrites
--- PASS: TestRPCDoubleOpenWithStaleWrites (22.96s)
=== RUN TestRPCRmDirBusy
--- PASS: TestRPCRmDirBusy (9.93s)
=== RUN TestRPCServerGCIdleHandle
--- PASS: TestRPCServerGCIdleHandle (15.01s)
=== RUN TestRPCServerShutdownWithIO
--- PASS: TestRPCServerShutdownWithIO (73.53s)
=== RUN TestRPCServerShutdownBusy
--- PASS: TestRPCServerShutdownBusy (10.06s)
=== RUN TestRPCServerBindWithRetry
--- PASS: TestRPCServerBindWithRetry (1.50s)
=== RUN TestRPCClientWithCorruptRequest
--- PASS: TestRPCClientWithCorruptRequest (3.17s)
=== RUN TestRPCClientWithCorruptReqHeaders
--- PASS: TestRPCClientWithCorruptReqHeaders (0.02s)
=== RUN TestRPCWithCorruptResponse
--- PASS: TestRPCWithCorruptResponse (0.01s)
=== RUN TestRPCVersion
--- PASS: TestRPCVersion (0.00s)
=== RUN TestRPCSyncFileIdempotent
--- PASS: TestRPCSyncFileIdempotent (10.06s)
=== RUN TestRPCSyncFileError
--- PASS: TestRPCSyncFileError (0.01s)
=== RUN TestRPCOpenWithRetry
--- PASS: TestRPCOpenWithRetry (5.01s)
=== RUN TestRPCOpenWithDialTimeout
--- PASS: TestRPCOpenWithDialTimeout (0.13s)
=== RUN TestRPCWriteRetryWithDigest
--- PASS: TestRPCWriteRetryWithDigest (40.44s)
=== RUN TestRPCWithThrottle
--- PASS: TestRPCWithThrottle (48.08s)
=== RUN TestRPCWriteEmptyFile
--- PASS: TestRPCWriteEmptyFile (0.03s)
=== RUN TestRPCPersistentConnections
--- PASS: TestRPCPersistentConnections (2.21s)
=== RUN TestRPCClientEOF
--- PASS: TestRPCClientEOF (9.23s)
=== RUN TestRPCServerWithHTTPS
--- PASS: TestRPCServerWithHTTPS (9.62s)
=== RUN TestShardMetadata
--- PASS: TestShardMetadata (0.92s)
=== RUN TestPlasmaId
--- PASS: TestPlasmaId (0.05s)
=== RUN TestShardPersistence
--- PASS: TestShardPersistence (0.32s)
=== RUN TestShardDestroy
--- PASS: TestShardDestroy (0.05s)
=== RUN TestShardClose
--- PASS: TestShardClose (5.03s)
=== RUN TestShardMgrRecovery
--- PASS: TestShardMgrRecovery (0.11s)
=== RUN TestShardDeadData
--- PASS: TestShardDeadData (0.31s)
=== RUN TestShardDeadDataNegativeFlushDataSize
--- PASS: TestShardDeadDataNegativeFlushDataSize (0.54s)
=== RUN TestShardConfigUpdate
--- PASS: TestShardConfigUpdate (0.03s)
=== RUN TestShardWriteAmp
--- PASS: TestShardWriteAmp (10.18s)
=== RUN TestShardStats
--- PASS: TestShardStats (0.25s)
=== RUN TestShardCompressionStats
--- PASS: TestShardCompressionStats (2.39s)
=== RUN TestShardMultipleWriters
--- PASS: TestShardMultipleWriters (0.18s)
=== RUN TestShardDestroyMultiple
--- PASS: TestShardDestroyMultiple (0.16s)
=== RUN TestShardBackupCorrupted
--- PASS: TestShardBackupCorrupted (0.16s)
=== RUN TestShardBackupCorruptedShare
--- PASS: TestShardBackupCorruptedShare (0.06s)
=== RUN TestShardCorruption
--- PASS: TestShardCorruption (0.14s)
=== RUN TestShardCorruptionAddInstance
--- PASS: TestShardCorruptionAddInstance (0.19s)
=== RUN TestShardCreateError
--- PASS: TestShardCreateError (0.25s)
=== RUN TestShardNumInsts
--- PASS: TestShardNumInsts (1.75s)
=== RUN TestShardInstanceGroup
--- PASS: TestShardInstanceGroup (0.07s)
=== RUN TestShardLeak
--- PASS: TestShardLeak (2.04s)
=== RUN TestShardMemLeak
--- PASS: TestShardMemLeak (1.05s)
=== RUN TestShardFind
--- PASS: TestShardFind (0.24s)
=== RUN TestShardFileOpenDescCount
--- PASS: TestShardFileOpenDescCount (87.27s)
=== RUN TestShardShutdownSharedLSS
--- PASS: TestShardShutdownSharedLSS (11.50s)
=== RUN TestShardUUIDChange
--- PASS: TestShardUUIDChange (0.05s)
=== RUN TestShardUUIDStable
--- PASS: TestShardUUIDStable (0.08s)
=== RUN TestShardUUIDUpgradeDedicated
--- PASS: TestShardUUIDUpgradeDedicated (0.08s)
=== RUN TestShardUUIDUpgradeShared
--- PASS: TestShardUUIDUpgradeShared (0.10s)
=== RUN TestShardMetadataPersistenceOnPanic
--- PASS: TestShardMetadataPersistenceOnPanic (0.13s)
=== RUN TestShardAlternateId
--- PASS: TestShardAlternateId (0.16s)
=== RUN TestSMRSimple
--- PASS: TestSMRSimple (1.12s)
=== RUN TestSMRConcurrent
--- PASS: TestSMRConcurrent (74.31s)
=== RUN TestSMRComplex
--- PASS: TestSMRComplex (148.32s)
=== RUN TestDGMWithCASConflicts
--- PASS: TestDGMWithCASConflicts (40.89s)
=== RUN TestMaxSMRPendingMem
--- PASS: TestMaxSMRPendingMem (0.01s)
=== RUN TestStatsLogger
--- PASS: TestStatsLogger (20.43s)
=== RUN TestStatsSamplePercentile
--- PASS: TestStatsSamplePercentile (0.01s)
=== RUN TestPlasmaSwapper
--- PASS: TestPlasmaSwapper (20.50s)
=== RUN TestPlasmaAutoSwapper
--- PASS: TestPlasmaAutoSwapper (88.29s)
=== RUN TestSwapperAddInstance
--- PASS: TestSwapperAddInstance (4.32s)
=== RUN TestSwapperRemoveInstance
--- PASS: TestSwapperRemoveInstance (4.39s)
=== RUN TestSwapperJoinContext
--- PASS: TestSwapperJoinContext (4.89s)
=== RUN TestSwapperSplitContext
--- PASS: TestSwapperSplitContext (4.87s)
=== RUN TestSwapperGlobalClock
--- PASS: TestSwapperGlobalClock (29.85s)
=== RUN TestSwapperConflict
--- PASS: TestSwapperConflict (2.85s)
=== RUN TestSwapperRemoveInstanceWait
--- PASS: TestSwapperRemoveInstanceWait (3.43s)
=== RUN TestSwapperStats
--- PASS: TestSwapperStats (0.91s)
=== RUN TestSwapperSweepInterval
--- PASS: TestSwapperSweepInterval (0.47s)
=== RUN TestSweepCompress
--- PASS: TestSweepCompress (0.06s)
=== RUN TestTenantShardAssignment
--- PASS: TestTenantShardAssignment (4.16s)
=== RUN TestTenantShardAssignmentServerless
--- PASS: TestTenantShardAssignmentServerless (4.41s)
=== RUN TestTenantShardAssignmentOnPrem
--- PASS: TestTenantShardAssignmentOnPrem (4.26s)
=== RUN TestTenantShardAssignmentDedicated
--- PASS: TestTenantShardAssignmentDedicated (2.20s)
=== RUN TestTenantShardAssignmentDedicatedMainBackIndexes
--- PASS: TestTenantShardAssignmentDedicatedMainBackIndexes (0.10s)
=== RUN TestTenantShardRecovery
--- PASS: TestTenantShardRecovery (4.16s)
=== RUN TestTenantMemUsed
--- PASS: TestTenantMemUsed (3.87s)
=== RUN TestTenantSwitchController
--- PASS: TestTenantSwitchController (0.13s)
=== RUN TestTenantSwitchControllerActiveWCtx
--- PASS: TestTenantSwitchControllerActiveWCtx (0.25s)
=== RUN TestTenantSwitchControllerDuringFlush
--- PASS: TestTenantSwitchControllerDuringFlush (4.09s)
=== RUN TestTenantBuildController
--- PASS: TestTenantBuildController (2.11s)
=== RUN TestTenantBuildControllerOnPrem
--- PASS: TestTenantBuildControllerOnPrem (2.09s)
=== RUN TestTenantSingleController
--- PASS: TestTenantSingleController (2.12s)
=== RUN TestTenantControllerSwapperIncremental
--- PASS: TestTenantControllerSwapperIncremental (1.35s)
=== RUN TestTenantControllerSwapperInitial
--- PASS: TestTenantControllerSwapperInitial (1.34s)
=== RUN TestTenantControllerSwapperPeriodic
--- PASS: TestTenantControllerSwapperPeriodic (3.43s)
=== RUN TestTenantSwapperZeroResident
--- PASS: TestTenantSwapperZeroResident (2.74s)
=== RUN TestTenantSwapperZeroItem
--- PASS: TestTenantSwapperZeroItem (1.15s)
=== RUN TestTenantAssignMandatoryQuota
--- PASS: TestTenantAssignMandatoryQuota (0.62s)
=== RUN TestTenantMutationQuota
--- PASS: TestTenantMutationQuota (0.16s)
=== RUN TestTenantMutationQuotaInitial
--- PASS: TestTenantMutationQuotaInitial (0.14s)
=== RUN TestTenantMutationQuotaEmpty
--- PASS: TestTenantMutationQuotaEmpty (0.07s)
=== RUN TestTenantMutationQuotaIncremental
--- PASS: TestTenantMutationQuotaIncremental (0.15s)
=== RUN TestTenantCalibrateMutationQuota
--- PASS: TestTenantCalibrateMutationQuota (0.05s)
=== RUN TestTenantMutationRate
--- PASS: TestTenantMutationRate (0.30s)
=== RUN TestTenantMutationQuotaAdjustRate
--- PASS: TestTenantMutationQuotaAdjustRate (0.45s)
=== RUN TestTenantBuildQuota
--- PASS: TestTenantBuildQuota (0.05s)
=== RUN TestTenantInitialBuildQuota
--- PASS: TestTenantInitialBuildQuota (0.05s)
=== RUN TestTenantInitialBuildNonDGM
--- PASS: TestTenantInitialBuildNonDGM (3.08s)
=== RUN TestTenantInitialBuildDGM
--- PASS: TestTenantInitialBuildDGM (3.11s)
=== RUN TestTenantInitialBuildZeroResident
--- PASS: TestTenantInitialBuildZeroResident (3.13s)
=== RUN TestTenantIncrementalBuildDGM
--- PASS: TestTenantIncrementalBuildDGM (4.91s)
=== RUN TestTenantInitialBuildTwoTenants
--- PASS: TestTenantInitialBuildTwoTenants (4.93s)
=== RUN TestTenantInitialBuildTwoControllers
--- PASS: TestTenantInitialBuildTwoControllers (4.94s)
=== RUN TestTenantIncrementalBuildTwoIndexes
--- PASS: TestTenantIncrementalBuildTwoIndexes (0.57s)
=== RUN TestTenantIncrementalBuildConcurrent
--- PASS: TestTenantIncrementalBuildConcurrent (7.35s)
=== RUN TestTenantMixedConcurrentSingleContainer
--- PASS: TestTenantMixedConcurrentSingleContainer (12.15s)
=== RUN TestTenantDecrementGlobalQuota
--- PASS: TestTenantDecrementGlobalQuota (3.71s)
=== RUN TestTenantInitialBuildNotEnoughQuota
--- PASS: TestTenantInitialBuildNotEnoughQuota (4.96s)
=== RUN TestTenantRecoveryResidentRatioHeaderReplay
--- PASS: TestTenantRecoveryResidentRatioHeaderReplay (0.20s)
=== RUN TestTenantRecoveryResidentRatioDataReplay
--- PASS: TestTenantRecoveryResidentRatioDataReplay (0.23s)
=== RUN TestTenantRecoveryController
--- PASS: TestTenantRecoveryController (2.49s)
=== RUN TestTenantRecoveryControllerOnPrem
--- PASS: TestTenantRecoveryControllerOnPrem (2.58s)
=== RUN TestTenantRecoveryQuotaWithLastCheckpoint
--- PASS: TestTenantRecoveryQuotaWithLastCheckpoint (1.28s)
=== RUN TestTenantRecoveryQuotaZeroResidentWithLastCheckpoint
--- PASS: TestTenantRecoveryQuotaZeroResidentWithLastCheckpoint (5.15s)
=== RUN TestTenantRecoveryQuotaWithFormula
--- PASS: TestTenantRecoveryQuotaWithFormula (4.98s)
=== RUN TestTenantRecoveryQuotaWithDataReplay
--- PASS: TestTenantRecoveryQuotaWithDataReplay (10.59s)
=== RUN TestTenantRecoveryEvictionNoCheckpoint
--- PASS: TestTenantRecoveryEvictionNoCheckpoint (24.01s)
=== RUN TestTenantRecoveryEvictionHeaderReplay
--- PASS: TestTenantRecoveryEvictionHeaderReplay (13.86s)
=== RUN TestTenantRecoveryEvictionDataReplaySequential
--- PASS: TestTenantRecoveryEvictionDataReplaySequential (13.29s)
=== RUN TestTenantRecoveryEvictionDataReplayInterleaved
--- PASS: TestTenantRecoveryEvictionDataReplayInterleaved (15.03s)
=== RUN TestTenantRecoveryEvictionDataReplayInterleavedSingleContainer
--- PASS: TestTenantRecoveryEvictionDataReplayInterleavedSingleContainer (9.05s)
=== RUN TestTenantRecoveryEvictionDataReplayInterleavedSingleContainerTwoTenants
--- PASS: TestTenantRecoveryEvictionDataReplayInterleavedSingleContainerTwoTenants (10.13s)
=== RUN TestTenantRecoveryEvictionDataReplayNoCheckpoint
--- PASS: TestTenantRecoveryEvictionDataReplayNoCheckpoint (15.15s)
=== RUN TestTenantRecoveryEvictionDataReplaySingle
--- PASS: TestTenantRecoveryEvictionDataReplaySingle (6.75s)
=== RUN TestTenantRecoveryLastCheckpoint
--- PASS: TestTenantRecoveryLastCheckpoint (7.99s)
=== RUN TestTenantRecoveryRequestQuota
--- PASS: TestTenantRecoveryRequestQuota (3.99s)
=== RUN TestTenantWorkingSetPageHits
--- PASS: TestTenantWorkingSetPageHits (0.02s)
=== RUN TestTenantWorkingSetConcurrent
--- PASS: TestTenantWorkingSetConcurrent (0.25s)
=== RUN TestTenantDiscretionaryQuotaNoScan
--- PASS: TestTenantDiscretionaryQuotaNoScan (3.22s)
=== RUN TestTenantDiscretionaryQuotaScan
--- PASS: TestTenantDiscretionaryQuotaScan (11.97s)
=== RUN TestTenantAssignDiscretionaryQuota
--- PASS: TestTenantAssignDiscretionaryQuota (35.85s)
=== RUN TestTenantMinimumQuota
--- PASS: TestTenantMinimumQuota (12.01s)
=== RUN TestTenantWorkingSetIdle
--- PASS: TestTenantWorkingSetIdle (0.02s)
=== RUN TestTenantWorkingSetSinceIdle
--- PASS: TestTenantWorkingSetSinceIdle (14.40s)
=== RUN TestTenantWorkingSetIdleTime
--- PASS: TestTenantWorkingSetIdleTime (1.02s)
=== RUN TestTenantAssignIdleQuota
--- PASS: TestTenantAssignIdleQuota (12.29s)
=== RUN TestTenantAssignIdleQuotaEmptyIndex
--- PASS: TestTenantAssignIdleQuotaEmptyIndex (0.17s)
=== RUN TestTenantActivateIdleTenant
--- PASS: TestTenantActivateIdleTenant (36.53s)
=== RUN TestTenantActivateIdleTenantWriter
--- PASS: TestTenantActivateIdleTenantWriter (35.51s)
=== RUN TestTenantActivateIdleTenantZeroQuota
--- PASS: TestTenantActivateIdleTenantZeroQuota (0.75s)
=== RUN TestTenantStatsInStr
--- PASS: TestTenantStatsInStr (0.01s)
=== RUN TestTenantRuntimeStats
--- PASS: TestTenantRuntimeStats (0.20s)
=== RUN TestTenantMandatoryQuotaLowResident
--- PASS: TestTenantMandatoryQuotaLowResident (61.71s)
=== RUN TestTenantMandatoryDeleteIndex
--- PASS: TestTenantMandatoryDeleteIndex (65.74s)
=== RUN TestTenantMandatoryQuotaSmallIndex
--- PASS: TestTenantMandatoryQuotaSmallIndex (0.06s)
=== RUN TestTenantNumShards
--- PASS: TestTenantNumShards (1.82s)
=== RUN TestTenantNumShardsMixedConfig
--- PASS: TestTenantNumShardsMixedConfig (3.01s)
=== RUN TestMVCCPurgeIdleTenant
--- PASS: TestMVCCPurgeIdleTenant (16.41s)
=== RUN TestTenantMemQuotaAfterRecoveryOnPrem
--- PASS: TestTenantMemQuotaAfterRecoveryOnPrem (1.32s)
=== RUN TestTenantShardLSSSegmentSizeOnPremVsServerless
--- PASS: TestTenantShardLSSSegmentSizeOnPremVsServerless (8.00s)
=== RUN TestWriteRenameFileWithSync
--- PASS: TestWriteRenameFileWithSync (0.00s)
=== RUN TestHistogram
--- PASS: TestHistogram (0.00s)
=== RUN TestSCtx
--- PASS: TestSCtx (17.55s)
=== RUN TestWCtxGeneric
--- PASS: TestWCtxGeneric (20.73s)
=== RUN TestWCtxWriter
--- PASS: TestWCtxWriter (20.80s)
=== RUN TestSCtxTrimWithReader
--- PASS: TestSCtxTrimWithReader (0.04s)
=== RUN TestSCtxTrimWithWriter
--- PASS: TestSCtxTrimWithWriter (0.03s)
=== RUN TestSCtxTrimEmpty
--- PASS: TestSCtxTrimEmpty (0.01s)
=== RUN TestWCtxTrimWithReader
--- PASS: TestWCtxTrimWithReader (0.03s)
=== RUN TestWCtxTrimWithWriter
--- PASS: TestWCtxTrimWithWriter (0.03s)
--- PASS: TestExtrasN1 (0.00s)
--- PASS: TestExtrasN3 (0.00s)
--- PASS: TestExtrasN2 (0.00s)
PASS
ok github.com/couchbase/plasma 7055.648s
=== RUN TestInteger
--- PASS: TestInteger (0.00s)
=== RUN TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN TestFloat
--- PASS: TestFloat (0.00s)
=== RUN TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN TestReference
--- PASS: TestReference (0.00s)
=== RUN TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618]
PASS
TESTING [0]
PASS
TESTING [0.0]
PASS
TESTING [0.0000]
PASS
TESTING [0.0000000]
PASS
TESTING [-0]
PASS
TESTING [-0.0]
PASS
TESTING [-0.0000]
PASS
TESTING [-0.0000000]
PASS
TESTING [1]
PASS
TESTING [20]
PASS
TESTING [3456]
PASS
TESTING [7645000]
PASS
TESTING [9223372036854775807]
PASS
TESTING [9223372036854775806]
PASS
TESTING [9223372036854775808]
PASS
TESTING [92233720368547758071234000]
PASS
TESTING [92233720368547758071234987437653]
PASS
TESTING [12300000000000000000000000000000056]
PASS
TESTING [12300000000000000000000000000000000]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [210690]
PASS
TESTING [90000]
PASS
TESTING [123000000]
PASS
TESTING [3.60e2]
PASS
TESTING [36e2]
PASS
TESTING [1.9999999999e10]
PASS
TESTING [1.99999e10]
PASS
TESTING [1.99999e5]
PASS
TESTING [0.00000000000012e15]
PASS
TESTING [7.64507352e8]
PASS
TESTING [9.2233720368547758071234987437653e31]
PASS
TESTING [2650e-1]
PASS
TESTING [26500e-1]
PASS
TESTING [-1]
PASS
TESTING [-20]
PASS
TESTING [-3456]
PASS
TESTING [-7645000]
PASS
TESTING [-9223372036854775808]
PASS
TESTING [-9223372036854775807]
PASS
TESTING [-9223372036854775806]
PASS
TESTING [-9223372036854775809]
PASS
TESTING [-92233720368547758071234000]
PASS
TESTING [-92233720368547758071234987437653]
PASS
TESTING [-12300000000000000000000000000000056]
PASS
TESTING [-12300000000000000000000000000000000]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [-210690]
PASS
TESTING [-90000]
PASS
TESTING [-123000000]
PASS
TESTING [-3.60e2]
PASS
TESTING [-36e2]
PASS
TESTING [-1.9999999999e10]
PASS
TESTING [-1.99999e10]
PASS
TESTING [-1.99999e5]
PASS
TESTING [-0.00000000000012e15]
PASS
TESTING [-2650e-1]
PASS
TESTING [-26500e-1]
PASS
TESTING [0.03]
PASS
TESTING [198.60]
PASS
TESTING [2000045.178]
PASS
TESTING [1.7976931348623157e+308]
PASS
TESTING [0.000000000000000000890]
PASS
TESTING [257953786.9864236576]
PASS
TESTING [257953786.9864236576e8]
PASS
TESTING [36.912e3]
PASS
TESTING [2761.67e0]
PASS
TESTING [2761.67e00]
PASS
TESTING [2761.67e000]
PASS
TESTING [7676546.67e-3]
PASS
TESTING [-0.03]
PASS
TESTING [-198.60]
PASS
TESTING [-2000045.178]
PASS
TESTING [-1.7976931348623157e+308]
PASS
TESTING [-0.000000000000000000890]
PASS
TESTING [-257953786.9864236576]
PASS
TESTING [-257953786.9864236576e8]
PASS
TESTING [-36.912e3]
PASS
TESTING [-2761.67e0]
PASS
TESTING [-2761.67e00]
PASS
TESTING [-2761.67e000]
PASS
TESTING [-7676546.67e-3]
PASS
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/collatejson 0.039s
=== RUN TestForestDBIterator
2023-08-07T00:31:34.727+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 5524 us
2023-08-07T00:31:34.728+05:30 [INFO][FDB] Forestdb opened database file test
2023-08-07T00:31:34.731+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.01s)
=== RUN TestForestDBIteratorSeek
2023-08-07T00:31:34.732+05:30 [INFO][FDB] Forestdb opened database file test
2023-08-07T00:31:34.733+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.00s)
=== RUN TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN TestMemDBInsertionPerf
Maximum number of file descriptors = 200000
Set IO Concurrency: 7200
2023-08-07T00:31:35.725+05:30 DEBU REGU.impl.init.0.func1() at aggrecorder.go:56 [id 50] will report aggregate recorder stats every 5m0s
Initial build: 10000000 items took 1m48.451307464s -> 92207.2793204403 items/s
Incr build: 10000000 items took 2m3.164168998s -> 81192.44485920564 items/s
Main Index: {
"node_count": 18000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 2,
"next_pointers_per_node": 1.3335,
"memory_used": 1695944796,
"node_allocs": 18000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 13498316,
"level1": 3376790,
"level2": 842864,
"level3": 211563,
"level4": 52877,
"level5": 13139,
"level6": 3301,
"level7": 888,
"level8": 185,
"level9": 60,
"level10": 14,
"level11": 2,
"level12": 1,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (231.62s)
=== RUN TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN TestDequeueA
--- PASS: TestDequeueA (1.21s)
=== RUN TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.01s)
=== RUN TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.01s)
PASS
ok github.com/couchbase/indexing/secondary/indexer 255.635s
=== RUN TestConnPoolBasicSanity
2023-08-07T00:35:53.725+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-08-07T00:35:53.935+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-08-07T00:35:54.725+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN TestConnRelease
2023-08-07T00:35:58.728+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2023-08-07T00:36:38.520+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-08-07T00:36:38.748+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.79s)
=== RUN TestLongevity
2023-08-07T00:36:42.522+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Releasing 3 conns.
Getting 2 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 2 conns.
Getting 1 conns.
Releasing 1 conns.
Getting 1 conns.
Releasing 3 conns.
Getting 2 conns.
Releasing 0 conns.
Getting 3 conns.
Releasing 2 conns.
Getting 0 conns.
Releasing 4 conns.
Getting 3 conns.
Releasing 3 conns.
Getting 1 conns.
Releasing 0 conns.
Getting 2 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 2 conns.
Getting 0 conns.
Releasing 3 conns.
Getting 3 conns.
Releasing 1 conns.
Getting 1 conns.
2023-08-07T00:37:20.904+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-08-07T00:37:21.540+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.38s)
=== RUN TestSustainedHighConns
2023-08-07T00:37:24.906+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Allocating 23 Connections
cp.curActConns = 0
Returning 1 Connections
cp.curActConns = 11
Returning 4 Connections
cp.curActConns = 18
Returning 3 Connections
Allocating 6 Connections
cp.curActConns = 21
Returning 0 Connections
Allocating 20 Connections
cp.curActConns = 22
Returning 2 Connections
cp.curActConns = 33
Returning 2 Connections
cp.curActConns = 37
Returning 4 Connections
Allocating 7 Connections
cp.curActConns = 40
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 41
Returning 2 Connections
Allocating 18 Connections
cp.curActConns = 44
Returning 3 Connections
cp.curActConns = 54
Returning 2 Connections
Allocating 17 Connections
cp.curActConns = 55
Returning 4 Connections
cp.curActConns = 65
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 66
Returning 2 Connections
cp.curActConns = 66
Allocating 2 Connections
Returning 3 Connections
cp.curActConns = 65
Allocating 8 Connections
Returning 1 Connections
cp.curActConns = 72
Returning 2 Connections
Allocating 19 Connections
cp.curActConns = 78
Returning 3 Connections
cp.curActConns = 86
Returning 3 Connections
Allocating 15 Connections
cp.curActConns = 90
Returning 3 Connections
cp.curActConns = 95
Returning 4 Connections
Allocating 22 Connections
cp.curActConns = 102
Returning 0 Connections
cp.curActConns = 113
Returning 4 Connections
Allocating 22 Connections
cp.curActConns = 114
Returning 0 Connections
cp.curActConns = 126
Returning 3 Connections
cp.curActConns = 128
Returning 4 Connections
Allocating 23 Connections
cp.curActConns = 138
Returning 2 Connections
cp.curActConns = 145
Returning 4 Connections
Allocating 11 Connections
cp.curActConns = 150
Returning 4 Connections
cp.curActConns = 148
Allocating 20 Connections
Returning 1 Connections
cp.curActConns = 161
Returning 0 Connections
cp.curActConns = 167
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 169
Returning 2 Connections
Allocating 11 Connections
cp.curActConns = 173
Returning 0 Connections
cp.curActConns = 178
Returning 0 Connections
Allocating 23 Connections
cp.curActConns = 185
Returning 4 Connections
cp.curActConns = 196
Returning 3 Connections
cp.curActConns = 194
Allocating 12 Connections
Returning 4 Connections
cp.curActConns = 202
Returning 1 Connections
Allocating 3 Connections
cp.curActConns = 204
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 207
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 206
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 207
Returning 3 Connections
cp.curActConns = 205
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 204
Allocating 3 Connections
Returning 0 Connections
cp.curActConns = 207
Allocating 0 Connections
Returning 2 Connections
cp.curActConns = 205
Allocating 3 Connections
Returning 0 Connections
cp.curActConns = 208
Allocating 2 Connections
Returning 2 Connections
cp.curActConns = 208
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 207
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 205
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 205
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 205
Allocating 0 Connections
Returning 2 Connections
cp.curActConns = 203
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 203
Allocating 4 Connections
Returning 4 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 2 Connections
cp.curActConns = 205
Allocating 2 Connections
Returning 3 Connections
cp.curActConns = 204
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 207
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 204
Allocating 3 Connections
Returning 3 Connections
cp.curActConns = 204
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 203
Allocating 4 Connections
Returning 1 Connections
cp.curActConns = 206
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 206
Allocating 0 Connections
Returning 1 Connections
cp.curActConns = 205
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 208
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 208
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 207
Allocating 3 Connections
Returning 1 Connections
cp.curActConns = 209
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 210
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 208
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 208
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 209
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 212
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 213
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 211
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 209
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 209
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 208
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 205
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 203
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 2 Connections
cp.curActConns = 205
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 203
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 203
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 206
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 206
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 2 Connections
cp.curActConns = 205
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 205
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 205
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 203
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 202
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 201
Returning 4 Connections
Allocating 13 Connections
cp.curActConns = 210
Retuning from startDeallocatorRoutine
Retuning from startAllocatorRoutine
2023-08-07T00:38:19.977+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-08-07T00:38:20.939+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.07s)
=== RUN TestLowWM
2023-08-07T00:38:23.979+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2023-08-07T00:39:23.997+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-08-07T00:40:24.014+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-08-07T00:40:29.495+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-08-07T00:40:30.016+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.52s)
=== RUN TestTotalConns
2023-08-07T00:40:33.497+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2023-08-07T00:40:47.691+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-08-07T00:40:48.504+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.20s)
=== RUN TestUpdateTickRate
2023-08-07T00:40:51.692+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2023-08-07T00:41:12.544+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-08-07T00:41:12.705+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.85s)
PASS
ok github.com/couchbase/indexing/secondary/queryport/client 322.871s
Starting server: attempt 1
Functional tests
2023/08/07 00:43:42 In TestMain()
2023/08/07 00:43:42 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2023/08/07 00:43:42 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2023/08/07 00:43:43 Initialising web UI on node: 127.0.0.1:9000
2023/08/07 00:43:43 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2023/08/07 00:43:44 Setting data quota of 1500M and Index quota of 1500M
2023/08/07 00:43:45 Adding node: https://127.0.0.1:19001 with role: kv,index to the cluster
2023/08/07 00:43:55 AddNode: Successfully added node: 127.0.0.1:9001 (role kv,index), response: {"otpNode":"n_1@127.0.0.1"}
2023/08/07 00:44:00 Rebalance progress: 0
2023/08/07 00:44:05 Rebalance progress: 0
2023/08/07 00:44:10 Rebalance progress: 75
2023/08/07 00:44:15 Rebalance progress: 100
2023/08/07 00:44:20 Created bucket default, responseBody:
2023/08/07 00:44:25 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/08/07 00:44:25 Successfully initialised cluster
2023/08/07 00:44:25 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/08/07 00:44:26 Changing config key queryport.client.settings.backfillLimit to value 0
2023/08/07 00:44:26 Changing config key queryport.client.log_level to value Warn
2023/08/07 00:44:26 Changing config key indexer.api.enableTestServer to value true
2023/08/07 00:44:26 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2023/08/07 00:44:26 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2023/08/07 00:44:26 Changing config key indexer.settings.log_level to value info
2023/08/07 00:44:26 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2023/08/07 00:44:26 Using plasma for creating indexes
2023/08/07 00:44:26 Changing config key indexer.settings.storage_mode to value plasma
2023/08/07 00:44:31 Data file exists. Skipping download
2023/08/07 00:44:31 Data file exists. Skipping download
2023/08/07 00:44:33 In DropAllSecondaryIndexes()
2023/08/07 00:44:33 Emptying the default bucket
2023/08/07 00:44:36 Flush Enabled on bucket default, responseBody:
2023/08/07 00:45:14 Flushed the bucket default, Response body:
2023/08/07 00:45:14 Create Index On the empty default Bucket()
2023/08/07 00:45:17 Created the secondary index index_eyeColor. Waiting for it become active
2023/08/07 00:45:17 Index is 2220963237297882470 now active
2023/08/07 00:45:17 Populating the default bucket
=== RUN TestScanAfterBucketPopulate
2023/08/07 00:45:26 In TestScanAfterBucketPopulate()
2023/08/07 00:45:26 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/08/07 00:45:26 Using n1ql client
2023-08-07T00:45:26.984+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2023/08/07 00:45:27 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.10s)
=== RUN TestRestartNilSnapshot
2023/08/07 00:45:27 In TestRestartNilSnapshot()
2023/08/07 00:45:31 Created the secondary index idx_age. Waiting for it become active
2023/08/07 00:45:31 Index is 13537424386812473893 now active
2023/08/07 00:45:31 Restarting indexer process ...
2023/08/07 00:45:31 []
2023-08-07T00:45:31.514+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-08-07T00:45:31.518+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/08/07 00:48:51 Using n1ql client
2023-08-07T00:48:51.465+05:30 [Error] transport error between 127.0.0.1:37346->127.0.0.1:9107: write tcp 127.0.0.1:37346->127.0.0.1:9107: write: broken pipe
2023-08-07T00:48:51.466+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -2193962232258691388 request transport failed `write tcp 127.0.0.1:37346->127.0.0.1:9107: write: broken pipe`
2023-08-07T00:48:51.466+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-08-07T00:48:51.466+05:30 [Error] metadataClient:PickRandom: Replicas - [5916175491444357832], PrunedReplica - map[], FilteredReplica map[]
2023/08/07 00:48:51 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.45s)
=== RUN TestThreeIndexCreates
2023/08/07 00:48:51 In TestThreeIndexCreates()
2023/08/07 00:48:55 Created the secondary index index_balance. Waiting for it become active
2023/08/07 00:48:55 Index is 3731124392702921323 now active
2023/08/07 00:48:55 Create docs mutations
2023/08/07 00:48:55 Using n1ql client
2023/08/07 00:48:55 Expected and Actual scan responses are the same
2023/08/07 00:49:02 Created the secondary index index_email. Waiting for it become active
2023/08/07 00:49:02 Index is 9164820749074774588 now active
2023/08/07 00:49:02 Create docs mutations
2023/08/07 00:49:02 Using n1ql client
2023/08/07 00:49:02 Expected and Actual scan responses are the same
2023/08/07 00:49:08 Created the secondary index index_pin. Waiting for it become active
2023/08/07 00:49:08 Index is 993337417904450096 now active
2023/08/07 00:49:08 Delete docs mutations
2023/08/07 00:49:09 Using n1ql client
2023/08/07 00:49:09 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (17.63s)
=== RUN TestMultipleIndexCreatesDropsWithMutations
2023/08/07 00:49:09 In TestThreeIndexCreates()
2023/08/07 00:49:15 Created the secondary index index_state. Waiting for it become active
2023/08/07 00:49:15 Index is 12372547651477876156 now active
2023/08/07 00:49:15 Create docs mutations
2023/08/07 00:49:15 Using n1ql client
2023/08/07 00:49:15 Expected and Actual scan responses are the same
2023/08/07 00:49:22 Created the secondary index index_registered. Waiting for it become active
2023/08/07 00:49:22 Index is 13491177938793107419 now active
2023/08/07 00:49:22 Create docs mutations
2023/08/07 00:49:22 Using n1ql client
2023/08/07 00:49:22 Expected and Actual scan responses are the same
2023/08/07 00:49:28 Created the secondary index index_gender. Waiting for it become active
2023/08/07 00:49:28 Index is 11762483999318089195 now active
2023/08/07 00:49:28 Create docs mutations
2023/08/07 00:49:29 Using n1ql client
2023/08/07 00:49:29 Expected and Actual scan responses are the same
2023/08/07 00:49:29 Dropping the secondary index index_registered
2023/08/07 00:49:29 Index dropped
2023/08/07 00:49:29 Create docs mutations
2023/08/07 00:49:29 Delete docs mutations
2023/08/07 00:49:29 Using n1ql client
2023/08/07 00:49:29 Expected and Actual scan responses are the same
2023/08/07 00:49:34 Created the secondary index index_longitude. Waiting for it become active
2023/08/07 00:49:34 Index is 6552756503924964961 now active
2023/08/07 00:49:34 Create docs mutations
2023/08/07 00:49:35 Using n1ql client
2023/08/07 00:49:35 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (26.15s)
=== RUN TestCreateDropScan
2023/08/07 00:49:35 In TestCreateDropScan()
2023/08/07 00:49:41 Created the secondary index index_cd. Waiting for it become active
2023/08/07 00:49:41 Index is 15400079296054228422 now active
2023/08/07 00:49:41 Using n1ql client
2023/08/07 00:49:41 Expected and Actual scan responses are the same
2023/08/07 00:49:41 Dropping the secondary index index_cd
2023/08/07 00:49:41 Index dropped
2023/08/07 00:49:41 Using n1ql client
2023/08/07 00:49:41 Scan failed as expected with error: Index Not Found - cause: GSI index index_cd not found.
--- PASS: TestCreateDropScan (6.40s)
=== RUN TestCreateDropCreate
2023/08/07 00:49:41 In TestCreateDropCreate()
2023/08/07 00:49:47 Created the secondary index index_cdc. Waiting for it become active
2023/08/07 00:49:47 Index is 8369340329359469779 now active
2023/08/07 00:49:47 Using n1ql client
2023/08/07 00:49:48 Expected and Actual scan responses are the same
2023/08/07 00:49:48 Dropping the secondary index index_cdc
2023/08/07 00:49:48 Index dropped
2023/08/07 00:49:48 Using n1ql client
2023/08/07 00:49:48 Scan 2 failed as expected with error: Index Not Found - cause: GSI index index_cdc not found.
2023/08/07 00:49:54 Created the secondary index index_cdc. Waiting for it become active
2023/08/07 00:49:54 Index is 13026035735725473215 now active
2023/08/07 00:49:54 Using n1ql client
2023/08/07 00:49:54 Expected and Actual scan responses are the same
2023/08/07 00:49:54 (Inclusion 1) Lengths of expected and actual scan results are 5046 and 5046. Num of docs in bucket = 10402
2023/08/07 00:49:54 Using n1ql client
2023/08/07 00:49:54 Expected and Actual scan responses are the same
2023/08/07 00:49:54 (Inclusion 3) Lengths of expected and actual scan results are 5046 and 5046. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (12.86s)
=== RUN TestCreate2Drop1Scan2
2023/08/07 00:49:54 In TestCreate2Drop1Scan2()
2023/08/07 00:50:00 Created the secondary index index_i1. Waiting for it become active
2023/08/07 00:50:00 Index is 2330718945219836460 now active
2023/08/07 00:50:07 Created the secondary index index_i2. Waiting for it become active
2023/08/07 00:50:07 Index is 18328229527799456895 now active
2023/08/07 00:50:07 Using n1ql client
2023/08/07 00:50:07 Expected and Actual scan responses are the same
2023/08/07 00:50:07 Using n1ql client
2023/08/07 00:50:07 Expected and Actual scan responses are the same
2023/08/07 00:50:07 Dropping the secondary index index_i1
2023/08/07 00:50:07 Index dropped
2023/08/07 00:50:07 Using n1ql client
2023/08/07 00:50:07 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (12.81s)
=== RUN TestIndexNameCaseSensitivity
2023/08/07 00:50:07 In TestIndexNameCaseSensitivity()
2023/08/07 00:50:13 Created the secondary index index_age. Waiting for it become active
2023/08/07 00:50:13 Index is 11117049233478748865 now active
2023/08/07 00:50:13 Using n1ql client
2023/08/07 00:50:13 Expected and Actual scan responses are the same
2023/08/07 00:50:13 Using n1ql client
2023/08/07 00:50:13 Scan failed as expected with error: Index Not Found - cause: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (6.20s)
=== RUN TestCreateDuplicateIndex
2023/08/07 00:50:13 In TestCreateDuplicateIndex()
2023/08/07 00:50:19 Created the secondary index index_di1. Waiting for it become active
2023/08/07 00:50:19 Index is 13759458725744026103 now active
2023/08/07 00:50:19 Index found: index_di1
2023/08/07 00:50:19 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (6.20s)
=== RUN TestDropNonExistingIndex
2023/08/07 00:50:19 In TestDropNonExistingIndex()
2023/08/07 00:50:19 Dropping the secondary index 123456
2023/08/07 00:50:19 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.06s)
=== RUN TestCreateIndexNonExistentBucket
2023/08/07 00:50:19 In TestCreateIndexNonExistentBucket()
2023-08-07T00:50:20.448+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-08-07T00:50:31.451+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023/08/07 00:50:31 Index create failed as expected with error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- PASS: TestCreateIndexNonExistentBucket (11.62s)
=== RUN TestScanWithNoTimeout
2023/08/07 00:50:31 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/08/07 00:50:31 Changing config key indexer.settings.scan_timeout to value 0
2023/08/07 00:50:31 Using n1ql client
2023/08/07 00:50:31 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.41s)
=== RUN TestIndexingOnBinaryBucketMeta
2023/08/07 00:50:31 In TestIndexingOnBinaryBucketMeta()
2023/08/07 00:50:31 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2023/08/07 00:50:31 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2023/08/07 00:50:34 Modified parameters of bucket default, responseBody:
2023/08/07 00:50:34 Created bucket binaryBucket, responseBody:
2023/08/07 00:50:53 Created the secondary index index_binary_meta_id. Waiting for it become active
2023/08/07 00:50:53 Index is 5239677550670419588 now active
2023/08/07 00:50:58 items_count stat is 10 for index index_binary_meta_id
2023/08/07 00:50:58 Dropping the secondary index index_binary_meta_id
2023/08/07 00:50:58 Index dropped
2023/08/07 00:51:01 Created the secondary index index_binary_meta_cas. Waiting for it become active
2023/08/07 00:51:01 Index is 9613668442232166882 now active
2023/08/07 00:51:06 items_count stat is 10 for index index_binary_meta_cas
2023/08/07 00:51:06 Dropping the secondary index index_binary_meta_cas
2023/08/07 00:51:06 Index dropped
2023/08/07 00:51:10 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2023/08/07 00:51:10 Index is 6876914958555305218 now active
2023/08/07 00:51:15 items_count stat is 10 for index index_binary_meta_expiration
2023/08/07 00:51:15 Dropping the secondary index index_binary_meta_expiration
2023/08/07 00:51:15 Index dropped
2023/08/07 00:51:16 Deleted bucket binaryBucket, responseBody:
2023/08/07 00:51:20 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnBinaryBucketMeta (63.14s)
=== RUN TestRetainDeleteXATTRBinaryDocs
2023/08/07 00:51:35 In TestRetainDeleteXATTRBinaryDocs()
2023/08/07 00:51:35 1. Populate a bucket with binary docs having system XATTRS
2023/08/07 00:51:35 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2023/08/07 00:51:35 3. Delete the documents in the bucket
2023/08/07 00:51:35 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2023/08/07 00:51:38 Modified parameters of bucket default, responseBody:
2023/08/07 00:51:38 Created bucket binaryBucket, responseBody:
2023/08/07 00:51:56 Created the secondary index index_system_xattr. Waiting for it become active
2023/08/07 00:51:56 Index is 16496930865062125773 now active
2023/08/07 00:52:01 Deleted all the documents in the bucket: binaryBucket successfully
2023/08/07 00:52:04 Deleted bucket binaryBucket, responseBody:
2023/08/07 00:52:07 Modified parameters of bucket default, responseBody:
--- PASS: TestRetainDeleteXATTRBinaryDocs (47.59s)
=== RUN TestIndexingOnXATTRs
2023/08/07 00:52:22 In TestIndexingOnXATTRs()
2023/08/07 00:52:25 Modified parameters of bucket default, responseBody:
2023/08/07 00:52:25 Created bucket bucket_xattrs, responseBody:
2023/08/07 00:52:45 Created the secondary index index_sync_rev. Waiting for it become active
2023/08/07 00:52:45 Index is 18264169371235136010 now active
2023/08/07 00:52:51 Created the secondary index index_sync_channels. Waiting for it become active
2023/08/07 00:52:51 Index is 12042618017003499353 now active
2023/08/07 00:52:57 Created the secondary index index_sync_sequence. Waiting for it become active
2023/08/07 00:52:57 Index is 7426702793013201672 now active
2023/08/07 00:53:02 items_count stat is 100 for index index_sync_rev
2023/08/07 00:53:02 items_count stat is 100 for index index_sync_channels
2023/08/07 00:53:03 items_count stat is 100 for index index_sync_sequence
2023/08/07 00:53:03 Using n1ql client
2023-08-07T00:53:03.051+05:30 [Info] GSIC[default/bucket_xattrs-_default-_default-1691349783046321875] started ...
2023/08/07 00:53:03 Dropping the secondary index index_sync_rev
2023/08/07 00:53:03 Index dropped
2023/08/07 00:53:03 Using n1ql client
2023/08/07 00:53:03 Dropping the secondary index index_sync_channels
2023/08/07 00:53:03 Index dropped
2023/08/07 00:53:03 Using n1ql client
2023/08/07 00:53:03 Dropping the secondary index index_sync_sequence
2023/08/07 00:53:03 Index dropped
2023/08/07 00:53:05 Deleted bucket bucket_xattrs, responseBody:
2023/08/07 00:53:08 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnXATTRs (61.00s)
=== RUN TestSimpleIndex_FloatDataType
2023/08/07 00:53:23 In TestSimpleIndex_FloatDataType()
2023/08/07 00:53:23 Index found: index_age
2023/08/07 00:53:23 Using n1ql client
2023/08/07 00:53:23 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.02s)
=== RUN TestSimpleIndex_StringDataType
2023/08/07 00:53:23 In TestSimpleIndex_StringDataType()
2023/08/07 00:53:28 Created the secondary index index_company. Waiting for it become active
2023/08/07 00:53:28 Index is 8410025190474010841 now active
2023/08/07 00:53:28 Using n1ql client
2023/08/07 00:53:28 Expected and Actual scan responses are the same
2023/08/07 00:53:28 Using n1ql client
2023/08/07 00:53:28 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.69s)
=== RUN TestSimpleIndex_FieldValueCaseSensitivity
2023/08/07 00:53:28 In TestSimpleIndex_StringCaseSensitivity()
2023/08/07 00:53:28 Index found: index_company
2023/08/07 00:53:28 Using n1ql client
2023/08/07 00:53:28 Expected and Actual scan responses are the same
2023/08/07 00:53:28 Using n1ql client
2023/08/07 00:53:28 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.14s)
=== RUN TestSimpleIndex_BoolDataType
2023/08/07 00:53:28 In TestSimpleIndex_BoolDataType()
2023/08/07 00:53:34 Created the secondary index index_isActive. Waiting for it become active
2023/08/07 00:53:34 Index is 4209386538595508045 now active
2023/08/07 00:53:34 Using n1ql client
2023/08/07 00:53:35 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (6.63s)
=== RUN TestBasicLookup
2023/08/07 00:53:35 In TestBasicLookup()
2023/08/07 00:53:35 Index found: index_company
2023/08/07 00:53:35 Using n1ql client
2023/08/07 00:53:35 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.02s)
=== RUN TestIndexOnNonExistentField
2023/08/07 00:53:35 In TestIndexOnNonExistentField()
2023/08/07 00:53:41 Created the secondary index index_height. Waiting for it become active
2023/08/07 00:53:41 Index is 17358092872324975677 now active
2023/08/07 00:53:41 Using n1ql client
2023/08/07 00:53:41 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (6.42s)
=== RUN TestIndexPartiallyMissingField
2023/08/07 00:53:41 In TestIndexPartiallyMissingField()
2023/08/07 00:53:47 Created the secondary index index_nationality. Waiting for it become active
2023/08/07 00:53:47 Index is 1658093940230415946 now active
2023/08/07 00:53:47 Using n1ql client
2023/08/07 00:53:47 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (6.40s)
=== RUN TestScanNonMatchingDatatype
2023/08/07 00:53:47 In TestScanNonMatchingDatatype()
2023/08/07 00:53:47 Index found: index_age
2023/08/07 00:53:47 Using n1ql client
2023/08/07 00:53:47 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.01s)
=== RUN TestInclusionNeither
2023/08/07 00:53:47 In TestInclusionNeither()
2023/08/07 00:53:47 Index found: index_age
2023/08/07 00:53:47 Using n1ql client
2023/08/07 00:53:47 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.05s)
=== RUN TestInclusionLow
2023/08/07 00:53:47 In TestInclusionLow()
2023/08/07 00:53:47 Index found: index_age
2023/08/07 00:53:48 Using n1ql client
2023/08/07 00:53:48 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.10s)
=== RUN TestInclusionHigh
2023/08/07 00:53:48 In TestInclusionHigh()
2023/08/07 00:53:48 Index found: index_age
2023/08/07 00:53:48 Using n1ql client
2023/08/07 00:53:48 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.04s)
=== RUN TestInclusionBoth
2023/08/07 00:53:48 In TestInclusionBoth()
2023/08/07 00:53:48 Index found: index_age
2023/08/07 00:53:48 Using n1ql client
2023/08/07 00:53:48 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.03s)
=== RUN TestNestedIndex_String
2023/08/07 00:53:48 In TestNestedIndex_String()
2023/08/07 00:53:54 Created the secondary index index_streetname. Waiting for it become active
2023/08/07 00:53:54 Index is 8796666999863979426 now active
2023/08/07 00:53:54 Using n1ql client
2023/08/07 00:53:54 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (6.35s)
=== RUN TestNestedIndex_Float
2023/08/07 00:53:54 In TestNestedIndex_Float()
2023/08/07 00:54:00 Created the secondary index index_floor. Waiting for it become active
2023/08/07 00:54:00 Index is 12255387173213072692 now active
2023/08/07 00:54:00 Using n1ql client
2023/08/07 00:54:00 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (6.45s)
=== RUN TestNestedIndex_Bool
2023/08/07 00:54:00 In TestNestedIndex_Bool()
2023/08/07 00:54:07 Created the secondary index index_isresidential. Waiting for it become active
2023/08/07 00:54:07 Index is 8980774850881919768 now active
2023/08/07 00:54:07 Using n1ql client
2023/08/07 00:54:07 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (6.65s)
=== RUN TestLookupJsonObject
2023/08/07 00:54:07 In TestLookupJsonObject()
2023/08/07 00:54:14 Created the secondary index index_streetaddress. Waiting for it become active
2023/08/07 00:54:14 Index is 10986366117795468650 now active
2023/08/07 00:54:14 Using n1ql client
2023/08/07 00:54:14 Count of docScanResults is 1
2023/08/07 00:54:14 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/08/07 00:54:14 Count of scanResults is 1
2023/08/07 00:54:14 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/08/07 00:54:14 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.51s)
=== RUN TestLookupObjDifferentOrdering
2023/08/07 00:54:14 In TestLookupObjDifferentOrdering()
2023/08/07 00:54:14 Index found: index_streetaddress
2023/08/07 00:54:14 Using n1ql client
2023/08/07 00:54:14 Count of docScanResults is 1
2023/08/07 00:54:14 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/08/07 00:54:14 Count of scanResults is 1
2023/08/07 00:54:14 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/08/07 00:54:14 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.01s)
=== RUN TestRangeJsonObject
2023/08/07 00:54:14 In TestRangeJsonObject()
2023/08/07 00:54:14 Index found: index_streetaddress
2023/08/07 00:54:14 Using n1ql client
2023/08/07 00:54:14 Count of scanResults is 2
2023/08/07 00:54:14 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2023/08/07 00:54:14 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/08/07 00:54:14 Count of docScanResults is 2
2023/08/07 00:54:14 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/08/07 00:54:14 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2023/08/07 00:54:14 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.00s)
=== RUN TestLookupFloatDiffForms
2023/08/07 00:54:14 In TestLookupFloatDiffForms()
2023/08/07 00:54:20 Created the secondary index index_latitude. Waiting for it become active
2023/08/07 00:54:20 Index is 12493066035250693665 now active
2023/08/07 00:54:20 Scan 1
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 2
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 3
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 4
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 5
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 6
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (6.64s)
=== RUN TestRangeFloatInclVariations
2023/08/07 00:54:20 In TestRangeFloatInclVariations()
2023/08/07 00:54:20 Index found: index_latitude
2023/08/07 00:54:20 Scan 1
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 2
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 3
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 4
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 5
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
2023/08/07 00:54:20 Scan 6
2023/08/07 00:54:20 Using n1ql client
2023/08/07 00:54:20 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.04s)
=== RUN TestScanAll
2023/08/07 00:54:20 In TestScanAll()
2023/08/07 00:54:27 Created the secondary index index_name. Waiting for it become active
2023/08/07 00:54:27 Index is 14371129720261221562 now active
2023/08/07 00:54:27 Length of docScanResults = 10502
2023/08/07 00:54:27 Using n1ql client
2023/08/07 00:54:27 Length of scanResults = 10502
2023/08/07 00:54:27 Expected and Actual scan responses are the same
--- PASS: TestScanAll (6.67s)
=== RUN TestScanAllNestedField
2023/08/07 00:54:27 In TestScanAllNestedField()
2023/08/07 00:54:27 Index found: index_streetname
2023/08/07 00:54:27 Length of docScanResults = 2
2023/08/07 00:54:27 Using n1ql client
2023/08/07 00:54:27 Length of scanResults = 2
2023/08/07 00:54:27 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN TestBasicPrimaryIndex
2023/08/07 00:54:27 In TestBasicPrimaryIndex()
2023/08/07 00:54:33 Created the secondary index index_p1. Waiting for it become active
2023/08/07 00:54:33 Index is 7232972435028860472 now active
2023-08-07T00:54:33.631+05:30 [Error] transport error between 127.0.0.1:37016->127.0.0.1:9107: write tcp 127.0.0.1:37016->127.0.0.1:9107: write: broken pipe
2023-08-07T00:54:33.631+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:37016->127.0.0.1:9107: write: broken pipe`
2023-08-07T00:54:33.631+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-08-07T00:54:33.631+05:30 [Error] metadataClient:PickRandom: Replicas - [1136959826393079106], PrunedReplica - map[], FilteredReplica map[]
2023/08/07 00:54:33 Expected and Actual scan responses are the same
2023/08/07 00:54:33 CountRange() expected and actual is: 1897 and 1897
2023/08/07 00:54:33 lookupkey for CountLookup() = User9dbe7d1c-faab-40db-b939-2ea1dfe75518
2023/08/07 00:54:33 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (6.25s)
=== RUN TestBasicNullDataType
2023/08/07 00:54:33 In TestBasicNullDataType()
2023/08/07 00:54:33 Index found: index_email
2023/08/07 00:54:33 Using n1ql client
2023/08/07 00:54:33 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.02s)
=== RUN TestBasicArrayDataType_ScanAll
2023/08/07 00:54:33 In TestBasicArrayDataType_ScanAll()
2023/08/07 00:54:40 Created the secondary index index_tags. Waiting for it become active
2023/08/07 00:54:40 Index is 7487704903830972981 now active
2023/08/07 00:54:40 Using n1ql client
2023/08/07 00:54:40 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (6.90s)
=== RUN TestBasicArrayDataType_Lookup
2023/08/07 00:54:40 In TestBasicArrayDataType_Lookup()
2023/08/07 00:54:42 Index found: index_tags
2023/08/07 00:54:42 Count of scanResults is 1
2023/08/07 00:54:42 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75 Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN TestArrayDataType_LookupMissingArrayValue
2023/08/07 00:54:42 In TestArrayDataType_LookupMissingArrayValue()
2023/08/07 00:54:42 Index found: index_tags
2023/08/07 00:54:42 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.01s)
=== RUN TestArrayDataType_LookupWrongOrder
2023/08/07 00:54:42 In TestArrayDataType_LookupWrongOrder()
2023/08/07 00:54:42 Index found: index_tags
2023/08/07 00:54:42 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN TestArrayDataType_LookupSubset
2023/08/07 00:54:42 In TestArrayDataType_LookupSubset()
2023/08/07 00:54:42 Index found: index_tags
2023/08/07 00:54:42 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN TestScanLimitParameter
2023/08/07 00:54:42 In TestScanLimitParameter()
2023/08/07 00:54:42 Index found: index_age
2023/08/07 00:54:42 Using n1ql client
2023/08/07 00:54:42 Using n1ql client
--- PASS: TestScanLimitParameter (0.01s)
=== RUN TestCountRange
2023/08/07 00:54:42 In TestRangeCount()
2023/08/07 00:54:42 Index found: index_age
2023/08/07 00:54:42 Count of expected and actual Range is: 2401 and 2401
2023/08/07 00:54:42 Count of expected and actual Range is: 10002 and 10002
2023/08/07 00:54:42 Count of expected and actual Range are: 0 and 0
2023/08/07 00:54:42 Count of expected and actual Range are: 471 and 471
2023/08/07 00:54:42 Testing CountRange() for key <= val
2023/08/07 00:54:42 Count of expected and actual CountRange for key <= 30 are: 5232 and 5232
2023/08/07 00:54:42 Testing CountRange() for key >= val
2023/08/07 00:54:42 Count of expected and actual CountRange for key >= 25 are: 7667 and 7667
2023/08/07 00:54:42 Testing CountRange() for null < key <= val
2023/08/07 00:54:42 Count of expected and actual CountRange for key > null && key <= 30 are: 5232 and 5232
2023/08/07 00:54:42 Testing CountRange() for val <= key < null
2023/08/07 00:54:42 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2023/08/07 00:54:42 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.07s)
=== RUN TestCountLookup
2023/08/07 00:54:42 In TestCountLookup()
2023/08/07 00:54:42 Index found: index_age
2023/08/07 00:54:42 Count of expected and actual Range are: 506 and 506
2023/08/07 00:54:42 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.01s)
=== RUN TestRangeStatistics
2023/08/07 00:54:42 In TestRangeCount()
2023/08/07 00:54:42 Index found: index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN TestIndexCreateWithWhere
2023/08/07 00:54:42 In TestIndexCreateWithWhere()
2023/08/07 00:54:47 Created the secondary index index_ageabove30. Waiting for it become active
2023/08/07 00:54:47 Index is 9927293087926712539 now active
2023/08/07 00:54:47 Using n1ql client
2023/08/07 00:54:47 Expected and Actual scan responses are the same
2023/08/07 00:54:47 Lengths of expected and actual scanReuslts are: 4299 and 4299
2023/08/07 00:54:53 Created the secondary index index_ageteens. Waiting for it become active
2023/08/07 00:54:53 Index is 17473744236701657662 now active
2023/08/07 00:54:53 Using n1ql client
2023/08/07 00:54:53 Expected and Actual scan responses are the same
2023/08/07 00:54:53 Lengths of expected and actual scanReuslts are: 0 and 0
2023/08/07 00:54:59 Created the secondary index index_age35to45. Waiting for it become active
2023/08/07 00:54:59 Index is 443549372799997816 now active
2023/08/07 00:55:00 Using n1ql client
2023/08/07 00:55:00 Expected and Actual scan responses are the same
2023/08/07 00:55:00 Lengths of expected and actual scanReuslts are: 2872 and 2872
--- PASS: TestIndexCreateWithWhere (17.32s)
=== RUN TestDeferredIndexCreate
2023/08/07 00:55:00 In TestDeferredIndexCreate()
2023/08/07 00:55:00 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2023/08/07 00:55:02 Build the deferred index index_deferred. Waiting for the index to become active
2023/08/07 00:55:02 Waiting for index 7896321597362042802 to go active ...
2023/08/07 00:55:03 Waiting for index 7896321597362042802 to go active ...
2023/08/07 00:55:04 Waiting for index 7896321597362042802 to go active ...
2023/08/07 00:55:05 Waiting for index 7896321597362042802 to go active ...
2023/08/07 00:55:06 Waiting for index 7896321597362042802 to go active ...
2023/08/07 00:55:07 Index is 7896321597362042802 now active
2023/08/07 00:55:07 Using n1ql client
2023/08/07 00:55:07 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (7.22s)
=== RUN TestCompositeIndex_NumAndString
2023/08/07 00:55:07 In TestCompositeIndex()
2023/08/07 00:55:13 Created the secondary index index_composite1. Waiting for it become active
2023/08/07 00:55:13 Index is 11986809339351829119 now active
2023/08/07 00:55:13 Using n1ql client
2023/08/07 00:55:15 Using n1ql client
2023/08/07 00:55:15 Using n1ql client
2023/08/07 00:55:15 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (7.71s)
=== RUN TestCompositeIndex_TwoNumberFields
2023/08/07 00:55:15 In TestCompositeIndex()
2023/08/07 00:55:20 Created the secondary index index_composite2. Waiting for it become active
2023/08/07 00:55:20 Index is 461011660954758688 now active
2023/08/07 00:55:20 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (5.70s)
=== RUN TestNumbers_Int64_Float64
2023/08/07 00:55:20 In TestNumbers_Int64_Float64()
2023/08/07 00:55:27 Created the secondary index idx_numbertest. Waiting for it become active
2023/08/07 00:55:27 Index is 15383302084031565905 now active
2023/08/07 00:55:27
==== Int64 test #0
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Int64 test #1
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Int64 test #2
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Int64 test #3
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Int64 test #4
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Int64 test #5
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Int64 test #6
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Int64 test #7
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Int64 test #8
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Float64 test #0
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Float64 test #1
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Float64 test #2
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
2023/08/07 00:55:27
==== Float64 test #3
2023/08/07 00:55:27 Using n1ql client
2023/08/07 00:55:27 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (7.24s)
=== RUN TestRestartIndexer
2023/08/07 00:55:27 In TestRestartIndexer()
2023/08/07 00:55:27 []
2023-08-07T00:55:28.039+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-08-07T00:55:28.039+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/08/07 00:55:47 Using n1ql client
2023-08-07T00:55:47.990+05:30 [Error] transport error between 127.0.0.1:37890->127.0.0.1:9107: write tcp 127.0.0.1:37890->127.0.0.1:9107: write: broken pipe
2023-08-07T00:55:47.990+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 1998961310338553972 request transport failed `write tcp 127.0.0.1:37890->127.0.0.1:9107: write: broken pipe`
2023/08/07 00:55:48 Len of expected and actual scan results are : 10002 and 10002
2023/08/07 00:55:48 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.09s)
=== RUN TestCreateDocsMutation
2023/08/07 00:55:48 In TestCreateDocsMutation()
2023/08/07 00:55:48 Index found: index_age
2023/08/07 00:55:48 Using n1ql client
2023/08/07 00:55:48 Len of expected and actual scan results are : 10002 and 10002
2023/08/07 00:55:48 Expected and Actual scan responses are the same
2023/08/07 00:55:48 Using n1ql client
2023/08/07 00:55:48 Index Scan after mutations took 116.068766ms
2023/08/07 00:55:48 Len of expected and actual scan results are : 10102 and 10102
2023/08/07 00:55:48 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.42s)
=== RUN TestRestartProjector
2023/08/07 00:55:48 In TestRestartProjector()
2023/08/07 00:55:48 []
2023/08/07 00:56:08 Using n1ql client
2023/08/07 00:56:08 Len of expected and actual scan results are : 10102 and 10102
2023/08/07 00:56:08 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.09s)
=== RUN TestDeleteDocsMutation
2023/08/07 00:56:08 In TestDeleteDocsMutation()
2023/08/07 00:56:08 Index found: index_age
2023/08/07 00:56:08 Using n1ql client
2023/08/07 00:56:08 Len of expected and actual scan results are : 10102 and 10102
2023/08/07 00:56:08 Expected and Actual scan responses are the same
2023/08/07 00:56:08 Using n1ql client
2023/08/07 00:56:09 Index Scan after mutations took 302.845815ms
2023/08/07 00:56:09 Len of expected and actual scan results are : 9902 and 9902
2023/08/07 00:56:09 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (0.64s)
=== RUN TestUpdateDocsMutation
2023/08/07 00:56:09 In TestUpdateDocsMutation()
2023/08/07 00:56:09 Index found: index_age
2023/08/07 00:56:09 Using n1ql client
2023/08/07 00:56:09 Len of expected and actual scan results are : 9420 and 9420
2023/08/07 00:56:09 Expected and Actual scan responses are the same
2023/08/07 00:56:09 Num of keysFromMutDocs: 100
2023/08/07 00:56:09 Updating number of documents: 99
2023/08/07 00:56:09 Using n1ql client
2023/08/07 00:56:09 Index Scan after mutations took 173.079034ms
2023/08/07 00:56:09 Len of expected and actual scan results are : 9423 and 9423
2023/08/07 00:56:09 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.48s)
=== RUN TestLargeMutations
2023/08/07 00:56:09 In TestLargeMutations()
2023/08/07 00:56:09 In DropAllSecondaryIndexes()
2023/08/07 00:56:09 Index found: index_balance
2023/08/07 00:56:09 Dropped index index_balance
2023/08/07 00:56:09 Index found: index_age35to45
2023/08/07 00:56:09 Dropped index index_age35to45
2023/08/07 00:56:09 Index found: index_composite1
2023/08/07 00:56:09 Dropped index index_composite1
2023/08/07 00:56:09 Index found: idx_numbertest
2023/08/07 00:56:10 Dropped index idx_numbertest
2023/08/07 00:56:10 Index found: index_longitude
2023/08/07 00:56:10 Dropped index index_longitude
2023/08/07 00:56:10 Index found: index_p1
2023/08/07 00:56:10 Dropped index index_p1
2023/08/07 00:56:10 Index found: index_composite2
2023/08/07 00:56:10 Dropped index index_composite2
2023/08/07 00:56:10 Index found: index_pin
2023/08/07 00:56:10 Dropped index index_pin
2023/08/07 00:56:10 Index found: index_isresidential
2023/08/07 00:56:10 Dropped index index_isresidential
2023/08/07 00:56:10 Index found: index_eyeColor
2023/08/07 00:56:10 Dropped index index_eyeColor
2023/08/07 00:56:10 Index found: index_nationality
2023/08/07 00:56:10 Dropped index index_nationality
2023/08/07 00:56:10 Index found: index_name
2023/08/07 00:56:10 Dropped index index_name
2023/08/07 00:56:10 Index found: index_cdc
2023/08/07 00:56:10 Dropped index index_cdc
2023/08/07 00:56:10 Index found: index_floor
2023/08/07 00:56:10 Dropped index index_floor
2023/08/07 00:56:10 Index found: index_ageteens
2023/08/07 00:56:10 Dropped index index_ageteens
2023/08/07 00:56:10 Index found: index_company
2023/08/07 00:56:11 Dropped index index_company
2023/08/07 00:56:11 Index found: index_i2
2023/08/07 00:56:11 Dropped index index_i2
2023/08/07 00:56:11 Index found: index_tags
2023/08/07 00:56:11 Dropped index index_tags
2023/08/07 00:56:11 Index found: index_streetaddress
2023/08/07 00:56:11 Dropped index index_streetaddress
2023/08/07 00:56:11 Index found: index_height
2023/08/07 00:56:11 Dropped index index_height
2023/08/07 00:56:11 Index found: index_deferred
2023/08/07 00:56:11 Dropped index index_deferred
2023/08/07 00:56:11 Index found: index_state
2023/08/07 00:56:11 Dropped index index_state
2023/08/07 00:56:11 Index found: idx_age
2023/08/07 00:56:11 Dropped index idx_age
2023/08/07 00:56:11 Index found: index_age
2023/08/07 00:56:11 Dropped index index_age
2023/08/07 00:56:11 Index found: index_di1
2023/08/07 00:56:11 Dropped index index_di1
2023/08/07 00:56:11 Index found: index_isActive
2023/08/07 00:56:11 Dropped index index_isActive
2023/08/07 00:56:11 Index found: index_gender
2023/08/07 00:56:11 Dropped index index_gender
2023/08/07 00:56:11 Index found: index_email
2023/08/07 00:56:12 Dropped index index_email
2023/08/07 00:56:12 Index found: index_streetname
2023/08/07 00:56:12 Dropped index index_streetname
2023/08/07 00:56:12 Index found: index_ageabove30
2023/08/07 00:56:12 Dropped index index_ageabove30
2023/08/07 00:56:12 Index found: index_latitude
2023/08/07 00:56:12 Dropped index index_latitude
2023/08/07 00:56:32 Created the secondary index indexmut_1. Waiting for it become active
2023/08/07 00:56:32 Index is 7336551537832245810 now active
2023/08/07 00:56:32 Using n1ql client
2023/08/07 00:56:32 Expected and Actual scan responses are the same
2023/08/07 00:56:32 Len of expected and actual scan results are : 29902 and 29902
2023/08/07 00:56:32 ITERATION 0
2023/08/07 00:56:50 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:56:50 Index is 1582947340898333657 now active
2023/08/07 00:56:50 Using n1ql client
2023/08/07 00:56:50 Expected and Actual scan responses are the same
2023/08/07 00:56:50 Len of expected and actual scan results are : 39902 and 39902
2023/08/07 00:56:50 Using n1ql client
2023/08/07 00:56:51 Expected and Actual scan responses are the same
2023/08/07 00:56:51 Len of expected and actual scan results are : 39902 and 39902
2023/08/07 00:56:51 Dropping the secondary index indexmut_2
2023/08/07 00:56:51 Index dropped
2023/08/07 00:56:51 ITERATION 1
2023/08/07 00:57:08 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:57:08 Index is 3718090419762457162 now active
2023/08/07 00:57:08 Using n1ql client
2023/08/07 00:57:08 Expected and Actual scan responses are the same
2023/08/07 00:57:08 Len of expected and actual scan results are : 49902 and 49902
2023/08/07 00:57:08 Using n1ql client
2023/08/07 00:57:09 Expected and Actual scan responses are the same
2023/08/07 00:57:09 Len of expected and actual scan results are : 49902 and 49902
2023/08/07 00:57:09 Dropping the secondary index indexmut_2
2023/08/07 00:57:09 Index dropped
2023/08/07 00:57:09 ITERATION 2
2023/08/07 00:57:26 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:57:26 Index is 7603064578817091567 now active
2023/08/07 00:57:27 Using n1ql client
2023/08/07 00:57:27 Expected and Actual scan responses are the same
2023/08/07 00:57:27 Len of expected and actual scan results are : 59902 and 59902
2023/08/07 00:57:27 Using n1ql client
2023/08/07 00:57:28 Expected and Actual scan responses are the same
2023/08/07 00:57:28 Len of expected and actual scan results are : 59902 and 59902
2023/08/07 00:57:28 Dropping the secondary index indexmut_2
2023/08/07 00:57:28 Index dropped
2023/08/07 00:57:28 ITERATION 3
2023/08/07 00:57:46 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:57:46 Index is 13091241546037295231 now active
2023/08/07 00:57:46 Using n1ql client
2023/08/07 00:57:47 Expected and Actual scan responses are the same
2023/08/07 00:57:47 Len of expected and actual scan results are : 69902 and 69902
2023/08/07 00:57:47 Using n1ql client
2023/08/07 00:57:48 Expected and Actual scan responses are the same
2023/08/07 00:57:48 Len of expected and actual scan results are : 69902 and 69902
2023/08/07 00:57:48 Dropping the secondary index indexmut_2
2023/08/07 00:57:48 Index dropped
2023/08/07 00:57:48 ITERATION 4
2023/08/07 00:58:09 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:58:09 Index is 14036355433359729569 now active
2023/08/07 00:58:09 Using n1ql client
2023/08/07 00:58:10 Expected and Actual scan responses are the same
2023/08/07 00:58:10 Len of expected and actual scan results are : 79902 and 79902
2023/08/07 00:58:11 Using n1ql client
2023/08/07 00:58:11 Expected and Actual scan responses are the same
2023/08/07 00:58:11 Len of expected and actual scan results are : 79902 and 79902
2023/08/07 00:58:11 Dropping the secondary index indexmut_2
2023/08/07 00:58:11 Index dropped
2023/08/07 00:58:11 ITERATION 5
2023/08/07 00:58:31 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:58:31 Index is 10378850484902948200 now active
2023/08/07 00:58:31 Using n1ql client
2023/08/07 00:58:32 Expected and Actual scan responses are the same
2023/08/07 00:58:32 Len of expected and actual scan results are : 89902 and 89902
2023/08/07 00:58:32 Using n1ql client
2023/08/07 00:58:33 Expected and Actual scan responses are the same
2023/08/07 00:58:33 Len of expected and actual scan results are : 89902 and 89902
2023/08/07 00:58:33 Dropping the secondary index indexmut_2
2023/08/07 00:58:33 Index dropped
2023/08/07 00:58:33 ITERATION 6
2023/08/07 00:58:52 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:58:52 Index is 7538942288234020274 now active
2023/08/07 00:58:53 Using n1ql client
2023/08/07 00:58:54 Expected and Actual scan responses are the same
2023/08/07 00:58:54 Len of expected and actual scan results are : 99902 and 99902
2023/08/07 00:58:54 Using n1ql client
2023/08/07 00:58:54 Expected and Actual scan responses are the same
2023/08/07 00:58:54 Len of expected and actual scan results are : 99902 and 99902
2023/08/07 00:58:54 Dropping the secondary index indexmut_2
2023/08/07 00:58:54 Index dropped
2023/08/07 00:58:54 ITERATION 7
2023/08/07 00:59:15 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:59:15 Index is 867652050004530018 now active
2023/08/07 00:59:15 Using n1ql client
2023/08/07 00:59:16 Expected and Actual scan responses are the same
2023/08/07 00:59:16 Len of expected and actual scan results are : 109902 and 109902
2023/08/07 00:59:17 Using n1ql client
2023/08/07 00:59:17 Expected and Actual scan responses are the same
2023/08/07 00:59:17 Len of expected and actual scan results are : 109902 and 109902
2023/08/07 00:59:17 Dropping the secondary index indexmut_2
2023/08/07 00:59:17 Index dropped
2023/08/07 00:59:17 ITERATION 8
2023/08/07 00:59:43 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 00:59:43 Index is 11237956788276009252 now active
2023/08/07 00:59:43 Using n1ql client
2023/08/07 00:59:44 Expected and Actual scan responses are the same
2023/08/07 00:59:44 Len of expected and actual scan results are : 119902 and 119902
2023/08/07 00:59:44 Using n1ql client
2023/08/07 00:59:46 Expected and Actual scan responses are the same
2023/08/07 00:59:46 Len of expected and actual scan results are : 119902 and 119902
2023/08/07 00:59:46 Dropping the secondary index indexmut_2
2023/08/07 00:59:46 Index dropped
2023/08/07 00:59:46 ITERATION 9
2023/08/07 01:00:08 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 01:00:08 Index is 14513675048526176432 now active
2023/08/07 01:00:08 Using n1ql client
2023/08/07 01:00:09 Expected and Actual scan responses are the same
2023/08/07 01:00:09 Len of expected and actual scan results are : 129902 and 129902
2023/08/07 01:00:09 Using n1ql client
2023/08/07 01:00:10 Expected and Actual scan responses are the same
2023/08/07 01:00:10 Len of expected and actual scan results are : 129902 and 129902
2023/08/07 01:00:10 Dropping the secondary index indexmut_2
2023/08/07 01:00:10 Index dropped
2023/08/07 01:00:10 ITERATION 10
2023/08/07 01:00:36 Created the secondary index indexmut_2. Waiting for it become active
2023/08/07 01:00:36 Index is 2036344295008288982 now active
2023/08/07 01:00:37 Using n1ql client
2023/08/07 01:00:38 Expected and Actual scan responses are the same
2023/08/07 01:00:38 Len of expected and actual scan results are : 139902 and 139902
2023/08/07 01:00:38 Using n1ql client
2023/08/07 01:00:39 Expected and Actual scan responses are the same
2023/08/07 01:00:39 Len of expected and actual scan results are : 139902 and 139902
2023/08/07 01:00:39 Dropping the secondary index indexmut_2
2023/08/07 01:00:39 Index dropped
--- PASS: TestLargeMutations (270.04s)
=== RUN TestPlanner
2023/08/07 01:00:39 In TestPlanner()
2023/08/07 01:00:39 -------------------------------------------
2023/08/07 01:00:39 initial placement - 20-50M, 10 index, 3 replica, 2x
2023-08-07T01:00:39.716+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:39.721+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-08-07T01:00:39.721+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-08-07T01:00:39.724+05:30 [Info] switched currmeta from 477 -> 478 force true
2023-08-07T01:00:39.725+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-08-07T01:00:39.725+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-08-07T01:00:39.727+05:30 [Info] switched currmeta from 482 -> 482 force true
2023-08-07T01:00:39.734+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-08-07T01:00:39.734+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-08-07T01:00:39.736+05:30 [Info] switched currmeta from 478 -> 478 force true
2023-08-07T01:00:39.743+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-08-07T01:00:39.743+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-08-07T01:00:39.744+05:30 [Info] switched currmeta from 482 -> 482 force true
2023-08-07T01:00:39.782+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:39.782+05:30 [Info] Score: 0.009408560836011328
2023-08-07T01:00:39.782+05:30 [Info] Memory Quota: 67305505302 (62.6831G)
2023-08-07T01:00:39.782+05:30 [Info] CPU Quota: 12
2023-08-07T01:00:39.782+05:30 [Info] Indexer Memory Mean 42839873593 (39.8977G)
2023-08-07T01:00:39.782+05:30 [Info] Indexer Memory Deviation 806123113 (768.779M) (1.88%)
2023-08-07T01:00:39.782+05:30 [Info] Indexer Memory Utilization 0.6365
2023-08-07T01:00:39.782+05:30 [Info] Indexer CPU Mean 13.4998
2023-08-07T01:00:39.782+05:30 [Info] Indexer CPU Deviation 2.47 (18.32%)
2023-08-07T01:00:39.782+05:30 [Info] Indexer CPU Utilization 1.1250
2023-08-07T01:00:39.782+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:39.782+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:39.782+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:39.782+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:39.782+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:39.782+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:39.782+05:30 [Info] Indexer Data Size Mean 42839873593 (39.8977G)
2023-08-07T01:00:39.782+05:30 [Info] Indexer Data Size Deviation 806123113 (768.779M) (1.88%)
2023-08-07T01:00:39.782+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:39.782+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:39.782+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:39.782+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:39 -------------------------------------------
2023/08/07 01:00:39 initial placement - 20-50M, 30 index, 3 replica, 2x
2023-08-07T01:00:39.783+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:40.522+05:30 [Info] Score: 0.03391126207258809
2023-08-07T01:00:40.522+05:30 [Info] Memory Quota: 72545211928 (67.563G)
2023-08-07T01:00:40.522+05:30 [Info] CPU Quota: 12
2023-08-07T01:00:40.522+05:30 [Info] Indexer Memory Mean 47012828480 (43.7841G)
2023-08-07T01:00:40.522+05:30 [Info] Indexer Memory Deviation 3188528694 (2.96955G) (6.78%)
2023-08-07T01:00:40.522+05:30 [Info] Indexer Memory Utilization 0.6480
2023-08-07T01:00:40.522+05:30 [Info] Indexer CPU Mean 12.9808
2023-08-07T01:00:40.522+05:30 [Info] Indexer CPU Deviation 2.93 (22.56%)
2023-08-07T01:00:40.522+05:30 [Info] Indexer CPU Utilization 1.0817
2023-08-07T01:00:40.522+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:40.522+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:40.522+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:40.522+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:40.522+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:40.522+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:40.522+05:30 [Info] Indexer Data Size Mean 47012828480 (43.7841G)
2023-08-07T01:00:40.522+05:30 [Info] Indexer Data Size Deviation 3188528694 (2.96955G) (6.78%)
2023-08-07T01:00:40.522+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:40.522+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:40.522+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:40.522+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:40 -------------------------------------------
2023/08/07 01:00:40 initial placement - 20-50M, 30 index, 3 replica, 4x
2023-08-07T01:00:40.523+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:40.787+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:40.787+05:30 [Info] Score: 0.01300541857096666
2023-08-07T01:00:40.787+05:30 [Info] Memory Quota: 129481505816 (120.589G)
2023-08-07T01:00:40.787+05:30 [Info] CPU Quota: 24
2023-08-07T01:00:40.787+05:30 [Info] Indexer Memory Mean 83321182296 (77.5989G)
2023-08-07T01:00:40.787+05:30 [Info] Indexer Memory Deviation 2167253703 (2.01841G) (2.60%)
2023-08-07T01:00:40.787+05:30 [Info] Indexer Memory Utilization 0.6435
2023-08-07T01:00:40.787+05:30 [Info] Indexer CPU Mean 22.3706
2023-08-07T01:00:40.787+05:30 [Info] Indexer CPU Deviation 4.52 (20.22%)
2023-08-07T01:00:40.787+05:30 [Info] Indexer CPU Utilization 0.9321
2023-08-07T01:00:40.787+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:40.787+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:40.787+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:40.787+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:40.787+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:40.787+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:40.787+05:30 [Info] Indexer Data Size Mean 83321182296 (77.5989G)
2023-08-07T01:00:40.787+05:30 [Info] Indexer Data Size Deviation 2167253703 (2.01841G) (2.60%)
2023-08-07T01:00:40.787+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:40.787+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:40.787+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:40.787+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:40 -------------------------------------------
2023/08/07 01:00:40 initial placement - 200-500M, 10 index, 3 replica, 2x
2023-08-07T01:00:40.788+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:40.826+05:30 [Info] Score: 0.032637992262121926
2023-08-07T01:00:40.826+05:30 [Info] Memory Quota: 527074967294 (490.877G)
2023-08-07T01:00:40.826+05:30 [Info] CPU Quota: 12
2023-08-07T01:00:40.827+05:30 [Info] Indexer Memory Mean 400195283832 (372.711G)
2023-08-07T01:00:40.827+05:30 [Info] Indexer Memory Deviation 26123141154 (24.3291G) (6.53%)
2023-08-07T01:00:40.827+05:30 [Info] Indexer Memory Utilization 0.7593
2023-08-07T01:00:40.827+05:30 [Info] Indexer CPU Mean 11.8769
2023-08-07T01:00:40.827+05:30 [Info] Indexer CPU Deviation 1.71 (14.40%)
2023-08-07T01:00:40.827+05:30 [Info] Indexer CPU Utilization 0.9897
2023-08-07T01:00:40.827+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:40.827+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:40.827+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:40.827+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:40.827+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:40.827+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:40.827+05:30 [Info] Indexer Data Size Mean 400195283832 (372.711G)
2023-08-07T01:00:40.827+05:30 [Info] Indexer Data Size Deviation 26123141154 (24.3291G) (6.53%)
2023-08-07T01:00:40.827+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:40.827+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:40.827+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:40.827+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:40 -------------------------------------------
2023/08/07 01:00:40 initial placement - 200-500M, 30 index, 3 replica, 2x
2023-08-07T01:00:40.827+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:41.005+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-08-07T01:00:41.012+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-08-07T01:00:41.012+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-08-07T01:00:41.012+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-08-07T01:00:41.012+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-08-07T01:00:41.014+05:30 [Info] switched currmeta from 482 -> 482 force true
2023-08-07T01:00:41.014+05:30 [Info] switched currmeta from 478 -> 478 force true
2023-08-07T01:00:42.256+05:30 [Info] Score: 0.02563264192589641
2023-08-07T01:00:42.256+05:30 [Info] Memory Quota: 485585853904 (452.237G)
2023-08-07T01:00:42.256+05:30 [Info] CPU Quota: 12
2023-08-07T01:00:42.256+05:30 [Info] Indexer Memory Mean 381211476079 (355.031G)
2023-08-07T01:00:42.256+05:30 [Info] Indexer Memory Deviation 19542914528 (18.2008G) (5.13%)
2023-08-07T01:00:42.256+05:30 [Info] Indexer Memory Utilization 0.7851
2023-08-07T01:00:42.256+05:30 [Info] Indexer CPU Mean 11.0720
2023-08-07T01:00:42.256+05:30 [Info] Indexer CPU Deviation 3.14 (28.39%)
2023-08-07T01:00:42.256+05:30 [Info] Indexer CPU Utilization 0.9227
2023-08-07T01:00:42.256+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:42.256+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:42.256+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:42.256+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:42.256+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:42.256+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:42.256+05:30 [Info] Indexer Data Size Mean 381211476079 (355.031G)
2023-08-07T01:00:42.256+05:30 [Info] Indexer Data Size Deviation 19542914528 (18.2008G) (5.13%)
2023-08-07T01:00:42.256+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:42.256+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:42.256+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:42.256+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:42 -------------------------------------------
2023/08/07 01:00:42 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2023-08-07T01:00:42.257+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:42.756+05:30 [Info] Score: 0.01611234650724494
2023-08-07T01:00:42.756+05:30 [Info] Memory Quota: 355229820153 (330.834G)
2023-08-07T01:00:42.756+05:30 [Info] CPU Quota: 16
2023-08-07T01:00:42.756+05:30 [Info] Indexer Memory Mean 282130132940 (262.754G)
2023-08-07T01:00:42.756+05:30 [Info] Indexer Memory Deviation 9091556924 (8.46717G) (3.22%)
2023-08-07T01:00:42.756+05:30 [Info] Indexer Memory Utilization 0.7942
2023-08-07T01:00:42.756+05:30 [Info] Indexer CPU Mean 8.1463
2023-08-07T01:00:42.756+05:30 [Info] Indexer CPU Deviation 5.03 (61.77%)
2023-08-07T01:00:42.756+05:30 [Info] Indexer CPU Utilization 0.5091
2023-08-07T01:00:42.756+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:42.756+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:42.756+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:42.756+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:42.756+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:42.756+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:42.756+05:30 [Info] Indexer Data Size Mean 282130132940 (262.754G)
2023-08-07T01:00:42.756+05:30 [Info] Indexer Data Size Deviation 9091556924 (8.46717G) (3.22%)
2023-08-07T01:00:42.756+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:42.756+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:42.756+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:42.756+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:42 -------------------------------------------
2023/08/07 01:00:42 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2023-08-07T01:00:42.757+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:43.176+05:30 [Info] Score: 0.01382013719106262
2023-08-07T01:00:43.176+05:30 [Info] Memory Quota: 365466190290 (340.367G)
2023-08-07T01:00:43.176+05:30 [Info] CPU Quota: 20
2023-08-07T01:00:43.176+05:30 [Info] Indexer Memory Mean 285463620591 (265.859G)
2023-08-07T01:00:43.176+05:30 [Info] Indexer Memory Deviation 7890292799 (7.34841G) (2.76%)
2023-08-07T01:00:43.176+05:30 [Info] Indexer Memory Utilization 0.7811
2023-08-07T01:00:43.176+05:30 [Info] Indexer CPU Mean 10.9972
2023-08-07T01:00:43.176+05:30 [Info] Indexer CPU Deviation 5.38 (48.95%)
2023-08-07T01:00:43.176+05:30 [Info] Indexer CPU Utilization 0.5499
2023-08-07T01:00:43.176+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.176+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.176+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.176+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.176+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.176+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.176+05:30 [Info] Indexer Data Size Mean 285463620591 (265.859G)
2023-08-07T01:00:43.176+05:30 [Info] Indexer Data Size Deviation 7890292799 (7.34841G) (2.76%)
2023-08-07T01:00:43.176+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.176+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.176+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.176+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 initial placement - 6 2M index, 1 replica, 2x
2023-08-07T01:00:43.187+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:43.201+05:30 [Info] Score: 0
2023-08-07T01:00:43.201+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2023-08-07T01:00:43.201+05:30 [Info] CPU Quota: 2
2023-08-07T01:00:43.201+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2023-08-07T01:00:43.201+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.201+05:30 [Info] Indexer Memory Utilization 0.4290
2023-08-07T01:00:43.201+05:30 [Info] Indexer CPU Mean 1.2000
2023-08-07T01:00:43.201+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:43.201+05:30 [Info] Indexer CPU Utilization 0.6000
2023-08-07T01:00:43.201+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.201+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.201+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.201+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.201+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.201+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.201+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2023-08-07T01:00:43.201+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.201+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.201+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.201+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.201+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 initial placement - 5 20M primary index, 2 replica, 2x
2023-08-07T01:00:43.211+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:43.253+05:30 [Info] Score: 0
2023-08-07T01:00:43.253+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2023-08-07T01:00:43.253+05:30 [Info] CPU Quota: 2
2023-08-07T01:00:43.253+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2023-08-07T01:00:43.253+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.253+05:30 [Info] Indexer Memory Utilization 0.7659
2023-08-07T01:00:43.253+05:30 [Info] Indexer CPU Mean 1.2000
2023-08-07T01:00:43.253+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:43.253+05:30 [Info] Indexer CPU Utilization 0.6000
2023-08-07T01:00:43.253+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.253+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.253+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.253+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.253+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.253+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.253+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2023-08-07T01:00:43.253+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.253+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.253+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.253+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.253+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 initial placement - 5 20M array index, 2 replica, 2x
2023-08-07T01:00:43.262+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:43.305+05:30 [Info] Score: 0
2023-08-07T01:00:43.305+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2023-08-07T01:00:43.305+05:30 [Info] CPU Quota: 2
2023-08-07T01:00:43.305+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2023-08-07T01:00:43.305+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.305+05:30 [Info] Indexer Memory Utilization 0.8063
2023-08-07T01:00:43.305+05:30 [Info] Indexer CPU Mean 1.2000
2023-08-07T01:00:43.305+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:43.305+05:30 [Info] Indexer CPU Utilization 0.6000
2023-08-07T01:00:43.305+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.305+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.305+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.305+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.305+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.305+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.305+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2023-08-07T01:00:43.305+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.305+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.305+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.305+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.305+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 initial placement - 3 replica constraint, 2 index, 2x
2023-08-07T01:00:43.309+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:43.347+05:30 [Info] Score: 0
2023-08-07T01:00:43.347+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-08-07T01:00:43.347+05:30 [Info] CPU Quota: 2
2023-08-07T01:00:43.347+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-08-07T01:00:43.347+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.347+05:30 [Info] Indexer Memory Utilization 0.0049
2023-08-07T01:00:43.347+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:43.347+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:43.347+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:43.347+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.347+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.347+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.347+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.347+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.347+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.347+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-08-07T01:00:43.347+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.347+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.347+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.347+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.347+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2023-08-07T01:00:43.356+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.021289113496167116
2023-08-07T01:00:43.486+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:43.486+05:30 [Info] Score: 0.007189938568471697
2023-08-07T01:00:43.486+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2023-08-07T01:00:43.486+05:30 [Info] CPU Quota: 27
2023-08-07T01:00:43.486+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2023-08-07T01:00:43.486+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2023-08-07T01:00:43.486+05:30 [Info] Indexer Memory Utilization 0.5679
2023-08-07T01:00:43.486+05:30 [Info] Indexer CPU Mean 20.1734
2023-08-07T01:00:43.486+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2023-08-07T01:00:43.486+05:30 [Info] Indexer CPU Utilization 0.7472
2023-08-07T01:00:43.486+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.486+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.486+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.487+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.487+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.487+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.487+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2023-08-07T01:00:43.487+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2023-08-07T01:00:43.487+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.487+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.487+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.487+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2023-08-07T01:00:43.498+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.00290577032754498
2023-08-07T01:00:43.673+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-08-07T01:00:43.679+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-08-07T01:00:43.679+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-08-07T01:00:43.679+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-08-07T01:00:43.679+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-08-07T01:00:43.680+05:30 [Info] switched currmeta from 478 -> 478 force true
2023-08-07T01:00:43.680+05:30 [Info] switched currmeta from 482 -> 482 force true
2023-08-07T01:00:43.743+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:43.743+05:30 [Info] Score: 0.00043718596495524715
2023-08-07T01:00:43.743+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-08-07T01:00:43.743+05:30 [Info] CPU Quota: 20
2023-08-07T01:00:43.743+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2023-08-07T01:00:43.743+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2023-08-07T01:00:43.743+05:30 [Info] Indexer Memory Utilization 0.7321
2023-08-07T01:00:43.743+05:30 [Info] Indexer CPU Mean 14.2305
2023-08-07T01:00:43.743+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2023-08-07T01:00:43.743+05:30 [Info] Indexer CPU Utilization 0.7115
2023-08-07T01:00:43.743+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.743+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.743+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.743+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.743+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.743+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.743+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2023-08-07T01:00:43.743+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2023-08-07T01:00:43.743+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.743+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.743+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.743+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 incr placement - 3 server group, 3 replica, 1x
2023-08-07T01:00:43.746+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:43.759+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:43.759+05:30 [Info] Score: 0
2023-08-07T01:00:43.759+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-08-07T01:00:43.759+05:30 [Info] CPU Quota: 16
2023-08-07T01:00:43.759+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-08-07T01:00:43.759+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.759+05:30 [Info] Indexer Memory Utilization 0.0049
2023-08-07T01:00:43.759+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:43.759+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:43.759+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:43.759+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.759+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.759+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.759+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.759+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.759+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.759+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-08-07T01:00:43.759+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.759+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.759+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.759+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.759+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 incr placement - 2 server group, 3 replica, 1x
2023-08-07T01:00:43.761+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2023-08-07T01:00:43.762+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2023-08-07T01:00:43.762+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2023-08-07T01:00:43.762+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.816496580927726
2023-08-07T01:00:43.787+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:43.787+05:30 [Info] Score: 0
2023-08-07T01:00:43.787+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-08-07T01:00:43.787+05:30 [Info] CPU Quota: 16
2023-08-07T01:00:43.787+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-08-07T01:00:43.787+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.787+05:30 [Info] Indexer Memory Utilization 0.0049
2023-08-07T01:00:43.787+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:43.787+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:43.787+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:43.787+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.787+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.787+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.787+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.787+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.787+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.787+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-08-07T01:00:43.787+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:43.787+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:43.787+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:43.787+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:43.787+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2023-08-07T01:00:43.790+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2213625912895936
2023-08-07T01:00:43.790+05:30 [Info] Planner::initial temperature: initial resource variation 0.2213625912895936 temp 0.022136259128959362
2023-08-07T01:00:43.968+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:43.968+05:30 [Info] Score: 0.22239405591130623
2023-08-07T01:00:43.968+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-08-07T01:00:43.968+05:30 [Info] CPU Quota: 30
2023-08-07T01:00:43.968+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-08-07T01:00:43.968+05:30 [Info] Indexer Memory Deviation 1691319845 (1.57516G) (1.90%)
2023-08-07T01:00:43.968+05:30 [Info] Indexer Memory Utilization 0.6367
2023-08-07T01:00:43.968+05:30 [Info] Indexer CPU Mean 24.0538
2023-08-07T01:00:43.968+05:30 [Info] Indexer CPU Deviation 3.57 (14.83%)
2023-08-07T01:00:43.968+05:30 [Info] Indexer CPU Utilization 0.8018
2023-08-07T01:00:43.968+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:43.968+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:43.968+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:43.968+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.968+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:43.968+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:43.968+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-08-07T01:00:43.968+05:30 [Info] Indexer Data Size Deviation 1691319845 (1.57516G) (1.90%)
2023-08-07T01:00:43.968+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2023-08-07T01:00:43.968+05:30 [Info] Index Data Moved (exclude new node) 442.814G (44.58%)
2023-08-07T01:00:43.968+05:30 [Info] No. Index (from non-deleted node) 90
2023-08-07T01:00:43.968+05:30 [Info] No. Index Moved (exclude new node) 38 (42.22%)
2023/08/07 01:00:43 -------------------------------------------
2023/08/07 01:00:43 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2023-08-07T01:00:43.970+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.261948897247737
2023-08-07T01:00:43.970+05:30 [Info] Planner::initial temperature: initial resource variation 0.261948897247737 temp 0.026194889724773702
2023-08-07T01:00:44.185+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:44.185+05:30 [Info] Score: 0.1488283495891421
2023-08-07T01:00:44.185+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-08-07T01:00:44.185+05:30 [Info] CPU Quota: 20
2023-08-07T01:00:44.185+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-08-07T01:00:44.185+05:30 [Info] Indexer Memory Deviation 23743950505 (22.1133G) (6.05%)
2023-08-07T01:00:44.185+05:30 [Info] Indexer Memory Utilization 0.7311
2023-08-07T01:00:44.185+05:30 [Info] Indexer CPU Mean 13.9305
2023-08-07T01:00:44.185+05:30 [Info] Indexer CPU Deviation 3.11 (22.32%)
2023-08-07T01:00:44.185+05:30 [Info] Indexer CPU Utilization 0.6965
2023-08-07T01:00:44.185+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:44.185+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:44.185+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:44.185+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.185+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:44.185+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.185+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-08-07T01:00:44.185+05:30 [Info] Indexer Data Size Deviation 23743950505 (22.1133G) (6.05%)
2023-08-07T01:00:44.185+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2023-08-07T01:00:44.185+05:30 [Info] Index Data Moved (exclude new node) 1.25839T (29.38%)
2023-08-07T01:00:44.185+05:30 [Info] No. Index (from non-deleted node) 90
2023-08-07T01:00:44.185+05:30 [Info] No. Index Moved (exclude new node) 19 (21.11%)
2023/08/07 01:00:44 -------------------------------------------
2023/08/07 01:00:44 rebalance - travel sample, 10% shuffle, 1x
2023-08-07T01:00:44.186+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.02262031463671501
2023-08-07T01:00:44.186+05:30 [Info] Planner::initial temperature: initial resource variation 0.02262031463671501 temp 0.0022620314636715012
2023-08-07T01:00:44.187+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:44.187+05:30 [Info] Score: 0.005655078659178752
2023-08-07T01:00:44.187+05:30 [Info] Memory Quota: 536870912 (512M)
2023-08-07T01:00:44.187+05:30 [Info] CPU Quota: 8
2023-08-07T01:00:44.187+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-08-07T01:00:44.187+05:30 [Info] Indexer Memory Deviation 395926 (386.646K) (2.26%)
2023-08-07T01:00:44.187+05:30 [Info] Indexer Memory Utilization 0.0326
2023-08-07T01:00:44.187+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:44.187+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:44.187+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:44.187+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:44.187+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:44.187+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:44.187+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.187+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:44.187+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.187+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-08-07T01:00:44.187+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:44.187+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:44.187+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:44.187+05:30 [Info] No. Index (from non-deleted node) 10
2023-08-07T01:00:44.187+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:44 -------------------------------------------
2023/08/07 01:00:44 rebalance - 20-50M, 90 index, swap 2, 1x
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-08-07T01:00:44.189+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-08-07T01:00:44.189+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4095843409677649
2023-08-07T01:00:44.189+05:30 [Info] Planner::initial temperature: initial resource variation 0.4095843409677649 temp 0.04095843409677649
2023-08-07T01:00:44.399+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:44.399+05:30 [Info] Score: 0.014312764552285683
2023-08-07T01:00:44.399+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-08-07T01:00:44.399+05:30 [Info] CPU Quota: 30
2023-08-07T01:00:44.399+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-08-07T01:00:44.399+05:30 [Info] Indexer Memory Deviation 2544138804 (2.36941G) (2.86%)
2023-08-07T01:00:44.399+05:30 [Info] Indexer Memory Utilization 0.6367
2023-08-07T01:00:44.399+05:30 [Info] Indexer CPU Mean 24.0538
2023-08-07T01:00:44.399+05:30 [Info] Indexer CPU Deviation 1.58 (6.55%)
2023-08-07T01:00:44.399+05:30 [Info] Indexer CPU Utilization 0.8018
2023-08-07T01:00:44.399+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:44.399+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:44.399+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:44.399+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.399+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:44.399+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.399+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-08-07T01:00:44.399+05:30 [Info] Indexer Data Size Deviation 2544138804 (2.36941G) (2.86%)
2023-08-07T01:00:44.399+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:44.399+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:44.399+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:44.399+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:44 -------------------------------------------
2023/08/07 01:00:44 rebalance - mixed small/medium, 90 index, swap 2, 1x
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-08-07T01:00:44.400+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-08-07T01:00:44.401+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4082556623939647
2023-08-07T01:00:44.401+05:30 [Info] Planner::initial temperature: initial resource variation 0.4082556623939647 temp 0.040825566239396475
2023-08-07T01:00:44.559+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:44.559+05:30 [Info] Score: 0.0011689458717389425
2023-08-07T01:00:44.559+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-08-07T01:00:44.559+05:30 [Info] CPU Quota: 20
2023-08-07T01:00:44.559+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-08-07T01:00:44.559+05:30 [Info] Indexer Memory Deviation 917635606 (875.126M) (0.23%)
2023-08-07T01:00:44.559+05:30 [Info] Indexer Memory Utilization 0.7311
2023-08-07T01:00:44.559+05:30 [Info] Indexer CPU Mean 13.9305
2023-08-07T01:00:44.559+05:30 [Info] Indexer CPU Deviation 0.63 (4.50%)
2023-08-07T01:00:44.559+05:30 [Info] Indexer CPU Utilization 0.6965
2023-08-07T01:00:44.559+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:44.559+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:44.559+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:44.559+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.559+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:44.559+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.559+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-08-07T01:00:44.559+05:30 [Info] Indexer Data Size Deviation 917635606 (875.126M) (0.23%)
2023-08-07T01:00:44.559+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:44.559+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:44.559+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:44.559+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:44 -------------------------------------------
2023/08/07 01:00:44 rebalance - travel sample, swap 2, 1x
2023-08-07T01:00:44.560+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 192.168.1.8:9000
2023-08-07T01:00:44.560+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-08-07T01:00:44.560+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0086622738872069
2023-08-07T01:00:44.560+05:30 [Info] Planner::initial temperature: initial resource variation 1.0086622738872069 temp 0.1008662273887207
2023-08-07T01:00:44.674+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:44.674+05:30 [Info] Score: 0.00031929273712825843
2023-08-07T01:00:44.674+05:30 [Info] Memory Quota: 536870912 (512M)
2023-08-07T01:00:44.674+05:30 [Info] CPU Quota: 8
2023-08-07T01:00:44.674+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-08-07T01:00:44.674+05:30 [Info] Indexer Memory Deviation 22354 (21.8301K) (0.13%)
2023-08-07T01:00:44.674+05:30 [Info] Indexer Memory Utilization 0.0326
2023-08-07T01:00:44.674+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:44.674+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:44.674+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:44.674+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:44.674+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:44.674+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:44.674+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.674+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:44.674+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:44.674+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-08-07T01:00:44.674+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:44.674+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:44.674+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:44.674+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:44.674+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:44 -------------------------------------------
2023/08/07 01:00:44 rebalance - 8 identical index, add 4, 1x
2023-08-07T01:00:44.675+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-08-07T01:00:44.675+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-08-07T01:00:44.675+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-08-07T01:00:44.675+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-08-07T01:00:44.675+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1
2023-08-07T01:00:44.675+05:30 [Info] Planner::initial temperature: initial resource variation 1 temp 0.1
2023-08-07T01:00:48.584+05:30 [Info] Score: 0
2023-08-07T01:00:48.584+05:30 [Info] Memory Quota: 930294000 (887.197M)
2023-08-07T01:00:48.584+05:30 [Info] CPU Quota: 2
2023-08-07T01:00:48.584+05:30 [Info] Indexer Memory Mean 260000000 (247.955M)
2023-08-07T01:00:48.584+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:48.584+05:30 [Info] Indexer Memory Utilization 0.2795
2023-08-07T01:00:48.584+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:48.584+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:48.584+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:48.584+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:48.584+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:48.584+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:48.584+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:48.584+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:48.584+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:48.584+05:30 [Info] Indexer Data Size Mean 260000000 (247.955M)
2023-08-07T01:00:48.584+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:48.584+05:30 [Info] Total Index Data (from non-deleted node) 1.93715G
2023-08-07T01:00:48.584+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:48.584+05:30 [Info] No. Index (from non-deleted node) 8
2023-08-07T01:00:48.584+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:48 -------------------------------------------
2023/08/07 01:00:48 rebalance - 8 identical index, delete 2, 2x
2023-08-07T01:00:48.585+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:48.585+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023-08-07T01:00:48.629+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:48.629+05:30 [Info] Score: 0
2023-08-07T01:00:48.629+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2023-08-07T01:00:48.629+05:30 [Info] CPU Quota: 4
2023-08-07T01:00:48.629+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2023-08-07T01:00:48.629+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:48.629+05:30 [Info] Indexer Memory Utilization 0.0098
2023-08-07T01:00:48.629+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:48.629+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:48.629+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:48.629+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:48.629+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:48.629+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:48.629+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:48.629+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:48.629+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:48.629+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2023-08-07T01:00:48.629+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:48.629+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:48.629+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:48.629+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:48.629+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:48 -------------------------------------------
2023/08/07 01:00:48 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2023-08-07T01:00:48.630+05:30 [Warn] There is more replica than available nodes. Will not move index replica (default,,,country) from ejected node 127.0.0.1:9003
2023-08-07T01:00:48.630+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-08-07T01:00:48.630+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-08-07T01:00:48.630+05:30 [Info] Score: 0
2023-08-07T01:00:48.630+05:30 [Info] Memory Quota: 536870912 (512M)
2023-08-07T01:00:48.630+05:30 [Info] CPU Quota: 16
2023-08-07T01:00:48.630+05:30 [Info] Indexer Memory Mean 0 (0)
2023-08-07T01:00:48.630+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:48.630+05:30 [Info] Indexer Memory Utilization 0.0000
2023-08-07T01:00:48.630+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:48.630+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:48.630+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:48.630+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:48.630+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:48.630+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:48.630+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:48.630+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:48.630+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:48.630+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-08-07T01:00:48.630+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:48.630+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:48.630+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:48.630+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:48.630+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:48 -------------------------------------------
2023/08/07 01:00:48 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2023-08-07T01:00:48.630+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-08-07T01:00:48.630+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-08-07T01:00:48.630+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9003
2023-08-07T01:00:48.630+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-08-07T01:00:48.631+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-08-07T01:00:48.631+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-08-07T01:00:48.631+05:30 [Info] Score: 0
2023-08-07T01:00:48.631+05:30 [Info] Memory Quota: 268435456 (256M)
2023-08-07T01:00:48.631+05:30 [Info] CPU Quota: 8
2023-08-07T01:00:48.631+05:30 [Info] Indexer Memory Mean 0 (0)
2023-08-07T01:00:48.631+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-08-07T01:00:48.631+05:30 [Info] Indexer Memory Utilization 0.0000
2023-08-07T01:00:48.631+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:48.631+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:48.631+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:48.631+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:48.631+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:48.631+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:48.631+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:48.631+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:48.631+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:48.631+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-08-07T01:00:48.631+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:48.631+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:48.631+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:48.631+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:48.631+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/08/07 01:00:48 -------------------------------------------
2023/08/07 01:00:48 Minimum memory test 1: min memory = 0
2023-08-07T01:00:48.632+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-08-07T01:00:48.632+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-08-07T01:00:48.634+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/08/07 01:00:48 -------------------------------------------
2023/08/07 01:00:48 Minimum memory test 2: min memory > quota
2023-08-07T01:00:48.634+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=7us
2023-08-07T01:00:48.634+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-08-07T01:00:48.634+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=7us
2023-08-07T01:00:48.634+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-08-07T01:00:48.634+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/08/07 01:00:49 -------------------------------------------
2023/08/07 01:00:49 Minimum memory test 3: min memory < quota
2023-08-07T01:00:49.601+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-08-07T01:00:49.601+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/08/07 01:00:50 -------------------------------------------
2023/08/07 01:00:50 Minimum memory test 4: replica repair with min memory > quota
2023-08-07T01:00:50.954+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2023-08-07T01:00:50.955+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=13us
2023-08-07T01:00:50.955+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=10us
2023-08-07T01:00:50.955+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=8us
2023-08-07T01:00:50.955+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-08-07T01:00:50.955+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-08-07T01:00:50.955+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-08-07T01:00:50.955+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:50.955+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=307us
2023-08-07T01:00:50.955+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-08-07T01:00:50.955+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-08-07T01:00:50.955+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-08-07T01:00:50.955+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:50.955+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=240us
2023-08-07T01:00:50.955+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster. Will not rebuild lost replica.
2023-08-07T01:00:50.955+05:30 [Warn]
MemoryQuota: 200
CpuQuota: 8
--- Violations for index (mem 130, cpu 0) at node 127.0.0.1:9003
Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2023-08-07T01:00:50.955+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-08-07T01:00:50.955+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0 is less than threshold: 0. No nodes have been added or deleted and there are no violations observed
2023-08-07T01:00:50.955+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023/08/07 01:00:50 -------------------------------------------
2023/08/07 01:00:50 Minimum memory test 5: replica repair with min memory < quota
2023-08-07T01:00:50.956+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2023-08-07T01:00:50.956+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-08-07T01:00:50.956+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-08-07T01:00:50.971+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/08/07 01:00:50 -------------------------------------------
2023/08/07 01:00:50 Minimum memory test 6: rebalance with min memory > quota
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=4us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=7us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=6us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=3us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=3us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=3us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=3us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=3us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=3us
2023/08/07 01:00:50 -------------------------------------------
2023/08/07 01:00:50 Minimum memory test 7: rebalance-out with min memory > quota
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=4us
2023-08-07T01:00:50.972+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=7us
2023-08-07T01:00:50.973+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-08-07T01:00:50.973+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=5us
2023-08-07T01:00:50.973+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=3us
2023-08-07T01:00:50.973+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-08-07T01:00:50.973+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-08-07T01:00:50.973+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-08-07T01:00:50.973+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/08/07 01:00:50 -------------------------------------------
2023/08/07 01:00:50 Minimum memory test 8: plan with min memory > quota
2023-08-07T01:00:50.976+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-08-07T01:00:50.977+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-08-07T01:00:50.977+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:50.977+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=1ms
2023-08-07T01:00:50.977+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=4us
2023-08-07T01:00:50.977+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=4us
2023-08-07T01:00:50.977+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-08-07T01:00:50.977+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=4us
2023-08-07T01:00:50.977+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=3us
2023-08-07T01:00:50.977+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-08-07T01:00:50.977+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-08-07T01:00:50.978+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/08/07 01:00:50 -------------------------------------------
2023/08/07 01:00:50 Minimum memory test 9: single node rebalance with min memory > quota
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=4us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=3us
2023-08-07T01:00:50.978+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=3us
2023/08/07 01:00:50 -------------------------------------------
2023/08/07 01:00:50 Minimum memory test 10: plan with partitioned index on empty cluster
2023-08-07T01:00:50.981+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.7071067811865476
2023-08-07T01:00:51.026+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 iterationTest :: Remove one node - failure
2023-08-07T01:00:51.027+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2957156694059855
2023-08-07T01:00:51.108+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:51.108+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.109+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.109+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.109+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.109+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1508325717976521).
2023-08-07T01:00:51.109+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=463us
2023-08-07T01:00:51.109+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.109+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.109+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.109+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.109+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.2194807768516413).
2023-08-07T01:00:51.109+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=378us
2023-08-07T01:00:51.109+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.109+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.110+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.110+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.110+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.26961294342928493).
2023-08-07T01:00:51.110+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=265us
2023-08-07T01:00:51.110+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.110+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.110+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.110+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.110+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.15627471190473383).
2023-08-07T01:00:51.110+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=323us
2023-08-07T01:00:51.110+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.110+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.110+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.110+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.110+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.19710321393289534).
2023-08-07T01:00:51.110+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=361us
2023-08-07T01:00:51.110+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.111+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.111+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.111+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.111+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.20090428921146417).
2023-08-07T01:00:51.111+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=304us
2023-08-07T01:00:51.111+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-08-07T01:00:51.111+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.111+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.111+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.111+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.111+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1916327534665922).
2023-08-07T01:00:51.111+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=306us
2023-08-07T01:00:51.111+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.111+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.111+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.111+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.111+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.19841835746597117).
2023-08-07T01:00:51.111+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=290us
2023-08-07T01:00:51.112+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.112+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.112+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.112+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.112+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1957244044402914).
2023-08-07T01:00:51.112+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=326us
2023-08-07T01:00:51.112+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.112+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.112+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.112+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.112+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.17465669387726898).
2023-08-07T01:00:51.112+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=328us
2023-08-07T01:00:51.112+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.112+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.112+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.112+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.112+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1508325717976521).
2023-08-07T01:00:51.113+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=299us
2023-08-07T01:00:51.113+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.014227975757132883
2023-08-07T01:00:51.113+05:30 [Info] Planner::initial temperature: initial resource variation 0.014227975757132883 temp 0.03357720242428671
2023-08-07T01:00:51.113+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.113+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-08-07T01:00:51.113+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.26961294342928493).
2023-08-07T01:00:51.113+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=295us
2023-08-07T01:00:51.113+05:30 [Error]
MemoryQuota: 5302940000000
CpuQuota: 5
--- Violations for index <6158060398607817242, bucket1, , > (mem 21.1295G, cpu 2.91276) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.67587T, free cpu -36.27108)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63214T, free cpu -42.49712)
--- Violations for index <9382536323093014220, bucket1, , > (mem 18.848G, cpu 1.024) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.67587T, free cpu -36.27108)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63214T, free cpu -42.49712)
--- Violations for index <16561708488425552802, bucket1, , > (mem 16.2688G, cpu 2.7704) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.67587T, free cpu -36.27108)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63214T, free cpu -42.49712)
--- Violations for index <1138180040390486440, bucket1, , > (mem 14.4477G, cpu 2.71128) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.67587T, free cpu -36.27108)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63214T, free cpu -42.49712)
--- Violations for index <12283766936536260157, bucket1, , > (mem 15.0426G, cpu 4.64936) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.67587T, free cpu -36.27108)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63214T, free cpu -42.49712)
--- Violations for index <16926462813491158777, bucket1, , > (mem 9.36221G, cpu 3.01996) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.67587T, free cpu -36.27108)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63214T, free cpu -42.49712)
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 iterationTest :: Remove one node - success
2023-08-07T01:00:51.113+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2577966092978232
2023-08-07T01:00:51.194+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:51.194+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0039045196683476055
2023-08-07T01:00:51.194+05:30 [Info] Planner::initial temperature: initial resource variation 0.0039045196683476055 temp 0.024609548033165243
2023-08-07T01:00:51.194+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-08-07T01:00:51.194+05:30 [Info] Planner::Finished planner run after 9 iterations.
2023-08-07T01:00:51.194+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.06273093437599972).
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 iterationTest :: Index rebuild - success
2023-08-07T01:00:51.197+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i13,1)
2023-08-07T01:00:51.197+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i15,1)
2023-08-07T01:00:51.197+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i18,1)
2023-08-07T01:00:51.197+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i22,1)
2023-08-07T01:00:51.197+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i0,1)
2023-08-07T01:00:51.197+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i5,1)
2023-08-07T01:00:51.197+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i10,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i11,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i24,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i26,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i28,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i2,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i4,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i8,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i27,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i1,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i3,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i6,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i12,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i14,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i20,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i23,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i17,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i19,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i21,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i25,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i29,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i7,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i9,1)
2023-08-07T01:00:51.198+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i16,1)
2023-08-07T01:00:51.199+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5773502691896258
2023-08-07T01:00:51.199+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0.5773502691896258 is less than threshold: 0.8. No nodes have been added or deleted and there are no violations observed
2023-08-07T01:00:51.199+05:30 [Info] Planner::initial temperature: initial resource variation 0.5773502691896258 temp 0.02226497308103742
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 iterationTest :: Index rebuild - initial placement - success
2023-08-07T01:00:51.200+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-08-07T01:00:51.200+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-08-07T01:00:51.200+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-08-07T01:00:51.200+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1)
2023-08-07T01:00:51.200+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1)
2023-08-07T01:00:51.200+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1)
2023-08-07T01:00:51.200+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6236095644623236
2023-08-07T01:00:51.200+05:30 [Info] Planner::initial temperature: initial resource variation 0.6236095644623236 temp 0.03663904355376764
2023-08-07T01:00:51.200+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:51.200+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:51.200+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.6236095644623236).
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 iterationTest :: Index rebuild - initial placement - numReplica > numSG - success
2023-08-07T01:00:51.201+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-08-07T01:00:51.201+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-08-07T01:00:51.201+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-08-07T01:00:51.201+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1)
2023-08-07T01:00:51.201+05:30 [Info] Rebuilding lost replica for (default,,,idx1,2)
2023-08-07T01:00:51.201+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1)
2023-08-07T01:00:51.201+05:30 [Info] Rebuilding lost replica for (default,,,idx2,2)
2023-08-07T01:00:51.201+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1)
2023-08-07T01:00:51.201+05:30 [Info] Rebuilding lost replica for (default,,,idx3,2)
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-08-07T01:00:51.201+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-08-07T01:00:51.202+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-08-07T01:00:51.202+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-08-07T01:00:51.202+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-08-07T01:00:51.202+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-08-07T01:00:51.202+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-08-07T01:00:51.202+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-08-07T01:00:51.202+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.24845199749997662
2023-08-07T01:00:51.202+05:30 [Info] Planner::initial temperature: initial resource variation 0.24845199749997662 temp 0.07415480025000235
2023-08-07T01:00:51.202+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:51.202+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:51.202+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.24845199749997662).
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 scaling with excludeIn - 8 identical index, add 1, 1x
2023-08-07T01:00:51.202+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-08-07T01:00:51.202+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 swap with excludeIn - 8 identical index, add 1, 1x
2023-08-07T01:00:51.357+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-08-07T01:00:51.357+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023-08-07T01:00:51.357+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 replica repair with excludeIn - 3 replica, 4 zone, delete 1, 1x
2023-08-07T01:00:51.358+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-08-07T01:00:51.358+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-08-07T01:00:51.358+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 heterogenous rebalance - keep vertically scaled Node, swap 1, 1x
2023-08-07T01:00:51.360+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.1237823254333867
2023-08-07T01:00:51.360+05:30 [Info] Planner::initial temperature: initial resource variation 1.1237823254333867 temp 0.11237823254333867
2023-08-07T01:00:51.360+05:30 [Info] Planner::finalizing the solution as final solution is found.
--- PASS: TestPlanner (11.65s)
=== RUN TestGreedyPlanner
2023/08/07 01:00:51 In TestGreedyPlanner()
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 3 empty nodes - 1 SG
2023-08-07T01:00:51.363+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 2 empty nodes, 1 non-empty node - 1 SG
2023-08-07T01:00:51.365+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 1 empty node, 2 non-empty nodes - 1 SG
2023-08-07T01:00:51.367+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 3 non-empty nodes - 1 SG
2023-08-07T01:00:51.370+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 3 empty nodes - 1 SG
2023-08-07T01:00:51.372+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 1 SG
2023-08-07T01:00:51.374+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 1 SG
2023-08-07T01:00:51.376+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 3 non-empty nodes - 1 SG
2023-08-07T01:00:51.377+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 2 Replica - 3 empty nodes - 1 SG
2023-08-07T01:00:51.379+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 2 Replica - 3 non-empty nodes - 1 SG
2023-08-07T01:00:51.381+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 2 SG
2023-08-07T01:00:51.383+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 2 SG
2023-08-07T01:00:51.387+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 3 non-empty nodes - 2 SG
2023-08-07T01:00:51.389+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Equivalent Index Without any replica - 3 non-empty nodes - 1 SG
2023-08-07T01:00:51.392+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Skip least loaded node
2023-08-07T01:00:51.395+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Use least loaded node
2023-08-07T01:00:51.398+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place 60 index instaces on 3 empty nodes - 1 SG
2023-08-07T01:00:51.400+05:30 [Info] Using greedy index placement for index 1000987654
2023-08-07T01:00:51.402+05:30 [Info] Using greedy index placement for index 1001987654
2023-08-07T01:00:51.404+05:30 [Info] Using greedy index placement for index 1002987654
2023-08-07T01:00:51.406+05:30 [Info] Using greedy index placement for index 1003987654
2023-08-07T01:00:51.407+05:30 [Info] Using greedy index placement for index 1004987654
2023-08-07T01:00:51.409+05:30 [Info] Using greedy index placement for index 1005987654
2023-08-07T01:00:51.411+05:30 [Info] Using greedy index placement for index 1006987654
2023-08-07T01:00:51.413+05:30 [Info] Using greedy index placement for index 1007987654
2023-08-07T01:00:51.414+05:30 [Info] Using greedy index placement for index 1008987654
2023-08-07T01:00:51.416+05:30 [Info] Using greedy index placement for index 1009987654
2023-08-07T01:00:51.418+05:30 [Info] Using greedy index placement for index 1010987654
2023-08-07T01:00:51.419+05:30 [Info] Using greedy index placement for index 1011987654
2023-08-07T01:00:51.421+05:30 [Info] Using greedy index placement for index 1012987654
2023-08-07T01:00:51.423+05:30 [Info] Using greedy index placement for index 1013987654
2023-08-07T01:00:51.425+05:30 [Info] Using greedy index placement for index 1014987654
2023-08-07T01:00:51.426+05:30 [Info] Using greedy index placement for index 1015987654
2023-08-07T01:00:51.428+05:30 [Info] Using greedy index placement for index 1016987654
2023-08-07T01:00:51.430+05:30 [Info] Using greedy index placement for index 1017987654
2023-08-07T01:00:51.432+05:30 [Info] Using greedy index placement for index 1018987654
2023-08-07T01:00:51.433+05:30 [Info] Using greedy index placement for index 1019987654
2023-08-07T01:00:51.435+05:30 [Info] Using greedy index placement for index 1020987654
2023-08-07T01:00:51.437+05:30 [Info] Using greedy index placement for index 1021987654
2023-08-07T01:00:51.438+05:30 [Info] Using greedy index placement for index 1022987654
2023-08-07T01:00:51.440+05:30 [Info] Using greedy index placement for index 1023987654
2023-08-07T01:00:51.442+05:30 [Info] Using greedy index placement for index 1024987654
2023-08-07T01:00:51.443+05:30 [Info] Using greedy index placement for index 1025987654
2023-08-07T01:00:51.445+05:30 [Info] Using greedy index placement for index 1026987654
2023-08-07T01:00:51.447+05:30 [Info] Using greedy index placement for index 1027987654
2023-08-07T01:00:51.449+05:30 [Info] Using greedy index placement for index 1028987654
2023-08-07T01:00:51.451+05:30 [Info] Using greedy index placement for index 1029987654
2023-08-07T01:00:51.453+05:30 [Info] Using greedy index placement for index 1030987654
2023-08-07T01:00:51.454+05:30 [Info] Using greedy index placement for index 1031987654
2023-08-07T01:00:51.456+05:30 [Info] Using greedy index placement for index 1032987654
2023-08-07T01:00:51.458+05:30 [Info] Using greedy index placement for index 1033987654
2023-08-07T01:00:51.460+05:30 [Info] Using greedy index placement for index 1034987654
2023-08-07T01:00:51.462+05:30 [Info] Using greedy index placement for index 1035987654
2023-08-07T01:00:51.464+05:30 [Info] Using greedy index placement for index 1036987654
2023-08-07T01:00:51.465+05:30 [Info] Using greedy index placement for index 1037987654
2023-08-07T01:00:51.467+05:30 [Info] Using greedy index placement for index 1038987654
2023-08-07T01:00:51.469+05:30 [Info] Using greedy index placement for index 1039987654
2023-08-07T01:00:51.470+05:30 [Info] Using greedy index placement for index 1040987654
2023-08-07T01:00:51.472+05:30 [Info] Using greedy index placement for index 1041987654
2023-08-07T01:00:51.474+05:30 [Info] Using greedy index placement for index 1042987654
2023-08-07T01:00:51.476+05:30 [Info] Using greedy index placement for index 1043987654
2023-08-07T01:00:51.477+05:30 [Info] Using greedy index placement for index 1044987654
2023-08-07T01:00:51.479+05:30 [Info] Using greedy index placement for index 1045987654
2023-08-07T01:00:51.481+05:30 [Info] Using greedy index placement for index 1046987654
2023-08-07T01:00:51.483+05:30 [Info] Using greedy index placement for index 1047987654
2023-08-07T01:00:51.484+05:30 [Info] Using greedy index placement for index 1048987654
2023-08-07T01:00:51.486+05:30 [Info] Using greedy index placement for index 1049987654
2023-08-07T01:00:51.488+05:30 [Info] Using greedy index placement for index 1050987654
2023-08-07T01:00:51.490+05:30 [Info] Using greedy index placement for index 1051987654
2023-08-07T01:00:51.491+05:30 [Info] Using greedy index placement for index 1052987654
2023-08-07T01:00:51.493+05:30 [Info] Using greedy index placement for index 1053987654
2023-08-07T01:00:51.495+05:30 [Info] Using greedy index placement for index 1054987654
2023-08-07T01:00:51.497+05:30 [Info] Using greedy index placement for index 1055987654
2023-08-07T01:00:51.498+05:30 [Info] Using greedy index placement for index 1056987654
2023-08-07T01:00:51.500+05:30 [Info] Using greedy index placement for index 1057987654
2023-08-07T01:00:51.502+05:30 [Info] Using greedy index placement for index 1058987654
2023-08-07T01:00:51.503+05:30 [Info] Using greedy index placement for index 1059987654
2023-08-07T01:00:51.504+05:30 [Info] Actual variance of deferred index count across nodes is 0
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place 60 index instaces on 1 empty and 1 10 percent filled node - 1 SG
2023-08-07T01:00:51.506+05:30 [Info] Using greedy index placement for index 1000987654
2023-08-07T01:00:51.508+05:30 [Info] Using greedy index placement for index 1001987654
2023-08-07T01:00:51.510+05:30 [Info] Using greedy index placement for index 1002987654
2023-08-07T01:00:51.512+05:30 [Info] Using greedy index placement for index 1003987654
2023-08-07T01:00:51.514+05:30 [Info] Using greedy index placement for index 1004987654
2023-08-07T01:00:51.515+05:30 [Info] Using greedy index placement for index 1005987654
2023-08-07T01:00:51.517+05:30 [Info] Using greedy index placement for index 1006987654
2023-08-07T01:00:51.519+05:30 [Info] Using greedy index placement for index 1007987654
2023-08-07T01:00:51.521+05:30 [Info] Using greedy index placement for index 1008987654
2023-08-07T01:00:51.523+05:30 [Info] Using greedy index placement for index 1009987654
2023-08-07T01:00:51.525+05:30 [Info] Using greedy index placement for index 1010987654
2023-08-07T01:00:51.527+05:30 [Info] Using greedy index placement for index 1011987654
2023-08-07T01:00:51.529+05:30 [Info] Using greedy index placement for index 1012987654
2023-08-07T01:00:51.531+05:30 [Info] Using greedy index placement for index 1013987654
2023-08-07T01:00:51.533+05:30 [Info] Using greedy index placement for index 1014987654
2023-08-07T01:00:51.534+05:30 [Info] Using greedy index placement for index 1015987654
2023-08-07T01:00:51.537+05:30 [Info] Using greedy index placement for index 1016987654
2023-08-07T01:00:51.538+05:30 [Info] Using greedy index placement for index 1017987654
2023-08-07T01:00:51.540+05:30 [Info] Using greedy index placement for index 1018987654
2023-08-07T01:00:51.542+05:30 [Info] Using greedy index placement for index 1019987654
2023-08-07T01:00:51.544+05:30 [Info] Using greedy index placement for index 1020987654
2023-08-07T01:00:51.546+05:30 [Info] Using greedy index placement for index 1021987654
2023-08-07T01:00:51.547+05:30 [Info] Using greedy index placement for index 1022987654
2023-08-07T01:00:51.549+05:30 [Info] Using greedy index placement for index 1023987654
2023-08-07T01:00:51.551+05:30 [Info] Using greedy index placement for index 1024987654
2023-08-07T01:00:51.553+05:30 [Info] Using greedy index placement for index 1025987654
2023-08-07T01:00:51.555+05:30 [Info] Using greedy index placement for index 1026987654
2023-08-07T01:00:51.556+05:30 [Info] Using greedy index placement for index 1027987654
2023-08-07T01:00:51.558+05:30 [Info] Using greedy index placement for index 1028987654
2023-08-07T01:00:51.560+05:30 [Info] Using greedy index placement for index 1029987654
2023-08-07T01:00:51.561+05:30 [Info] Using greedy index placement for index 1030987654
2023-08-07T01:00:51.563+05:30 [Info] Using greedy index placement for index 1031987654
2023-08-07T01:00:51.565+05:30 [Info] Using greedy index placement for index 1032987654
2023-08-07T01:00:51.567+05:30 [Info] Using greedy index placement for index 1033987654
2023-08-07T01:00:51.569+05:30 [Info] Using greedy index placement for index 1034987654
2023-08-07T01:00:51.570+05:30 [Info] Using greedy index placement for index 1035987654
2023-08-07T01:00:51.572+05:30 [Info] Using greedy index placement for index 1036987654
2023-08-07T01:00:51.574+05:30 [Info] Using greedy index placement for index 1037987654
2023-08-07T01:00:51.576+05:30 [Info] Using greedy index placement for index 1038987654
2023-08-07T01:00:51.577+05:30 [Info] Using greedy index placement for index 1039987654
2023-08-07T01:00:51.579+05:30 [Info] Using greedy index placement for index 1040987654
2023-08-07T01:00:51.581+05:30 [Info] Using greedy index placement for index 1041987654
2023-08-07T01:00:51.583+05:30 [Info] Using greedy index placement for index 1042987654
2023-08-07T01:00:51.585+05:30 [Info] Using greedy index placement for index 1043987654
2023-08-07T01:00:51.586+05:30 [Info] Using greedy index placement for index 1044987654
2023-08-07T01:00:51.588+05:30 [Info] Using greedy index placement for index 1045987654
2023-08-07T01:00:51.590+05:30 [Info] Using greedy index placement for index 1046987654
2023-08-07T01:00:51.592+05:30 [Info] Using greedy index placement for index 1047987654
2023-08-07T01:00:51.593+05:30 [Info] Using greedy index placement for index 1048987654
2023-08-07T01:00:51.595+05:30 [Info] Using greedy index placement for index 1049987654
2023-08-07T01:00:51.597+05:30 [Info] Using greedy index placement for index 1050987654
2023-08-07T01:00:51.598+05:30 [Info] Using greedy index placement for index 1051987654
2023-08-07T01:00:51.600+05:30 [Info] Using greedy index placement for index 1052987654
2023-08-07T01:00:51.602+05:30 [Info] Using greedy index placement for index 1053987654
2023-08-07T01:00:51.604+05:30 [Info] Using greedy index placement for index 1054987654
2023-08-07T01:00:51.605+05:30 [Info] Using greedy index placement for index 1055987654
2023-08-07T01:00:51.607+05:30 [Info] Using greedy index placement for index 1056987654
2023-08-07T01:00:51.609+05:30 [Info] Using greedy index placement for index 1057987654
2023-08-07T01:00:51.611+05:30 [Info] Using greedy index placement for index 1058987654
2023-08-07T01:00:51.613+05:30 [Info] Using greedy index placement for index 1059987654
2023-08-07T01:00:51.613+05:30 [Info] Actual variance of deferred index count across nodes is 8
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place 60 index instaces on 1 empty and 1 30 percent filled node - 1 SG
2023-08-07T01:00:51.615+05:30 [Info] Using greedy index placement for index 1000987654
2023-08-07T01:00:51.617+05:30 [Info] Using greedy index placement for index 1001987654
2023-08-07T01:00:51.618+05:30 [Info] Using greedy index placement for index 1002987654
2023-08-07T01:00:51.620+05:30 [Info] Using greedy index placement for index 1003987654
2023-08-07T01:00:51.622+05:30 [Info] Using greedy index placement for index 1004987654
2023-08-07T01:00:51.624+05:30 [Info] Using greedy index placement for index 1005987654
2023-08-07T01:00:51.625+05:30 [Info] Using greedy index placement for index 1006987654
2023-08-07T01:00:51.627+05:30 [Info] Using greedy index placement for index 1007987654
2023-08-07T01:00:51.628+05:30 [Info] Using greedy index placement for index 1008987654
2023-08-07T01:00:51.630+05:30 [Info] Using greedy index placement for index 1009987654
2023-08-07T01:00:51.632+05:30 [Info] Using greedy index placement for index 1010987654
2023-08-07T01:00:51.634+05:30 [Info] Using greedy index placement for index 1011987654
2023-08-07T01:00:51.635+05:30 [Info] Using greedy index placement for index 1012987654
2023-08-07T01:00:51.637+05:30 [Info] Using greedy index placement for index 1013987654
2023-08-07T01:00:51.639+05:30 [Info] Using greedy index placement for index 1014987654
2023-08-07T01:00:51.640+05:30 [Info] Using greedy index placement for index 1015987654
2023-08-07T01:00:51.642+05:30 [Info] Using greedy index placement for index 1016987654
2023-08-07T01:00:51.643+05:30 [Info] Using greedy index placement for index 1017987654
2023-08-07T01:00:51.645+05:30 [Info] Using greedy index placement for index 1018987654
2023-08-07T01:00:51.647+05:30 [Info] Using greedy index placement for index 1019987654
2023-08-07T01:00:51.649+05:30 [Info] Using greedy index placement for index 1020987654
2023-08-07T01:00:51.651+05:30 [Info] Using greedy index placement for index 1021987654
2023-08-07T01:00:51.652+05:30 [Info] Using greedy index placement for index 1022987654
2023-08-07T01:00:51.654+05:30 [Info] Using greedy index placement for index 1023987654
2023-08-07T01:00:51.656+05:30 [Info] Using greedy index placement for index 1024987654
2023-08-07T01:00:51.657+05:30 [Info] Using greedy index placement for index 1025987654
2023-08-07T01:00:51.659+05:30 [Info] Using greedy index placement for index 1026987654
2023-08-07T01:00:51.661+05:30 [Info] Using greedy index placement for index 1027987654
2023-08-07T01:00:51.663+05:30 [Info] Using greedy index placement for index 1028987654
2023-08-07T01:00:51.664+05:30 [Info] Using greedy index placement for index 1029987654
2023-08-07T01:00:51.666+05:30 [Info] Using greedy index placement for index 1030987654
2023-08-07T01:00:51.668+05:30 [Info] Using greedy index placement for index 1031987654
2023-08-07T01:00:51.670+05:30 [Info] Using greedy index placement for index 1032987654
2023-08-07T01:00:51.671+05:30 [Info] Using greedy index placement for index 1033987654
2023-08-07T01:00:51.673+05:30 [Info] Using greedy index placement for index 1034987654
2023-08-07T01:00:51.675+05:30 [Info] Using greedy index placement for index 1035987654
2023-08-07T01:00:51.677+05:30 [Info] Using greedy index placement for index 1036987654
2023-08-07T01:00:51.678+05:30 [Info] Using greedy index placement for index 1037987654
2023-08-07T01:00:51.680+05:30 [Info] Using greedy index placement for index 1038987654
2023-08-07T01:00:51.682+05:30 [Info] Using greedy index placement for index 1039987654
2023-08-07T01:00:51.684+05:30 [Info] Using greedy index placement for index 1040987654
2023-08-07T01:00:51.686+05:30 [Info] Using greedy index placement for index 1041987654
2023-08-07T01:00:51.688+05:30 [Info] Using greedy index placement for index 1042987654
2023-08-07T01:00:51.689+05:30 [Info] Using greedy index placement for index 1043987654
2023-08-07T01:00:51.691+05:30 [Info] Using greedy index placement for index 1044987654
2023-08-07T01:00:51.693+05:30 [Info] Using greedy index placement for index 1045987654
2023-08-07T01:00:51.694+05:30 [Info] Using greedy index placement for index 1046987654
2023-08-07T01:00:51.696+05:30 [Info] Using greedy index placement for index 1047987654
2023-08-07T01:00:51.698+05:30 [Info] Using greedy index placement for index 1048987654
2023-08-07T01:00:51.699+05:30 [Info] Using greedy index placement for index 1049987654
2023-08-07T01:00:51.701+05:30 [Info] Using greedy index placement for index 1050987654
2023-08-07T01:00:51.703+05:30 [Info] Using greedy index placement for index 1051987654
2023-08-07T01:00:51.705+05:30 [Info] Using greedy index placement for index 1052987654
2023-08-07T01:00:51.706+05:30 [Info] Using greedy index placement for index 1053987654
2023-08-07T01:00:51.708+05:30 [Info] Using greedy index placement for index 1054987654
2023-08-07T01:00:51.710+05:30 [Info] Using greedy index placement for index 1055987654
2023-08-07T01:00:51.712+05:30 [Info] Using greedy index placement for index 1056987654
2023-08-07T01:00:51.713+05:30 [Info] Using greedy index placement for index 1057987654
2023-08-07T01:00:51.715+05:30 [Info] Using greedy index placement for index 1058987654
2023-08-07T01:00:51.717+05:30 [Info] Using greedy index placement for index 1059987654
2023-08-07T01:00:51.717+05:30 [Info] Actual variance of deferred index count across nodes is 98
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place 5 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-08-07T01:00:51.719+05:30 [Info] Using greedy index placement for index 1000987654
2023-08-07T01:00:51.721+05:30 [Info] Using greedy index placement for index 1001987654
2023-08-07T01:00:51.723+05:30 [Info] Using greedy index placement for index 1002987654
2023-08-07T01:00:51.724+05:30 [Info] Using greedy index placement for index 1003987654
2023-08-07T01:00:51.726+05:30 [Info] Using greedy index placement for index 1004987654
2023-08-07T01:00:51.726+05:30 [Info] Actual variance of deferred index count across nodes is 4.5
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place 60 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-08-07T01:00:51.728+05:30 [Info] Using greedy index placement for index 1000987654
2023-08-07T01:00:51.730+05:30 [Info] Using greedy index placement for index 1001987654
2023-08-07T01:00:51.732+05:30 [Info] Using greedy index placement for index 1002987654
2023-08-07T01:00:51.733+05:30 [Info] Using greedy index placement for index 1003987654
2023-08-07T01:00:51.735+05:30 [Info] Using greedy index placement for index 1004987654
2023-08-07T01:00:51.737+05:30 [Info] Using greedy index placement for index 1005987654
2023-08-07T01:00:51.738+05:30 [Info] Using greedy index placement for index 1006987654
2023-08-07T01:00:51.740+05:30 [Info] Using greedy index placement for index 1007987654
2023-08-07T01:00:51.742+05:30 [Info] Using greedy index placement for index 1008987654
2023-08-07T01:00:51.743+05:30 [Info] Using greedy index placement for index 1009987654
2023-08-07T01:00:51.745+05:30 [Info] Using greedy index placement for index 1010987654
2023-08-07T01:00:51.747+05:30 [Info] Using greedy index placement for index 1011987654
2023-08-07T01:00:51.748+05:30 [Info] Using greedy index placement for index 1012987654
2023-08-07T01:00:51.750+05:30 [Info] Using greedy index placement for index 1013987654
2023-08-07T01:00:51.752+05:30 [Info] Using greedy index placement for index 1014987654
2023-08-07T01:00:51.753+05:30 [Info] Using greedy index placement for index 1015987654
2023-08-07T01:00:51.755+05:30 [Info] Using greedy index placement for index 1016987654
2023-08-07T01:00:51.757+05:30 [Info] Using greedy index placement for index 1017987654
2023-08-07T01:00:51.759+05:30 [Info] Using greedy index placement for index 1018987654
2023-08-07T01:00:51.760+05:30 [Info] Using greedy index placement for index 1019987654
2023-08-07T01:00:51.762+05:30 [Info] Using greedy index placement for index 1020987654
2023-08-07T01:00:51.764+05:30 [Info] Using greedy index placement for index 1021987654
2023-08-07T01:00:51.766+05:30 [Info] Using greedy index placement for index 1022987654
2023-08-07T01:00:51.768+05:30 [Info] Using greedy index placement for index 1023987654
2023-08-07T01:00:51.769+05:30 [Info] Using greedy index placement for index 1024987654
2023-08-07T01:00:51.771+05:30 [Info] Using greedy index placement for index 1025987654
2023-08-07T01:00:51.773+05:30 [Info] Using greedy index placement for index 1026987654
2023-08-07T01:00:51.774+05:30 [Info] Using greedy index placement for index 1027987654
2023-08-07T01:00:51.776+05:30 [Info] Using greedy index placement for index 1028987654
2023-08-07T01:00:51.778+05:30 [Info] Using greedy index placement for index 1029987654
2023-08-07T01:00:51.780+05:30 [Info] Using greedy index placement for index 1030987654
2023-08-07T01:00:51.782+05:30 [Info] Using greedy index placement for index 1031987654
2023-08-07T01:00:51.784+05:30 [Info] Using greedy index placement for index 1032987654
2023-08-07T01:00:51.786+05:30 [Info] Using greedy index placement for index 1033987654
2023-08-07T01:00:51.788+05:30 [Info] Using greedy index placement for index 1034987654
2023-08-07T01:00:51.789+05:30 [Info] Using greedy index placement for index 1035987654
2023-08-07T01:00:51.791+05:30 [Info] Using greedy index placement for index 1036987654
2023-08-07T01:00:51.793+05:30 [Info] Using greedy index placement for index 1037987654
2023-08-07T01:00:51.794+05:30 [Info] Using greedy index placement for index 1038987654
2023-08-07T01:00:51.796+05:30 [Info] Using greedy index placement for index 1039987654
2023-08-07T01:00:51.798+05:30 [Info] Using greedy index placement for index 1040987654
2023-08-07T01:00:51.800+05:30 [Info] Using greedy index placement for index 1041987654
2023-08-07T01:00:51.801+05:30 [Info] Using greedy index placement for index 1042987654
2023-08-07T01:00:51.803+05:30 [Info] Using greedy index placement for index 1043987654
2023-08-07T01:00:51.805+05:30 [Info] Using greedy index placement for index 1044987654
2023-08-07T01:00:51.807+05:30 [Info] Using greedy index placement for index 1045987654
2023-08-07T01:00:51.808+05:30 [Info] Using greedy index placement for index 1046987654
2023-08-07T01:00:51.810+05:30 [Info] Using greedy index placement for index 1047987654
2023-08-07T01:00:51.812+05:30 [Info] Using greedy index placement for index 1048987654
2023-08-07T01:00:51.814+05:30 [Info] Using greedy index placement for index 1049987654
2023-08-07T01:00:51.816+05:30 [Info] Using greedy index placement for index 1050987654
2023-08-07T01:00:51.817+05:30 [Info] Using greedy index placement for index 1051987654
2023-08-07T01:00:51.819+05:30 [Info] Using greedy index placement for index 1052987654
2023-08-07T01:00:51.821+05:30 [Info] Using greedy index placement for index 1053987654
2023-08-07T01:00:51.822+05:30 [Info] Using greedy index placement for index 1054987654
2023-08-07T01:00:51.824+05:30 [Info] Using greedy index placement for index 1055987654
2023-08-07T01:00:51.826+05:30 [Info] Using greedy index placement for index 1056987654
2023-08-07T01:00:51.828+05:30 [Info] Using greedy index placement for index 1057987654
2023-08-07T01:00:51.830+05:30 [Info] Using greedy index placement for index 1058987654
2023-08-07T01:00:51.832+05:30 [Info] Using greedy index placement for index 1059987654
2023-08-07T01:00:51.832+05:30 [Info] Actual variance of deferred index count across nodes is 648
--- PASS: TestGreedyPlanner (0.47s)
=== RUN TestTenantAwarePlanner
2023/08/07 01:00:51 In TestTenantAwarePlanner()
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 1 empty node - 1 SG
2023-08-07T01:00:51.833+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-08-07T01:00:51.833+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.833+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 empty nodes - 2 SG
2023-08-07T01:00:51.836+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9003 127.0.0.1:9002]]
2023-08-07T01:00:51.836+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.836+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9002]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 1 node - 1 SG
2023-08-07T01:00:51.838+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.838+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-08-07T01:00:51.838+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-08-07T01:00:51.838+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 2 nodes - 1 SG
2023-08-07T01:00:51.840+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.840+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.840+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-08-07T01:00:51.840+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-08-07T01:00:51.840+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(a)
2023-08-07T01:00:51.842+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.842+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.842+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9004 127.0.0.1:9003]]
2023-08-07T01:00:51.842+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9002]
2023-08-07T01:00:51.842+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(b)
2023-08-07T01:00:51.844+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.844+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.844+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9002]]
2023-08-07T01:00:51.844+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.845+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(c)
2023-08-07T01:00:51.847+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.847+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.847+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.847+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.847+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-08-07T01:00:51.847+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.847+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Memory Above LWM
2023-08-07T01:00:51.849+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.849+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-08-07T01:00:51.849+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.849+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-08-07T01:00:51.849+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.849+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.849+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Units Above LWM
2023-08-07T01:00:51.852+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.852+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-08-07T01:00:51.852+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.852+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5000 Tenants 0
2023-08-07T01:00:51.852+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.852+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.852+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(a)
2023-08-07T01:00:51.854+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.854+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-08-07T01:00:51.854+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.854+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-08-07T01:00:51.854+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.854+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.854+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(b)
2023-08-07T01:00:51.856+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.856+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-08-07T01:00:51.856+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.857+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-08-07T01:00:51.857+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.857+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.857+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Units HWM
2023-08-07T01:00:51.859+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 8000 Tenants 0
2023-08-07T01:00:51.859+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.859+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.859+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 8000 Tenants 0
2023-08-07T01:00:51.859+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-08-07T01:00:51.859+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.859+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-08-07T01:00:51.861+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-08-07T01:00:51.861+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-08-07T01:00:51.861+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-08-07T01:00:51.861+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-08-07T01:00:51.861+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.861+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.861+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-08-07T01:00:51.863+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.863+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.863+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.863+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-08-07T01:00:51.863+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.863+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-08-07T01:00:51.863+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.863+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-08-07T01:00:51.865+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.865+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.865+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.865+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.865+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-08-07T01:00:51.866+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.866+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-08-07T01:00:51.868+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.868+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.868+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.868+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-08-07T01:00:51.868+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.868+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-08-07T01:00:51.868+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.868+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-08-07T01:00:51.870+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.870+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.870+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.870+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.870+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-08-07T01:00:51.870+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.870+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 2 empty nodes - 1 SG
2023-08-07T01:00:51.872+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-08-07T01:00:51.872+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.872+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9002]
2023-08-07T01:00:51.872+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9001]
2023-08-07T01:00:51.872+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Unable to find any valid SubCluster
2023/08/07 01:00:51 Expected error Planner not able to find any node for placement - Unable to find any valid SubCluster
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Memory HWM
2023-08-07T01:00:51.872+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-08-07T01:00:51.872+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.873+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.873+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-08-07T01:00:51.873+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-08-07T01:00:51.873+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.873+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2023/08/07 01:00:51 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Memory Above LWM
2023-08-07T01:00:51.873+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 680000000 Units 1000 Tenants 0
2023-08-07T01:00:51.873+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-08-07T01:00:51.873+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 680000000 Units 1000 Tenants 0
2023-08-07T01:00:51.873+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-08-07T01:00:51.873+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.873+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-08-07T01:00:51.873+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2023/08/07 01:00:51 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 0 Units 4500 Tenants 0
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-08-07T01:00:51.874+05:30 [Error] Planner::validateSubClusterGrouping Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/08/07 01:00:51 Expected error Planner Constraint Violation. Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-08-07T01:00:51.874+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/08/07 01:00:51 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-08-07T01:00:51.875+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.875+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.875+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/08/07 01:00:51 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-08-07T01:00:51.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-08-07T01:00:51.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-08-07T01:00:51.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/08/07 01:00:51 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-08-07T01:00:51.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9004 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/08/07 01:00:51 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 3 SG, 1 empty, 1 Memory Above HWM
2023-08-07T01:00:51.877+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.878+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-08-07T01:00:51.878+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.878+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-08-07T01:00:51.878+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.878+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.878+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.878+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500
2023-08-07T01:00:51.878+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.878+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 3 SG, 1 empty, 1 Units Above HWM
2023-08-07T01:00:51.879+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 8000 Tenants 0
2023-08-07T01:00:51.879+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 400000000 Units 1000 Tenants 0
2023-08-07T01:00:51.879+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 8000 Tenants 0
2023-08-07T01:00:51.879+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 400000000 Units 1000 Tenants 0
2023-08-07T01:00:51.879+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.879+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.879+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.879+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000
2023-08-07T01:00:51.879+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.879+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 3 SG, 1 empty, Both Memory/Units Above HWM
2023-08-07T01:00:51.880+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.880+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.880+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.880+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.880+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.880+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.880+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.880+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.880+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-08-07T01:00:51.880+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.880+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.880+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 3 SG, Multiple tenants to move, single source, multiple destination
2023-08-07T01:00:51.881+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.881+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.881+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.881+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.881+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.881+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.881+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.881+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000
2023-08-07T01:00:51.881+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000
2023-08-07T01:00:51.881+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.881+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.881+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 3 SG, Multiple tenants to move, no nodes below LWM
2023-08-07T01:00:51.882+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-08-07T01:00:51.882+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-08-07T01:00:51.882+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 700000000 Units 3000 Tenants 0
2023-08-07T01:00:51.882+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-08-07T01:00:51.882+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-08-07T01:00:51.883+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 700000000 Units 3000 Tenants 0
2023-08-07T01:00:51.883+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.883+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.883+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.883+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-08-07T01:00:51.883+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-08-07T01:00:51.883+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-08-07T01:00:51.884+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.884+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.884+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.884+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.884+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.884+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000
2023-08-07T01:00:51.884+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.884+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.884+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.884+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.884+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.884+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.884+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.884+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.884+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-08-07T01:00:51.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-08-07T01:00:51.885+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.885+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.885+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.885+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.885+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.885+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.885+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.885+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.885+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 3 SG, Single Large Tenant, Nothing to move
2023-08-07T01:00:51.886+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-08-07T01:00:51.886+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 2000 Tenants 0
2023-08-07T01:00:51.886+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-08-07T01:00:51.886+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 2000 Tenants 0
2023-08-07T01:00:51.886+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.886+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.886+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.886+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000
2023-08-07T01:00:51.886+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.886+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(zero usage tenants)
2023-08-07T01:00:51.888+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.888+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.888+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 3 SG, 1 Partial Subcluster
2023-08-07T01:00:51.890+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.890+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-08-07T01:00:51.890+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.890+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-08-07T01:00:51.890+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003]]
2023-08-07T01:00:51.890+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.890+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.890+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.890+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-08-07T01:00:51.890+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-08-07T01:00:51.890+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9003]
2023-08-07T01:00:51.890+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.890+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.890+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Replica Repair - 4 SG, Missing Replicas for multiple tenants in SG
2023-08-07T01:00:51.891+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.891+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.891+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.891+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.891+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.891+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.891+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.891+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-08-07T01:00:51.891+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-08-07T01:00:51.891+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-08-07T01:00:51.891+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-08-07T01:00:51.891+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over
2023-08-07T01:00:51.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.892+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-08-07T01:00:51.892+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9004
2023-08-07T01:00:51.892+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-08-07T01:00:51.893+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9004
2023-08-07T01:00:51.893+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-08-07T01:00:51.893+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-08-07T01:00:51.893+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.893+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over, No replacement
2023-08-07T01:00:51.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.893+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.893+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9001] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.893+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Replica Repair - 4 SG, Missing Replicas, one replica missing with pendingDelete true
2023-08-07T01:00:51.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.894+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.894+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-08-07T01:00:51.894+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-08-07T01:00:51.894+05:30 [Info] Planner::findMissingReplicaForIndexerNode Skipping Replica Repair for 88883:81813:0. PendingDelete true
2023-08-07T01:00:51.894+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx2,1) on 127.0.0.1:9005
2023-08-07T01:00:51.894+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Replica Repair - 2 SG, Missing Replicas with Nodes over HWM
2023-08-07T01:00:51.895+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 7000 Tenants 0
2023-08-07T01:00:51.895+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.895+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 7000 Tenants 0
2023-08-07T01:00:51.895+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.896+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket9,,,idx2,1) on 127.0.0.1:9005
2023-08-07T01:00:51.896+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.896+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.896+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-08-07T01:00:51.896+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700
2023-08-07T01:00:51.896+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-08-07T01:00:51.896+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000
2023-08-07T01:00:51.896+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.896+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.896+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.896+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.896+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes
2023-08-07T01:00:51.897+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9004]
2023-08-07T01:00:51.897+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9004]
2023-08-07T01:00:51.897+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9001]
2023-08-07T01:00:51.897+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006 127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.897+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9008 127.0.0.1:9006 127.0.0.1:9007]
2023-08-07T01:00:51.897+05:30 [Info] Moving index 7777:7171:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-08-07T01:00:51.897+05:30 [Info] Moving index 8888:8181:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-08-07T01:00:51.897+05:30 [Info] Moving index 9999:9191:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-08-07T01:00:51.897+05:30 [Info] Moving index 101010:101101:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-08-07T01:00:51.897+05:30 [Info] Moving index 111111:112112:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-08-07T01:00:51.897+05:30 [Info] Moving index 121212:121121:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-08-07T01:00:51.897+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.897+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.897+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.897+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.897+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.897+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.897+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-08-07T01:00:51.897+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-08-07T01:00:51.897+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.897+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.897+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.897+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 1100000000 Units 8100 Tenants 0
2023-08-07T01:00:51.897+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008] [127.0.0.1:9003 127.0.0.1:9005] [127.0.0.1:9006] [127.0.0.1:9007]]
2023-08-07T01:00:51.897+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9006] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.897+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.897+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes(different SG)
2023-08-07T01:00:51.898+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004 127.0.0.1:9005]
2023-08-07T01:00:51.899+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004 127.0.0.1:9005]
2023-08-07T01:00:51.899+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-08-07T01:00:51.899+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.899+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.899+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.899+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.899+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.899+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.899+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.899+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.899+05:30 [Info] Moving index 7777:17171:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-08-07T01:00:51.899+05:30 [Info] Moving index 8888:18181:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-08-07T01:00:51.899+05:30 [Info] Moving index 9999:19191:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-08-07T01:00:51.899+05:30 [Info] Moving index 101010:1101101:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-08-07T01:00:51.899+05:30 [Info] Moving index 111111:1112112:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-08-07T01:00:51.899+05:30 [Info] Moving index 121212:1121121:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-08-07T01:00:51.899+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-08-07T01:00:51.899+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-08-07T01:00:51.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.899+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9003] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.899+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Swap Rebalance - 4 SG, Swap 1 SG with 2 new nodes
2023-08-07T01:00:51.900+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.900+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.900+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-08-07T01:00:51.900+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.900+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.900+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-08-07T01:00:51.900+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-08-07T01:00:51.900+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-08-07T01:00:51.900+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-08-07T01:00:51.900+05:30 [Info] Moving index 5555:5151:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-08-07T01:00:51.900+05:30 [Info] Moving index 6666:6161:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-08-07T01:00:51.900+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.900+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.900+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.900+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.900+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.900+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.900+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-08-07T01:00:51.900+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-08-07T01:00:51.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.900+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.900+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Swap Rebalance - 4 SG, Swap 1 node with 2 new nodes
2023-08-07T01:00:51.901+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-08-07T01:00:51.901+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-08-07T01:00:51.901+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-08-07T01:00:51.901+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008 127.0.0.1:9006]
2023-08-07T01:00:51.901+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.901+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.901+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.901+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.901+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.901+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.901+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-08-07T01:00:51.901+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-08-07T01:00:51.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.901+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003] [127.0.0.1:9008] [127.0.0.1:9007]]
2023-08-07T01:00:51.901+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.901+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9008] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.901+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.901+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Swap Rebalance - 4 SG, Swap 1 empty node with 2 new nodes
2023-08-07T01:00:51.902+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-08-07T01:00:51.902+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-08-07T01:00:51.902+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-08-07T01:00:51.902+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.902+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.902+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.903+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.903+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.903+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-08-07T01:00:51.903+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9006
2023-08-07T01:00:51.903+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9006
2023-08-07T01:00:51.903+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9006
2023-08-07T01:00:51.903+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9006
2023-08-07T01:00:51.903+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9006
2023-08-07T01:00:51.903+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket6,,,idx2,1) on 127.0.0.1:9006
2023-08-07T01:00:51.903+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.903+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Swap Rebalance - 1 SG, Swap 1 node - Failed swap rebalance
2023-08-07T01:00:51.904+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-08-07T01:00:51.904+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-08-07T01:00:51.904+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-08-07T01:00:51.904+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.904+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-08-07T01:00:51.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-08-07T01:00:51.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.904+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9008 as replacement node for deleted node 127.0.0.1:9004.
2023-08-07T01:00:51.904+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.904+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.904+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.904+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.904+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 600000000 Units 4000
2023-08-07T01:00:51.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 500000000 Units 4100 Tenants 0
2023-08-07T01:00:51.904+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008]]
2023-08-07T01:00:51.904+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Swap Rebalance - 1 SG, Swap 2 node - server group mismatch
2023-08-07T01:00:51.904+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9002]
2023-08-07T01:00:51.904+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-08-07T01:00:51.904+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9002 127.0.0.1:9001]
2023-08-07T01:00:51.904+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9004]
2023/08/07 01:00:51 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 subcluster, Enough Capacity
2023-08-07T01:00:51.906+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.906+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 600000000 Units 4500 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 600000000 Units 4500 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 600000000 Units 4100 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 600000000 Units 4100 Tenants 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.906+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity
2023-08-07T01:00:51.907+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-08-07T01:00:51.907+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-08-07T01:00:51.908+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-08-07T01:00:51.908+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.908+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-08-07T01:00:51.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-08-07T01:00:51.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.908+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.908+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.908+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.908+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 on any target
2023-08-07T01:00:51.908+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.908+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 on any target
2023-08-07T01:00:51.908+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 on any target
2023-08-07T01:00:51.908+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.908+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.908+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/08/07 01:00:51 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 node, Pair node not deleted(Failed swap rebalance of 1 node)
2023-08-07T01:00:51.909+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001]
2023-08-07T01:00:51.909+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001]
2023-08-07T01:00:51.909+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004]
2023-08-07T01:00:51.909+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.909+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9009 as replacement node for deleted node 127.0.0.1:9001.
2023-08-07T01:00:51.910+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-08-07T01:00:51.910+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-08-07T01:00:51.910+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-08-07T01:00:51.910+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-08-07T01:00:51.910+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 600000000 Units 4000
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 500000000 Units 4100 Tenants 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9004 127.0.0.1:9009] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9004 127.0.0.1:9009]]
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9009]
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.910+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.910+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 node, Pair node already deleted
2023-08-07T01:00:51.911+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002]
2023-08-07T01:00:51.911+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002]
2023-08-07T01:00:51.911+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes []
2023-08-07T01:00:51.911+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.911+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-08-07T01:00:51.911+05:30 [Info] Planner::moveTenantsFromDeletedNodes Pair node not found for deleted node 127.0.0.1:9002.
2023-08-07T01:00:51.911+05:30 [Error] Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/08/07 01:00:51 Expected error Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 subcluster, empty nodes
2023-08-07T01:00:51.912+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9005 127.0.0.1:9007 127.0.0.1:9008]
2023-08-07T01:00:51.912+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-08-07T01:00:51.912+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-08-07T01:00:51.912+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-08-07T01:00:51.912+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-08-07T01:00:51.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-08-07T01:00:51.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 800000000 Units 7000 Tenants 0
2023-08-07T01:00:51.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-08-07T01:00:51.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.912+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.912+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9002] with len 1. Skipping replica repair attempt.
2023-08-07T01:00:51.912+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 subcluster, Deleted Nodes more than added nodes
2023-08-07T01:00:51.913+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.913+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.913+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-08-07T01:00:51.913+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-08-07T01:00:51.913+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 1
2023-08-07T01:00:51.913+05:30 [Error] Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/08/07 01:00:51 Expected error Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 node, Add 1 node in, server group mismatch
2023-08-07T01:00:51.913+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9006]
2023-08-07T01:00:51.913+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9006]
2023-08-07T01:00:51.913+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9003]
2023-08-07T01:00:51.913+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9007]
2023/08/07 01:00:51 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 node, Pair node exists
2023-08-07T01:00:51.914+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-08-07T01:00:51.914+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-08-07T01:00:51.914+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-08-07T01:00:51.914+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.914+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-08-07T01:00:51.914+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.914+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.914+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.914+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-08-07T01:00:51.914+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.914+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.914+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.914+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.914+05:30 [Info] Planner::moveTenantsFromDeletedNodes No replacement node found for deleted node 127.0.0.1:9004.
2023-08-07T01:00:51.914+05:30 [Error] Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/08/07 01:00:51 Expected error Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 subcluster, No nodes under LWM
2023-08-07T01:00:51.915+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-08-07T01:00:51.915+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-08-07T01:00:51.915+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.915+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-08-07T01:00:51.915+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-08-07T01:00:51.915+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/08/07 01:00:51 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity, Partial Subcluster
2023-08-07T01:00:51.915+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-08-07T01:00:51.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-08-07T01:00:51.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 100000000 UnitsUsage 500
2023-08-07T01:00:51.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 500
2023-08-07T01:00:51.916+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 200000000 Units 1000
2023-08-07T01:00:51.916+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.916+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 200000000 Units 1000
2023-08-07T01:00:51.916+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.916+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-08-07T01:00:51.916+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9006]
2023-08-07T01:00:51.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-08-07T01:00:51.916+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/08/07 01:00:51 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 2 SG, Move out 1 non-empty and 1 empty node
2023-08-07T01:00:51.917+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9007 127.0.0.1:9004]
2023-08-07T01:00:51.917+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-08-07T01:00:51.917+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-08-07T01:00:51.917+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-08-07T01:00:51.917+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9008]
2023-08-07T01:00:51.917+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.917+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.917+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.917+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.917+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.917+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.917+05:30 [Info] Moving index 171717:1171171:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.917+05:30 [Info] Moving index 141414:1141141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-08-07T01:00:51.917+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 0 Units 0
2023-08-07T01:00:51.917+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-08-07T01:00:51.917+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-08-07T01:00:51.917+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-08-07T01:00:51.917+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9008 127.0.0.1:9001]]
2023-08-07T01:00:51.917+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM
2023-08-07T01:00:51.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.918+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.918+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.918+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.918+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.918+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-08-07T01:00:51.918+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.918+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.918+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-08-07T01:00:51.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-08-07T01:00:51.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-08-07T01:00:51.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-08-07T01:00:51.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-08-07T01:00:51.918+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.918+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 2 Subclusters, 1 below LWM, 1 above HWM
2023-08-07T01:00:51.919+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.919+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.919+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.919+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.919+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.919+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.919+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.919+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.919+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-08-07T01:00:51.919+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.919+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.919+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-08-07T01:00:51.919+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-08-07T01:00:51.919+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 600000000 Units 4000 Tenants 0
2023-08-07T01:00:51.919+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-08-07T01:00:51.919+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 600000000 Units 4000 Tenants 0
2023-08-07T01:00:51.919+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.919+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 3 Subclusters, 1 empty, 1 Above HWM, 1 below LWM
2023-08-07T01:00:51.920+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.920+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.920+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.920+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-08-07T01:00:51.920+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.920+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.920+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.920+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.920+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-08-07T01:00:51.920+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.921+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.921+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.921+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.921+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.921+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.921+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.921+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.921+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.921+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-08-07T01:00:51.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-08-07T01:00:51.921+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-08-07T01:00:51.921+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 2 Subclusters, 1 above LWM/below HWM, 1 empty
2023-08-07T01:00:51.922+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-08-07T01:00:51.922+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-08-07T01:00:51.922+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.922+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 2 Subclusters, Both above LWM/below HWM
2023-08-07T01:00:51.923+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-08-07T01:00:51.923+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-08-07T01:00:51.923+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-08-07T01:00:51.923+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-08-07T01:00:51.923+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.923+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-08-07T01:00:51.923+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-08-07T01:00:51.923+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-08-07T01:00:51.923+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-08-07T01:00:51.923+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-08-07T01:00:51.923+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.923+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM (partial replica repair)
2023-08-07T01:00:51.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 550000000 Units 5500 Tenants 0
2023-08-07T01:00:51.924+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.924+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-08-07T01:00:51.924+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-08-07T01:00:51.924+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.924+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.924+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.924+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-08-07T01:00:51.924+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.924+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.924+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-08-07T01:00:51.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-08-07T01:00:51.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-08-07T01:00:51.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-08-07T01:00:51.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-08-07T01:00:51.924+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.924+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM(full replica repair)
2023-08-07T01:00:51.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-08-07T01:00:51.924+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.924+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx1,1) on 127.0.0.1:9001
2023-08-07T01:00:51.924+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9001
2023-08-07T01:00:51.924+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx1,1) on 127.0.0.1:9001
2023-08-07T01:00:51.924+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9001
2023-08-07T01:00:51.924+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9001
2023-08-07T01:00:51.925+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,1) on 127.0.0.1:9001
2023-08-07T01:00:51.925+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9004 127.0.0.1:9001]]
2023-08-07T01:00:51.925+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9001]
2023-08-07T01:00:51.925+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.925+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-08-07T01:00:51.925+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.925+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-08-07T01:00:51.925+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.925+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 ScaleIn- 2 Subclusters, Both below LWM, Positive Case
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-08-07T01:00:51.925+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.925+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-08-07T01:00:51.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-08-07T01:00:51.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-08-07T01:00:51.926+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.926+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.926+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-08-07T01:00:51.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-08-07T01:00:51.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000
2023-08-07T01:00:51.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2023-08-07T01:00:51.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2023-08-07T01:00:51.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-08-07T01:00:51.926+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.926+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9003 SG sg1 Memory 0 Units 0
2023-08-07T01:00:51.926+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9006 SG sg3 Memory 0 Units 0
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 ScaleIn- 2 Subclusters, One below LWM/ 1 Empty
2023-08-07T01:00:51.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.927+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-08-07T01:00:51.927+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.927+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. No ScaleIn.
2023-08-07T01:00:51.927+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-08-07T01:00:51.927+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.927+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-08-07T01:00:51.927+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.927+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.927+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.927+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.927+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.927+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-08-07T01:00:51.927+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.927+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.927+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.927+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.928+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.928+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-08-07T01:00:51.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-08-07T01:00:51.928+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. ScaleIn.
2023-08-07T01:00:51.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.929+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.929+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.929+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-08-07T01:00:51.929+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-08-07T01:00:51.929+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.929+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.929+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.929+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.929+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-08-07T01:00:51.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-08-07T01:00:51.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-08-07T01:00:51.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-08-07T01:00:51.929+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-08-07T01:00:51.929+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-08-07T01:00:51.929+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-08-07T01:00:51.929+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Rebalance - 1 Subcluster, Below HWM (partial replica repair)
2023-08-07T01:00:51.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-08-07T01:00:51.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 350000000 Units 500 Tenants 0
2023-08-07T01:00:51.930+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.930+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-08-07T01:00:51.930+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-08-07T01:00:51.930+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-08-07T01:00:51.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-08-07T01:00:51.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 500000000 Units 800 Tenants 0
2023-08-07T01:00:51.930+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-08-07T01:00:51.930+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Resume - 1 tenant, Empty node in cluster.
2023-08-07T01:00:51.931+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-08-07T01:00:51.931+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.931+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.931+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.931+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.931+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.931+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.931+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.931+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-08-07T01:00:51.931+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-08-07T01:00:51.932+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Resume - 1 tenant, No empty node in cluster.
2023-08-07T01:00:51.933+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-08-07T01:00:51.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.934+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.934+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-08-07T01:00:51.934+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.934+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Resume - 1 tenant, No node below LWM in the cluster.
2023-08-07T01:00:51.935+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-08-07T01:00:51.935+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.935+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.935+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.935+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.935+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 5000 Tenants 0
2023-08-07T01:00:51.935+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 5000 Tenants 0
2023-08-07T01:00:51.935+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.935+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-08-07T01:00:51.935+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM []
2023/08/07 01:00:51 Expected error No SubCluster Below Low Usage Threshold
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Resume - 1 tenant, Not enough capacity in the cluster.
2023-08-07T01:00:51.936+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-08-07T01:00:51.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-08-07T01:00:51.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-08-07T01:00:51.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-08-07T01:00:51.936+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.936+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250
2023-08-07T01:00:51.936+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-08-07T01:00:51.936+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250 on any target
2023/08/07 01:00:51 Expected error Not Enough Capacity To Place Tenant
--- PASS: TestTenantAwarePlanner (0.10s)
=== RUN TestPlanDuringHeterogenousScaleup
2023/08/07 01:00:51 In TestPlanDuringHeterogenousScaleup()
=== RUN TestPlanDuringHeterogenousScaleup/GreedyPlanner
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-08-07T01:00:51.939+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-08-07T01:00:51.941+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-08-07T01:00:51.943+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-08-07T01:00:51.946+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-08-07T01:00:51.948+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-08-07T01:00:51.950+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-08-07T01:00:51.952+05:30 [Info] Using greedy index placement for index 987654
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-08-07T01:00:51.954+05:30 [Info] Using greedy index placement for index 987654
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests
2023/08/07 01:00:51 -------------------------------------------
2023/08/07 01:00:51 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-08-07T01:00:51.957+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.2180081556498616
2023-08-07T01:00:52.057+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.057+05:30 [Info] Score: 0.5118702120133598
2023-08-07T01:00:52.057+05:30 [Info] variation: 1.0237404240267196
2023-08-07T01:00:52.057+05:30 [Info] ElapsedTime: 100ms
2023-08-07T01:00:52.057+05:30 [Info] ConvergenceTime: 98ms
2023-08-07T01:00:52.057+05:30 [Info] Iteration: 7000
2023-08-07T01:00:52.057+05:30 [Info] Move: 3918
2023-08-07T01:00:52.057+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.057+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.057+05:30 [Info] Indexer Memory Mean 126888575449 (118.174G)
2023-08-07T01:00:52.057+05:30 [Info] Indexer Memory Deviation 80354383758 (74.8359G) (63.33%)
2023-08-07T01:00:52.058+05:30 [Info] Indexer Memory Utilization 2.3004
2023-08-07T01:00:52.058+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.058+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.058+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.058+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.058+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.058+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.058+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.058+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.058+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.058+05:30 [Info] Indexer Data Size Mean 18082106963 (16.8403G)
2023-08-07T01:00:52.058+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (141.42%)
2023-08-07T01:00:52.058+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.058+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.058+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.058+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.058+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.058+05:30 [Info] Number of indexes: 13
2023-08-07T01:00:52.058+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.058+05:30 [Info] Avg Index Size: 29281978949 (27.271G)
2023-08-07T01:00:52.058+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.058+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-08-07T01:00:52.058+05:30 [Info] Avg Index Cpu: 3.5385
2023-08-07T01:00:52.058+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.058+05:30 [Info] Num Estimation Run: 11
2023-08-07T01:00:52.058+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.058+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.058+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.058+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.058+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.058+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.058+05:30 [Info] Total iteration: 7010
2023-08-07T01:00:52.058+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.058+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.058+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.058+05:30 [Info] RandomMove time: 0ns
2023-08-07T01:00:52.058+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-08-07T01:00:52.058+05:30 [Info] ExhaustMove time: 43ms
2023-08-07T01:00:52.058+05:30 [Info] ExhaustMove call: 7010
2023-08-07T01:00:52.058+05:30 [Info] ExhaustMove average time: 6us
2023-08-07T01:00:52.058+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.058+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.058+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.058+05:30 [Info]
2023-08-07T01:00:52.058+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.058+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-08-07T01:00:52.058+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.37390490588193165 allowDDLDuringScaleup:true
2023-08-07T01:00:52.058+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.058+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.058+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.058+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.058+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.058+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.058+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.058+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.058+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.058+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.058+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.058+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.058+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.058+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.058+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.058+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.058+05:30 [Info]
2023-08-07T01:00:52.058+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.059+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.059+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7501886306380632 allowDDLDuringScaleup:true
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:546065131081142445, Partition: 0, new/moved:true
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.059+05:30 [Info]
2023-08-07T01:00:52.059+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.059+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:0 (0), data:0 (0) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-08-07T01:00:52.059+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.07590646348000514 allowDDLDuringScaleup:true
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.059+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.059+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.059+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.059+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-08-07T01:00:52.062+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6856271841119315
2023-08-07T01:00:52.122+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.122+05:30 [Info] Score: 0.28937833136341934
2023-08-07T01:00:52.122+05:30 [Info] variation: 0.5787566627268387
2023-08-07T01:00:52.122+05:30 [Info] ElapsedTime: 60ms
2023-08-07T01:00:52.122+05:30 [Info] ConvergenceTime: 57ms
2023-08-07T01:00:52.122+05:30 [Info] Iteration: 3900
2023-08-07T01:00:52.122+05:30 [Info] Move: 2642
2023-08-07T01:00:52.122+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.122+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.122+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-08-07T01:00:52.122+05:30 [Info] Indexer Memory Deviation 65295744085 (60.8114G) (45.04%)
2023-08-07T01:00:52.122+05:30 [Info] Indexer Memory Utilization 2.6283
2023-08-07T01:00:52.122+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.122+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.122+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.122+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.122+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.122+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.122+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.122+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.122+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.122+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-08-07T01:00:52.122+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-08-07T01:00:52.122+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.122+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.122+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.122+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.122+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.122+05:30 [Info] Number of indexes: 14
2023-08-07T01:00:52.122+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.122+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-08-07T01:00:52.122+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.122+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-08-07T01:00:52.122+05:30 [Info] Avg Index Cpu: 3.2857
2023-08-07T01:00:52.122+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.122+05:30 [Info] Num Estimation Run: 11
2023-08-07T01:00:52.122+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.122+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.122+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.122+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.122+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.122+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.122+05:30 [Info] Total iteration: 4200
2023-08-07T01:00:52.122+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.122+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.122+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.122+05:30 [Info] RandomMove time: 20ms
2023-08-07T01:00:52.122+05:30 [Info] RandomMove call: 3899 (empty index 0)
2023-08-07T01:00:52.122+05:30 [Info] RandomMove average time: 5us
2023-08-07T01:00:52.122+05:30 [Info] ExhaustMove time: 7us
2023-08-07T01:00:52.122+05:30 [Info] ExhaustMove call: 1
2023-08-07T01:00:52.122+05:30 [Info] ExhaustMove average time: 7us
2023-08-07T01:00:52.122+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.122+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.122+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.122+05:30 [Info]
2023-08-07T01:00:52.122+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.122+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-08-07T01:00:52.122+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32726796943638176 allowDDLDuringScaleup:true
2023-08-07T01:00:52.122+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.122+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.122+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.122+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.122+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.122+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.122+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.122+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.122+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.122+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info]
2023-08-07T01:00:52.123+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.123+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.123+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:4421162956423219046, Partition: 0, new/moved:true
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info]
2023-08-07T01:00:52.123+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.123+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.123+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.123+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.123+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:4421162956423219046, Partition: 0, new/moved:true
2023-08-07T01:00:52.123+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.123+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-08-07T01:00:52.126+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5284872008906434
2023-08-07T01:00:52.129+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-08-07T01:00:52.129+05:30 [Info] Score: 0.13929460298637122
2023-08-07T01:00:52.129+05:30 [Info] variation: 0.27858920597274245
2023-08-07T01:00:52.129+05:30 [Info] ElapsedTime: 3ms
2023-08-07T01:00:52.129+05:30 [Info] ConvergenceTime: 1ms
2023-08-07T01:00:52.129+05:30 [Info] Iteration: 1
2023-08-07T01:00:52.129+05:30 [Info] Move: 1
2023-08-07T01:00:52.129+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.129+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.130+05:30 [Info] Indexer Memory Mean 163052789375 (151.855G)
2023-08-07T01:00:52.130+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (55.72%)
2023-08-07T01:00:52.130+05:30 [Info] Indexer Memory Utilization 2.9561
2023-08-07T01:00:52.130+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.130+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.130+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.130+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.130+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.130+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.130+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.130+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.130+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.130+05:30 [Info] Indexer Data Size Mean 54246320889 (50.5208G)
2023-08-07T01:00:52.130+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:52.130+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.130+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.130+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.130+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.130+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Number of indexes: 15
2023-08-07T01:00:52.130+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.130+05:30 [Info] Avg Index Size: 21761293697 (20.2668G)
2023-08-07T01:00:52.130+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.130+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-08-07T01:00:52.130+05:30 [Info] Avg Index Cpu: 3.0667
2023-08-07T01:00:52.130+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.130+05:30 [Info] Num Estimation Run: 230
2023-08-07T01:00:52.130+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.130+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.130+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.130+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.130+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Total iteration: 521
2023-08-07T01:00:52.130+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.130+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.130+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.130+05:30 [Info] RandomMove time: 9us
2023-08-07T01:00:52.130+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-08-07T01:00:52.130+05:30 [Info] RandomMove average time: 9us
2023-08-07T01:00:52.130+05:30 [Info] ExhaustMove time: 1ms
2023-08-07T01:00:52.130+05:30 [Info] ExhaustMove call: 220
2023-08-07T01:00:52.130+05:30 [Info] ExhaustMove average time: 5us
2023-08-07T01:00:52.130+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.130+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.130+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.130+05:30 [Info]
2023-08-07T01:00:52.130+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.130+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.130+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5575132033129112 allowDDLDuringScaleup:true
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12854573125004258275, Partition: 0, new/moved:true
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info]
2023-08-07T01:00:52.130+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.130+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.130+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3168776165275712 allowDDLDuringScaleup:true
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.130+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:12854573125004258275, Partition: 0, new/moved:true
2023-08-07T01:00:52.130+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.130+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.130+05:30 [Info]
2023-08-07T01:00:52.130+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.130+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.130+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.3256091801595177 allowDDLDuringScaleup:true
2023-08-07T01:00:52.130+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.131+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.131+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.131+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.131+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.131+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.131+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.131+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.131+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.131+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.131+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.131+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.131+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.131+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.131+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.131+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.131+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.131+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12854573125004258275, Partition: 0, new/moved:true
2023-08-07T01:00:52.131+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.131+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-08-07T01:00:52.133+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0155476961840748
2023-08-07T01:00:52.326+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.326+05:30 [Info] Score: 0.358469577773188
2023-08-07T01:00:52.326+05:30 [Info] variation: 0.716939155546376
2023-08-07T01:00:52.326+05:30 [Info] ElapsedTime: 193ms
2023-08-07T01:00:52.326+05:30 [Info] ConvergenceTime: 191ms
2023-08-07T01:00:52.326+05:30 [Info] Iteration: 7400
2023-08-07T01:00:52.326+05:30 [Info] Move: 5794
2023-08-07T01:00:52.326+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.326+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.326+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-08-07T01:00:52.326+05:30 [Info] Indexer Memory Deviation 105360564648 (98.1247G) (72.68%)
2023-08-07T01:00:52.326+05:30 [Info] Indexer Memory Utilization 2.6283
2023-08-07T01:00:52.326+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.326+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.327+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.327+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.327+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.327+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.327+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.327+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.327+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.327+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-08-07T01:00:52.327+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-08-07T01:00:52.327+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.327+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.327+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.327+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.327+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Number of indexes: 14
2023-08-07T01:00:52.327+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.327+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-08-07T01:00:52.327+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.327+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-08-07T01:00:52.327+05:30 [Info] Avg Index Cpu: 3.2857
2023-08-07T01:00:52.327+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.327+05:30 [Info] Num Estimation Run: 11
2023-08-07T01:00:52.327+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.327+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.327+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.327+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.327+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Total iteration: 19656
2023-08-07T01:00:52.327+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.327+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.327+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.327+05:30 [Info] RandomMove time: 44ms
2023-08-07T01:00:52.327+05:30 [Info] RandomMove call: 7399 (empty index 0)
2023-08-07T01:00:52.327+05:30 [Info] RandomMove average time: 5us
2023-08-07T01:00:52.327+05:30 [Info] ExhaustMove time: 108us
2023-08-07T01:00:52.327+05:30 [Info] ExhaustMove call: 11
2023-08-07T01:00:52.327+05:30 [Info] ExhaustMove average time: 9us
2023-08-07T01:00:52.327+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.327+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.327+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.327+05:30 [Info]
2023-08-07T01:00:52.327+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.327+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.327+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7021056124497257 allowDDLDuringScaleup:true
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12334373158396695307, Partition: 0, new/moved:true
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info]
2023-08-07T01:00:52.327+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.327+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.327+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.327+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.327+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:12334373158396695307, Partition: 0, new/moved:true
2023-08-07T01:00:52.327+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.328+05:30 [Info]
2023-08-07T01:00:52.328+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.328+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:0 (0), data:0 (0) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-08-07T01:00:52.328+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.06643869545280173 allowDDLDuringScaleup:true
2023-08-07T01:00:52.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.328+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.328+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.328+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.328+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.328+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.328+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.328+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.328+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-08-07T01:00:52.330+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6856271841119315
2023-08-07T01:00:52.422+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.422+05:30 [Info] Score: 0.28937833136341934
2023-08-07T01:00:52.422+05:30 [Info] variation: 0.5787566627268387
2023-08-07T01:00:52.422+05:30 [Info] ElapsedTime: 91ms
2023-08-07T01:00:52.422+05:30 [Info] ConvergenceTime: 88ms
2023-08-07T01:00:52.422+05:30 [Info] Iteration: 4200
2023-08-07T01:00:52.422+05:30 [Info] Move: 2447
2023-08-07T01:00:52.422+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.422+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.422+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-08-07T01:00:52.422+05:30 [Info] Indexer Memory Deviation 65295744085 (60.8114G) (45.04%)
2023-08-07T01:00:52.422+05:30 [Info] Indexer Memory Utilization 2.6283
2023-08-07T01:00:52.422+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.422+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.422+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.422+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.422+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.422+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.422+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.423+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.423+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.423+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-08-07T01:00:52.423+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-08-07T01:00:52.423+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.423+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.423+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.423+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.423+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.423+05:30 [Info] Number of indexes: 14
2023-08-07T01:00:52.423+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.423+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-08-07T01:00:52.423+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.423+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-08-07T01:00:52.423+05:30 [Info] Avg Index Cpu: 3.2857
2023-08-07T01:00:52.423+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.423+05:30 [Info] Num Estimation Run: 11
2023-08-07T01:00:52.423+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.423+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.423+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.423+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.423+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.423+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.423+05:30 [Info] Total iteration: 8205
2023-08-07T01:00:52.423+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.423+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.423+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.423+05:30 [Info] RandomMove time: 24ms
2023-08-07T01:00:52.423+05:30 [Info] RandomMove call: 4199 (empty index 0)
2023-08-07T01:00:52.423+05:30 [Info] RandomMove average time: 5us
2023-08-07T01:00:52.423+05:30 [Info] ExhaustMove time: 8us
2023-08-07T01:00:52.423+05:30 [Info] ExhaustMove call: 1
2023-08-07T01:00:52.423+05:30 [Info] ExhaustMove average time: 8us
2023-08-07T01:00:52.423+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.423+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.423+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.423+05:30 [Info]
2023-08-07T01:00:52.423+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.423+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-08-07T01:00:52.423+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32726796943638176 allowDDLDuringScaleup:true
2023-08-07T01:00:52.423+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.423+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.423+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.423+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.423+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.423+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.423+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.423+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.423+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.423+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.423+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.423+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.423+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.423+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.423+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.423+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.423+05:30 [Info]
2023-08-07T01:00:52.423+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.424+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.424+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:9191505588062807834, Partition: 0, new/moved:true
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info]
2023-08-07T01:00:52.424+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.424+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.424+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.424+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.424+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.424+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.424+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:9191505588062807834, Partition: 0, new/moved:true
2023-08-07T01:00:52.425+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.425+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-08-07T01:00:52.427+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.1877979057133785
2023-08-07T01:00:52.428+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-08-07T01:00:52.428+05:30 [Info] Score: 0.4863052536963559
2023-08-07T01:00:52.428+05:30 [Info] variation: 0.9726105073927118
2023-08-07T01:00:52.428+05:30 [Info] ElapsedTime: 311us
2023-08-07T01:00:52.428+05:30 [Info] ConvergenceTime: 236us
2023-08-07T01:00:52.428+05:30 [Info] Iteration: 1
2023-08-07T01:00:52.428+05:30 [Info] Move: 1
2023-08-07T01:00:52.428+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.428+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.428+05:30 [Info] Indexer Memory Mean 14745215094 (13.7326G)
2023-08-07T01:00:52.428+05:30 [Info] Indexer Memory Deviation 7829819102 (7.29209G) (53.10%)
2023-08-07T01:00:52.428+05:30 [Info] Indexer Memory Utilization 1.6384
2023-08-07T01:00:52.428+05:30 [Info] Indexer CPU Mean 0.6667
2023-08-07T01:00:52.428+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-08-07T01:00:52.428+05:30 [Info] Indexer CPU Utilization 0.0833
2023-08-07T01:00:52.428+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.428+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.428+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.428+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.428+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.428+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.428+05:30 [Info] Indexer Data Size Mean 2745215094 (2.55668G)
2023-08-07T01:00:52.428+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (141.42%)
2023-08-07T01:00:52.428+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.428+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.428+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.428+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.428+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.428+05:30 [Info] Number of indexes: 4
2023-08-07T01:00:52.428+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.428+05:30 [Info] Avg Index Size: 11058911320 (10.2994G)
2023-08-07T01:00:52.428+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-08-07T01:00:52.428+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-08-07T01:00:52.428+05:30 [Info] Avg Index Cpu: 0.7500
2023-08-07T01:00:52.428+05:30 [Info] Max Index Cpu: 1.0000
2023-08-07T01:00:52.428+05:30 [Info] Num Estimation Run: 7
2023-08-07T01:00:52.428+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.428+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-08-07T01:00:52.428+05:30 [Info] CPU Quota 8
2023-08-07T01:00:52.428+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.428+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.428+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.428+05:30 [Info] Total iteration: 8
2023-08-07T01:00:52.428+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.429+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.429+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.429+05:30 [Info] RandomMove time: 0ns
2023-08-07T01:00:52.429+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-08-07T01:00:52.429+05:30 [Info] ExhaustMove time: 68us
2023-08-07T01:00:52.429+05:30 [Info] ExhaustMove call: 8
2023-08-07T01:00:52.429+05:30 [Info] ExhaustMove average time: 8us
2023-08-07T01:00:52.429+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.429+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.429+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.429+05:30 [Info]
2023-08-07T01:00:52.429+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-08-07T01:00:52.429+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:52.429+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.3390930527717129 allowDDLDuringScaleup:true
2023-08-07T01:00:52.429+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.429+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false
2023-08-07T01:00:52.429+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.429+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.429+05:30 [Info]
2023-08-07T01:00:52.429+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-08-07T01:00:52.429+05:30 [Info] Indexer total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:0 (0), data:0 (0) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:52.429+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0813823326652111 allowDDLDuringScaleup:true
2023-08-07T01:00:52.429+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.429+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false
2023-08-07T01:00:52.429+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.429+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.429+05:30 [Info]
2023-08-07T01:00:52.429+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-08-07T01:00:52.429+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:52.429+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.779524614563076 allowDDLDuringScaleup:true
2023-08-07T01:00:52.429+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.429+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false
2023-08-07T01:00:52.429+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.429+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.429+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.429+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:10469411906451140137, Partition: 0, new/moved:true
2023-08-07T01:00:52.429+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.430+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-08-07T01:00:52.432+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-08-07T01:00:52.432+05:30 [Warn] Definition 987654 Instance 1781732121131476725 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-08-07T01:00:52.432+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-08-07T01:00:52.432+05:30 [Warn] Definition 987654 Instance 1781732121131476725 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-08-07T01:00:52.432+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6702149941767832
2023-08-07T01:00:52.488+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.488+05:30 [Info] Score: 0.25290029571859646
2023-08-07T01:00:52.488+05:30 [Info] variation: 0.5058005914371929
2023-08-07T01:00:52.488+05:30 [Info] ElapsedTime: 56ms
2023-08-07T01:00:52.488+05:30 [Info] ConvergenceTime: 54ms
2023-08-07T01:00:52.488+05:30 [Info] Iteration: 3700
2023-08-07T01:00:52.488+05:30 [Info] Move: 2432
2023-08-07T01:00:52.488+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.488+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.488+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-08-07T01:00:52.488+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-08-07T01:00:52.488+05:30 [Info] Indexer Memory Utilization 1.9434
2023-08-07T01:00:52.488+05:30 [Info] Indexer CPU Mean 0.6667
2023-08-07T01:00:52.488+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-08-07T01:00:52.488+05:30 [Info] Indexer CPU Utilization 0.0833
2023-08-07T01:00:52.488+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.488+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.488+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.488+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.488+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.488+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.488+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-08-07T01:00:52.488+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-08-07T01:00:52.488+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.488+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.488+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.488+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.488+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.488+05:30 [Info] Number of indexes: 5
2023-08-07T01:00:52.488+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.488+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-08-07T01:00:52.488+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-08-07T01:00:52.488+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-08-07T01:00:52.488+05:30 [Info] Avg Index Cpu: 0.6000
2023-08-07T01:00:52.488+05:30 [Info] Max Index Cpu: 1.0000
2023-08-07T01:00:52.488+05:30 [Info] Num Estimation Run: 7
2023-08-07T01:00:52.488+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.488+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-08-07T01:00:52.488+05:30 [Info] CPU Quota 8
2023-08-07T01:00:52.488+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.488+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.488+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.488+05:30 [Info] Total iteration: 3880
2023-08-07T01:00:52.488+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.488+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.488+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.488+05:30 [Info] RandomMove time: 18ms
2023-08-07T01:00:52.488+05:30 [Info] RandomMove call: 3699 (empty index 0)
2023-08-07T01:00:52.488+05:30 [Info] RandomMove average time: 4us
2023-08-07T01:00:52.488+05:30 [Info] ExhaustMove time: 6us
2023-08-07T01:00:52.488+05:30 [Info] ExhaustMove call: 1
2023-08-07T01:00:52.488+05:30 [Info] ExhaustMove average time: 6us
2023-08-07T01:00:52.488+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.488+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.488+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.488+05:30 [Info]
2023-08-07T01:00:52.488+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-08-07T01:00:52.488+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:52.488+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-08-07T01:00:52.488+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.488+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false
2023-08-07T01:00:52.488+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.488+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.488+05:30 [Info]
2023-08-07T01:00:52.488+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-08-07T01:00:52.488+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:52.488+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-08-07T01:00:52.488+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.489+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false
2023-08-07T01:00:52.489+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.489+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.489+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.489+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:1781732121131476725, Partition: 0, new/moved:true
2023-08-07T01:00:52.489+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.489+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.489+05:30 [Info]
2023-08-07T01:00:52.489+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-08-07T01:00:52.489+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:52.489+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-08-07T01:00:52.489+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.489+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false
2023-08-07T01:00:52.489+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.489+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.489+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.489+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:1781732121131476725, Partition: 0, new/moved:true
2023-08-07T01:00:52.489+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.489+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-08-07T01:00:52.491+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-08-07T01:00:52.491+05:30 [Warn] Definition 987654 Instance 491203074405149854 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-08-07T01:00:52.491+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-08-07T01:00:52.491+05:30 [Warn] Definition 987654 Instance 491203074405149854 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-08-07T01:00:52.491+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.2401371728156407
2023-08-07T01:00:52.549+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.549+05:30 [Info] Score: 0.25290029571859646
2023-08-07T01:00:52.549+05:30 [Info] variation: 0.5058005914371929
2023-08-07T01:00:52.549+05:30 [Info] ElapsedTime: 57ms
2023-08-07T01:00:52.549+05:30 [Info] ConvergenceTime: 55ms
2023-08-07T01:00:52.549+05:30 [Info] Iteration: 4100
2023-08-07T01:00:52.549+05:30 [Info] Move: 2425
2023-08-07T01:00:52.549+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.549+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.549+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-08-07T01:00:52.549+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-08-07T01:00:52.549+05:30 [Info] Indexer Memory Utilization 1.9434
2023-08-07T01:00:52.549+05:30 [Info] Indexer CPU Mean 0.6667
2023-08-07T01:00:52.549+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-08-07T01:00:52.549+05:30 [Info] Indexer CPU Utilization 0.0833
2023-08-07T01:00:52.549+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.549+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.549+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.549+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.549+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.549+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.549+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-08-07T01:00:52.549+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-08-07T01:00:52.549+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.549+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.549+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.549+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.549+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.549+05:30 [Info] Number of indexes: 5
2023-08-07T01:00:52.549+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.549+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-08-07T01:00:52.549+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-08-07T01:00:52.549+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-08-07T01:00:52.549+05:30 [Info] Avg Index Cpu: 0.6000
2023-08-07T01:00:52.549+05:30 [Info] Max Index Cpu: 1.0000
2023-08-07T01:00:52.549+05:30 [Info] Num Estimation Run: 7
2023-08-07T01:00:52.549+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.549+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-08-07T01:00:52.549+05:30 [Info] CPU Quota 8
2023-08-07T01:00:52.549+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.549+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.549+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.549+05:30 [Info] Total iteration: 4106
2023-08-07T01:00:52.549+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.549+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.549+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.549+05:30 [Info] RandomMove time: 19ms
2023-08-07T01:00:52.549+05:30 [Info] RandomMove call: 4099 (empty index 0)
2023-08-07T01:00:52.549+05:30 [Info] RandomMove average time: 4us
2023-08-07T01:00:52.549+05:30 [Info] ExhaustMove time: 51us
2023-08-07T01:00:52.549+05:30 [Info] ExhaustMove call: 7
2023-08-07T01:00:52.549+05:30 [Info] ExhaustMove average time: 7us
2023-08-07T01:00:52.549+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.549+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.549+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.549+05:30 [Info]
2023-08-07T01:00:52.549+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-08-07T01:00:52.550+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:52.550+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-08-07T01:00:52.550+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.550+05:30 [Info] Index name:nonEquiv 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false
2023-08-07T01:00:52.550+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.550+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.550+05:30 [Info]
2023-08-07T01:00:52.550+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-08-07T01:00:52.550+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:52.550+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-08-07T01:00:52.550+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.550+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false
2023-08-07T01:00:52.550+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.550+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.550+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.550+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:491203074405149854, Partition: 0, new/moved:true
2023-08-07T01:00:52.550+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.550+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.550+05:30 [Info]
2023-08-07T01:00:52.550+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-08-07T01:00:52.550+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:52.550+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-08-07T01:00:52.550+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.550+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false
2023-08-07T01:00:52.550+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.550+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.550+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.550+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:491203074405149854, Partition: 0, new/moved:true
2023-08-07T01:00:52.550+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.550+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up
2023-08-07T01:00:52.553+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.22315389658892215
2023-08-07T01:00:52.598+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.598+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=45ms
2023-08-07T01:00:52.598+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.22315389658892215
2023-08-07T01:00:52.622+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.622+05:30 [Info] Score: 0.12404325807734162
2023-08-07T01:00:52.622+05:30 [Info] variation: 0.22315389658892215
2023-08-07T01:00:52.622+05:30 [Info] ElapsedTime: 24ms
2023-08-07T01:00:52.623+05:30 [Info] ConvergenceTime: 185us
2023-08-07T01:00:52.623+05:30 [Info] Iteration: 4
2023-08-07T01:00:52.623+05:30 [Info] Move: 4
2023-08-07T01:00:52.623+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.623+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.623+05:30 [Info] Indexer Memory Mean 523678278948 (487.713G)
2023-08-07T01:00:52.623+05:30 [Info] Indexer Memory Deviation 141147581461 (131.454G) (26.95%)
2023-08-07T01:00:52.623+05:30 [Info] Indexer Memory Utilization 9.4941
2023-08-07T01:00:52.623+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.623+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.623+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.623+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.623+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.623+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.623+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.623+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.623+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.623+05:30 [Info] Indexer Data Size Mean 414871810461 (386.379G)
2023-08-07T01:00:52.623+05:30 [Info] Indexer Data Size Deviation 73339667625 (68.3029G) (17.68%)
2023-08-07T01:00:52.623+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.623+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.623+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.623+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.623+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.623+05:30 [Info] Number of indexes: 20
2023-08-07T01:00:52.623+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.623+05:30 [Info] Avg Index Size: 16320970273 (15.2001G)
2023-08-07T01:00:52.623+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.623+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-08-07T01:00:52.623+05:30 [Info] Avg Index Cpu: 2.3000
2023-08-07T01:00:52.623+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.623+05:30 [Info] Num Estimation Run: 230
2023-08-07T01:00:52.623+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.623+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.623+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.623+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.623+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.623+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.623+05:30 [Info] Total iteration: 16358
2023-08-07T01:00:52.623+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.623+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.623+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.623+05:30 [Info] RandomMove time: 36us
2023-08-07T01:00:52.623+05:30 [Info] RandomMove call: 5 (empty index 4)
2023-08-07T01:00:52.623+05:30 [Info] RandomMove average time: 7us
2023-08-07T01:00:52.623+05:30 [Info] ExhaustMove time: 0ns
2023-08-07T01:00:52.623+05:30 [Info] ExhaustMove call: 0
2023-08-07T01:00:52.623+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.623+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.623+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.623+05:30 [Info]
2023-08-07T01:00:52.623+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.623+05:30 [Info] Indexer total memory:734512475878 (684.068G), mem:703952091074 (655.606G), overhead:30560384804 (28.4616G), min:42699834774 (39.7673G), data:466730786769 (434.677G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-08-07T01:00:52.623+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4938490698862463 allowDDLDuringScaleup:true
2023-08-07T01:00:52.623+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.623+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.623+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:4995829886 (4.65273G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.623+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.623+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.623+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.623+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:13150749438 (12.2476G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.623+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.623+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.623+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.623+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:13051410687 (12.1551G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:11501844763 (10.7119G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info]
2023-08-07T01:00:52.624+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.624+05:30 [Info] Indexer total memory:524101727770 (488.108G), mem:507770572832 (472.898G), overhead:16331154938 (15.2096G), min:36935807455 (34.3992G), data:466730786769 (434.677G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-08-07T01:00:52.624+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.41892462633815686 allowDDLDuringScaleup:true
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:4995829886 (4.65273G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:13150749438 (12.2476G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:9400037446 (8.75447G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:9389190685 (8.74437G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:14476401992314059705, Partition: 0, new/moved:true
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:14476401992314059705, Partition: 3, new/moved:true
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:14476401992314059705, Partition: 1, new/moved:true
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info]
2023-08-07T01:00:52.624+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.624+05:30 [Info] Indexer total memory:382755407358 (356.469G), mem:359312172938 (334.636G), overhead:23443234420 (21.8332G), min:43342483581 (40.3658G), data:311153857846 (289.785G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-08-07T01:00:52.624+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.2872263037755968 allowDDLDuringScaleup:true
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:13051410687 (12.1551G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:11501844763 (10.7119G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:9400037446 (8.75447G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:9389190685 (8.74437G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.624+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.624+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.624+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:14476401992314059705, Partition: 5, new/moved:true
2023-08-07T01:00:52.624+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.625+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.625+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.625+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:14476401992314059705, Partition: 7, new/moved:true
2023-08-07T01:00:52.625+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.625+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.625+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.625+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:14476401992314059705, Partition: 6, new/moved:true
2023-08-07T01:00:52.625+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.625+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.625+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.625+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:14476401992314059705, Partition: 4, new/moved:true
2023-08-07T01:00:52.625+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.625+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.625+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.625+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:14476401992314059705, Partition: 2, new/moved:true
2023-08-07T01:00:52.625+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.625+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 2 Scaled up
2023-08-07T01:00:52.628+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.21948680330955667
2023-08-07T01:00:52.672+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.672+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=44ms
2023-08-07T01:00:52.673+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.21948680330955667
2023-08-07T01:00:52.695+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.695+05:30 [Info] Score: 0.12858513212924208
2023-08-07T01:00:52.695+05:30 [Info] variation: 0.21948680330955667
2023-08-07T01:00:52.696+05:30 [Info] ElapsedTime: 22ms
2023-08-07T01:00:52.696+05:30 [Info] ConvergenceTime: 164us
2023-08-07T01:00:52.696+05:30 [Info] Iteration: 6
2023-08-07T01:00:52.696+05:30 [Info] Move: 6
2023-08-07T01:00:52.696+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.696+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.696+05:30 [Info] Indexer Memory Mean 622732914954 (579.965G)
2023-08-07T01:00:52.696+05:30 [Info] Indexer Memory Deviation 163278646879 (152.065G) (26.22%)
2023-08-07T01:00:52.696+05:30 [Info] Indexer Memory Utilization 11.2899
2023-08-07T01:00:52.696+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.696+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.696+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.696+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.696+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.696+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.696+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.696+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.696+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.696+05:30 [Info] Indexer Data Size Mean 459206731717 (427.67G)
2023-08-07T01:00:52.696+05:30 [Info] Indexer Data Size Deviation 81177048490 (75.602G) (17.68%)
2023-08-07T01:00:52.696+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.696+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.696+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.696+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.696+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.696+05:30 [Info] Number of indexes: 20
2023-08-07T01:00:52.696+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.696+05:30 [Info] Avg Index Size: 24528927485 (22.8443G)
2023-08-07T01:00:52.696+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.696+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-08-07T01:00:52.696+05:30 [Info] Avg Index Cpu: 2.3000
2023-08-07T01:00:52.696+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.696+05:30 [Info] Num Estimation Run: 231
2023-08-07T01:00:52.696+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.696+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.696+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.696+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.696+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.696+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.696+05:30 [Info] Total iteration: 16357
2023-08-07T01:00:52.696+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.696+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.696+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.696+05:30 [Info] RandomMove time: 40us
2023-08-07T01:00:52.696+05:30 [Info] RandomMove call: 7 (empty index 6)
2023-08-07T01:00:52.696+05:30 [Info] RandomMove average time: 5us
2023-08-07T01:00:52.696+05:30 [Info] ExhaustMove time: 0ns
2023-08-07T01:00:52.696+05:30 [Info] ExhaustMove call: 0
2023-08-07T01:00:52.696+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.696+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.696+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.696+05:30 [Info]
2023-08-07T01:00:52.696+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.696+05:30 [Info] Indexer total memory:784389262291 (730.519G), mem:753828877487 (702.058G), overhead:30560384804 (28.4616G), min:42699834774 (39.7673G), data:516607573182 (481.128G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.696+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.46710343130549853 allowDDLDuringScaleup:true
2023-08-07T01:00:52.696+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.696+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.696+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:4995829886 (4.65273G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.696+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.696+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.696+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.696+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:13150749438 (12.2476G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.696+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.696+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.696+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.696+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:13051410687 (12.1551G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:11501844763 (10.7119G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:6040182607737920497, Partition: 7, new/moved:true
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info]
2023-08-07T01:00:52.697+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.697+05:30 [Info] Indexer total memory:803462278187 (748.283G), mem:721806503497 (672.235G), overhead:81655774690 (76.0479G), min:36935807455 (34.3992G), data:516607573182 (481.128G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-08-07T01:00:52.697+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4568189664182262 allowDDLDuringScaleup:true
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:4995829886 (4.65273G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:13150749438 (12.2476G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:9400037446 (8.75447G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:9389190685 (8.74437G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:6040182607737920497, Partition: 6, new/moved:true
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info]
2023-08-07T01:00:52.697+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.697+05:30 [Info] Indexer total memory:416006598300 (387.436G), mem:392563363880 (365.603G), overhead:23443234420 (21.8332G), min:43342483581 (40.3658G), data:344405048788 (320.752G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-08-07T01:00:52.697+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.27607760227627526 allowDDLDuringScaleup:true
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:13051410687 (12.1551G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:11501844763 (10.7119G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:9400037446 (8.75447G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:9389190685 (8.74437G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.697+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:6040182607737920497, Partition: 0, new/moved:true
2023-08-07T01:00:52.697+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.697+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.698+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:6040182607737920497, Partition: 4, new/moved:true
2023-08-07T01:00:52.698+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.698+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.698+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:6040182607737920497, Partition: 3, new/moved:true
2023-08-07T01:00:52.698+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.698+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.698+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:6040182607737920497, Partition: 5, new/moved:true
2023-08-07T01:00:52.698+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.698+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.698+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:6040182607737920497, Partition: 1, new/moved:true
2023-08-07T01:00:52.698+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.698+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.698+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:6040182607737920497, Partition: 2, new/moved:true
2023-08-07T01:00:52.698+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.698+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-08-07T01:00:52.700+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.22394268783091786
2023-08-07T01:00:52.763+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.763+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=62ms
2023-08-07T01:00:52.763+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.22394268783091786
2023-08-07T01:00:52.789+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.789+05:30 [Info] Score: 0.15358553534239294
2023-08-07T01:00:52.789+05:30 [Info] variation: 0.22394268783091786
2023-08-07T01:00:52.789+05:30 [Info] ElapsedTime: 26ms
2023-08-07T01:00:52.789+05:30 [Info] ConvergenceTime: 502us
2023-08-07T01:00:52.789+05:30 [Info] Iteration: 7
2023-08-07T01:00:52.789+05:30 [Info] Move: 7
2023-08-07T01:00:52.789+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.789+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.789+05:30 [Info] Indexer Memory Mean 938550089409 (874.093G)
2023-08-07T01:00:52.789+05:30 [Info] Indexer Memory Deviation 200879554691 (187.084G) (21.40%)
2023-08-07T01:00:52.789+05:30 [Info] Indexer Memory Utilization 17.0156
2023-08-07T01:00:52.789+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.789+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.789+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.789+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.789+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.789+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.789+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.789+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.789+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.789+05:30 [Info] Indexer Data Size Mean 829743620922 (772.759G)
2023-08-07T01:00:52.789+05:30 [Info] Indexer Data Size Deviation 194038521772 (180.712G) (23.39%)
2023-08-07T01:00:52.789+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.789+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.789+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.789+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.790+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Number of indexes: 28
2023-08-07T01:00:52.790+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.790+05:30 [Info] Avg Index Size: 11657835909 (10.8572G)
2023-08-07T01:00:52.790+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.790+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-08-07T01:00:52.790+05:30 [Info] Avg Index Cpu: 1.6429
2023-08-07T01:00:52.790+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.790+05:30 [Info] Num Estimation Run: 230
2023-08-07T01:00:52.790+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.790+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.790+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.790+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.790+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Total iteration: 16441
2023-08-07T01:00:52.790+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.790+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.790+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.790+05:30 [Info] RandomMove time: 58us
2023-08-07T01:00:52.790+05:30 [Info] RandomMove call: 6 (empty index 7)
2023-08-07T01:00:52.790+05:30 [Info] RandomMove average time: 9us
2023-08-07T01:00:52.790+05:30 [Info] ExhaustMove time: 24us
2023-08-07T01:00:52.790+05:30 [Info] ExhaustMove call: 2
2023-08-07T01:00:52.790+05:30 [Info] ExhaustMove average time: 12us
2023-08-07T01:00:52.790+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.790+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.790+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.790+05:30 [Info]
2023-08-07T01:00:52.790+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.790+05:30 [Info] Indexer total memory:1045666333724 (973.853G), mem:1015105948920 (945.391G), overhead:30560384804 (28.4616G), min:42699834774 (39.7673G), data:777884644615 (724.462G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-08-07T01:00:52.790+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4038136438586557 allowDDLDuringScaleup:true
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:4995829886 (4.65273G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:13150749438 (12.2476G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:13051410687 (12.1551G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:11501844763 (10.7119G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 2, new/moved:true
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 0, new/moved:true
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 1, new/moved:true
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 3, new/moved:true
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 7, new/moved:true
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info]
2023-08-07T01:00:52.790+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.790+05:30 [Info] Indexer total memory:679678656693 (633G), mem:663347501755 (617.791G), overhead:16331154938 (15.2096G), min:36935807455 (34.3992G), data:622307715692 (579.569G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-08-07T01:00:52.790+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.2913558017287007 allowDDLDuringScaleup:true
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:4995829886 (4.65273G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:13150749438 (12.2476G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:9400037446 (8.75447G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:9389190685 (8.74437G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 1, new/moved:true
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.790+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 2, new/moved:true
2023-08-07T01:00:52.790+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.790+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.790+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 5, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 7, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 6, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 3, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 4, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 0, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info]
2023-08-07T01:00:52.791+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.791+05:30 [Info] Indexer total memory:1160640051973 (1.0556T), mem:1137196817553 (1.03427T), overhead:23443234420 (21.8332G), min:43342483581 (40.3658G), data:1089038502461 (1014.25G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-08-07T01:00:52.791+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5048305544126437 allowDDLDuringScaleup:true
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:13051410687 (12.1551G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:11501844763 (10.7119G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:9400037446 (8.75447G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:9389190685 (8.74437G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 4, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 6, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.791+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.791+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:13490216679032732611, Partition: 5, new/moved:true
2023-08-07T01:00:52.791+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.791+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-08-07T01:00:52.793+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.24413211823091774
2023-08-07T01:00:52.945+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.945+05:30 [Info] Score: 0.11475962811811741
2023-08-07T01:00:52.945+05:30 [Info] variation: 0.22951925623623481
2023-08-07T01:00:52.946+05:30 [Info] ElapsedTime: 152ms
2023-08-07T01:00:52.946+05:30 [Info] ConvergenceTime: 148ms
2023-08-07T01:00:52.946+05:30 [Info] Iteration: 6000
2023-08-07T01:00:52.946+05:30 [Info] Move: 4096
2023-08-07T01:00:52.946+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.946+05:30 [Info] Indexer Memory Mean 211591134437 (197.06G)
2023-08-07T01:00:52.946+05:30 [Info] Indexer Memory Deviation 78426288854 (73.0402G) (37.07%)
2023-08-07T01:00:52.946+05:30 [Info] Indexer Memory Utilization 3.8361
2023-08-07T01:00:52.946+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.946+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.946+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.946+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.946+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.946+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.946+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.946+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.946+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.946+05:30 [Info] Indexer Data Size Mean 48064951200 (44.764G)
2023-08-07T01:00:52.946+05:30 [Info] Indexer Data Size Deviation 4248381616 (3.95661G) (8.84%)
2023-08-07T01:00:52.946+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.946+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.946+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.946+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.946+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Number of indexes: 28
2023-08-07T01:00:52.946+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.946+05:30 [Info] Avg Index Size: 22670478689 (21.1135G)
2023-08-07T01:00:52.946+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.946+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-08-07T01:00:52.946+05:30 [Info] Avg Index Cpu: 1.6429
2023-08-07T01:00:52.946+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.946+05:30 [Info] Num Estimation Run: 29
2023-08-07T01:00:52.946+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.946+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.946+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.946+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.946+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Total iteration: 9935
2023-08-07T01:00:52.946+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.946+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.946+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.946+05:30 [Info] RandomMove time: 42ms
2023-08-07T01:00:52.946+05:30 [Info] RandomMove call: 5999 (empty index 0)
2023-08-07T01:00:52.946+05:30 [Info] RandomMove average time: 7us
2023-08-07T01:00:52.946+05:30 [Info] ExhaustMove time: 8us
2023-08-07T01:00:52.946+05:30 [Info] ExhaustMove call: 1
2023-08-07T01:00:52.946+05:30 [Info] ExhaustMove average time: 8us
2023-08-07T01:00:52.946+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.946+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.946+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.946+05:30 [Info]
2023-08-07T01:00:52.946+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.946+05:30 [Info] Indexer total memory:312842580859 (291.357G), mem:282282196055 (262.896G), overhead:30560384804 (28.4616G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-08-07T01:00:52.946+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4543185477672772 allowDDLDuringScaleup:true
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 1, new/moved:true
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 7, new/moved:true
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 6, new/moved:true
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 3, new/moved:true
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 4, new/moved:true
2023-08-07T01:00:52.946+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.946+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.946+05:30 [Info]
2023-08-07T01:00:52.946+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.946+05:30 [Info] Indexer total memory:331915596755 (309.12G), mem:250259822065 (233.073G), overhead:81655774690 (76.0479G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-08-07T01:00:52.946+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.42405038546912194 allowDDLDuringScaleup:true
2023-08-07T01:00:52.946+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.946+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 2, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 0, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 5, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 4, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 3, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info]
2023-08-07T01:00:52.947+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.947+05:30 [Info] Indexer total memory:125674619612 (117.044G), mem:102231385192 (95.2104G), overhead:23443234420 (21.8332G), min:54073070100 (50.3595G), data:54073070100 (50.3595G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-08-07T01:00:52.947+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32163106676360087 allowDDLDuringScaleup:true
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 2, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 5, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 1, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 0, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 6, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.947+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6524960539071977626, Partition: 7, new/moved:true
2023-08-07T01:00:52.947+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-08-07T01:00:52.950+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.22651976156522108
2023-08-07T01:00:52.983+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:52.983+05:30 [Info] Score: 0.14532097559770876
2023-08-07T01:00:52.983+05:30 [Info] variation: 0.2906419511954175
2023-08-07T01:00:52.983+05:30 [Info] ElapsedTime: 33ms
2023-08-07T01:00:52.983+05:30 [Info] ConvergenceTime: 5ms
2023-08-07T01:00:52.983+05:30 [Info] Iteration: 7
2023-08-07T01:00:52.983+05:30 [Info] Move: 7
2023-08-07T01:00:52.983+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.983+05:30 [Info] Using SAPlanner
2023-08-07T01:00:52.983+05:30 [Info] Indexer Memory Mean 156291089214 (145.557G)
2023-08-07T01:00:52.983+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (58.13%)
2023-08-07T01:00:52.983+05:30 [Info] Indexer Memory Utilization 2.8335
2023-08-07T01:00:52.983+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:52.983+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:52.983+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:52.983+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:52.983+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:52.984+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:52.984+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.984+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:52.984+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:52.984+05:30 [Info] Indexer Data Size Mean 47484620728 (44.2235G)
2023-08-07T01:00:52.984+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:52.984+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:52.984+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.984+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:52.984+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:52.984+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.984+05:30 [Info] Number of indexes: 36
2023-08-07T01:00:52.984+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:52.984+05:30 [Info] Avg Index Size: 13024257434 (12.1298G)
2023-08-07T01:00:52.984+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:52.984+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-08-07T01:00:52.984+05:30 [Info] Avg Index Cpu: 1.2778
2023-08-07T01:00:52.984+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:52.984+05:30 [Info] Num Estimation Run: 32
2023-08-07T01:00:52.984+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.984+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:52.984+05:30 [Info] CPU Quota 27
2023-08-07T01:00:52.984+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:52.984+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:52.984+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.984+05:30 [Info] Total iteration: 6730
2023-08-07T01:00:52.984+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:52.984+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:52.984+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:52.984+05:30 [Info] RandomMove time: 53us
2023-08-07T01:00:52.984+05:30 [Info] RandomMove call: 6 (empty index 0)
2023-08-07T01:00:52.984+05:30 [Info] RandomMove average time: 8us
2023-08-07T01:00:52.984+05:30 [Info] ExhaustMove time: 9us
2023-08-07T01:00:52.984+05:30 [Info] ExhaustMove call: 1
2023-08-07T01:00:52.984+05:30 [Info] ExhaustMove average time: 9us
2023-08-07T01:00:52.984+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:52.984+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:52.984+05:30 [Info] ----------------------------------------
2023-08-07T01:00:52.984+05:30 [Info]
2023-08-07T01:00:52.984+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:52.984+05:30 [Info] Indexer total memory:315266309837 (293.615G), mem:284705925033 (265.153G), overhead:30560384804 (28.4616G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-08-07T01:00:52.984+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5643277764120702 allowDDLDuringScaleup:true
2023-08-07T01:00:52.984+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.984+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.984+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.984+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.984+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.984+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.984+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.984+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.984+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.984+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.984+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.984+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.984+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.984+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:52.984+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.984+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.984+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.984+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 4, new/moved:true
2023-08-07T01:00:52.984+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 6, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 0, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 1, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 2, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 3, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 5, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 7, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info]
2023-08-07T01:00:52.985+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:52.985+05:30 [Info] Indexer total memory:104855561729 (97.6544G), mem:88524406791 (82.4448G), overhead:16331154938 (15.2096G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-08-07T01:00:52.985+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3132814509590003 allowDDLDuringScaleup:true
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 7, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.985+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.985+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.985+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 1, new/moved:true
2023-08-07T01:00:52.985+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 3, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 4, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 5, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 6, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 0, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 2, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info]
2023-08-07T01:00:52.986+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:52.986+05:30 [Info] Indexer total memory:119086170240 (110.908G), mem:95642935820 (89.0744G), overhead:23443234420 (21.8332G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-08-07T01:00:52.986+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3223907726289295 allowDDLDuringScaleup:true
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 0, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 1, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 2, new/moved:true
2023-08-07T01:00:52.986+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.986+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.986+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.986+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 5, new/moved:true
2023-08-07T01:00:52.987+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.987+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.987+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.987+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 6, new/moved:true
2023-08-07T01:00:52.987+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.987+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.987+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.987+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 7, new/moved:true
2023-08-07T01:00:52.987+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.987+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.987+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.987+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 3, new/moved:true
2023-08-07T01:00:52.987+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.987+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:52.987+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:52.987+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16981696238190113334, Partition: 4, new/moved:true
2023-08-07T01:00:52.987+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:52.987+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:52 -------------------------------------------
2023/08/07 01:00:52 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-08-07T01:00:52.989+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.41655626122480466
2023-08-07T01:00:53.080+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.080+05:30 [Info] Score: 0.09558528691637125
2023-08-07T01:00:53.080+05:30 [Info] variation: 0.1911705738327425
2023-08-07T01:00:53.080+05:30 [Info] ElapsedTime: 91ms
2023-08-07T01:00:53.080+05:30 [Info] ConvergenceTime: 6ms
2023-08-07T01:00:53.080+05:30 [Info] Iteration: 5
2023-08-07T01:00:53.080+05:30 [Info] Move: 5
2023-08-07T01:00:53.080+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.080+05:30 [Info] Using SAPlanner
2023-08-07T01:00:53.080+05:30 [Info] Indexer Memory Mean 216085207365 (201.245G)
2023-08-07T01:00:53.080+05:30 [Info] Indexer Memory Deviation 82618266177 (76.9443G) (38.23%)
2023-08-07T01:00:53.080+05:30 [Info] Indexer Memory Utilization 3.9175
2023-08-07T01:00:53.080+05:30 [Info] Indexer CPU Mean 15.3333
2023-08-07T01:00:53.080+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-08-07T01:00:53.080+05:30 [Info] Indexer CPU Utilization 0.5679
2023-08-07T01:00:53.080+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:53.080+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:53.080+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:53.080+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.080+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:53.080+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.080+05:30 [Info] Indexer Data Size Mean 52559024128 (48.9494G)
2023-08-07T01:00:53.080+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:53.080+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:53.080+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.080+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:53.080+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.080+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.080+05:30 [Info] Number of indexes: 36
2023-08-07T01:00:53.080+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:53.080+05:30 [Info] Avg Index Size: 13627181936 (12.6913G)
2023-08-07T01:00:53.080+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-08-07T01:00:53.080+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-08-07T01:00:53.080+05:30 [Info] Avg Index Cpu: 1.2778
2023-08-07T01:00:53.080+05:30 [Info] Max Index Cpu: 5.0000
2023-08-07T01:00:53.080+05:30 [Info] Num Estimation Run: 231
2023-08-07T01:00:53.080+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.080+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:53.080+05:30 [Info] CPU Quota 27
2023-08-07T01:00:53.080+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:53.080+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:53.080+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.080+05:30 [Info] Total iteration: 12766
2023-08-07T01:00:53.081+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:53.081+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:53.081+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:53.081+05:30 [Info] RandomMove time: 54us
2023-08-07T01:00:53.081+05:30 [Info] RandomMove call: 5 (empty index 0)
2023-08-07T01:00:53.081+05:30 [Info] RandomMove average time: 10us
2023-08-07T01:00:53.081+05:30 [Info] ExhaustMove time: 0ns
2023-08-07T01:00:53.081+05:30 [Info] ExhaustMove call: 0
2023-08-07T01:00:53.081+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:53.081+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:53.081+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.081+05:30 [Info]
2023-08-07T01:00:53.081+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-08-07T01:00:53.081+05:30 [Info] Indexer total memory:320340713237 (298.341G), mem:289780328433 (269.879G), overhead:30560384804 (28.4616G), min:52559024128 (48.9494G), data:52559024128 (48.9494G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-08-07T01:00:53.081+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.4682093160991544 allowDDLDuringScaleup:true
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 1, new/moved:true
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 2, new/moved:true
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 6, new/moved:true
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 0, new/moved:true
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 3, new/moved:true
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 5, new/moved:true
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 7, new/moved:true
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 4, new/moved:true
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info]
2023-08-07T01:00:53.081+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-08-07T01:00:53.081+05:30 [Info] Indexer total memory:339413729133 (316.104G), mem:257757954443 (240.056G), overhead:81655774690 (76.0479G), min:52559024128 (48.9494G), data:52559024128 (48.9494G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-08-07T01:00:53.081+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.4385706616253568 allowDDLDuringScaleup:true
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.081+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.081+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.081+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.081+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 0, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 1, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 2, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 4, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 6, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 3, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 7, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 5, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info]
2023-08-07T01:00:53.082+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-08-07T01:00:53.082+05:30 [Info] Indexer total memory:124160573640 (115.634G), mem:100717339220 (93.8003G), overhead:23443234420 (21.8332G), min:52559024128 (48.9494G), data:52559024128 (48.9494G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-08-07T01:00:53.082+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.2932200222754888 allowDDLDuringScaleup:true
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 3, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.082+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.082+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 5, new/moved:true
2023-08-07T01:00:53.082+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.082+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.083+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.083+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 0, new/moved:true
2023-08-07T01:00:53.083+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.083+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.083+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.083+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 7, new/moved:true
2023-08-07T01:00:53.083+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.083+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.083+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.083+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 1, new/moved:true
2023-08-07T01:00:53.083+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.083+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.083+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.083+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 2, new/moved:true
2023-08-07T01:00:53.083+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.083+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.083+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.083+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 4, new/moved:true
2023-08-07T01:00:53.083+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.083+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.083+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.083+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16065856567429801486, Partition: 6, new/moved:true
2023-08-07T01:00:53.083+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.083+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/CommandRepair
2023/08/07 01:00:53 -------------------------------------------
2023/08/07 01:00:53 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-08-07T01:00:53.084+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2)
2023-08-07T01:00:53.084+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=8us
2023-08-07T01:00:53.084+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=9us
2023-08-07T01:00:53.084+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=10us
2023-08-07T01:00:53.084+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=8us
2023-08-07T01:00:53.084+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-08-07T01:00:53.084+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-08-07T01:00:53.084+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:53.084+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.084+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=182us
2023-08-07T01:00:53.084+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-08-07T01:00:53.085+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-08-07T01:00:53.085+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:53.085+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.085+05:30 [Info] Score: 0.22489777375378742
2023-08-07T01:00:53.085+05:30 [Info] variation: 0.8995910950151497
2023-08-07T01:00:53.085+05:30 [Info] ElapsedTime: 94us
2023-08-07T01:00:53.085+05:30 [Info] ConvergenceTime: 2us
2023-08-07T01:00:53.085+05:30 [Info] Iteration: 0
2023-08-07T01:00:53.085+05:30 [Info] Move: 0
2023-08-07T01:00:53.085+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.085+05:30 [Info] Using SAPlanner
2023-08-07T01:00:53.085+05:30 [Info] Indexer Memory Mean 122486397174 (114.074G)
2023-08-07T01:00:53.085+05:30 [Info] Indexer Memory Deviation 110187672158 (102.62G) (89.96%)
2023-08-07T01:00:53.085+05:30 [Info] Indexer Memory Utilization 2.2206
2023-08-07T01:00:53.085+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:53.085+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:53.085+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:53.085+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:53.085+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:53.085+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:53.085+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.085+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:53.085+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.085+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-08-07T01:00:53.085+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:53.085+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:53.085+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.085+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:53.085+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.085+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.085+05:30 [Info] Number of indexes: 4
2023-08-07T01:00:53.085+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:53.085+05:30 [Info] Avg Index Size: 91864797880 (85.5558G)
2023-08-07T01:00:53.085+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-08-07T01:00:53.085+05:30 [Info] Max Indexer Overhead: 46891539742 (43.6711G)
2023-08-07T01:00:53.085+05:30 [Info] Avg Index Cpu: 0.0000
2023-08-07T01:00:53.085+05:30 [Info] Max Index Cpu: 0.0000
2023-08-07T01:00:53.085+05:30 [Info] Num Estimation Run: 0
2023-08-07T01:00:53.085+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.085+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:53.085+05:30 [Info] CPU Quota 27
2023-08-07T01:00:53.085+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:53.085+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:53.085+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.085+05:30 [Info] Total iteration: 0
2023-08-07T01:00:53.085+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:53.085+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:53.085+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:53.085+05:30 [Info] RandomMove time: 0ns
2023-08-07T01:00:53.085+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-08-07T01:00:53.085+05:30 [Info] ExhaustMove time: 0ns
2023-08-07T01:00:53.085+05:30 [Info] ExhaustMove call: 0
2023-08-07T01:00:53.085+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:53.085+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:53.085+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.085+05:30 [Info]
2023-08-07T01:00:53.085+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-08-07T01:00:53.085+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:53.085+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.45435427408637796 allowDDLDuringScaleup:true
2023-08-07T01:00:53.085+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.085+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.085+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.085+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.085+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.085+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:2494337984506180762, Partition: 0, new/moved:true
2023-08-07T01:00:53.085+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.086+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.086+05:30 [Info]
2023-08-07T01:00:53.086+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-08-07T01:00:53.086+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:53.086+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.06701117350131312 allowDDLDuringScaleup:true
2023-08-07T01:00:53.086+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.086+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.086+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.086+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.086+05:30 [Info]
2023-08-07T01:00:53.086+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-08-07T01:00:53.086+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:53.086+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0786345524123089 allowDDLDuringScaleup:true
2023-08-07T01:00:53.086+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.086+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false
2023-08-07T01:00:53.086+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.086+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:53 -------------------------------------------
2023/08/07 01:00:53 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-08-07T01:00:53.086+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1)
2023-08-07T01:00:53.086+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2)
2023-08-07T01:00:53.086+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=7us
2023-08-07T01:00:53.086+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-08-07T01:00:53.086+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-08-07T01:00:53.086+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=49us
2023-08-07T01:00:53.086+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=10us
2023-08-07T01:00:53.086+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-08-07T01:00:53.086+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-08-07T01:00:53.086+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:53.087+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.087+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=170us
2023-08-07T01:00:53.087+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-08-07T01:00:53.087+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-08-07T01:00:53.087+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-08-07T01:00:53.087+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:53.087+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.087+05:30 [Info] Score: 0.019876174419669376
2023-08-07T01:00:53.087+05:30 [Info] variation: 0.0795046976786775
2023-08-07T01:00:53.087+05:30 [Info] ElapsedTime: 100us
2023-08-07T01:00:53.087+05:30 [Info] ConvergenceTime: 3us
2023-08-07T01:00:53.087+05:30 [Info] Iteration: 0
2023-08-07T01:00:53.087+05:30 [Info] Move: 0
2023-08-07T01:00:53.087+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.087+05:30 [Info] Using SAPlanner
2023-08-07T01:00:53.087+05:30 [Info] Indexer Memory Mean 266954004690 (248.62G)
2023-08-07T01:00:53.087+05:30 [Info] Indexer Memory Deviation 21224097436 (19.7665G) (7.95%)
2023-08-07T01:00:53.087+05:30 [Info] Indexer Memory Utilization 4.8398
2023-08-07T01:00:53.087+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:53.087+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:53.087+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:53.087+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:53.087+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:53.087+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:53.087+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.087+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:53.087+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.087+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-08-07T01:00:53.087+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:53.087+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:53.087+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.087+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:53.087+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.087+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.087+05:30 [Info] Number of indexes: 5
2023-08-07T01:00:53.087+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:53.087+05:30 [Info] Avg Index Size: 160172402814 (149.172G)
2023-08-07T01:00:53.087+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-08-07T01:00:53.087+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-08-07T01:00:53.087+05:30 [Info] Avg Index Cpu: 0.0000
2023-08-07T01:00:53.087+05:30 [Info] Max Index Cpu: 0.0000
2023-08-07T01:00:53.087+05:30 [Info] Num Estimation Run: 0
2023-08-07T01:00:53.087+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.087+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:53.087+05:30 [Info] CPU Quota 27
2023-08-07T01:00:53.087+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:53.087+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:53.087+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.087+05:30 [Info] Total iteration: 0
2023-08-07T01:00:53.087+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:53.087+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:53.087+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:53.087+05:30 [Info] RandomMove time: 0ns
2023-08-07T01:00:53.087+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-08-07T01:00:53.087+05:30 [Info] ExhaustMove time: 0ns
2023-08-07T01:00:53.087+05:30 [Info] ExhaustMove call: 0
2023-08-07T01:00:53.088+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:53.088+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:53.088+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.088+05:30 [Info]
2023-08-07T01:00:53.088+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-08-07T01:00:53.088+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:53.088+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1777244769790758 allowDDLDuringScaleup:true
2023-08-07T01:00:53.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.088+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.088+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.088+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.088+05:30 [Info]
2023-08-07T01:00:53.088+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-08-07T01:00:53.088+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:53.088+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.20847118640616036 allowDDLDuringScaleup:true
2023-08-07T01:00:53.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.088+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.088+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.088+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.088+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:3424878087821432293, Partition: 0, new/moved:true
2023-08-07T01:00:53.088+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.088+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.088+05:30 [Info]
2023-08-07T01:00:53.088+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-08-07T01:00:53.088+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:53.088+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2138043366147638 allowDDLDuringScaleup:true
2023-08-07T01:00:53.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.088+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false
2023-08-07T01:00:53.088+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.088+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.088+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:13450819112765481694, Partition: 0, new/moved:true
2023-08-07T01:00:53.088+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.088+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:53 -------------------------------------------
2023/08/07 01:00:53 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-08-07T01:00:53.089+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2)
2023-08-07T01:00:53.089+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-08-07T01:00:53.089+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-08-07T01:00:53.089+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=8us
2023-08-07T01:00:53.089+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=9us
2023-08-07T01:00:53.089+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-08-07T01:00:53.089+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-08-07T01:00:53.089+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:53.089+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.089+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=163us
2023-08-07T01:00:53.089+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-08-07T01:00:53.089+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-08-07T01:00:53.089+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:53.089+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.089+05:30 [Info] Score: 0.17469212089072378
2023-08-07T01:00:53.089+05:30 [Info] variation: 0.6987684835628951
2023-08-07T01:00:53.089+05:30 [Info] ElapsedTime: 71us
2023-08-07T01:00:53.089+05:30 [Info] ConvergenceTime: 2us
2023-08-07T01:00:53.089+05:30 [Info] Iteration: 0
2023-08-07T01:00:53.089+05:30 [Info] Move: 0
2023-08-07T01:00:53.089+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.089+05:30 [Info] Using SAPlanner
2023-08-07T01:00:53.089+05:30 [Info] Indexer Memory Mean 231925826675 (215.998G)
2023-08-07T01:00:53.089+05:30 [Info] Indexer Memory Deviation 162062458205 (150.932G) (69.88%)
2023-08-07T01:00:53.089+05:30 [Info] Indexer Memory Utilization 4.2047
2023-08-07T01:00:53.089+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:53.089+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:53.089+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:53.089+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:53.089+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:53.089+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:53.089+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.089+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:53.089+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.089+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-08-07T01:00:53.089+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:53.089+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:53.089+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.089+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:53.089+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.089+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.089+05:30 [Info] Number of indexes: 4
2023-08-07T01:00:53.089+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:53.089+05:30 [Info] Avg Index Size: 173944370006 (161.998G)
2023-08-07T01:00:53.090+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-08-07T01:00:53.090+05:30 [Info] Max Indexer Overhead: 49341212983 (45.9526G)
2023-08-07T01:00:53.090+05:30 [Info] Avg Index Cpu: 0.0000
2023-08-07T01:00:53.090+05:30 [Info] Max Index Cpu: 0.0000
2023-08-07T01:00:53.090+05:30 [Info] Num Estimation Run: 0
2023-08-07T01:00:53.090+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.090+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:53.090+05:30 [Info] CPU Quota 27
2023-08-07T01:00:53.090+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:53.090+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:53.090+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.090+05:30 [Info] Total iteration: 0
2023-08-07T01:00:53.090+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:53.090+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:53.090+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:53.090+05:30 [Info] RandomMove time: 0ns
2023-08-07T01:00:53.090+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-08-07T01:00:53.090+05:30 [Info] ExhaustMove time: 0ns
2023-08-07T01:00:53.090+05:30 [Info] ExhaustMove call: 0
2023-08-07T01:00:53.090+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:53.090+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:53.090+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.090+05:30 [Info]
2023-08-07T01:00:53.090+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-08-07T01:00:53.090+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:53.090+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.38151873032984485 allowDDLDuringScaleup:true
2023-08-07T01:00:53.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.090+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.090+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.090+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.090+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:14190019260115342519, Partition: 0, new/moved:true
2023-08-07T01:00:53.090+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.090+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.090+05:30 [Info]
2023-08-07T01:00:53.090+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-08-07T01:00:53.090+05:30 [Info] Indexer total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:53.090+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1769522034317959 allowDDLDuringScaleup:true
2023-08-07T01:00:53.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.090+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.090+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.090+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.090+05:30 [Info]
2023-08-07T01:00:53.090+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-08-07T01:00:53.090+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:53.090+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0415290662383593 allowDDLDuringScaleup:true
2023-08-07T01:00:53.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.090+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false
2023-08-07T01:00:53.090+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.090+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/08/07 01:00:53 -------------------------------------------
2023/08/07 01:00:53 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-08-07T01:00:53.090+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1)
2023-08-07T01:00:53.090+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2)
2023-08-07T01:00:53.090+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-08-07T01:00:53.090+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-08-07T01:00:53.090+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=4us
2023-08-07T01:00:53.090+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-08-07T01:00:53.091+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=6us
2023-08-07T01:00:53.091+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-08-07T01:00:53.091+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-08-07T01:00:53.091+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:53.091+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.091+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=126us
2023-08-07T01:00:53.091+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-08-07T01:00:53.091+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-08-07T01:00:53.091+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-08-07T01:00:53.091+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-08-07T01:00:53.091+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-08-07T01:00:53.091+05:30 [Info] Score: 0.06809310854298714
2023-08-07T01:00:53.091+05:30 [Info] variation: 0.27237243417194856
2023-08-07T01:00:53.091+05:30 [Info] ElapsedTime: 69us
2023-08-07T01:00:53.091+05:30 [Info] ConvergenceTime: 2us
2023-08-07T01:00:53.091+05:30 [Info] Iteration: 0
2023-08-07T01:00:53.091+05:30 [Info] Move: 0
2023-08-07T01:00:53.091+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.091+05:30 [Info] Using SAPlanner
2023-08-07T01:00:53.091+05:30 [Info] Indexer Memory Mean 321673719440 (299.582G)
2023-08-07T01:00:53.091+05:30 [Info] Indexer Memory Deviation 87615053973 (81.5979G) (27.24%)
2023-08-07T01:00:53.091+05:30 [Info] Indexer Memory Utilization 5.8318
2023-08-07T01:00:53.091+05:30 [Info] Indexer CPU Mean 0.0000
2023-08-07T01:00:53.091+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-08-07T01:00:53.091+05:30 [Info] Indexer CPU Utilization 0.0000
2023-08-07T01:00:53.091+05:30 [Info] Indexer IO Mean 0.0000
2023-08-07T01:00:53.091+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-08-07T01:00:53.091+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-08-07T01:00:53.091+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.091+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-08-07T01:00:53.091+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-08-07T01:00:53.091+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-08-07T01:00:53.091+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-08-07T01:00:53.091+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-08-07T01:00:53.091+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.091+05:30 [Info] No. Index (from non-deleted node) 0
2023-08-07T01:00:53.091+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-08-07T01:00:53.091+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.091+05:30 [Info] Number of indexes: 5
2023-08-07T01:00:53.091+05:30 [Info] Number of indexers: 3
2023-08-07T01:00:53.091+05:30 [Info] Avg Index Size: 193004231664 (179.749G)
2023-08-07T01:00:53.091+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-08-07T01:00:53.091+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-08-07T01:00:53.091+05:30 [Info] Avg Index Cpu: 0.0000
2023-08-07T01:00:53.091+05:30 [Info] Max Index Cpu: 0.0000
2023-08-07T01:00:53.091+05:30 [Info] Num Estimation Run: 0
2023-08-07T01:00:53.091+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.091+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-08-07T01:00:53.091+05:30 [Info] CPU Quota 27
2023-08-07T01:00:53.091+05:30 [Info] Max Cpu Utilization -1
2023-08-07T01:00:53.091+05:30 [Info] Max Memory Utilization -1
2023-08-07T01:00:53.091+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.091+05:30 [Info] Total iteration: 0
2023-08-07T01:00:53.091+05:30 [Info] RandomSwap time: 0ns
2023-08-07T01:00:53.091+05:30 [Info] RandomSwap call: 0
2023-08-07T01:00:53.091+05:30 [Info] RandomSwap iteration: 0
2023-08-07T01:00:53.091+05:30 [Info] RandomMove time: 0ns
2023-08-07T01:00:53.091+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-08-07T01:00:53.091+05:30 [Info] ExhaustMove time: 0ns
2023-08-07T01:00:53.091+05:30 [Info] ExhaustMove call: 0
2023-08-07T01:00:53.091+05:30 [Info] ExhaustSwap time: 0ns
2023-08-07T01:00:53.091+05:30 [Info] ExhaustSwap call: 0
2023-08-07T01:00:53.091+05:30 [Info] ----------------------------------------
2023-08-07T01:00:53.091+05:30 [Info]
2023-08-07T01:00:53.091+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-08-07T01:00:53.091+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-08-07T01:00:53.091+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.14749187761902688 allowDDLDuringScaleup:true
2023-08-07T01:00:53.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.091+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.091+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.091+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.091+05:30 [Info]
2023-08-07T01:00:53.091+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-08-07T01:00:53.091+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:53.091+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.2750739074297335 allowDDLDuringScaleup:true
2023-08-07T01:00:53.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.091+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false
2023-08-07T01:00:53.091+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.092+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.092+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:16638509064294254623, Partition: 0, new/moved:true
2023-08-07T01:00:53.092+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.092+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.092+05:30 [Info]
2023-08-07T01:00:53.092+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-08-07T01:00:53.092+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-08-07T01:00:53.092+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.17743421495123962 allowDDLDuringScaleup:true
2023-08-07T01:00:53.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.092+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false
2023-08-07T01:00:53.092+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.092+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-08-07T01:00:53.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-08-07T01:00:53.092+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:8610183123497303723, Partition: 0, new/moved:true
2023-08-07T01:00:53.092+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-08-07T01:00:53.092+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
--- PASS: TestPlanDuringHeterogenousScaleup (1.16s)
--- PASS: TestPlanDuringHeterogenousScaleup/GreedyPlanner (0.02s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner (1.13s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests (0.60s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex (0.53s)
--- PASS: TestPlanDuringHeterogenousScaleup/CommandRepair (0.01s)
=== RUN TestRestfulAPI
2023/08/07 01:00:53 In TestRestfulAPI()
2023/08/07 01:00:53 In DropAllSecondaryIndexes()
2023/08/07 01:00:53 Index found: indexmut_1
2023/08/07 01:00:53 Dropped index indexmut_1
2023/08/07 01:00:53 Setting JSON docs in KV
2023/08/07 01:00:54 GET all indexes
2023/08/07 01:00:54 200 OK
2023/08/07 01:00:54 FOUND indexes: []
2023/08/07 01:00:54 DROP index: badindexid
2023/08/07 01:00:54 status: 400 Bad Request
2023/08/07 01:00:54 DROP index: 23544142
2023/08/07 01:00:54 status: 500 Internal Server Error
2023/08/07 01:00:54 TEST: malformed body
2023/08/07 01:00:54 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"
2023/08/07 01:00:54 TEST: missing field ``name``
2023/08/07 01:00:54 400 Bad Request "missing field name"
2023/08/07 01:00:54 TEST: empty field ``name``
2023/08/07 01:00:54 400 Bad Request "empty field name"
2023/08/07 01:00:54 TEST: missing field ``bucket``
2023/08/07 01:00:54 400 Bad Request "missing field bucket"
2023/08/07 01:00:54 TEST: empty field ``bucket``
2023/08/07 01:00:54 400 Bad Request "empty field bucket"
2023/08/07 01:00:54 TEST: missing field ``secExprs``
2023/08/07 01:00:54 400 Bad Request "missing field secExprs"
2023/08/07 01:00:54 TEST: empty field ``secExprs``
2023/08/07 01:00:54 400 Bad Request "empty field secExprs"
2023/08/07 01:00:54 TEST: incomplete field ``desc``
2023/08/07 01:00:54 400 Bad Request "incomplete desc information [true]"
2023/08/07 01:00:54 TEST: invalid field ``desc``
2023/08/07 01:00:54 400 Bad Request "incomplete desc information [1]"
2023/08/07 01:00:54
2023/08/07 01:00:54 CREATE INDEX: idx1
2023/08/07 01:01:06 status : 201 Created
2023/08/07 01:01:06 {"id": "6574856673112532084"}
2023/08/07 01:01:06 CREATE INDEX: idx2 (defer)
2023/08/07 01:01:06 status : 201 Created
2023/08/07 01:01:06 {"id": "6000245437767702097"}
2023/08/07 01:01:06 CREATE INDEX: idx3 (defer)
2023/08/07 01:01:07 status : 201 Created
2023/08/07 01:01:07 {"id": "11744188411640782945"}
2023/08/07 01:01:07 CREATE INDEX: idx4 (defer)
2023/08/07 01:01:07 status : 201 Created
2023/08/07 01:01:07 {"id": "7050407591796033106"}
2023/08/07 01:01:07 CREATE INDEX: idx5
2023/08/07 01:01:19 status : 201 Created
2023/08/07 01:01:19 {"id": "17758068476097714417"}
2023/08/07 01:01:19 BUILD single deferred index
2023/08/07 01:01:19 202 Accepted
2023/08/07 01:01:19 GET all indexes
2023/08/07 01:01:19 200 OK
2023/08/07 01:01:19 index idx1 in INDEX_STATE_ACTIVE
2023/08/07 01:01:19 GET all indexes
2023/08/07 01:01:19 200 OK
2023/08/07 01:01:19 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:20 GET all indexes
2023/08/07 01:01:20 200 OK
2023/08/07 01:01:20 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:21 GET all indexes
2023/08/07 01:01:21 200 OK
2023/08/07 01:01:21 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:22 GET all indexes
2023/08/07 01:01:22 200 OK
2023/08/07 01:01:22 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:23 GET all indexes
2023/08/07 01:01:23 200 OK
2023/08/07 01:01:23 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:24 GET all indexes
2023/08/07 01:01:24 200 OK
2023/08/07 01:01:24 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:25 GET all indexes
2023/08/07 01:01:25 200 OK
2023/08/07 01:01:25 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:26 GET all indexes
2023/08/07 01:01:26 200 OK
2023/08/07 01:01:26 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:28 GET all indexes
2023/08/07 01:01:28 200 OK
2023/08/07 01:01:28 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:29 GET all indexes
2023/08/07 01:01:29 200 OK
2023/08/07 01:01:29 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:30 GET all indexes
2023/08/07 01:01:30 200 OK
2023/08/07 01:01:30 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:31 GET all indexes
2023/08/07 01:01:31 200 OK
2023/08/07 01:01:31 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:32 GET all indexes
2023/08/07 01:01:32 200 OK
2023/08/07 01:01:32 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:33 GET all indexes
2023/08/07 01:01:33 200 OK
2023/08/07 01:01:33 index idx2 in INDEX_STATE_INITIAL
2023/08/07 01:01:34 GET all indexes
2023/08/07 01:01:34 200 OK
2023/08/07 01:01:34 index idx2 in INDEX_STATE_ACTIVE
2023/08/07 01:01:34 BUILD many deferred index
2023/08/07 01:01:34 202 Accepted
2023/08/07 01:01:34 GET all indexes
2023/08/07 01:01:34 200 OK
2023/08/07 01:01:34 index idx1 in INDEX_STATE_ACTIVE
2023/08/07 01:01:34 GET all indexes
2023/08/07 01:01:34 200 OK
2023/08/07 01:01:34 index idx2 in INDEX_STATE_ACTIVE
2023/08/07 01:01:34 GET all indexes
2023/08/07 01:01:34 200 OK
2023/08/07 01:01:34 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:35 GET all indexes
2023/08/07 01:01:35 200 OK
2023/08/07 01:01:35 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:36 GET all indexes
2023/08/07 01:01:36 200 OK
2023/08/07 01:01:36 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:37 GET all indexes
2023/08/07 01:01:37 200 OK
2023/08/07 01:01:37 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:38 GET all indexes
2023/08/07 01:01:38 200 OK
2023/08/07 01:01:38 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:39 GET all indexes
2023/08/07 01:01:39 200 OK
2023/08/07 01:01:39 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:40 GET all indexes
2023/08/07 01:01:40 200 OK
2023/08/07 01:01:40 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:41 GET all indexes
2023/08/07 01:01:41 200 OK
2023/08/07 01:01:41 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:42 GET all indexes
2023/08/07 01:01:42 200 OK
2023/08/07 01:01:42 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:43 GET all indexes
2023/08/07 01:01:43 200 OK
2023/08/07 01:01:43 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:44 GET all indexes
2023/08/07 01:01:44 200 OK
2023/08/07 01:01:44 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:45 GET all indexes
2023/08/07 01:01:45 200 OK
2023/08/07 01:01:45 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:46 GET all indexes
2023/08/07 01:01:46 200 OK
2023/08/07 01:01:46 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:47 GET all indexes
2023/08/07 01:01:47 200 OK
2023/08/07 01:01:47 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:48 GET all indexes
2023/08/07 01:01:48 200 OK
2023/08/07 01:01:48 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:49 GET all indexes
2023/08/07 01:01:49 200 OK
2023/08/07 01:01:49 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:50 GET all indexes
2023/08/07 01:01:50 200 OK
2023/08/07 01:01:50 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:52 GET all indexes
2023/08/07 01:01:52 200 OK
2023/08/07 01:01:52 index idx3 in INDEX_STATE_INITIAL
2023/08/07 01:01:53 GET all indexes
2023/08/07 01:01:53 200 OK
2023/08/07 01:01:53 index idx3 in INDEX_STATE_ACTIVE
2023/08/07 01:01:53 GET all indexes
2023/08/07 01:01:53 200 OK
2023/08/07 01:01:53 index idx4 in INDEX_STATE_ACTIVE
2023/08/07 01:01:53 GET all indexes
2023/08/07 01:01:53 200 OK
2023/08/07 01:01:53 index idx5 in INDEX_STATE_ACTIVE
2023/08/07 01:01:53 GET all indexes
2023/08/07 01:01:53 200 OK
2023/08/07 01:01:53 CREATED indexes: [6574856673112532084 6000245437767702097 11744188411640782945 7050407591796033106 17758068476097714417]
2023/08/07 01:01:53
2023/08/07 01:01:53 LOOKUP missing index
2023/08/07 01:01:53 status : 404 Not Found
2023/08/07 01:01:53 LOOKUP Pyongyang
2023/08/07 01:01:53 status : 200 OK
2023/08/07 01:01:53 number of entries 554
2023/08/07 01:01:53 Expected and Actual scan responses are the same
2023/08/07 01:01:53 LOOKUP with stale as false
2023/08/07 01:01:53 status : 200 OK
2023/08/07 01:01:53 number of entries 554
2023/08/07 01:01:53 Expected and Actual scan responses are the same
2023/08/07 01:01:53 LOOKUP with Rome
2023/08/07 01:01:53 status : 200 OK
2023/08/07 01:01:53 number of entries 540
2023/08/07 01:01:53 Expected and Actual scan responses are the same
2023/08/07 01:01:53 RANGE missing index
2023/08/07 01:01:53 Status : 404 Not Found
2023/08/07 01:01:53 RANGE cities - none
2023/08/07 01:01:53 Status : 200 OK
2023/08/07 01:01:58 number of entries 140902
2023/08/07 01:01:59 Expected and Actual scan responses are the same
2023/08/07 01:01:59 RANGE cities -low
2023/08/07 01:01:59 Status : 200 OK
2023/08/07 01:02:03 number of entries 140902
2023/08/07 01:02:04 Expected and Actual scan responses are the same
2023/08/07 01:02:04 RANGE cities -high
2023/08/07 01:02:04 Status : 200 OK
2023/08/07 01:02:09 number of entries 140902
2023/08/07 01:02:10 Expected and Actual scan responses are the same
2023/08/07 01:02:10 RANGE cities - both
2023/08/07 01:02:10 Status : 200 OK
2023/08/07 01:02:14 number of entries 140902
2023/08/07 01:02:15 Expected and Actual scan responses are the same
2023/08/07 01:02:15 RANGE missing cities
2023/08/07 01:02:15 Status : 200 OK
2023/08/07 01:02:15 number of entries 0
2023/08/07 01:02:15 Expected and Actual scan responses are the same
2023/08/07 01:02:15
2023/08/07 01:02:15 SCANALL missing index
2023/08/07 01:02:15 {"limit":1000000,"stale":"ok"}
2023/08/07 01:02:15 Status : 404 Not Found
2023/08/07 01:02:15 SCANALL stale ok
2023/08/07 01:02:15 {"limit":1000000,"stale":"ok"}
2023/08/07 01:02:15 Status : 200 OK
2023/08/07 01:02:21 number of entries 140902
2023/08/07 01:02:22 Expected and Actual scan responses are the same
2023/08/07 01:02:22 SCANALL stale false
2023/08/07 01:02:22 {"limit":1000000,"stale":"false"}
2023/08/07 01:02:22 Status : 200 OK
2023/08/07 01:02:27 number of entries 140902
2023/08/07 01:02:27 Expected and Actual scan responses are the same
2023/08/07 01:02:27
2023/08/07 01:02:27 COUNT missing index
2023/08/07 01:02:27 Status : 404 Not Found
2023/08/07 01:02:27 COUNT cities - none
2023/08/07 01:02:28 Status : 200 OK
2023/08/07 01:02:28 number of entries 140902
2023/08/07 01:02:28 COUNT cities -low
2023/08/07 01:02:28 Status : 200 OK
2023/08/07 01:02:28 number of entries 140902
2023/08/07 01:02:28 COUNT cities -high
2023/08/07 01:02:28 Status : 200 OK
2023/08/07 01:02:28 number of entries 140902
2023/08/07 01:02:29 COUNT cities - both
2023/08/07 01:02:29 Status : 200 OK
2023/08/07 01:02:29 number of entries 140902
2023/08/07 01:02:29 COUNT missing cities
2023/08/07 01:02:29 Status : 200 OK
2023/08/07 01:02:29 number of entries 0
2023/08/07 01:02:29
2023/08/07 01:02:30 STATS: Testing URLs with valid authentication
2023/08/07 01:02:30 STATS: Testing URLs with invalid authentication
2023/08/07 01:02:30 STATS: Testing invalid URLs
2023/08/07 01:02:30 STATS: Testing unsupported methods
2023/08/07 01:02:30
--- PASS: TestRestfulAPI (97.84s)
=== RUN TestStatIndexInstFilter
2023/08/07 01:02:30 CREATE INDEX: statIdx1
2023/08/07 01:02:44 status : 201 Created
2023/08/07 01:02:44 {"id": "16048926536901295620"}
2023/08/07 01:02:44 CREATE INDEX: statIdx2
2023/08/07 01:02:58 status : 201 Created
2023/08/07 01:02:58 {"id": "1262529624952815089"}
2023/08/07 01:02:58 Instance Id for statIdx2 is 1724680914520465407, common.IndexInstId
--- PASS: TestStatIndexInstFilter (27.52s)
=== RUN TestBucketDefaultDelete
2023-08-07T01:02:58.583+05:30 [Warn] Client:runObserveStreamingEndpoint streaming endpoint for /pools/default/bs/default returned err EOF
2023-08-07T01:02:58.583+05:30 [Warn] serviceChangeNotifier: Connection terminated for collection manifest notifier instance of http://%40query@127.0.0.1:9000-default, bucket: default, (EOF)
2023/08/07 01:03:00 Deleted bucket default, responseBody:
2023/08/07 01:03:15 Created bucket default, responseBody:
2023/08/07 01:03:32 Populating the default bucket
2023/08/07 01:03:40 Using n1ql client
2023-08-07T01:03:40.104+05:30 [Info] GSIC[default/default-_default-_default-1691350420101877099] started ...
2023/08/07 01:03:40 Scan failed as expected with error: Index Not Found - cause: GSI index index_isActive not found.
2023/08/07 01:03:40 Populating the default bucket after it was deleted
2023/08/07 01:03:49 Created the secondary index index_isActive. Waiting for it become active
2023/08/07 01:03:49 Index is 16498300842736063787 now active
2023/08/07 01:03:49 Using n1ql client
2023/08/07 01:03:49 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (51.29s)
=== RUN TestMixedDatatypesScanAll
2023/08/07 01:03:49 In TestMixedDatatypesScanAll()
2023/08/07 01:03:49 Before test begin: Length of kv docs is 10002
2023/08/07 01:03:49 In DropAllSecondaryIndexes()
2023/08/07 01:03:49 Index found: index_isActive
2023/08/07 01:03:49 Dropped index index_isActive
2023/08/07 01:03:50 Number of number fields is: 267
2023/08/07 01:03:50 Number of string fields is: 269
2023/08/07 01:03:50 Number of json fields is: 222
2023/08/07 01:03:50 Number of true bool fields is: 123
2023/08/07 01:03:50 Number of false bool fields is: 119
2023/08/07 01:03:50 After generate docs: Length of kv docs is 11002
2023/08/07 01:03:50 Setting mixed datatypes JSON docs in KV
2023/08/07 01:03:55 Created the secondary index index_mixeddt. Waiting for it become active
2023/08/07 01:03:55 Index is 9012482609205252048 now active
2023/08/07 01:03:55 Using n1ql client
2023/08/07 01:03:55 Expected and Actual scan responses are the same
2023/08/07 01:03:55 Lengths of expected and actual scan results are: 1000 and 1000
2023/08/07 01:03:55 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (5.52s)
=== RUN TestMixedDatatypesRange_Float
2023/08/07 01:03:55 In TestMixedDatatypesRange_Float()
2023/08/07 01:03:55 In DropAllSecondaryIndexes()
2023/08/07 01:03:55 Index found: index_mixeddt
2023/08/07 01:03:55 Dropped index index_mixeddt
2023/08/07 01:03:55 Number of number fields is: 258
2023/08/07 01:03:55 Number of string fields is: 252
2023/08/07 01:03:55 Number of json fields is: 254
2023/08/07 01:03:55 Number of true bool fields is: 110
2023/08/07 01:03:55 Number of false bool fields is: 126
2023/08/07 01:03:55 Setting mixed datatypes JSON docs in KV
2023/08/07 01:04:00 Created the secondary index index_mixeddt. Waiting for it become active
2023/08/07 01:04:00 Index is 5902782472607878484 now active
2023/08/07 01:04:00 Using n1ql client
2023/08/07 01:04:00 Expected and Actual scan responses are the same
2023/08/07 01:04:00 Lengths of expected and actual scan results are: 20 and 20
2023/08/07 01:04:00 Using n1ql client
2023/08/07 01:04:00 Expected and Actual scan responses are the same
2023/08/07 01:04:00 Lengths of expected and actual scan results are: 1 and 1
2023/08/07 01:04:00 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (5.55s)
=== RUN TestMixedDatatypesRange_String
2023/08/07 01:04:00 In TestMixedDatatypesRange_String()
2023/08/07 01:04:00 In DropAllSecondaryIndexes()
2023/08/07 01:04:00 Index found: index_mixeddt
2023/08/07 01:04:00 Dropped index index_mixeddt
2023/08/07 01:04:01 Number of number fields is: 233
2023/08/07 01:04:01 Number of string fields is: 264
2023/08/07 01:04:01 Number of json fields is: 240
2023/08/07 01:04:01 Number of true bool fields is: 133
2023/08/07 01:04:01 Number of false bool fields is: 130
2023/08/07 01:04:01 Setting mixed datatypes JSON docs in KV
2023/08/07 01:04:06 Created the secondary index index_mixeddt. Waiting for it become active
2023/08/07 01:04:06 Index is 10459190433820893279 now active
2023/08/07 01:04:06 Using n1ql client
2023/08/07 01:04:06 Expected and Actual scan responses are the same
2023/08/07 01:04:06 Lengths of expected and actual scan results are: 209 and 209
2023/08/07 01:04:06 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (5.80s)
=== RUN TestMixedDatatypesRange_Json
2023/08/07 01:04:06 In TestMixedDatatypesRange_Json()
2023/08/07 01:04:06 In DropAllSecondaryIndexes()
2023/08/07 01:04:06 Index found: index_mixeddt
2023/08/07 01:04:06 Dropped index index_mixeddt
2023/08/07 01:04:06 Number of number fields is: 249
2023/08/07 01:04:06 Number of string fields is: 251
2023/08/07 01:04:06 Number of json fields is: 254
2023/08/07 01:04:06 Number of true bool fields is: 124
2023/08/07 01:04:06 Number of false bool fields is: 122
2023/08/07 01:04:06 Setting mixed datatypes JSON docs in KV
2023/08/07 01:04:12 Created the secondary index index_mixeddt. Waiting for it become active
2023/08/07 01:04:12 Index is 15327604979389949560 now active
2023/08/07 01:04:12 Using n1ql client
2023/08/07 01:04:12 Expected and Actual scan responses are the same
2023/08/07 01:04:12 Lengths of expected and actual scan results are: 748 and 748
2023/08/07 01:04:12 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (5.78s)
=== RUN TestMixedDatatypesScan_Bool
2023/08/07 01:04:12 In TestMixedDatatypesScan_Bool()
2023/08/07 01:04:12 In DropAllSecondaryIndexes()
2023/08/07 01:04:12 Index found: index_mixeddt
2023/08/07 01:04:12 Dropped index index_mixeddt
2023/08/07 01:04:12 Number of number fields is: 257
2023/08/07 01:04:12 Number of string fields is: 235
2023/08/07 01:04:12 Number of json fields is: 256
2023/08/07 01:04:12 Number of true bool fields is: 136
2023/08/07 01:04:12 Number of false bool fields is: 116
2023/08/07 01:04:12 Setting mixed datatypes JSON docs in KV
2023/08/07 01:04:18 Created the secondary index index_mixeddt. Waiting for it become active
2023/08/07 01:04:18 Index is 3853825928142415833 now active
2023/08/07 01:04:18 Using n1ql client
2023/08/07 01:04:18 Expected and Actual scan responses are the same
2023/08/07 01:04:18 Lengths of expected and actual scan results are: 503 and 503
2023/08/07 01:04:18 Using n1ql client
2023/08/07 01:04:18 Expected and Actual scan responses are the same
2023/08/07 01:04:18 Lengths of expected and actual scan results are: 494 and 494
2023/08/07 01:04:18 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (5.95s)
=== RUN TestLargeSecondaryKeyLength
2023/08/07 01:04:18 In TestLargeSecondaryKeyLength()
2023/08/07 01:04:18 In DropAllSecondaryIndexes()
2023/08/07 01:04:18 Index found: index_mixeddt
2023/08/07 01:04:18 Dropped index index_mixeddt
2023/08/07 01:04:18 Setting JSON docs in KV
2023/08/07 01:04:24 Created the secondary index index_LongSecField. Waiting for it become active
2023/08/07 01:04:24 Index is 4650083042818681755 now active
2023/08/07 01:04:24 Using n1ql client
2023/08/07 01:04:24 ScanAll: Lengths of expected and actual scan results are: 1000 and 1000
2023/08/07 01:04:24 Expected and Actual scan responses are the same
2023/08/07 01:04:24 Using n1ql client
2023/08/07 01:04:24 Range: Lengths of expected and actual scan results are: 817 and 817
2023/08/07 01:04:24 Expected and Actual scan responses are the same
2023/08/07 01:04:24 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (6.20s)
=== RUN TestLargePrimaryKeyLength
2023/08/07 01:04:24 In TestLargePrimaryKeyLength()
2023/08/07 01:04:24 In DropAllSecondaryIndexes()
2023/08/07 01:04:24 Index found: index_LongSecField
2023/08/07 01:04:24 Dropped index index_LongSecField
2023/08/07 01:04:24 Setting JSON docs in KV
2023/08/07 01:04:30 Created the secondary index index_LongPrimaryField. Waiting for it become active
2023/08/07 01:04:30 Index is 12909670652649831395 now active
2023/08/07 01:04:30 Using n1ql client
2023/08/07 01:04:30 Lengths of num of docs and scanResults are: 17002 and 17002
2023/08/07 01:04:30 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (6.30s)
=== RUN TestUpdateMutations_DeleteField
2023/08/07 01:04:30 In TestUpdateMutations_DeleteField()
2023/08/07 01:04:31 Setting JSON docs in KV
2023/08/07 01:04:38 Created the secondary index index_bal. Waiting for it become active
2023/08/07 01:04:38 Index is 5156774325199824503 now active
2023/08/07 01:04:38 Using n1ql client
2023/08/07 01:04:38 Expected and Actual scan responses are the same
2023/08/07 01:04:38 Using n1ql client
2023/08/07 01:04:39 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (8.21s)
=== RUN TestUpdateMutations_AddField
2023/08/07 01:04:39 In TestUpdateMutations_AddField()
2023/08/07 01:04:39 Setting JSON docs in KV
2023/08/07 01:04:46 Created the secondary index index_newField. Waiting for it become active
2023/08/07 01:04:46 Index is 12684060171905582240 now active
2023/08/07 01:04:46 Using n1ql client
2023/08/07 01:04:46 Count of scan results before add field mutations: 0
2023/08/07 01:04:46 Expected and Actual scan responses are the same
2023/08/07 01:04:46 Using n1ql client
2023/08/07 01:04:46 Count of scan results after add field mutations: 300
2023/08/07 01:04:46 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (7.50s)
=== RUN TestUpdateMutations_DataTypeChange
2023/08/07 01:04:46 In TestUpdateMutations_DataTypeChange()
2023/08/07 01:04:46 Setting JSON docs in KV
2023/08/07 01:04:54 Created the secondary index index_isUserActive. Waiting for it become active
2023/08/07 01:04:54 Index is 241807375744453926 now active
2023/08/07 01:04:54 Using n1ql client
2023/08/07 01:04:55 Expected and Actual scan responses are the same
2023/08/07 01:04:55 Using n1ql client
2023/08/07 01:04:55 Expected and Actual scan responses are the same
2023/08/07 01:04:55 Using n1ql client
2023/08/07 01:04:55 Expected and Actual scan responses are the same
2023/08/07 01:04:55 Using n1ql client
2023/08/07 01:04:55 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (8.81s)
=== RUN TestMultipleBuckets
2023/08/07 01:04:55 In TestMultipleBuckets()
2023/08/07 01:04:55 In DropAllSecondaryIndexes()
2023/08/07 01:04:55 Index found: index_bal
2023/08/07 01:04:55 Dropped index index_bal
2023/08/07 01:04:55 Index found: index_LongPrimaryField
2023/08/07 01:04:55 Dropped index index_LongPrimaryField
2023/08/07 01:04:55 Index found: index_newField
2023/08/07 01:04:55 Dropped index index_newField
2023/08/07 01:04:55 Index found: index_isUserActive
2023/08/07 01:04:55 Dropped index index_isUserActive
2023/08/07 01:05:33 Flushed the bucket default, Response body:
2023/08/07 01:05:36 Modified parameters of bucket default, responseBody:
2023/08/07 01:05:36 Created bucket testbucket2, responseBody:
2023/08/07 01:05:36 Created bucket testbucket3, responseBody:
2023/08/07 01:05:36 Created bucket testbucket4, responseBody:
2023/08/07 01:05:51 Generating docs and Populating all the buckets
2023/08/07 01:05:55 Created the secondary index bucket1_age. Waiting for it become active
2023/08/07 01:05:55 Index is 16318839189310293893 now active
2023/08/07 01:06:02 Created the secondary index bucket2_city. Waiting for it become active
2023/08/07 01:06:02 Index is 2508685987629345323 now active
2023/08/07 01:06:08 Created the secondary index bucket3_gender. Waiting for it become active
2023/08/07 01:06:08 Index is 15483444207839140190 now active
2023/08/07 01:06:14 Created the secondary index bucket4_balance. Waiting for it become active
2023/08/07 01:06:14 Index is 8432103617708564803 now active
2023/08/07 01:06:17 Using n1ql client
2023/08/07 01:06:17 Expected and Actual scan responses are the same
2023/08/07 01:06:17 Using n1ql client
2023-08-07T01:06:17.627+05:30 [Info] GSIC[default/testbucket2-_default-_default-1691350577624053134] started ...
2023/08/07 01:06:17 Expected and Actual scan responses are the same
2023/08/07 01:06:17 Using n1ql client
2023-08-07T01:06:17.640+05:30 [Info] GSIC[default/testbucket3-_default-_default-1691350577638109206] started ...
2023/08/07 01:06:17 Expected and Actual scan responses are the same
2023/08/07 01:06:17 Using n1ql client
2023-08-07T01:06:17.652+05:30 [Info] GSIC[default/testbucket4-_default-_default-1691350577647915127] started ...
2023/08/07 01:06:17 Expected and Actual scan responses are the same
2023/08/07 01:06:19 Deleted bucket testbucket2, responseBody:
2023/08/07 01:06:22 Deleted bucket testbucket3, responseBody:
2023/08/07 01:06:24 Deleted bucket testbucket4, responseBody:
2023/08/07 01:06:27 Modified parameters of bucket default, responseBody:
--- PASS: TestMultipleBuckets (107.21s)
=== RUN TestBucketFlush
2023/08/07 01:06:42 In TestBucketFlush()
2023/08/07 01:06:42 In DropAllSecondaryIndexes()
2023/08/07 01:06:42 Index found: bucket1_age
2023/08/07 01:06:42 Dropped index bucket1_age
2023/08/07 01:07:20 Flushed the bucket default, Response body:
2023/08/07 01:07:24 Created the secondary index index_age. Waiting for it become active
2023/08/07 01:07:24 Index is 7174141717395692493 now active
2023/08/07 01:07:24 Using n1ql client
2023/08/07 01:07:24 Expected and Actual scan responses are the same
2023/08/07 01:07:31 Created the secondary index index_gender. Waiting for it become active
2023/08/07 01:07:31 Index is 17177888592752240363 now active
2023/08/07 01:07:31 Using n1ql client
2023/08/07 01:07:31 Expected and Actual scan responses are the same
2023/08/07 01:07:37 Created the secondary index index_city. Waiting for it become active
2023/08/07 01:07:37 Index is 17602369948377632675 now active
2023/08/07 01:07:37 Using n1ql client
2023/08/07 01:07:37 Expected and Actual scan responses are the same
2023/08/07 01:08:15 Flushed the bucket default, Response body:
2023/08/07 01:08:15 TestBucketFlush:: Flushed the bucket
2023/08/07 01:08:15 Using n1ql client
2023/08/07 01:08:15 Using n1ql client
2023/08/07 01:08:15 Using n1ql client
--- PASS: TestBucketFlush (92.78s)
=== RUN TestLargeDocumentSize
2023/08/07 01:08:15 In TestLargeDocumentSize()
2023/08/07 01:08:15 Data file exists. Skipping download
2023/08/07 01:08:15 Length of docs and largeDocs = 200 and 200
2023/08/07 01:08:19 Created the secondary index index_userscreenname. Waiting for it become active
2023/08/07 01:08:19 Index is 1702258186957798585 now active
2023/08/07 01:08:19 Using n1ql client
2023/08/07 01:08:20 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (5.56s)
=== RUN TestFieldsWithSpecialCharacters
2023/08/07 01:08:20 In TestFieldsWithSpecialCharacters()
2023/08/07 01:08:26 Created the secondary index index_specialchar. Waiting for it become active
2023/08/07 01:08:26 Index is 8725099365250362828 now active
2023/08/07 01:08:26 Looking up for value yß0x§2Š
2023/08/07 01:08:26 Using n1ql client
2023/08/07 01:08:26 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (5.43s)
=== RUN TestLargeKeyLookup
2023/08/07 01:08:26 In TestLargeKeyLookup()
2023/08/07 01:08:33 Created the secondary index index_largeKeyLookup. Waiting for it become active
2023/08/07 01:08:33 Index is 11136865044968852275 now active
2023/08/07 01:08:33 Looking up for a large key
2023/08/07 01:08:33 Using n1ql client
2023/08/07 01:08:34 Expected and Actual scan responses are the same
--- PASS: TestLargeKeyLookup (8.06s)
=== RUN TestIndexNameValidation
2023/08/07 01:08:34 In TestIndexNameValidation()
2023/08/07 01:08:34 Setting JSON docs in KV
2023/08/07 01:08:35 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected
2023/08/07 01:08:40 Created the secondary index #primary-Index_test. Waiting for it become active
2023/08/07 01:08:40 Index is 8759401395227770928 now active
2023/08/07 01:08:40 Using n1ql client
2023/08/07 01:08:40 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (5.70s)
=== RUN TestSameFieldNameAtDifferentLevels
2023/08/07 01:08:40 In TestSameFieldNameAtDifferentLevels()
2023/08/07 01:08:40 Setting JSON docs in KV
2023/08/07 01:08:47 Created the secondary index cityindex. Waiting for it become active
2023/08/07 01:08:47 Index is 9843231396216154681 now active
2023/08/07 01:08:47 Using n1ql client
2023/08/07 01:08:47 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (7.00s)
=== RUN TestSameIndexNameInTwoBuckets
2023/08/07 01:08:47 In TestSameIndexNameInTwoBuckets()
2023/08/07 01:08:47 In DropAllSecondaryIndexes()
2023/08/07 01:08:47 Index found: #primary-Index_test
2023/08/07 01:08:47 Dropped index #primary-Index_test
2023/08/07 01:08:47 Index found: index_gender
2023/08/07 01:08:47 Dropped index index_gender
2023/08/07 01:08:47 Index found: index_age
2023/08/07 01:08:47 Dropped index index_age
2023/08/07 01:08:47 Index found: index_city
2023/08/07 01:08:47 Dropped index index_city
2023/08/07 01:08:47 Index found: cityindex
2023/08/07 01:08:47 Dropped index cityindex
2023/08/07 01:08:47 Index found: index_userscreenname
2023/08/07 01:08:47 Dropped index index_userscreenname
2023/08/07 01:08:47 Index found: index_specialchar
2023/08/07 01:08:47 Dropped index index_specialchar
2023/08/07 01:08:47 Index found: index_largeKeyLookup
2023/08/07 01:08:47 Dropped index index_largeKeyLookup
2023/08/07 01:09:25 Flushed the bucket default, Response body:
2023/08/07 01:09:28 Modified parameters of bucket default, responseBody:
2023/08/07 01:09:28 Created bucket buck2, responseBody:
2023/08/07 01:09:43 Generating docs and Populating all the buckets
2023/08/07 01:09:47 Created the secondary index b_idx. Waiting for it become active
2023/08/07 01:09:47 Index is 1291821898279876872 now active
2023/08/07 01:09:54 Created the secondary index b_idx. Waiting for it become active
2023/08/07 01:09:54 Index is 2314280802153461153 now active
2023/08/07 01:09:57 Using n1ql client
2023/08/07 01:09:57 Expected and Actual scan responses are the same
2023/08/07 01:09:57 Using n1ql client
2023-08-07T01:09:57.141+05:30 [Info] GSIC[default/buck2-_default-_default-1691350797138086685] started ...
2023/08/07 01:09:57 Expected and Actual scan responses are the same
2023/08/07 01:10:00 Modified parameters of bucket default, responseBody:
2023/08/07 01:10:02 Deleted bucket buck2, responseBody:
--- PASS: TestSameIndexNameInTwoBuckets (90.27s)
=== RUN TestLargeKeysSplChars
2023/08/07 01:10:17 In TestLargeKeysSplChars()
2023/08/07 01:10:26 Created the secondary index idspl1. Waiting for it become active
2023/08/07 01:10:26 Index is 12238835613470007842 now active
2023/08/07 01:10:36 Created the secondary index idspl2. Waiting for it become active
2023/08/07 01:10:36 Index is 15273219475549247548 now active
2023/08/07 01:10:43 Created the secondary index idspl3. Waiting for it become active
2023/08/07 01:10:43 Index is 2459524803920073868 now active
2023/08/07 01:10:43 Using n1ql client
2023/08/07 01:10:43 Expected and Actual scan responses are the same
2023-08-07T01:10:43.182+05:30 [Error] transport error between 127.0.0.1:40806->127.0.0.1:9107: write tcp 127.0.0.1:40806->127.0.0.1:9107: write: broken pipe
2023-08-07T01:10:43.183+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:40806->127.0.0.1:9107: write: broken pipe`
2023-08-07T01:10:43.183+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-08-07T01:10:43.183+05:30 [Error] metadataClient:PickRandom: Replicas - [8467877628445810450], PrunedReplica - map[], FilteredReplica map[]
2023/08/07 01:10:43 Expected and Actual scan responses are the same
2023/08/07 01:10:43 Using n1ql client
2023/08/07 01:10:43 Expected and Actual scan responses are the same
--- PASS: TestLargeKeysSplChars (26.18s)
=== RUN TestVeryLargeIndexKey
2023/08/07 01:10:43 In DropAllSecondaryIndexes()
2023/08/07 01:10:43 Index found: b_idx
2023/08/07 01:10:43 Dropped index b_idx
2023/08/07 01:10:43 Index found: idspl2
2023/08/07 01:10:43 Dropped index idspl2
2023/08/07 01:10:43 Index found: idspl3
2023/08/07 01:10:43 Dropped index idspl3
2023/08/07 01:10:43 Index found: idspl1
2023/08/07 01:10:43 Dropped index idspl1
2023/08/07 01:11:21 Flushed the bucket default, Response body:
2023/08/07 01:11:21 TestVeryLargeIndexKey:: Flushed the bucket
2023/08/07 01:11:22 clusterconfig.KVAddress = 127.0.0.1:9000
2023/08/07 01:11:26 Created the secondary index i1. Waiting for it become active
2023/08/07 01:11:26 Index is 6249029934905208463 now active
2023/08/07 01:11:26 Using n1ql client
2023/08/07 01:11:27 Expected and Actual scan responses are the same
2023/08/07 01:11:34 Created the secondary index i2. Waiting for it become active
2023/08/07 01:11:34 Index is 4281904719723529645 now active
2023/08/07 01:11:34 Using n1ql client
2023/08/07 01:11:34 Expected and Actual scan responses are the same
2023/08/07 01:11:34 In DropAllSecondaryIndexes()
2023/08/07 01:11:34 Index found: i2
2023/08/07 01:11:35 Dropped index i2
2023/08/07 01:11:35 Index found: i1
2023/08/07 01:11:35 Dropped index i1
2023/08/07 01:12:13 Flushed the bucket default, Response body:
--- PASS: TestVeryLargeIndexKey (89.93s)
=== RUN TestTempBufScanResult
2023/08/07 01:12:13 In DropAllSecondaryIndexes()
2023/08/07 01:12:51 Flushed the bucket default, Response body:
2023/08/07 01:12:51 TestTempBufScanResult:: Flushed the bucket
2023/08/07 01:12:54 Created the secondary index index_idxKey. Waiting for it become active
2023/08/07 01:12:54 Index is 10097391233643381196 now active
2023/08/07 01:12:54 Using n1ql client
2023/08/07 01:12:55 Expected and Actual scan responses are the same
2023/08/07 01:12:55 In DropAllSecondaryIndexes()
2023/08/07 01:12:55 Index found: index_idxKey
2023/08/07 01:12:55 Dropped index index_idxKey
2023/08/07 01:13:34 Flushed the bucket default, Response body:
--- PASS: TestTempBufScanResult (80.59s)
=== RUN TestBuildDeferredAnotherBuilding
2023/08/07 01:13:34 In TestBuildDeferredAnotherBuilding()
2023/08/07 01:13:34 In DropAllSecondaryIndexes()
2023/08/07 01:14:17 Setting JSON docs in KV
2023/08/07 01:16:10 Build the deferred index id_age1. Waiting for the index to become active
2023/08/07 01:16:10 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:11 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:12 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:13 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:14 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:15 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:16 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:17 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:18 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:19 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:20 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:21 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:22 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:23 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:24 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:25 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:26 Waiting for index 4122424614462636125 to go active ...
2023/08/07 01:16:27 Index is 4122424614462636125 now active
2023/08/07 01:16:27 Build command issued for the deferred indexes [4516201758544226973]
2023/08/07 01:16:29 Build index failed as expected: Build index failed. Encountered transient error. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2023/08/07 01:16:29 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:30 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:31 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:32 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:33 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:34 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:35 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:36 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:37 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:38 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:39 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:40 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:41 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:42 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:43 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:44 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:45 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:46 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:47 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:48 Waiting for index 4516201758544226973 to go active ...
2023/08/07 01:16:49 Index is 4516201758544226973 now active
2023/08/07 01:16:49 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:50 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:51 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:52 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:53 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:54 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:55 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:56 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:57 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:58 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:16:59 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:17:00 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:17:01 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:17:02 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:17:03 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:17:04 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:17:05 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:17:06 Waiting for index 16796934368368921610 to go active ...
2023/08/07 01:17:07 Index is 16796934368368921610 now active
2023/08/07 01:17:07 Using n1ql client
2023/08/07 01:17:09 Expected and Actual scan responses are the same
2023/08/07 01:17:09 Using n1ql client
2023/08/07 01:17:09 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (215.54s)
=== RUN TestMultipleBucketsDeferredBuild
2023/08/07 01:17:09 In TestMultipleBucketsDeferredBuild()
2023/08/07 01:17:09 In DropAllSecondaryIndexes()
2023/08/07 01:17:09 Index found: id_age
2023/08/07 01:17:09 Dropped index id_age
2023/08/07 01:17:09 Index found: id_age1
2023/08/07 01:17:09 Dropped index id_age1
2023/08/07 01:17:09 Index found: id_company
2023/08/07 01:17:09 Dropped index id_company
2023/08/07 01:17:46 Flushed the bucket default, Response body:
2023/08/07 01:17:50 Modified parameters of bucket default, responseBody:
2023/08/07 01:17:50 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2023/08/07 01:17:50 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000480d8}
2023/08/07 01:17:50 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Sun, 06 Aug 2023 19:47:49 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0023f9940 31 [] false false map[] 0xc001272d00 }
2023/08/07 01:17:50 DeleteBucket failed for bucket defertest_buck2
2023/08/07 01:17:50 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2023/08/07 01:17:50 Created bucket defertest_buck2, responseBody:
2023/08/07 01:18:05 Setting JSON docs in KV
2023/08/07 01:19:19 Build command issued for the deferred indexes [11618092539219930224]
2023/08/07 01:19:19 Build command issued for the deferred indexes [5194698366348257557 12588182694149419557]
2023/08/07 01:19:19 Index state of 12588182694149419557 is INDEX_STATE_READY
2023/08/07 01:19:19 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:20 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:21 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:22 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:23 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:24 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:25 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:26 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:27 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:28 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:29 Waiting for index 11618092539219930224 to go active ...
2023/08/07 01:19:30 Index is 11618092539219930224 now active
2023/08/07 01:19:30 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:31 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:32 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:33 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:34 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:35 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:36 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:37 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:38 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:39 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:40 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:41 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:42 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:43 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:44 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:45 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:46 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:47 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:48 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:49 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:50 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:51 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:52 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:53 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:54 Waiting for index 5194698366348257557 to go active ...
2023/08/07 01:19:55 Index is 5194698366348257557 now active
2023/08/07 01:19:56 Using n1ql client
2023/08/07 01:19:56 Expected and Actual scan responses are the same
2023/08/07 01:19:56 Using n1ql client
2023/08/07 01:19:56 Expected and Actual scan responses are the same
2023/08/07 01:19:56 Using n1ql client
2023-08-07T01:19:56.278+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1691351396276295530] started ...
2023/08/07 01:19:56 Expected and Actual scan responses are the same
2023/08/07 01:19:59 Modified parameters of bucket default, responseBody:
2023/08/07 01:20:01 Deleted bucket defertest_buck2, responseBody:
--- PASS: TestMultipleBucketsDeferredBuild (177.12s)
=== RUN TestCreateDropCreateDeferredIndex
2023/08/07 01:20:06 In TestCreateDropCreateDeferredIndex()
2023/08/07 01:20:06 In DropAllSecondaryIndexes()
2023/08/07 01:20:06 Index found: buck1_id2
2023/08/07 01:20:06 Dropped index buck1_id2
2023/08/07 01:20:06 Index found: buck1_id1
2023/08/07 01:20:06 Dropped index buck1_id1
2023/08/07 01:20:09 Setting JSON docs in KV
2023/08/07 01:20:21 Created the secondary index id_company. Waiting for it become active
2023/08/07 01:20:21 Index is 3592789711813888030 now active
2023/08/07 01:20:23 Dropping the secondary index id_age
2023/08/07 01:20:23 Index dropped
2023/08/07 01:20:26 Setting JSON docs in KV
2023/08/07 01:20:35 Using n1ql client
2023/08/07 01:20:36 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (29.33s)
=== RUN TestMultipleDeferredIndexes_BuildTogether
2023/08/07 01:20:36 In TestMultipleDeferredIndexes_BuildTogether()
2023/08/07 01:20:36 In DropAllSecondaryIndexes()
2023/08/07 01:20:36 Index found: id_company
2023/08/07 01:20:36 Dropped index id_company
2023/08/07 01:20:38 Setting JSON docs in KV
2023/08/07 01:20:52 Created the secondary index id_company. Waiting for it become active
2023/08/07 01:20:52 Index is 3046415629630650291 now active
2023/08/07 01:20:54 Build command issued for the deferred indexes [id_age id_gender id_isActive], bucket: default, scope: _default, coll: _default
2023/08/07 01:20:54 Waiting for the index id_age to become active
2023/08/07 01:20:54 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:20:55 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:20:56 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:20:57 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:20:58 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:20:59 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:00 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:01 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:02 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:03 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:04 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:05 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:06 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:07 Waiting for index 3886458415080364642 to go active ...
2023/08/07 01:21:08 Index is 3886458415080364642 now active
2023/08/07 01:21:08 Waiting for the index id_gender to become active
2023/08/07 01:21:08 Index is 1177030246631993203 now active
2023/08/07 01:21:08 Waiting for the index id_isActive to become active
2023/08/07 01:21:08 Index is 17507449302989321638 now active
2023/08/07 01:21:08 Using n1ql client
2023/08/07 01:21:09 Expected and Actual scan responses are the same
2023/08/07 01:21:11 Setting JSON docs in KV
2023/08/07 01:21:21 Using n1ql client
2023/08/07 01:21:21 Expected and Actual scan responses are the same
2023/08/07 01:21:21 Using n1ql client
2023/08/07 01:21:21 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (45.62s)
=== RUN TestMultipleDeferredIndexes_BuildOneByOne
2023/08/07 01:21:21 In TestMultipleDeferredIndexes_BuildOneByOne()
2023/08/07 01:21:21 In DropAllSecondaryIndexes()
2023/08/07 01:21:21 Index found: id_age
2023/08/07 01:21:21 Dropped index id_age
2023/08/07 01:21:21 Index found: id_gender
2023/08/07 01:21:21 Dropped index id_gender
2023/08/07 01:21:21 Index found: id_company
2023/08/07 01:21:21 Dropped index id_company
2023/08/07 01:21:21 Index found: id_isActive
2023/08/07 01:21:22 Dropped index id_isActive
2023/08/07 01:21:24 Setting JSON docs in KV
2023/08/07 01:21:45 Created the secondary index id_company. Waiting for it become active
2023/08/07 01:21:45 Index is 2272471299830205294 now active
2023/08/07 01:21:47 Build command issued for the deferred indexes [id_age], bucket: default, scope: _default, coll: _default
2023/08/07 01:21:47 Waiting for the index id_age to become active
2023/08/07 01:21:47 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:48 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:49 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:50 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:51 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:52 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:53 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:54 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:55 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:56 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:57 Waiting for index 2858524094764510188 to go active ...
2023/08/07 01:21:58 Index is 2858524094764510188 now active
2023/08/07 01:21:58 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/08/07 01:21:58 Waiting for the index id_gender to become active
2023/08/07 01:21:58 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:21:59 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:00 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:01 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:02 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:03 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:04 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:05 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:06 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:07 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:08 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:09 Waiting for index 13093646265278827320 to go active ...
2023/08/07 01:22:10 Index is 13093646265278827320 now active
2023/08/07 01:22:10 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/08/07 01:22:10 Waiting for the index id_isActive to become active
2023/08/07 01:22:10 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:11 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:12 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:13 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:14 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:15 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:16 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:17 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:18 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:19 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:20 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:21 Waiting for index 7124129292940100004 to go active ...
2023/08/07 01:22:22 Index is 7124129292940100004 now active
2023/08/07 01:22:22 Using n1ql client
2023/08/07 01:22:23 Expected and Actual scan responses are the same
2023/08/07 01:22:25 Setting JSON docs in KV
2023/08/07 01:22:34 Using n1ql client
2023/08/07 01:22:35 Expected and Actual scan responses are the same
2023/08/07 01:22:35 Using n1ql client
2023/08/07 01:22:36 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (74.41s)
=== RUN TestDropDeferredIndexWhileOthersBuilding
2023/08/07 01:22:36 In TestDropDeferredIndexWhileOthersBuilding()
2023/08/07 01:22:36 In DropAllSecondaryIndexes()
2023/08/07 01:22:36 Index found: id_isActive
2023/08/07 01:22:36 Dropped index id_isActive
2023/08/07 01:22:36 Index found: id_age
2023/08/07 01:22:36 Dropped index id_age
2023/08/07 01:22:36 Index found: id_company
2023/08/07 01:22:36 Dropped index id_company
2023/08/07 01:22:36 Index found: id_gender
2023/08/07 01:22:36 Dropped index id_gender
2023/08/07 01:22:39 Setting JSON docs in KV
2023/08/07 01:22:55 Created the secondary index id_company. Waiting for it become active
2023/08/07 01:22:55 Index is 16273796958419922729 now active
2023/08/07 01:22:57 Build command issued for the deferred indexes [9516717902234357391 10926666976691994651]
2023/08/07 01:22:59 Dropping the secondary index id_isActive
2023/08/07 01:23:00 Index dropped
2023/08/07 01:23:00 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:01 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:02 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:03 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:04 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:05 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:06 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:07 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:08 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:09 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:10 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:11 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:12 Waiting for index 9516717902234357391 to go active ...
2023/08/07 01:23:13 Index is 9516717902234357391 now active
2023/08/07 01:23:13 Index is 10926666976691994651 now active
2023/08/07 01:23:14 Using n1ql client
2023/08/07 01:23:14 Expected and Actual scan responses are the same
2023/08/07 01:23:14 Using n1ql client
2023/08/07 01:23:14 Expected and Actual scan responses are the same
2023/08/07 01:23:16 Setting JSON docs in KV
2023/08/07 01:23:25 Using n1ql client
2023/08/07 01:23:26 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (50.15s)
=== RUN TestDropBuildingDeferredIndex
2023/08/07 01:23:26 In TestDropBuildingDeferredIndex()
2023/08/07 01:23:26 In DropAllSecondaryIndexes()
2023/08/07 01:23:26 Index found: id_gender
2023/08/07 01:23:26 Dropped index id_gender
2023/08/07 01:23:26 Index found: id_age
2023/08/07 01:23:26 Dropped index id_age
2023/08/07 01:23:26 Index found: id_company
2023/08/07 01:23:26 Dropped index id_company
2023/08/07 01:23:29 Setting JSON docs in KV
2023/08/07 01:23:36 Build command issued for the deferred indexes [3595916947868974353 5034243896118818145]
2023/08/07 01:23:37 Dropping the secondary index id_age
2023/08/07 01:23:37 Index dropped
2023/08/07 01:23:37 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:38 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:39 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:40 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:41 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:42 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:43 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:44 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:45 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:46 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:47 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:48 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:49 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:50 Waiting for index 3595916947868974353 to go active ...
2023/08/07 01:23:51 Index is 3595916947868974353 now active
2023/08/07 01:23:51 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/08/07 01:23:51 Waiting for the index id_gender to become active
2023/08/07 01:23:51 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:23:52 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:23:53 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:23:54 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:23:55 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:23:56 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:23:57 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:23:58 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:23:59 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:00 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:01 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:02 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:03 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:04 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:05 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:06 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:07 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:08 Waiting for index 12699654021007487333 to go active ...
2023/08/07 01:24:09 Index is 12699654021007487333 now active
2023/08/07 01:24:10 Using n1ql client
2023/08/07 01:24:11 Expected and Actual scan responses are the same
2023/08/07 01:24:11 Using n1ql client
2023/08/07 01:24:11 Expected and Actual scan responses are the same
2023/08/07 01:24:14 Setting JSON docs in KV
2023/08/07 01:24:23 Using n1ql client
2023/08/07 01:24:24 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (57.96s)
=== RUN TestDropMultipleBuildingDeferredIndexes
2023/08/07 01:24:24 In TestDropMultipleBuildingDeferredIndexes()
2023/08/07 01:24:24 In DropAllSecondaryIndexes()
2023/08/07 01:24:24 Index found: id_company
2023/08/07 01:24:24 Dropped index id_company
2023/08/07 01:24:24 Index found: id_gender
2023/08/07 01:24:24 Dropped index id_gender
2023/08/07 01:24:31 Setting JSON docs in KV
2023/08/07 01:25:06 Created the secondary index id_company. Waiting for it become active
2023/08/07 01:25:06 Index is 3336715938374185487 now active
2023/08/07 01:25:09 Build command issued for the deferred indexes [3311970735910495577 9163419680094322465]
2023/08/07 01:25:10 Dropping the secondary index id_age
2023/08/07 01:25:10 Index dropped
2023/08/07 01:25:10 Dropping the secondary index id_gender
2023/08/07 01:25:26 Index dropped
2023/08/07 01:25:26 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/08/07 01:25:26 Waiting for the index id_isActive to become active
2023/08/07 01:25:26 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:27 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:28 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:29 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:30 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:31 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:32 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:33 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:34 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:35 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:36 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:37 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:38 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:39 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:40 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:41 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:42 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:43 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:44 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:45 Waiting for index 14026098216917567502 to go active ...
2023/08/07 01:25:46 Index is 14026098216917567502 now active
2023/08/07 01:25:56 Using n1ql client
2023/08/07 01:25:57 Expected and Actual scan responses are the same
2023/08/07 01:25:57 Number of docScanResults and scanResults = 180000 and 180000
2023/08/07 01:25:58 Using n1ql client
2023/08/07 01:25:59 Expected and Actual scan responses are the same
2023/08/07 01:25:59 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (95.15s)
=== RUN TestDropOneIndexSecondDeferBuilding
2023/08/07 01:25:59 In TestDropOneIndexSecondDeferBuilding()
2023/08/07 01:25:59 In DropAllSecondaryIndexes()
2023/08/07 01:25:59 Index found: id_company
2023/08/07 01:25:59 Dropped index id_company
2023/08/07 01:25:59 Index found: id_isActive
2023/08/07 01:25:59 Dropped index id_isActive
2023/08/07 01:26:02 Setting JSON docs in KV
2023/08/07 01:26:08 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/08/07 01:26:08 Waiting for the index id_company to become active
2023/08/07 01:26:08 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:09 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:10 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:11 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:12 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:13 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:14 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:15 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:16 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:17 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:18 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:19 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:20 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:21 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:22 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:23 Waiting for index 10675816888062620929 to go active ...
2023/08/07 01:26:24 Index is 10675816888062620929 now active
2023/08/07 01:26:24 Build command issued for the deferred indexes [3897380962416447777]
2023/08/07 01:26:25 Dropping the secondary index id_company
2023/08/07 01:26:25 Index dropped
2023/08/07 01:26:29 Setting JSON docs in KV
2023/08/07 01:26:46 Waiting for index 3897380962416447777 to go active ...
2023/08/07 01:26:47 Waiting for index 3897380962416447777 to go active ...
2023/08/07 01:26:48 Waiting for index 3897380962416447777 to go active ...
2023/08/07 01:26:49 Waiting for index 3897380962416447777 to go active ...
2023/08/07 01:26:50 Index is 3897380962416447777 now active
2023/08/07 01:26:50 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/08/07 01:26:50 Waiting for the index id_gender to become active
2023/08/07 01:26:50 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:51 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:52 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:53 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:54 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:55 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:56 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:57 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:58 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:26:59 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:00 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:01 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:02 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:03 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:04 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:05 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:06 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:07 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:08 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:09 Waiting for index 812911237589813359 to go active ...
2023/08/07 01:27:10 Index is 812911237589813359 now active
2023/08/07 01:27:10 Using n1ql client
2023/08/07 01:27:10 Expected and Actual scan responses are the same
2023/08/07 01:27:10 Using n1ql client
2023/08/07 01:27:12 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (73.45s)
=== RUN TestDropSecondIndexSecondDeferBuilding
2023/08/07 01:27:12 In TestDropSecondIndexSecondDeferBuilding()
2023/08/07 01:27:12 In DropAllSecondaryIndexes()
2023/08/07 01:27:12 Index found: id_age
2023/08/07 01:27:12 Dropped index id_age
2023/08/07 01:27:12 Index found: id_gender
2023/08/07 01:27:12 Dropped index id_gender
2023/08/07 01:27:14 Setting JSON docs in KV
2023/08/07 01:27:20 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/08/07 01:27:20 Waiting for the index id_company to become active
2023/08/07 01:27:20 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:21 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:22 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:23 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:24 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:25 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:26 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:27 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:28 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:29 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:30 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:31 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:32 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:33 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:34 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:35 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:36 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:37 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:38 Waiting for index 5948717941512291787 to go active ...
2023/08/07 01:27:39 Index is 5948717941512291787 now active
2023/08/07 01:27:39 Build command issued for the deferred indexes [5839788865401452539]
2023/08/07 01:27:40 Dropping the secondary index id_age
2023/08/07 01:27:41 Index dropped
2023/08/07 01:27:44 Setting JSON docs in KV
2023/08/07 01:27:52 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/08/07 01:27:52 Waiting for the index id_gender to become active
2023/08/07 01:27:52 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:27:53 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:27:54 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:27:55 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:27:56 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:27:57 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:27:58 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:27:59 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:00 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:01 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:02 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:03 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:04 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:05 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:06 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:07 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:08 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:09 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:10 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:11 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:12 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:13 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:14 Waiting for index 17841278531584401946 to go active ...
2023/08/07 01:28:15 Index is 17841278531584401946 now active
2023/08/07 01:28:16 Using n1ql client
2023/08/07 01:28:16 Expected and Actual scan responses are the same
2023/08/07 01:28:16 Using n1ql client
2023/08/07 01:28:18 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (65.50s)
=== RUN TestCreateAfterDropWhileIndexBuilding
2023/08/07 01:28:18 In TestCreateAfterDropWhileIndexBuilding()
2023/08/07 01:28:18 In DropAllSecondaryIndexes()
2023/08/07 01:28:18 Index found: id_company
2023/08/07 01:28:18 Dropped index id_company
2023/08/07 01:28:18 Index found: id_gender
2023/08/07 01:28:18 Dropped index id_gender
2023/08/07 01:28:40 Setting JSON docs in KV
2023/08/07 01:29:35 Build command issued for the deferred indexes [18438568537763054928]
2023/08/07 01:29:36 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:37 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:38 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:39 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:40 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:41 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:42 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:43 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:44 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:45 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:46 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:47 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:48 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:49 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:50 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:51 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:52 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:53 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:54 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:55 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:56 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:57 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:58 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:29:59 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:30:00 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:30:01 Waiting for index 18438568537763054928 to go active ...
2023/08/07 01:30:02 Index is 18438568537763054928 now active
2023/08/07 01:30:02 Build command issued for the deferred indexes [2227246867942179834]
2023/08/07 01:30:03 Dropping the secondary index id_company
2023/08/07 01:30:03 Index dropped
2023/08/07 01:30:03 Dropping the secondary index id_age
2023/08/07 01:30:05 Index dropped
2023/08/07 01:30:12 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/08/07 01:30:12 Waiting for the index id_gender to become active
2023/08/07 01:30:12 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:13 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:14 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:15 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:16 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:17 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:18 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:19 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:20 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:21 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:22 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:23 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:24 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:25 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:26 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:27 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:28 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:29 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:30 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:31 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:32 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:33 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:34 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:35 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:36 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:37 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:38 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:39 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:40 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:41 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:42 Waiting for index 688541449497391392 to go active ...
2023/08/07 01:30:43 Index is 688541449497391392 now active
2023/08/07 01:30:44 Index is 688541449497391392 now active
2023/08/07 01:30:45 Using n1ql client
2023/08/07 01:30:46 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (148.68s)
=== RUN TestDropBuildingIndex1
2023/08/07 01:30:46 In TestDropBuildingIndex1()
2023/08/07 01:30:46 In DropAllSecondaryIndexes()
2023/08/07 01:30:46 Index found: id_gender
2023/08/07 01:30:47 Dropped index id_gender
2023/08/07 01:30:51 Setting JSON docs in KV
2023/08/07 01:31:01 set: EOF
--- FAIL: TestDropBuildingIndex1 (14.25s)
panic: set: EOF
[recovered]
panic: set: EOF
goroutine 15248 [running]:
panic({0x1047160, 0xc01a1ae870})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/panic.go:987 +0x3bb fp=0xc0013198e0 sp=0xc001319820 pc=0x43ecfb
testing.tRunner.func1.2({0x1047160, 0xc01a1ae870})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:1526 +0x24e fp=0xc001319990 sp=0xc0013198e0 pc=0x533aae
testing.tRunner.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:1529 +0x39f fp=0xc001319af8 sp=0xc001319990 pc=0x53353f
runtime.deferCallSave(0xc001319bc8, 0xc001319f90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/panic.go:796 +0x88 fp=0xc001319b08 sp=0xc001319af8 pc=0x43e8e8
runtime.runOpenDeferFrame(0xc06ccf3400)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/panic.go:769 +0x1b4 fp=0xc001319b50 sp=0xc001319b08 pc=0x43e714
panic({0x1047160, 0xc01a1ae870})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/panic.go:884 +0x213 fp=0xc001319c10 sp=0xc001319b50 pc=0x43eb53
log.Panicf({0x12089e4?, 0x3?}, {0xc001319cc0?, 0x7?, 0x108f200?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/log/log.go:391 +0x67 fp=0xc001319c58 sp=0xc001319c10 pc=0x5e98c7
github.com/couchbase/indexing/secondary/tests/framework/common.HandleError(...)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/framework/common/util.go:77
github.com/couchbase/indexing/secondary/tests/framework/kvutility.SetKeyValues(0x121de3d?, {0x12093ca, 0x7}, {0x0, 0x0}, {0xc000049ad0, 0xe})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/framework/kvutility/kvdataoperations.go:40 +0x34f fp=0xc001319db8 sp=0xc001319c58 pc=0xcef5ef
github.com/couchbase/indexing/secondary/tests/functionaltests.TestDropBuildingIndex1(0xc0784a9ba0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/functionaltests/set07_system_test.go:812 +0x250 fp=0xc001319f70 sp=0xc001319db8 pc=0xf38590
testing.tRunner(0xc0784a9ba0, 0x128e5d8)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:1576 +0x10b fp=0xc001319fc0 sp=0xc001319f70 pc=0x5330eb
testing.(*T).Run.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:1629 +0x2a fp=0xc001319fe0 sp=0xc001319fc0 pc=0x53412a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc001319fe8 sp=0xc001319fe0 pc=0x475001
created by testing.(*T).Run
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:1629 +0x3ea
goroutine 1 [chan receive]:
runtime.gopark(0xc041c10000?, 0xc03b490700?, 0xa0?, 0x1?, 0xc000315818?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000315798 sp=0xc000315778 pc=0x441f16
runtime.chanrecv(0xc06bb62620, 0xc000315897, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc000315828 sp=0xc000315798 pc=0x40ed3d
runtime.chanrecv1(0x1d67e40?, 0x1047160?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:442 +0x18 fp=0xc000315850 sp=0xc000315828 pc=0x40e838
testing.(*T).Run(0xc000102820, {0x121c5a0?, 0x532965?}, 0x128e5d8)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:1630 +0x405 fp=0xc000315910 sp=0xc000315850 pc=0x533fa5
testing.runTests.func1(0xc0004de000?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:2036 +0x45 fp=0xc000315960 sp=0xc000315910 pc=0x536165
testing.tRunner(0xc000102820, 0xc007887a78)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:1576 +0x10b fp=0xc0003159b0 sp=0xc000315960 pc=0x5330eb
testing.runTests(0xc000402be0?, {0x1cea660, 0xdd, 0xdd}, {0xc007887b08?, 0xc007887b10?, 0x1d68c20?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:2034 +0x489 fp=0xc000315aa8 sp=0xc0003159b0 pc=0x536049
testing.(*M).Run(0xc000402be0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/testing/testing.go:1906 +0x63a fp=0xc000315cf0 sp=0xc000315aa8 pc=0x5349ba
github.com/couchbase/indexing/secondary/tests/functionaltests.TestMain(0xffffffffffffffff?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/functionaltests/common_test.go:168 +0x1276 fp=0xc000315ec8 sp=0xc000315cf0 pc=0xed99d6
main.main()
_testmain.go:489 +0x1d3 fp=0xc000315f80 sp=0xc000315ec8 pc=0xfb97f3
runtime.main()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:250 +0x207 fp=0xc000315fe0 sp=0xc000315f80 pc=0x441ae7
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000315fe8 sp=0xc000315fe0 pc=0x475001
goroutine 2 [force gc (idle), 43 minutes]:
runtime.gopark(0x3222f845d566?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006cfb0 sp=0xc00006cf90 pc=0x441f16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:387
runtime.forcegchelper()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:305 +0xb0 fp=0xc00006cfe0 sp=0xc00006cfb0 pc=0x441d50
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x475001
created by runtime.init.6
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:293 +0x25
goroutine 3 [GC sweep wait]:
runtime.gopark(0x1d68201?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006d780 sp=0xc00006d760 pc=0x441f16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:387
runtime.bgsweep(0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgcsweep.go:319 +0xde fp=0xc00006d7c8 sp=0xc00006d780 pc=0x42c37e
runtime.gcenable.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:178 +0x26 fp=0xc00006d7e0 sp=0xc00006d7c8 pc=0x4215e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006d7e8 sp=0xc00006d7e0 pc=0x475001
created by runtime.gcenable
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:178 +0x6b
goroutine 4 [GC scavenge wait]:
runtime.gopark(0x342848cdbd5d?, 0x3f2849?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006df70 sp=0xc00006df50 pc=0x441f16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:387
runtime.(*scavengerState).park(0x1d68d20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc00006dfa0 sp=0xc00006df70 pc=0x42a253
runtime.bgscavenge(0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgcscavenge.go:633 +0x65 fp=0xc00006dfc8 sp=0xc00006dfa0 pc=0x42a845
runtime.gcenable.func2()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:179 +0x26 fp=0xc00006dfe0 sp=0xc00006dfc8 pc=0x421586
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006dfe8 sp=0xc00006dfe0 pc=0x475001
created by runtime.gcenable
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:179 +0xaa
goroutine 5 [finalizer wait]:
runtime.gopark(0x0?, 0x1293d60?, 0x0?, 0xe0?, 0x2000000020?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006c628 sp=0xc00006c608 pc=0x441f16
runtime.runfinq()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mfinal.go:193 +0x107 fp=0xc00006c7e0 sp=0xc00006c628 pc=0x420627
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006c7e8 sp=0xc00006c7e0 pc=0x475001
created by runtime.createfing
/home/buildbtee: /opt/build/test.log: No space left on device
ot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mfinal.go:163 +0x45
goroutine 6 [select, 47 minutes]:
runtime.gopark(0xc00006e798?, 0x2?, 0x0?, 0x0?, 0xc00006e784?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006e610 sp=0xc00006e5f0 pc=0x441f16
runtime.selectgo(0xc00006e798, 0xc00006e780, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00006e750 sp=0xc00006e610 pc=0x4521be
github.com/couchbase/cbauth/cbauthimpl.(*tlsNotifier).loop(0xc000012600)
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:390 +0x67 fp=0xc00006e7c8 sp=0xc00006e750 pc=0x7c0207
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func2()
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:543 +0x26 fp=0xc00006e7e0 sp=0xc00006e7c8 pc=0x7c0dc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006e7e8 sp=0xc00006e7e0 pc=0x475001
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:543 +0x38c
goroutine 7 [select, 47 minutes]:
runtime.gopark(0xc00006ef98?, 0x2?, 0x0?, 0x0?, 0xc00006ef8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006ee08 sp=0xc00006ede8 pc=0x441f16
runtime.selectgo(0xc00006ef98, 0xc00006ef88, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00006ef48 sp=0xc00006ee08 pc=0x4521be
github.com/couchbase/cbauth/cbauthimpl.(*cfgChangeNotifier).loop(0xc000012618)
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:309 +0x85 fp=0xc00006efc8 sp=0xc00006ef48 pc=0x7bfc65
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func3()
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:544 +0x26 fp=0xc00006efe0 sp=0xc00006efc8 pc=0x7c0d66
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006efe8 sp=0xc00006efe0 pc=0x475001
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:544 +0x3da
goroutine 8 [IO wait, 11 minutes]:
runtime.gopark(0x8?, 0xb?, 0x0?, 0x0?, 0x6?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0000d3700 sp=0xc0000d36e0 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0000d3738 sp=0xc0000d3700 pc=0x43a537
internal/poll.runtime_pollWait(0x7f9783e1eec8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0000d3758 sp=0xc0000d3738 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc00011c000?, 0xc00012d000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0000d3780 sp=0xc0000d3758 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00011c000, {0xc00012d000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc0000d3818 sp=0xc0000d3780 pc=0x4adb79
net.(*netFD).Read(0xc00011c000, {0xc00012d000?, 0xc0000d38e0?, 0x57d685?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc0000d3860 sp=0xc0000d3818 pc=0x68ada9
net.(*conn).Read(0xc000120000, {0xc00012d000?, 0xc026435820?, 0x1?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc0000d38a8 sp=0xc0000d3860 pc=0x69afe5
net.(*TCPConn).Read(0xc038b75400?, {0xc00012d000?, 0x57e4b6?, 0x104c5e0?})
:1 +0x29 fp=0xc0000d38d8 sp=0xc0000d38a8 pc=0x6ad849
bufio.(*Reader).Read(0xc00010e0c0, {0xc00014e001, 0x5ff, 0xc0000d3988?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:237 +0x1bb fp=0xc0000d3910 sp=0xc0000d38d8 pc=0x53af3b
github.com/couchbase/cbauth/revrpc.(*minirwc).Read(0x1?, {0xc00014e001?, 0x28?, 0x8?})
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:109 +0x25 fp=0xc0000d3940 sp=0xc0000d3910 pc=0x826945
encoding/json.(*Decoder).refill(0xc00014a000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0000d3990 sp=0xc0000d3940 pc=0x590488
encoding/json.(*Decoder).readValue(0xc00014a000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0000d39e0 sp=0xc0000d3990 pc=0x59007b
encoding/json.(*Decoder).Decode(0xc00014a000, {0x107d8c0, 0xc00010e260})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0000d3a10 sp=0xc0000d39e0 pc=0x58fcb8
net/rpc/jsonrpc.(*serverCodec).ReadRequestHeader(0xc00010e240, 0xc000110080)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/rpc/jsonrpc/server.go:66 +0x85 fp=0xc0000d3a50 sp=0xc0000d3a10 pc=0x825be5
github.com/couchbase/cbauth/revrpc.(*jsonServerCodec).ReadRequestHeader(0xc00012e040?, 0x415510?)
:1 +0x2a fp=0xc0000d3a70 sp=0xc0000d3a50 pc=0x828f6a
net/rpc.(*Server).readRequestHeader(0xc00012e040, {0x13c1b58, 0xc000112230})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/rpc/server.go:588 +0x66 fp=0xc0000d3b40 sp=0xc0000d3a70 pc=0x823de6
net/rpc.(*Server).readRequest(0x0?, {0x13c1b58, 0xc000112230})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/rpc/server.go:548 +0x3b fp=0xc0000d3c18 sp=0xc0000d3b40 pc=0x82393b
net/rpc.(*Server).ServeCodec(0xc00012e040, {0x13c1b58?, 0xc000112230})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/rpc/server.go:463 +0x87 fp=0xc0000d3d10 sp=0xc0000d3c18 pc=0x822e87
github.com/couchbase/cbauth/revrpc.(*Service).Run(0xc00006f760?, 0xc0000d3fa0)
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:244 +0x85f fp=0xc0000d3f38 sp=0xc0000d3d10 pc=0x82783f
github.com/couchbase/cbauth/revrpc.BabysitService(0x1cd0a60?, 0x0?, {0x13b6820?, 0xc000114000?})
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:343 +0x58 fp=0xc0000d3f70 sp=0xc0000d3f38 pc=0x827eb8
github.com/couchbase/cbauth.runRPCForSvc(0x0?, 0xc0001840d0)
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:58 +0xbd fp=0xc0000d3fc0 sp=0xc0000d3f70 pc=0x8342bd
github.com/couchbase/cbauth.startDefault.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:67 +0x25 fp=0xc0000d3fe0 sp=0xc0000d3fc0 pc=0x8345a5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000d3fe8 sp=0xc0000d3fe0 pc=0x475001
created by github.com/couchbase/cbauth.startDefault
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:66 +0xf9
goroutine 19 [select]:
runtime.gopark(0xc0000fbba0?, 0x3?, 0x4a?, 0x5a?, 0xc0000fbb1a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0000fb978 sp=0xc0000fb958 pc=0x441f16
runtime.selectgo(0xc0000fbba0, 0xc0000fbb14, 0xc078535e00?, 0x0, 0x4b?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0000fbab8 sp=0xc0000fb978 pc=0x4521be
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc00018c600?, {0x12233c1, 0x1b}, 0xc0000fbe68, 0xc00033e180)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:310 +0x429 fp=0xc0000fbe40 sp=0xc0000fbab8 pc=0xb04569
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:268
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x12233c1?, 0x0?}, 0x0?, 0x0?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:398 +0x58 fp=0xc0000fbe88 sp=0xc0000fbe40 pc=0xb04ab8
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0x0?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1626 +0xc7 fp=0xc0000fbf00 sp=0xc0000fbe88 pc=0xcfd727
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc0000fbfa0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc0000fbf38 sp=0xc0000fbf00 pc=0xc38f03
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1631 +0xdf fp=0xc0000fbfe0 sp=0xc0000fbf38 pc=0xcfd5df
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000fbfe8 sp=0xc0000fbfe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1619 +0xaf
goroutine 9 [chan receive, 47 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006fef8 sp=0xc00006fed8 pc=0x441f16
runtime.chanrecv(0xc0000988a0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc00006ff88 sp=0xc00006fef8 pc=0x40ed3d
runtime.chanrecv1(0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:442 +0x18 fp=0xc00006ffb0 sp=0xc00006ff88 pc=0x40e838
github.com/couchbase/regulator/utils/logging.duplicateFlushLoop()
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:253 +0x25 fp=0xc00006ffd0 sp=0xc00006ffb0 pc=0xb0fe85
github.com/couchbase/regulator/utils/logging.init.0.func1()
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:49 +0x25 fp=0xc00006ffe0 sp=0xc00006ffd0 pc=0xb128c5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006ffe8 sp=0xc00006ffe0 pc=0x475001
created by github.com/couchbase/regulator/utils/logging.init.0
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:49 +0x7e
goroutine 51 [select, 46 minutes]:
runtime.gopark(0xc000086f68?, 0x4?, 0x3?, 0x0?, 0xc000086db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000086c00 sp=0xc000086be0 pc=0x441f16
runtime.selectgo(0xc000086f68, 0xc000086da8, 0xc0003282c0?, 0x0, 0xc0000dfb01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000086d40 sp=0xc000086c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc0004066c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc000086fc8 sp=0xc000086d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 52 [select, 46 minutes]:
runtime.gopark(0xc000085f90?, 0x2?, 0xf8?, 0x5d?, 0xc000085f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000085db0 sp=0xc000085d90 pc=0x441f16
runtime.selectgo(0xc000085f90, 0xc000085f30, 0xc0003b2fc0?, 0x0, 0xc000404b40?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000085ef0 sp=0xc000085db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc0004066c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc000085fc8 sp=0xc000085ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 59 [GC worker (idle)]:
runtime.gopark(0x3465dd57dc2f?, 0x1?, 0x85?, 0x14?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000068f50 sp=0xc000068f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000068fe0 sp=0xc000068f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000068fe8 sp=0xc000068fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 41 [select]:
runtime.gopark(0xc0004bb798?, 0x2?, 0xf1?, 0xd2?, 0xc0004bb78c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004bb618 sp=0xc0004bb5f8 pc=0x441f16
runtime.selectgo(0xc0004bb798, 0xc0004bb788, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0004bb758 sp=0xc0004bb618 pc=0x4521be
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc00031c510)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2399 +0x92 fp=0xc0004bb7c8 sp=0xc0004bb758 pc=0xe5cc52
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2192 +0x26 fp=0xc0004bb7e0 sp=0xc0004bb7c8 pc=0xe5b626
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004bb7e8 sp=0xc0004bb7e0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2192 +0x296
goroutine 1017 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0x1f?, 0xb1?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052ce750 sp=0xc0052ce730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052ce7e0 sp=0xc0052ce750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052ce7e8 sp=0xc0052ce7e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 39 [IO wait]:
runtime.gopark(0xc000456200?, 0xb?, 0x0?, 0x0?, 0x8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0000d75b0 sp=0xc0000d7590 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0000d75e8 sp=0xc0000d75b0 pc=0x43a537
internal/poll.runtime_pollWait(0x7f9783e1ebf8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0000d7608 sp=0xc0000d75e8 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc000041b00?, 0xc000410000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0000d7630 sp=0xc0000d7608 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000041b00, {0xc000410000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc0000d76c8 sp=0xc0000d7630 pc=0x4adb79
net.(*netFD).Read(0xc000041b00, {0xc000410000?, 0xc008506500?, 0x40b045?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc0000d7710 sp=0xc0000d76c8 pc=0x68ada9
net.(*conn).Read(0xc0000149a0, {0xc000410000?, 0xc0000d77d8?, 0x58d80f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc0000d7758 sp=0xc0000d7710 pc=0x69afe5
net.(*TCPConn).Read(0xc0000d77f8?, {0xc000410000?, 0xc004ce22f8?, 0x13cdb00?})
:1 +0x29 fp=0xc0000d7788 sp=0xc0000d7758 pc=0x6ad849
net/http.(*persistConn).Read(0xc0004066c0, {0xc000410000?, 0xc0000d7840?, 0x57d27b?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1943 +0x4e fp=0xc0000d77e8 sp=0xc0000d7788 pc=0x7a320e
bufio.(*Reader).fill(0xc0000994a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:106 +0xff fp=0xc0000d7820 sp=0xc0000d77e8 pc=0x53a95f
bufio.(*Reader).ReadSlice(0xc0000994a0, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:372 +0x2f fp=0xc0000d7870 sp=0xc0000d7820 pc=0x53b54f
net/http/internal.readChunkLine(0xc004ce22d0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0000d78c0 sp=0xc0000d7870 pc=0x7400c5
net/http/internal.(*chunkedReader).beginChunk(0xc00031ca80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0000d78f0 sp=0xc0000d78c0 pc=0x73fb28
net/http/internal.(*chunkedReader).Read(0xc00031ca80, {0xc000024000?, 0x6?, 0x7?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc0000d7970 sp=0xc0000d78f0 pc=0x73fdf6
net/http.(*body).readLocked(0xc0003282c0, {0xc000024000?, 0x7f96c510d418?, 0x5?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:839 +0x3c fp=0xc0000d79c0 sp=0xc0000d7970 pc=0x79809c
net/http.(*body).Read(0x65?, {0xc000024000?, 0x0?, 0xc00294ba50?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:831 +0x125 fp=0xc0000d7a38 sp=0xc0000d79c0 pc=0x797f65
net/http.(*bodyEOFSignal).Read(0xc000328300, {0xc000024000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2792 +0x142 fp=0xc0000d7ab8 sp=0xc0000d7a38 pc=0x7a7902
bufio.(*Reader).fill(0xc0000d7e50)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:106 +0xff fp=0xc0000d7af0 sp=0xc0000d7ab8 pc=0x53a95f
bufio.(*Reader).ReadSlice(0xc0000d7e50, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:372 +0x2f fp=0xc0000d7b40 sp=0xc0000d7af0 pc=0x53b54f
bufio.(*Reader).collectFragments(0x1167680?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:447 +0x74 fp=0xc0000d7c00 sp=0xc0000d7b40 pc=0x53b994
bufio.(*Reader).ReadBytes(0xc00294a000?, 0x8b?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:474 +0x1d fp=0xc0000d7c80 sp=0xc0000d7c00 pc=0x53bbbd
github.com/couchbase/indexing/secondary/common.WatchClusterVersionChanges({0xc000049ad0, 0xe}, 0x9)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/dcp_seqno.go:1653 +0x5ec fp=0xc0000d7fb8 sp=0xc0000d7c80 pc=0xc2eccc
github.com/couchbase/indexing/secondary/queryport/client.watchClusterVer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:2045 +0x2f fp=0xc0000d7fe0 sp=0xc0000d7fb8 pc=0xe4a84f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000d7fe8 sp=0xc0000d7fe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.watchClusterVer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:2045 +0x8d
goroutine 66 [GC worker (idle)]:
runtime.gopark(0x3465e18591be?, 0x3?, 0x99?, 0xab?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004b6750 sp=0xc0004b6730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0004b67e0 sp=0xc0004b6750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004b67e8 sp=0xc0004b67e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 60 [GC worker (idle)]:
runtime.gopark(0x3465e1ab28c6?, 0x1?, 0x74?, 0x54?, 0xc0000ff100?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000068750 sp=0xc000068730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000687e0 sp=0xc000068750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 67 [GC worker (idle)]:
runtime.gopark(0x3465e374bbea?, 0x1?, 0x14?, 0x4?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004b6f50 sp=0xc0004b6f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0004b6fe0 sp=0xc0004b6f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004b6fe8 sp=0xc0004b6fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 71 [chan receive, 47 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004ba678 sp=0xc0004ba658 pc=0x441f16
runtime.chanrecv(0xc00010e600, 0xc0004ba790, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc0004ba708 sp=0xc0004ba678 pc=0x40ed3d
runtime.chanrecv2(0xc000116bb7?, 0x16?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:447 +0x18 fp=0xc0004ba730 sp=0xc0004ba708 pc=0x40e878
github.com/couchbase/goutils/systemeventlog.(*SystemEventLoggerImpl).logEvents(0xc0003aa070)
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:186 +0xb7 fp=0xc0004ba7c8 sp=0xc0004ba730 pc=0xcf8557
github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger.func1()
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x26 fp=0xc0004ba7e0 sp=0xc0004ba7c8 pc=0xcf7ee6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004ba7e8 sp=0xc0004ba7e0 pc=0x475001
created by github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x1d6
goroutine 64 [select]:
runtime.gopark(0xc0000d5d08?, 0x4?, 0x2?, 0x0?, 0xc0000d5c90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0000d5b08 sp=0xc0000d5ae8 pc=0x441f16
runtime.selectgo(0xc0000d5d08, 0xc0000d5c88, 0xc00392f130?, 0x0, 0xc006fcb301?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0000d5c48 sp=0xc0000d5b08 pc=0x4521be
github.com/couchbase/gometa/protocol.runWatcher(0xc0078a79c0, {0x13b9f70, 0xc0004480c0}, {0x13ca8b8?, 0xc0004480c0}, {0x13c8b20?, 0x1da4790}, 0xc000420150, 0xc00015b2c0, 0xc0004201c0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:357 +0x3be fp=0xc0000d5d60 sp=0xc0000d5c48 pc=0xdafffe
github.com/couchbase/gometa/protocol.runOnce(0x3, {0xc000117f50, 0xe}, {0x13b9f70, 0xc0004480c0}, {0x13ca8b8, 0xc0004480c0}, {0x13c8b20, 0x1da4790}, 0xc000420150, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:213 +0x525 fp=0xc0000d5e90 sp=0xc0000d5d60 pc=0xdaf0c5
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc000117f50, 0xe}, {0x13b9f70, 0xc0004480c0}, {0x13ca8b8, 0xc0004480c0}, {0x13c8b20, 0x1da4790}, 0xc000420150, 0xc00015b2c0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:65 +0x174 fp=0xc0000d5f68 sp=0xc0000d5e90 pc=0xdae9f4
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4454 +0x9f fp=0xc0000d5fe0 sp=0xc0000d5f68 pc=0xe1da3f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000d5fe8 sp=0xc0000d5fe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4454 +0x1f8
goroutine 3672 [select]:
runtime.gopark(0xc003af7f90?, 0x2?, 0x80?, 0x17?, 0xc003af7f4c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc003af7dc8 sp=0xc003af7da8 pc=0x441f16
runtime.selectgo(0xc003af7f90, 0xc003af7f48, 0xc06e8de420?, 0x0, 0x1000101050cf7d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc003af7f08 sp=0xc003af7dc8 pc=0x4521be
github.com/couchbase/gometa/protocol.(*Follower).startListener(0xc0001958f0)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:149 +0xe5 fp=0xc003af7fc8 sp=0xc003af7f08 pc=0xdad4e5
github.com/couchbase/gometa/protocol.(*Follower).Start.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x26 fp=0xc003af7fe0 sp=0xc003af7fc8 pc=0xdad0e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc003af7fe8 sp=0xc003af7fe0 pc=0x475001
created by github.com/couchbase/gometa/protocol.(*Follower).Start
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x56
goroutine 47 [select, 46 minutes]:
runtime.gopark(0xc00001ff90?, 0x2?, 0xf8?, 0xfd?, 0xc00001ff34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00001fdb0 sp=0xc00001fd90 pc=0x441f16
runtime.selectgo(0xc00001ff90, 0xc00001ff30, 0xc000328280?, 0x0, 0xc00048e960?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00001fef0 sp=0xc00001fdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc0000ce480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc00001ffc8 sp=0xc00001fef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc00001ffe0 sp=0xc00001ffc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00001ffe8 sp=0xc00001ffe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 72 [select, 45 minutes]:
runtime.gopark(0xc00034ff68?, 0x4?, 0x3?, 0x0?, 0xc00034fdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00034fc00 sp=0xc00034fbe0 pc=0x441f16
runtime.selectgo(0xc00034ff68, 0xc00034fda8, 0xc00539cac0?, 0x0, 0xc0004bad01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00034fd40 sp=0xc00034fc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc00013a5a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00034ffc8 sp=0xc00034fd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00034ffe0 sp=0xc00034ffc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00034ffe8 sp=0xc00034ffe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 46 [select, 46 minutes]:
runtime.gopark(0xc000351f68?, 0x4?, 0x3?, 0x0?, 0xc000351db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000351c00 sp=0xc000351be0 pc=0x441f16
runtime.selectgo(0xc000351f68, 0xc000351da8, 0xc00049a440?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000351d40 sp=0xc000351c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc0000ce480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc000351fc8 sp=0xc000351d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc000351fe0 sp=0xc000351fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000351fe8 sp=0xc000351fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 44 [select, 46 minutes]:
runtime.gopark(0xc00001df68?, 0x4?, 0x3?, 0x0?, 0xc00001ddb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00001dc00 sp=0xc00001dbe0 pc=0x441f16
runtime.selectgo(0xc00001df68, 0xc00001dda8, 0xc00012e400?, 0x0, 0xc00006ad01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00001dd40 sp=0xc00001dc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc000406360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00001dfc8 sp=0xc00001dd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00001dfe0 sp=0xc00001dfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00001dfe8 sp=0xc00001dfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 45 [select, 46 minutes]:
runtime.gopark(0xc00001ef90?, 0x2?, 0xf8?, 0xed?, 0xc00001ef34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00001edb0 sp=0xc00001ed90 pc=0x441f16
runtime.selectgo(0xc00001ef90, 0xc00001ef30, 0xc000328240?, 0x0, 0xc00031c990?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00001eef0 sp=0xc00001edb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc000406360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc00001efc8 sp=0xc00001eef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc00001efe0 sp=0xc00001efc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00001efe8 sp=0xc00001efe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 73 [select, 45 minutes]:
runtime.gopark(0xc000350f90?, 0x2?, 0xf8?, 0xd?, 0xc000350f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000350db0 sp=0xc000350d90 pc=0x441f16
runtime.selectgo(0xc000350f90, 0xc000350f30, 0xc0003b2200?, 0x0, 0xc006d82f60?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000350ef0 sp=0xc000350db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc00013a5a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc000350fc8 sp=0xc000350ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc000350fe0 sp=0xc000350fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000350fe8 sp=0xc000350fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 63 [IO wait]:
runtime.gopark(0x12054db?, 0xb?, 0x0?, 0x0?, 0xa?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0000819a0 sp=0xc000081980 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0000819d8 sp=0xc0000819a0 pc=0x43a537
internal/poll.runtime_pollWait(0x7f9783e1ece8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0000819f8 sp=0xc0000819d8 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc000040200?, 0xc000020000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc000081a20 sp=0xc0000819f8 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000040200, {0xc000020000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc000081ab8 sp=0xc000081a20 pc=0x4adb79
net.(*netFD).Read(0xc000040200, {0xc000020000?, 0x47cd16?, 0xc000081b40?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc000081b00 sp=0xc000081ab8 pc=0x68ada9
net.(*conn).Read(0xc000332088, {0xc000020000?, 0xc007bb271f?, 0x5?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc000081b48 sp=0xc000081b00 pc=0x69afe5
net.(*TCPConn).Read(0xc000136450?, {0xc000020000?, 0x0?, 0x120?})
:1 +0x29 fp=0xc000081b78 sp=0xc000081b48 pc=0x6ad849
net/http.(*persistConn).Read(0xc000406360, {0xc000020000?, 0xc0003ce140?, 0xc0004b9c18?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1943 +0x4e fp=0xc000081bd8 sp=0xc000081b78 pc=0x7a320e
bufio.(*Reader).fill(0xc00032e480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:106 +0xff fp=0xc000081c10 sp=0xc000081bd8 pc=0x53a95f
bufio.(*Reader).ReadSlice(0xc00032e480, 0xb?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:372 +0x2f fp=0xc000081c60 sp=0xc000081c10 pc=0x53b54f
net/http/internal.readChunkLine(0x114?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc000081cb0 sp=0xc000081c60 pc=0x7400c5
net/http/internal.(*chunkedReader).beginChunk(0xc000404e40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc000081ce0 sp=0xc000081cb0 pc=0x73fb28
net/http/internal.(*chunkedReader).Read(0xc000404e40, {0xc007bb2600?, 0xc00013c1b0?, 0xc007bacb40?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc000081d60 sp=0xc000081ce0 pc=0x73fdf6
net/http.(*body).readLocked(0xc00012e400, {0xc007bb2600?, 0xc0003a81d0?, 0x1126b40?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:839 +0x3c fp=0xc000081db0 sp=0xc000081d60 pc=0x79809c
net/http.(*body).Read(0x0?, {0xc007bb2600?, 0x57d33e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:831 +0x125 fp=0xc000081e28 sp=0xc000081db0 pc=0x797f65
net/http.(*bodyEOFSignal).Read(0xc00012e440, {0xc007bb2600, 0x600, 0x600})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2792 +0x142 fp=0xc000081ea8 sp=0xc000081e28 pc=0x7a7902
encoding/json.(*Decoder).refill(0xc0003a8140)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:165 +0x188 fp=0xc000081ef8 sp=0xc000081ea8 pc=0x590488
encoding/json.(*Decoder).readValue(0xc0003a8140)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:140 +0xbb fp=0xc000081f48 sp=0xc000081ef8 pc=0x59007b
encoding/json.(*Decoder).Decode(0xc0003a8140, {0x1017340, 0xc000136410})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:63 +0x78 fp=0xc000081f78 sp=0xc000081f48 pc=0x58fcb8
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:293 +0xc5 fp=0xc000081fe0 sp=0xc000081f78 pc=0xb049a5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x475001
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:289 +0x2eb
goroutine 168 [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x56?, 0x0?, 0xc00001ce50?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00001cda8 sp=0xc00001cd88 pc=0x441f16
runtime.chanrecv(0xc007c5a720, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc00001ce38 sp=0xc00001cda8 pc=0x40ed3d
runtime.chanrecv1(0xc00001cf48?, 0x56?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:442 +0x18 fp=0xc00001ce60 sp=0xc00001ce38 pc=0x40e838
github.com/couchbase/indexing/secondary/queryport/n1ql.(*monitor).backfillMonitor(0xc00032c2e0, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:91 +0x9b fp=0xc00001cfc0 sp=0xc00001ce60 pc=0xe8519b
github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:40 +0x2a fp=0xc00001cfe0 sp=0xc00001cfc0 pc=0xe84a4a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00001cfe8 sp=0xc00001cfe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:40 +0xb8
goroutine 3702 [select]:
runtime.gopark(0xc003af9f90?, 0x2?, 0x60?, 0x3e?, 0xc003af9f4c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc003af9dc8 sp=0xc003af9da8 pc=0x441f16
runtime.selectgo(0xc003af9f90, 0xc003af9f48, 0xc06eefeed0?, 0x0, 0x100010161746164?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc003af9f08 sp=0xc003af9dc8 pc=0x4521be
github.com/couchbase/gometa/protocol.(*Follower).startListener(0xc005187ea0)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:149 +0xe5 fp=0xc003af9fc8 sp=0xc003af9f08 pc=0xdad4e5
github.com/couchbase/gometa/protocol.(*Follower).Start.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x26 fp=0xc003af9fe0 sp=0xc003af9fc8 pc=0xdad0e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc003af9fe8 sp=0xc003af9fe0 pc=0x475001
created by github.com/couchbase/gometa/protocol.(*Follower).Start
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x56
goroutine 6179 [select, 28 minutes]:
runtime.gopark(0xc005506f90?, 0x2?, 0xf8?, 0x6d?, 0xc005506f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc005506db0 sp=0xc005506d90 pc=0x441f16
runtime.selectgo(0xc005506f90, 0xc005506f30, 0xc028936880?, 0x0, 0xc028950f30?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc005506ef0 sp=0xc005506db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc005506fc8 sp=0xc005506ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc005506fe0 sp=0xc005506fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc005506fe8 sp=0xc005506fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 77 [select]:
runtime.gopark(0xc000348790?, 0x2?, 0xfd?, 0xf2?, 0xc000348774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0003485f8 sp=0xc0003485d8 pc=0x441f16
runtime.selectgo(0xc000348790, 0xc000348770, 0x0?, 0x0, 0x7a5f00?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000348738 sp=0xc0003485f8 pc=0x4521be
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc0004480c0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6640 +0xcd fp=0xc0003487c8 sp=0xc000348738 pc=0xe2bc2d
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6631 +0x26 fp=0xc0003487e0 sp=0xc0003487c8 pc=0xe2bb26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0003487e8 sp=0xc0003487e0 pc=0x475001
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6631 +0x8d
goroutine 23 [chan send, 46 minutes]:
runtime.gopark(0xc35a08?, 0xc0077e2000?, 0xbc?, 0x19?, 0x124fb37?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0078b6d60 sp=0xc0078b6d40 pc=0x441f16
runtime.chansend(0xc000056c00, 0x13ad030, 0x1, 0xc000631d01?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:259 +0x42e fp=0xc0078b6de8 sp=0xc0078b6d60 pc=0x40df2e
runtime.chansend1(0xc0000469c0?, 0x2c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:145 +0x1d fp=0xc0078b6e18 sp=0xc0078b6de8 pc=0x40dadd
github.com/couchbase/indexing/secondary/common.(*internalVersionMonitor).notifier(0xc0000ea150)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:745 +0x465 fp=0xc0078b6fc8 sp=0xc0078b6e18 pc=0xc36165
github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:238 +0x26 fp=0xc0078b6fe0 sp=0xc0078b6fc8 pc=0xc31686
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0078b6fe8 sp=0xc0078b6fe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:238 +0x3e5
goroutine 100 [chan receive]:
runtime.gopark(0xc00041cb40?, 0xc00033ec58?, 0x40?, 0xeb?, 0xc00033eb40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00034cec8 sp=0xc00034cea8 pc=0x441f16
runtime.chanrecv(0xc00041cae0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc00034cf58 sp=0xc00034cec8 pc=0x40ed3d
runtime.chanrecv1(0xc0004920b0?, 0x1208f1d?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:442 +0x18 fp=0xc00034cf80 sp=0xc00034cf58 pc=0x40e838
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc0004920b0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1415 +0x79 fp=0xc00034cfc8 sp=0xc00034cf80 pc=0xe559d9
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x26 fp=0xc00034cfe0 sp=0xc00034cfc8 pc=0xe4e466
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00034cfe8 sp=0xc00034cfe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x616
goroutine 1021 [GC worker (idle)]:
runtime.gopark(0x3465e1c13a17?, 0x3?, 0x9b?, 0x23?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052d0750 sp=0xc0052d0730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052d07e0 sp=0xc0052d0750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052d07e8 sp=0xc0052d07e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1020 [GC worker (idle)]:
runtime.gopark(0x3465dd0729f2?, 0x3?, 0x19?, 0x5e?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052cff50 sp=0xc0052cff30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052cffe0 sp=0xc0052cff50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052cffe8 sp=0xc0052cffe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6200 [select, 28 minutes]:
runtime.gopark(0xc007c06f90?, 0x2?, 0xf8?, 0x6d?, 0xc007c06f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c06db0 sp=0xc007c06d90 pc=0x441f16
runtime.selectgo(0xc007c06f90, 0xc007c06f30, 0xc02879d2c0?, 0x0, 0xc0289a0db0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c06ef0 sp=0xc007c06db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888ad80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc007c06fc8 sp=0xc007c06ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc007c06fe0 sp=0xc007c06fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c06fe8 sp=0xc007c06fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1019 [GC worker (idle)]:
runtime.gopark(0x3465e37506c1?, 0x1?, 0x2c?, 0x5e?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052cf750 sp=0xc0052cf730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052cf7e0 sp=0xc0052cf750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052cf7e8 sp=0xc0052cf7e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1042 [GC worker (idle)]:
runtime.gopark(0x3465e1856e6d?, 0x3?, 0x4e?, 0x69?, 0x415a00?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052d1f50 sp=0xc0052d1f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052d1fe0 sp=0xc0052d1f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052d1fe8 sp=0xc0052d1fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1018 [GC worker (idle)]:
runtime.gopark(0x3465e348d3c0?, 0x1?, 0xd4?, 0xed?, 0x1?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052cef50 sp=0xc0052cef30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052cefe0 sp=0xc0052cef50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052cefe8 sp=0xc0052cefe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 162 [select, 45 minutes]:
runtime.gopark(0xc00034bf68?, 0x4?, 0x3?, 0x0?, 0xc00034bdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00034bc00 sp=0xc00034bbe0 pc=0x441f16
runtime.selectgo(0xc00034bf68, 0xc00034bda8, 0xc00a1e0100?, 0x0, 0xc0004b9d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00034bd40 sp=0xc00034bc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc00803a6c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00034bfc8 sp=0xc00034bd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00034bfe0 sp=0xc00034bfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00034bfe8 sp=0xc00034bfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 972 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xd7?, 0x30?, 0xc000346fd0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000346f50 sp=0xc000346f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000346fe0 sp=0xc000346f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000346fe8 sp=0xc000346fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6158 [select, 28 minutes]:
runtime.gopark(0xc00034df68?, 0x4?, 0x3?, 0x0?, 0xc00034ddb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00034dc00 sp=0xc00034dbe0 pc=0x441f16
runtime.selectgo(0xc00034df68, 0xc00034dda8, 0xc028201240?, 0x0, 0xc0404c9901?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00034dd40 sp=0xc00034dc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00034dfc8 sp=0xc00034dd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00034dfe0 sp=0xc00034dfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00034dfe8 sp=0xc00034dfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 973 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0x42?, 0xd3?, 0xc005359b01?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000342750 sp=0xc000342730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0003427e0 sp=0xc000342750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0003427e8 sp=0xc0003427e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 164 [select]:
runtime.gopark(0xc0078b7f90?, 0x2?, 0x0?, 0x0?, 0xc0078b7f8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0078b7e18 sp=0xc0078b7df8 pc=0x441f16
runtime.selectgo(0xc0078b7f90, 0xc0078b7f88, 0x3235373132302e31?, 0x0, 0x6564757469676e6f?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0078b7f58 sp=0xc0078b7e18 pc=0x4521be
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc0053a2a80, 0xc0004a0380)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1830 +0x6e fp=0xc0078b7fc0 sp=0xc0078b7f58 pc=0xe496ee
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x2a fp=0xc0078b7fe0 sp=0xc0078b7fc0 pc=0xe4964a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0078b7fe8 sp=0xc0078b7fe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x298
goroutine 117 [select]:
runtime.gopark(0xc000311ba0?, 0x3?, 0x4a?, 0x5a?, 0xc000311b1a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000311978 sp=0xc000311958 pc=0x441f16
runtime.selectgo(0xc000311ba0, 0xc000311b14, 0xc075cfef50?, 0x0, 0x4b?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000311ab8 sp=0xc000311978 pc=0x4521be
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc00018c600?, {0x12233c1, 0x1b}, 0xc000311e68, 0xc008044360)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:310 +0x429 fp=0xc000311e40 sp=0xc000311ab8 pc=0xb04569
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:268
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x12233c1?, 0xffffffffffffffff?}, 0xffffffffffffffff?, 0x7300630000441f16?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:398 +0x58 fp=0xc000311e88 sp=0xc000311e40 pc=0xb04ab8
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0xc007a702a0?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1626 +0xc7 fp=0xc000311f00 sp=0xc000311e88 pc=0xcfd727
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc000311fa0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc000311f38 sp=0xc000311f00 pc=0xc38f03
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1631 +0xdf fp=0xc000311fe0 sp=0xc000311f38 pc=0xcfd5df
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000311fe8 sp=0xc000311fe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1619 +0xaf
goroutine 974 [GC worker (idle)]:
runtime.gopark(0x3465dd3a9f7a?, 0x1?, 0x15?, 0x1d?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000342f50 sp=0xc000342f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000342fe0 sp=0xc000342f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000342fe8 sp=0xc000342fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 107 [sleep]:
runtime.gopark(0x34681ff968d2?, 0xc0004baf18?, 0x85?, 0xf2?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004baee8 sp=0xc0004baec8 pc=0x441f16
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/time.go:195 +0x135 fp=0xc0004baf28 sp=0xc0004baee8 pc=0x471e75
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc0000c44d0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:461 +0xa5 fp=0xc0004bafc8 sp=0xc0004baf28 pc=0xe4db85
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc0004bafe0 sp=0xc0004bafc8 pc=0xe4ade6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004bafe8 sp=0xc0004bafe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x4b6
goroutine 109 [select]:
runtime.gopark(0xc00001bf90?, 0x2?, 0x0?, 0x0?, 0xc00001bf8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00001be18 sp=0xc00001bdf8 pc=0x441f16
runtime.selectgo(0xc00001bf90, 0xc00001bf88, 0x415a00?, 0x0, 0x13c19d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00001bf58 sp=0xc00001be18 pc=0x4521be
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc00011c480, 0xc00032a460)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1830 +0x6e fp=0xc00001bfc0 sp=0xc00001bf58 pc=0xe496ee
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x2a fp=0xc00001bfe0 sp=0xc00001bfc0 pc=0xe4964a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00001bfe8 sp=0xc00001bfe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x298
goroutine 110 [select]:
runtime.gopark(0xc0004bd750?, 0x2?, 0x0?, 0x0?, 0xc0004bd714?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004bd590 sp=0xc0004bd570 pc=0x441f16
runtime.selectgo(0xc0004bd750, 0xc0004bd710, 0x122761d?, 0x0, 0xc0004bd720?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0004bd6d0 sp=0xc0004bd590 pc=0x4521be
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc00011c480, 0xc00032a460)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1849 +0x238 fp=0xc0004bd7c0 sp=0xc0004bd6d0 pc=0xe49958
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2a fp=0xc0004bd7e0 sp=0xc0004bd7c0 pc=0xe495ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004bd7e8 sp=0xc0004bd7e0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2fa
goroutine 169 [chan receive]:
runtime.gopark(0xc00032e660?, 0x4219b1?, 0xc0?, 0x5a?, 0xc0004b85e8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004b8568 sp=0xc0004b8548 pc=0x441f16
runtime.chanrecv(0xc007c5a780, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc0004b85f8 sp=0xc0004b8568 pc=0x40ed3d
runtime.chanrecv1(0xc0004b86b8?, 0x7?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:442 +0x18 fp=0xc0004b8620 sp=0xc0004b85f8 pc=0x40e838
github.com/couchbase/indexing/secondary/queryport/n1ql.(*monitor).logStats(0xc00032c2e0, 0xc0001840d0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:124 +0x9b fp=0xc0004b87c0 sp=0xc0004b8620 pc=0xe8555b
github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:41 +0x2a fp=0xc0004b87e0 sp=0xc0004b87c0 pc=0xe849ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004b87e8 sp=0xc0004b87e0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:41 +0x10a
goroutine 165 [select]:
runtime.gopark(0xc000346750?, 0x2?, 0xa0?, 0x66?, 0xc000346714?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000346590 sp=0xc000346570 pc=0x441f16
runtime.selectgo(0xc000346750, 0xc000346710, 0x122761d?, 0x0, 0xc000346720?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0003466d0 sp=0xc000346590 pc=0x4521be
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc0053a2a80, 0xc0004a0380)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1849 +0x238 fp=0xc0003467c0 sp=0xc0003466d0 pc=0xe49958
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2a fp=0xc0003467e0 sp=0xc0003467c0 pc=0xe495ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0003467e8 sp=0xc0003467e0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2fa
goroutine 151 [select, 41 minutes]:
runtime.gopark(0xc00b667bc0?, 0x3?, 0x0?, 0x0?, 0xc00b667b3a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004c1998 sp=0xc0004c1978 pc=0x441f16
runtime.selectgo(0xc0004c1bc0, 0xc00b667b34, 0xc009033000?, 0x0, 0xf12?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0004c1ad8 sp=0xc0004c1998 pc=0x4521be
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc00018c600?, {0x12178a7, 0x13}, 0xc0004c1e88, 0xc007a700c0)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:310 +0x429 fp=0xc0004c1e60 sp=0xc0004c1ad8 pc=0xb04569
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:268
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x12178a7?, 0x13ad9a0?}, 0x1?, 0x13b0f30?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:398 +0x58 fp=0xc0004c1ea8 sp=0xc0004c1e60 pc=0xb04ab8
github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings.func1.1(0xc0004bbf60?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:89 +0xcc fp=0xc0004c1f28 sp=0xc0004c1ea8 pc=0xe772ac
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc0004c1fa8)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc0004c1f60 sp=0xc0004c1f28 pc=0xc38f03
github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:93 +0x75 fp=0xc0004c1fe0 sp=0xc0004c1f60 pc=0xe77195
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004c1fe8 sp=0xc0004c1fe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:84 +0x1cf
goroutine 163 [select, 45 minutes]:
runtime.gopark(0xc0078b9f90?, 0x2?, 0xf8?, 0x9d?, 0xc0078b9f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0078b9db0 sp=0xc0078b9d90 pc=0x441f16
runtime.selectgo(0xc0078b9f90, 0xc0078b9f30, 0xc007c5c000?, 0x0, 0xc007c58060?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0078b9ef0 sp=0xc0078b9db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc00803a6c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0078b9fc8 sp=0xc0078b9ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0078b9fe0 sp=0xc0078b9fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0078b9fe8 sp=0xc0078b9fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 152 [select]:
runtime.gopark(0xc00006b798?, 0x2?, 0xf1?, 0xd2?, 0xc00006b78c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006b618 sp=0xc00006b5f8 pc=0x441f16
runtime.selectgo(0xc00006b798, 0xc00006b788, 0xc00006b7d0?, 0x0, 0xc0003a9b80?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00006b758 sp=0xc00006b618 pc=0x4521be
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc0053a6900)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2399 +0x92 fp=0xc00006b7c8 sp=0xc00006b758 pc=0xe5cc52
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2192 +0x26 fp=0xc00006b7e0 sp=0xc00006b7c8 pc=0xe5b626
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006b7e8 sp=0xc00006b7e0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2192 +0x296
goroutine 153 [IO wait, 41 minutes]:
runtime.gopark(0x0?, 0xb?, 0x0?, 0x0?, 0x7?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0003779a0 sp=0xc000377980 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0003779d8 sp=0xc0003779a0 pc=0x43a537
internal/poll.runtime_pollWait(0x7f9783e1edd8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0003779f8 sp=0xc0003779d8 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc00011c380?, 0xc00012a000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc000377a20 sp=0xc0003779f8 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00011c380, {0xc00012a000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc000377ab8 sp=0xc000377a20 pc=0x4adb79
net.(*netFD).Read(0xc00011c380, {0xc00012a000?, 0x47cd16?, 0xc000377b40?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc000377b00 sp=0xc000377ab8 pc=0x68ada9
net.(*conn).Read(0xc000126000, {0xc00012a000?, 0xc004df74f4?, 0x5?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc000377b48 sp=0xc000377b00 pc=0x69afe5
net.(*TCPConn).Read(0xc0004d24f0?, {0xc00012a000?, 0x0?, 0x14f5?})
:1 +0x29 fp=0xc000377b78 sp=0xc000377b48 pc=0x6ad849
net/http.(*persistConn).Read(0xc00013a5a0, {0xc00012a000?, 0x4357f0?, 0x472e2e?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1943 +0x4e fp=0xc000377bd8 sp=0xc000377b78 pc=0x7a320e
bufio.(*Reader).fill(0xc00041c060)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:106 +0xff fp=0xc000377c10 sp=0xc000377bd8 pc=0x53a95f
bufio.(*Reader).ReadSlice(0xc00041c060, 0xb?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:372 +0x2f fp=0xc000377c60 sp=0xc000377c10 pc=0x53b54f
net/http/internal.readChunkLine(0x14e9?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc000377cb0 sp=0xc000377c60 pc=0x7400c5
net/http/internal.(*chunkedReader).beginChunk(0xc0053a6c90)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc000377ce0 sp=0xc000377cb0 pc=0x73fb28
net/http/internal.(*chunkedReader).Read(0xc0053a6c90, {0xc004df6000?, 0xc00013c1b0?, 0xc006d835f0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc000377d60 sp=0xc000377ce0 pc=0x73fdf6
net/http.(*body).readLocked(0xc00539cac0, {0xc004df6000?, 0xc005393210?, 0x1126b40?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:839 +0x3c fp=0xc000377db0 sp=0xc000377d60 pc=0x79809c
net/http.(*body).Read(0x0?, {0xc004df6000?, 0x57d33e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:831 +0x125 fp=0xc000377e28 sp=0xc000377db0 pc=0x797f65
net/http.(*bodyEOFSignal).Read(0xc00539cb00, {0xc004df6000, 0x1e00, 0x1e00})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2792 +0x142 fp=0xc000377ea8 sp=0xc000377e28 pc=0x7a7902
encoding/json.(*Decoder).refill(0xc005393180)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:165 +0x188 fp=0xc000377ef8 sp=0xc000377ea8 pc=0x590488
encoding/json.(*Decoder).readValue(0xc005393180)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:140 +0xbb fp=0xc000377f48 sp=0xc000377ef8 pc=0x59007b
encoding/json.(*Decoder).Decode(0xc005393180, {0x1017340, 0xc0004d24b0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:63 +0x78 fp=0xc000377f78 sp=0xc000377f48 pc=0x58fcb8
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:293 +0xc5 fp=0xc000377fe0 sp=0xc000377f78 pc=0xb049a5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000377fe8 sp=0xc000377fe0 pc=0x475001
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:289 +0x2eb
goroutine 142 [IO wait]:
runtime.gopark(0x203a22726f6c6f43?, 0xb?, 0x0?, 0x0?, 0x11?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0078b49a0 sp=0xc0078b4980 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0078b49d8 sp=0xc0078b49a0 pc=0x43a537
internal/poll.runtime_pollWait(0x7f9783e1e478, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0078b49f8 sp=0xc0078b49d8 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc004d9b600?, 0xc00012c000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0078b4a20 sp=0xc0078b49f8 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc004d9b600, {0xc00012c000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc0078b4ab8 sp=0xc0078b4a20 pc=0x4adb79
net.(*netFD).Read(0xc004d9b600, {0xc00012c000?, 0x47cd16?, 0xc0078b4b40?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc0078b4b00 sp=0xc0078b4ab8 pc=0x68ada9
net.(*conn).Read(0xc000126010, {0xc00012c000?, 0xc007b0c11f?, 0x5?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc0078b4b48 sp=0xc0078b4b00 pc=0x69afe5
net.(*TCPConn).Read(0xc00040e1d0?, {0xc00012c000?, 0x0?, 0x120?})
:1 +0x29 fp=0xc0078b4b78 sp=0xc0078b4b48 pc=0x6ad849
net/http.(*persistConn).Read(0xc00803a6c0, {0xc00012c000?, 0x0?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1943 +0x4e fp=0xc0078b4bd8 sp=0xc0078b4b78 pc=0x7a320e
bufio.(*Reader).fill(0xc007c5a000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:106 +0xff fp=0xc0078b4c10 sp=0xc0078b4bd8 pc=0x53a95f
bufio.(*Reader).ReadSlice(0xc007c5a000, 0xb?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:372 +0x2f fp=0xc0078b4c60 sp=0xc0078b4c10 pc=0x53b54f
net/http/internal.readChunkLine(0x114?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0078b4cb0 sp=0xc0078b4c60 pc=0x7400c5
net/http/internal.(*chunkedReader).beginChunk(0xc00a1da240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0078b4ce0 sp=0xc0078b4cb0 pc=0x73fb28
net/http/internal.(*chunkedReader).Read(0xc00a1da240, {0xc007b0c000?, 0xc00013c1b0?, 0xc00a1dadb0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc0078b4d60 sp=0xc0078b4ce0 pc=0x73fdf6
net/http.(*body).readLocked(0xc00a1e0100, {0xc007b0c000?, 0xc00a1ea1d0?, 0x1126b40?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:839 +0x3c fp=0xc0078b4db0 sp=0xc0078b4d60 pc=0x79809c
net/http.(*body).Read(0x0?, {0xc007b0c000?, 0x57d33e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:831 +0x125 fp=0xc0078b4e28 sp=0xc0078b4db0 pc=0x797f65
net/http.(*bodyEOFSignal).Read(0xc00a1e0140, {0xc007b0c000, 0x600, 0x600})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2792 +0x142 fp=0xc0078b4ea8 sp=0xc0078b4e28 pc=0x7a7902
encoding/json.(*Decoder).refill(0xc00a1ea140)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0078b4ef8 sp=0xc0078b4ea8 pc=0x590488
encoding/json.(*Decoder).readValue(0xc00a1ea140)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0078b4f48 sp=0xc0078b4ef8 pc=0x59007b
encoding/json.(*Decoder).Decode(0xc00a1ea140, {0x1017340, 0xc00040e190})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0078b4f78 sp=0xc0078b4f48 pc=0x58fcb8
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:293 +0xc5 fp=0xc0078b4fe0 sp=0xc0078b4f78 pc=0xb049a5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0078b4fe8 sp=0xc0078b4fe0 pc=0x475001
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:289 +0x2eb
goroutine 129 [select]:
runtime.gopark(0xc0004bbf90?, 0x2?, 0xfd?, 0xf2?, 0xc0004bbf74?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004bbdf8 sp=0xc0004bbdd8 pc=0x441f16
runtime.selectgo(0xc0004bbf90, 0xc0004bbf70, 0xc0004bbfb0?, 0x0, 0xc007906168?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0004bbf38 sp=0xc0004bbdf8 pc=0x4521be
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc008038240)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6640 +0xcd fp=0xc0004bbfc8 sp=0xc0004bbf38 pc=0xe2bc2d
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6631 +0x26 fp=0xc0004bbfe0 sp=0xc0004bbfc8 pc=0xe2bb26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004bbfe8 sp=0xc0004bbfe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6631 +0x8d
goroutine 1162 [select, 39 minutes]:
runtime.gopark(0xc000373f68?, 0x4?, 0x3?, 0x0?, 0xc000373db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000373c00 sp=0xc000373be0 pc=0x441f16
runtime.selectgo(0xc000373f68, 0xc000373da8, 0xc002213200?, 0x0, 0xc002e07701?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000373d40 sp=0xc000373c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc006a69320)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc000373fc8 sp=0xc000373d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc000373fe0 sp=0xc000373fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000373fe8 sp=0xc000373fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 154 [select, 35 minutes]:
runtime.gopark(0xc00030fd08?, 0x4?, 0x5?, 0x0?, 0xc00030fc90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00030fb08 sp=0xc00030fae8 pc=0x441f16
runtime.selectgo(0xc00030fd08, 0xc00030fc88, 0xc00030fc70?, 0x0, 0xc0073f0e01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00030fc48 sp=0xc00030fb08 pc=0x4521be
github.com/couchbase/gometa/protocol.runWatcher(0xc00834b140, {0x13b9f70, 0xc008038240}, {0x13ca8b8?, 0xc008038240}, {0x13c8b20?, 0x1da4790}, 0xc0004a0690, 0xc008044d20, 0xc0004a0700, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:357 +0x3be fp=0xc00030fd60 sp=0xc00030fc48 pc=0xdafffe
github.com/couchbase/gometa/protocol.runOnce(0x3, {0xc007c35ab0, 0xe}, {0x13b9f70, 0xc008038240}, {0x13ca8b8, 0xc008038240}, {0x13c8b20, 0x1da4790}, 0xc0004a0690, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:213 +0x525 fp=0xc00030fe90 sp=0xc00030fd60 pc=0xdaf0c5
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc007c35ab0, 0xe}, {0x13b9f70, 0xc008038240}, {0x13ca8b8, 0xc008038240}, {0x13c8b20, 0x1da4790}, 0xc0004a0690, 0xc008044d20, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:65 +0x174 fp=0xc00030ff68 sp=0xc00030fe90 pc=0xdae9f4
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4454 +0x9f fp=0xc00030ffe0 sp=0xc00030ff68 pc=0xe1da3f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00030ffe8 sp=0xc00030ffe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4454 +0x1f8
goroutine 179 [chan receive]:
runtime.gopark(0xc00032f440?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00562dec8 sp=0xc00562dea8 pc=0x441f16
runtime.chanrecv(0xc005359b60, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc00562df58 sp=0xc00562dec8 pc=0x40ed3d
runtime.chanrecv1(0xc00077e420?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:442 +0x18 fp=0xc00562df80 sp=0xc00562df58 pc=0x40e838
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc00077e420)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1415 +0x79 fp=0xc00562dfc8 sp=0xc00562df80 pc=0xe559d9
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x26 fp=0xc00562dfe0 sp=0xc00562dfc8 pc=0xe4e466
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00562dfe8 sp=0xc00562dfe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x616
goroutine 157 [sleep]:
runtime.gopark(0x34681ff90b7a?, 0xc000069f18?, 0x85?, 0xf2?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000069ee8 sp=0xc000069ec8 pc=0x441f16
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/time.go:195 +0x135 fp=0xc000069f28 sp=0xc000069ee8 pc=0x471e75
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc00041b130)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:461 +0xa5 fp=0xc000069fc8 sp=0xc000069f28 pc=0xe4db85
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc000069fe0 sp=0xc000069fc8 pc=0xe4ade6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x4b6
goroutine 6177 [select, 28 minutes]:
runtime.gopark(0xc028c86f68?, 0x4?, 0x25?, 0xc9?, 0xc028c86db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028c86c00 sp=0xc028c86be0 pc=0x441f16
runtime.selectgo(0xc028c86f68, 0xc028c86da8, 0xc028a60c40?, 0x0, 0xc02bf09801?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028c86d40 sp=0xc028c86c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc00d6edd40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028c86fc8 sp=0xc028c86d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028c86fe0 sp=0xc028c86fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028c86fe8 sp=0xc028c86fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1060 [GC worker (idle)]:
runtime.gopark(0x3465e1aad278?, 0x1?, 0x3e?, 0x36?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d9f50 sp=0xc00b9d9f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d9fe0 sp=0xc00b9d9f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d9fe8 sp=0xc00b9d9fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1056 [GC worker (idle)]:
runtime.gopark(0x3465dd183116?, 0x3?, 0x37?, 0xe1?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d7750 sp=0xc00b9d7730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d77e0 sp=0xc00b9d7750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d77e8 sp=0xc00b9d77e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1127 [sleep]:
runtime.gopark(0x346758bcbd06?, 0x294351aee2b?, 0x20?, 0x8c?, 0xc12c1cde73ac2cd4?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004c3e60 sp=0xc0004c3e40 pc=0x441f16
time.Sleep(0x12a05d12d)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/time.go:195 +0x135 fp=0xc0004c3ea0 sp=0xc0004c3e60 pc=0x471e75
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc000477080, {0xc0067ce070, 0xf})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc0004c3f00 sp=0xc0004c3ea0 pc=0xcc3c37
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc0067ce070?, 0xc0000d9f01?})
:1 +0x34 fp=0xc0004c3f28 sp=0xc0004c3f00 pc=0xcdb6b4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc0004c3f48 sp=0xc0004c3f28 pc=0xcca545
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc00ba54bc0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc0004c3fc8 sp=0xc0004c3f48 pc=0xccf73b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0004c3fe0 sp=0xc0004c3fc8 pc=0xccdc06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004c3fe8 sp=0xc0004c3fe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 6234 [select, 28 minutes]:
runtime.gopark(0xc007c32f90?, 0x2?, 0xf8?, 0x2d?, 0xc007c32f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c32db0 sp=0xc007c32d90 pc=0x441f16
runtime.selectgo(0xc007c32f90, 0xc007c32f30, 0xc02879d8c0?, 0x0, 0xc0289a1a70?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c32ef0 sp=0xc007c32db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b320)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc007c32fc8 sp=0xc007c32ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc007c32fe0 sp=0xc007c32fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c32fe8 sp=0xc007c32fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1108 [IO wait, 39 minutes]:
runtime.gopark(0x90?, 0xb?, 0x0?, 0x0?, 0x23?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000375ab0 sp=0xc000375a90 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc000375ae8 sp=0xc000375ab0 pc=0x43a537
internal/poll.runtime_pollWait(0x7f97582c9fc8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc000375b08 sp=0xc000375ae8 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc00ba91f00?, 0xc004b96000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc000375b30 sp=0xc000375b08 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00ba91f00, {0xc004b96000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc000375bc8 sp=0xc000375b30 pc=0x4adb79
net.(*netFD).Read(0xc00ba91f00, {0xc004b96000?, 0x441fc7?, 0xc000375c30?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc000375c10 sp=0xc000375bc8 pc=0x68ada9
net.(*conn).Read(0xc000126438, {0xc004b96000?, 0x0?, 0xc0080276c0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc000375c58 sp=0xc000375c10 pc=0x69afe5
net.(*TCPConn).Read(0xc005f5b110?, {0xc004b96000?, 0xc0099aa948?, 0x11?})
:1 +0x29 fp=0xc000375c88 sp=0xc000375c58 pc=0x6ad849
net/http.(*persistConn).Read(0xc006a39b00, {0xc004b96000?, 0xc007bb0cc0?, 0xc000375d30?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1943 +0x4e fp=0xc000375ce8 sp=0xc000375c88 pc=0x7a320e
bufio.(*Reader).fill(0xc00b659f20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:106 +0xff fp=0xc000375d20 sp=0xc000375ce8 pc=0x53a95f
bufio.(*Reader).Peek(0xc00b659f20, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:144 +0x5d fp=0xc000375d40 sp=0xc000375d20 pc=0x53aabd
net/http.(*persistConn).readLoop(0xc006a39b00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2107 +0x1ac fp=0xc000375fc8 sp=0xc000375d40 pc=0x7a402c
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc000375fe0 sp=0xc000375fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000375fe8 sp=0xc000375fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1064 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xb?, 0x86?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9dbf50 sp=0xc00b9dbf30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9dbfe0 sp=0xc00b9dbf50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9dbfe8 sp=0xc00b9dbfe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6274 [select, 28 minutes]:
runtime.gopark(0xc028ad9f90?, 0x2?, 0xf8?, 0x9d?, 0xc028ad9f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028ad9db0 sp=0xc028ad9d90 pc=0x441f16
runtime.selectgo(0xc028ad9f90, 0xc028ad9f30, 0xc028201e00?, 0x0, 0xc02863dcb0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028ad9ef0 sp=0xc028ad9db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816f320)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028ad9fc8 sp=0xc028ad9ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028ad9fe0 sp=0xc028ad9fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028ad9fe8 sp=0xc028ad9fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1055 [GC worker (idle)]:
runtime.gopark(0x3465e35cf0d5?, 0x1?, 0x3c?, 0xb9?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d6f50 sp=0xc00b9d6f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d6fe0 sp=0xc00b9d6f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d6fe8 sp=0xc00b9d6fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6293 [select, 28 minutes]:
runtime.gopark(0xc028bbbf90?, 0x2?, 0xf8?, 0xbd?, 0xc028bbbf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028bbbdb0 sp=0xc028bbbd90 pc=0x441f16
runtime.selectgo(0xc028bbbf90, 0xc028bbbf30, 0xc02879dc40?, 0x0, 0xc028b32180?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028bbbef0 sp=0xc028bbbdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18d80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028bbbfc8 sp=0xc028bbbef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028bbbfe0 sp=0xc028bbbfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028bbbfe8 sp=0xc028bbbfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1166 [select, 39 minutes]:
runtime.gopark(0xc008800f68?, 0x4?, 0x3?, 0x0?, 0xc008800db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008800c00 sp=0xc008800be0 pc=0x441f16
runtime.selectgo(0xc008800f68, 0xc008800da8, 0xc002213c00?, 0x0, 0xc0004bdd01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008800d40 sp=0xc008800c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc006a69440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc008800fc8 sp=0xc008800d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc008800fe0 sp=0xc008800fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008800fe8 sp=0xc008800fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1065 [GC worker (idle)]:
runtime.gopark(0x3465dd18955f?, 0x3?, 0x69?, 0x24?, 0xc0050ec480?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052cc750 sp=0xc0052cc730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052cc7e0 sp=0xc0052cc750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052cc7e8 sp=0xc0052cc7e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6159 [select, 28 minutes]:
runtime.gopark(0xc00034af90?, 0x2?, 0xf8?, 0xad?, 0xc00034af34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00034adb0 sp=0xc00034ad90 pc=0x441f16
runtime.selectgo(0xc00034af90, 0xc00034af30, 0xc028936740?, 0x0, 0xc028950c60?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00034aef0 sp=0xc00034adb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc00034afc8 sp=0xc00034aef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc00034afe0 sp=0xc00034afc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00034afe8 sp=0xc00034afe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1057 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xe6?, 0x86?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d7f50 sp=0xc00b9d7f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d7fe0 sp=0xc00b9d7f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d7fe8 sp=0xc00b9d7fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1054 [GC worker (idle)]:
runtime.gopark(0x3465e185adab?, 0x3?, 0x2d?, 0xfb?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d6750 sp=0xc00b9d6730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d67e0 sp=0xc00b9d6750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d67e8 sp=0xc00b9d67e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1095 [chan send, 39 minutes]:
runtime.gopark(0x0?, 0xc0048e3a98?, 0x27?, 0x5e?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0056a1a68 sp=0xc0056a1a48 pc=0x441f16
runtime.chansend(0xc00b7f1bc0, 0xc0056a1b78, 0x1, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:259 +0x42e fp=0xc0056a1af0 sp=0xc0056a1a68 pc=0x40df2e
runtime.chansend1(0x7459a0?, 0xc0048e399b?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:145 +0x1d fp=0xc0056a1b20 sp=0xc0056a1af0 pc=0x40dadd
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc005f9c0c0?, {0x0?, 0x12366e9?}, {0x13b5b20, 0xc0000a3270})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x11e fp=0xc0056a1b60 sp=0xc0056a1b20 pc=0xcada9e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x423 fp=0xc0056a1c58 sp=0xc0056a1b60 pc=0xcb1f83
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44f fp=0xc0056a1d50 sp=0xc0056a1c58 pc=0xcb1faf
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc000477080, 0xc00015fee0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x35a fp=0xc0056a1fc0 sp=0xc0056a1d50 pc=0xcb105a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc0056a1fe0 sp=0xc0056a1fc0 pc=0xcad94a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0056a1fe8 sp=0xc0056a1fe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0xb1c
goroutine 1044 [GC worker (idle)]:
runtime.gopark(0x3465e1aad270?, 0x3?, 0x8?, 0x8?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000344f50 sp=0xc000344f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000344fe0 sp=0xc000344f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000344fe8 sp=0xc000344fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1167 [select, 39 minutes]:
runtime.gopark(0xc008807f90?, 0x2?, 0xf8?, 0x7d?, 0xc008807f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008807db0 sp=0xc008807d90 pc=0x441f16
runtime.selectgo(0xc008807f90, 0xc008807f30, 0xc002213a00?, 0x0, 0xc00313dd40?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008807ef0 sp=0xc008807db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc006a69440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc008807fc8 sp=0xc008807ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc008807fe0 sp=0xc008807fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008807fe8 sp=0xc008807fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6278 [select, 28 minutes]:
runtime.gopark(0xc028adbf90?, 0x2?, 0xf8?, 0xbd?, 0xc028adbf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028adbdb0 sp=0xc028adbd90 pc=0x441f16
runtime.selectgo(0xc028adbf90, 0xc028adbf30, 0xc028201ec0?, 0x0, 0xc02863def0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028adbef0 sp=0xc028adbdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816f440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028adbfc8 sp=0xc028adbef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028adbfe0 sp=0xc028adbfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028adbfe8 sp=0xc028adbfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1163 [select, 39 minutes]:
runtime.gopark(0xc0078bbf90?, 0x2?, 0xf8?, 0xbd?, 0xc0078bbf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0078bbdb0 sp=0xc0078bbd90 pc=0x441f16
runtime.selectgo(0xc0078bbf90, 0xc0078bbf30, 0xc002213000?, 0x0, 0xc00313d590?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0078bbef0 sp=0xc0078bbdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc006a69320)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0078bbfc8 sp=0xc0078bbef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0078bbfe0 sp=0xc0078bbfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0078bbfe8 sp=0xc0078bbfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1061 [GC worker (idle)]:
runtime.gopark(0x3465dd3ab26d?, 0x3?, 0xa5?, 0xd?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9da750 sp=0xc00b9da730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9da7e0 sp=0xc00b9da750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9da7e8 sp=0xc00b9da7e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6095 [select, 28 minutes]:
runtime.gopark(0xc007c07f68?, 0x4?, 0x3?, 0x0?, 0xc007c07db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c07c00 sp=0xc007c07be0 pc=0x441f16
runtime.selectgo(0xc007c07f68, 0xc007c07da8, 0xc02879d080?, 0x0, 0xc026b1a501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c07d40 sp=0xc007c07c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816eb40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc007c07fc8 sp=0xc007c07d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc007c07fe0 sp=0xc007c07fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c07fe8 sp=0xc007c07fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1062 [GC worker (idle)]:
runtime.gopark(0x3465e193c8ba?, 0x3?, 0x74?, 0x54?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9daf50 sp=0xc00b9daf30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9dafe0 sp=0xc00b9daf50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9dafe8 sp=0xc00b9dafe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1063 [GC worker (idle)]:
runtime.gopark(0x3465e1a5fb29?, 0x1?, 0xdf?, 0x2b?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9db750 sp=0xc00b9db730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9db7e0 sp=0xc00b9db750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9db7e8 sp=0xc00b9db7e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1059 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xaf?, 0x6f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d9750 sp=0xc00b9d9730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d97e0 sp=0xc00b9d9750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d97e8 sp=0xc00b9d97e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1058 [GC worker (idle)]:
runtime.gopark(0x3465dd06f9db?, 0x3?, 0x46?, 0xbb?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d8f50 sp=0xc00b9d8f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d8fe0 sp=0xc00b9d8f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d8fe8 sp=0xc00b9d8fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 976 [GC worker (idle)]:
runtime.gopark(0x3465e193e783?, 0x1?, 0x2c?, 0x6c?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000343f50 sp=0xc000343f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000343fe0 sp=0xc000343f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000343fe8 sp=0xc000343fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1043 [GC worker (idle)]:
runtime.gopark(0x345c7d8ba78d?, 0x3?, 0xd7?, 0xc5?, 0x415a00?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006f750 sp=0xc00006f730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00006f7e0 sp=0xc00006f750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006f7e8 sp=0xc00006f7e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1090 [GC worker (idle)]:
runtime.gopark(0x3465e1c1b80d?, 0x3?, 0xb0?, 0x1c?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d8750 sp=0xc00b9d8730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d87e0 sp=0xc00b9d8750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d87e8 sp=0xc00b9d87e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1439 [select, 38 minutes]:
runtime.gopark(0xc0050dbf90?, 0x2?, 0xf8?, 0xbd?, 0xc0050dbf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0050dbdb0 sp=0xc0050dbd90 pc=0x441f16
runtime.selectgo(0xc0050dbf90, 0xc0050dbf30, 0xc006acf700?, 0x0, 0xc00a147a40?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0050dbef0 sp=0xc0050dbdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc002afd320)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0050dbfc8 sp=0xc0050dbef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0050dbfe0 sp=0xc0050dbfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0050dbfe8 sp=0xc0050dbfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 975 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xe7?, 0xde?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000343750 sp=0xc000343730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0003437e0 sp=0xc000343750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0003437e8 sp=0xc0003437e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6182 [select, 28 minutes]:
runtime.gopark(0xc0076cbf68?, 0x4?, 0x3?, 0x0?, 0xc0076cbdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0076cbc00 sp=0xc0076cbbe0 pc=0x441f16
runtime.selectgo(0xc0076cbf68, 0xc0076cbda8, 0xc02879d300?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0076cbd40 sp=0xc0076cbc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc0076cbfc8 sp=0xc0076cbd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc0076cbfe0 sp=0xc0076cbfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0076cbfe8 sp=0xc0076cbfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1053 [GC worker (idle)]:
runtime.gopark(0x3465dd57f109?, 0x1?, 0xf8?, 0xd3?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d5f50 sp=0xc00b9d5f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d5fe0 sp=0xc00b9d5f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d5fe8 sp=0xc00b9d5fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1052 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xd3?, 0x12?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d5750 sp=0xc00b9d5730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d57e0 sp=0xc00b9d5750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d57e8 sp=0xc00b9d57e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1051 [GC worker (idle)]:
runtime.gopark(0x3465dd57d3e4?, 0x1?, 0xde?, 0xc0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00b9d4f50 sp=0xc00b9d4f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00b9d4fe0 sp=0xc00b9d4f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00b9d4fe8 sp=0xc00b9d4fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1091 [GC worker (idle)]:
runtime.gopark(0x3465da1321a9?, 0x3?, 0x85?, 0x4b?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00bbb2f50 sp=0xc00bbb2f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00bbb2fe0 sp=0xc00bbb2f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00bbb2fe8 sp=0xc00bbb2fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1049 [GC worker (idle)]:
runtime.gopark(0x3465de3eaaeb?, 0x1?, 0x6b?, 0xd4?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052d3f50 sp=0xc0052d3f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052d3fe0 sp=0xc0052d3f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052d3fe8 sp=0xc0052d3fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1048 [GC worker (idle)]:
runtime.gopark(0x3465dd189859?, 0x1?, 0xd6?, 0x26?, 0x1?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052d3750 sp=0xc0052d3730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052d37e0 sp=0xc0052d3750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052d37e8 sp=0xc0052d37e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1047 [GC worker (idle)]:
runtime.gopark(0x3465de3f0002?, 0x3?, 0xd8?, 0xcc?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052d2f50 sp=0xc0052d2f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052d2fe0 sp=0xc0052d2f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052d2fe8 sp=0xc0052d2fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1046 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0x82?, 0xc9?, 0xc005276ba0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052d2750 sp=0xc0052d2730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052d27e0 sp=0xc0052d2750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052d27e8 sp=0xc0052d27e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1050 [GC worker (idle)]:
runtime.gopark(0x3465e3474ba7?, 0x1?, 0x49?, 0xec?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000349f50 sp=0xc000349f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000349fe0 sp=0xc000349f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000349fe8 sp=0xc000349fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1024 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0x26?, 0x79?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00bbb7f50 sp=0xc00bbb7f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00bbb7fe0 sp=0xc00bbb7f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00bbb7fe8 sp=0xc00bbb7fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1022 [GC worker (idle)]:
runtime.gopark(0x3465dcf5f7bc?, 0x3?, 0x7b?, 0x31?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00bbb6f50 sp=0xc00bbb6f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00bbb6fe0 sp=0xc00bbb6f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00bbb6fe8 sp=0xc00bbb6fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 977 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xb6?, 0x73?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000344750 sp=0xc000344730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0003447e0 sp=0xc000344750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0003447e8 sp=0xc0003447e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6196 [select, 28 minutes]:
runtime.gopark(0xc0078b8f90?, 0x2?, 0xf8?, 0x8d?, 0xc0078b8f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0078b8db0 sp=0xc0078b8d90 pc=0x441f16
runtime.selectgo(0xc0078b8f90, 0xc0078b8f30, 0xc02879d180?, 0x0, 0xc0289a0ae0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0078b8ef0 sp=0xc0078b8db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888ac60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0078b8fc8 sp=0xc0078b8ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0078b8fe0 sp=0xc0078b8fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0078b8fe8 sp=0xc0078b8fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1174 [select, 39 minutes]:
runtime.gopark(0xc000379f68?, 0x4?, 0x5?, 0x0?, 0xc000379db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000379c00 sp=0xc000379be0 pc=0x441f16
runtime.selectgo(0xc000379f68, 0xc000379da8, 0xc000e39800?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000379d40 sp=0xc000379c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc00677cb40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc000379fc8 sp=0xc000379d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc000379fe0 sp=0xc000379fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000379fe8 sp=0xc000379fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1126 [sleep]:
runtime.gopark(0x346709b6ad33?, 0x293e614db7a?, 0x20?, 0x8c?, 0xc12c1cde2040e7c5?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc07b391e60 sp=0xc07b391e40 pc=0x441f16
time.Sleep(0x12a05ceb3)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/time.go:195 +0x135 fp=0xc07b391ea0 sp=0xc07b391e60 pc=0x471e75
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc000477080, {0xc00a162c78, 0x12})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc07b391f00 sp=0xc07b391ea0 pc=0xcc3c37
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc00a162c78?, 0xc07b391f01?})
:1 +0x34 fp=0xc07b391f28 sp=0xc07b391f00 pc=0xcdb6b4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc07b391f48 sp=0xc07b391f28 pc=0xcca545
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc00ba54b80)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc07b391fc8 sp=0xc07b391f48 pc=0xccf73b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc07b391fe0 sp=0xc07b391fc8 pc=0xccdc06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc07b391fe8 sp=0xc07b391fe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 1016 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xa0?, 0xa8?, 0x415a00?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052cdf50 sp=0xc0052cdf30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052cdfe0 sp=0xc0052cdf50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052cdfe8 sp=0xc0052cdfe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1023 [GC worker (idle)]:
runtime.gopark(0x3465dd187b04?, 0x3?, 0x61?, 0x54?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00bbb7750 sp=0xc00bbb7730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00bbb77e0 sp=0xc00bbb7750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00bbb77e8 sp=0xc00bbb77e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1015 [GC worker (idle)]:
runtime.gopark(0x3465e2e29d4c?, 0x1?, 0x58?, 0xe9?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0052ccf50 sp=0xc0052ccf30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0052ccfe0 sp=0xc0052ccf50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0052ccfe8 sp=0xc0052ccfe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6312 [select, 28 minutes]:
runtime.gopark(0xc028bbcf68?, 0x4?, 0x3?, 0x0?, 0xc028bbcdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028bbcc00 sp=0xc028bbcbe0 pc=0x441f16
runtime.selectgo(0xc028bbcf68, 0xc028bbcda8, 0xc0145c0200?, 0x0, 0xc029e2b401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028bbcd40 sp=0xc028bbcc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028bbcfc8 sp=0xc028bbcd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028bbcfe0 sp=0xc028bbcfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028bbcfe8 sp=0xc028bbcfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1186 [select, 39 minutes]:
runtime.gopark(0xc00001af68?, 0x4?, 0x3?, 0x0?, 0xc00001adb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00001ac00 sp=0xc00001abe0 pc=0x441f16
runtime.selectgo(0xc00001af68, 0xc00001ada8, 0xc0021bb800?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00001ad40 sp=0xc00001ac00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc001ea8c60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00001afc8 sp=0xc00001ad40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00001afe0 sp=0xc00001afc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00001afe8 sp=0xc00001afe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6189 [select, 28 minutes]:
runtime.gopark(0xc0076caf90?, 0x2?, 0xf8?, 0xad?, 0xc0076caf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0076cadb0 sp=0xc0076cad90 pc=0x441f16
runtime.selectgo(0xc0076caf90, 0xc0076caf30, 0xc028936b40?, 0x0, 0xc028951530?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0076caef0 sp=0xc0076cadb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888afc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0076cafc8 sp=0xc0076caef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0076cafe0 sp=0xc0076cafc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0076cafe8 sp=0xc0076cafe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1045 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0x76?, 0xf1?, 0x415a00?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004b8f50 sp=0xc0004b8f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0004b8fe0 sp=0xc0004b8f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004b8fe8 sp=0xc0004b8fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1094 [select]:
runtime.gopark(0xc004f39f98?, 0x2?, 0x0?, 0x0?, 0xc004f39f94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc004f39e20 sp=0xc004f39e00 pc=0x441f16
runtime.selectgo(0xc004f39f98, 0xc004f39f90, 0x1d68c20?, 0x0, 0x2931a6802ef?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc004f39f60 sp=0xc004f39e20 pc=0x4521be
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc000484f00)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc004f39fc8 sp=0xc004f39f60 pc=0xce4605
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc004f39fe0 sp=0xc004f39fc8 pc=0xce4526
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc004f39fe8 sp=0xc004f39fe0 pc=0x475001
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 1009 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0x8e?, 0x50?, 0x75beb20636724800?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004b9f50 sp=0xc0004b9f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0004b9fe0 sp=0xc0004b9f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004b9fe8 sp=0xc0004b9fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1187 [select, 39 minutes]:
runtime.gopark(0xc00562af90?, 0x2?, 0xf8?, 0xad?, 0xc00562af34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00562adb0 sp=0xc00562ad90 pc=0x441f16
runtime.selectgo(0xc00562af90, 0xc00562af30, 0xc001fdf400?, 0x0, 0xc0031c76b0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00562aef0 sp=0xc00562adb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc001ea8c60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc00562afc8 sp=0xc00562aef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc00562afe0 sp=0xc00562afc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00562afe8 sp=0xc00562afe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1025 [GC worker (idle)]:
runtime.gopark(0x1da5ac0?, 0x1?, 0xf4?, 0xd7?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00bbb8750 sp=0xc00bbb8730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00bbb87e0 sp=0xc00bbb8750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00bbb87e8 sp=0xc00bbb87e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1074 [GC worker (idle)]:
runtime.gopark(0x3465e1aab19a?, 0x1?, 0x4d?, 0xe5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00bbb8f50 sp=0xc00bbb8f30 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00bbb8fe0 sp=0xc00bbb8f50 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00bbb8fe8 sp=0xc00bbb8fe0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 1075 [GC worker (idle)]:
runtime.gopark(0x3465dd3ab272?, 0x1?, 0x25?, 0x82?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00bbb9750 sp=0xc00bbb9730 pc=0x441f16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00bbb97e0 sp=0xc00bbb9750 pc=0x423351
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00bbb97e8 sp=0xc00bbb97e0 pc=0x475001
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/mgc.go:1199 +0x25
goroutine 6178 [select, 28 minutes]:
runtime.gopark(0xc007c0bf68?, 0x4?, 0x3?, 0x0?, 0xc007c0bdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c0bc00 sp=0xc007c0bbe0 pc=0x441f16
runtime.selectgo(0xc007c0bf68, 0xc007c0bda8, 0xc028201380?, 0x0, 0xc00a61f401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c0bd40 sp=0xc007c0bc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc007c0bfc8 sp=0xc007c0bd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc007c0bfe0 sp=0xc007c0bfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c0bfe8 sp=0xc007c0bfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6215 [select, 28 minutes]:
runtime.gopark(0xc0050daf68?, 0x4?, 0x3?, 0x0?, 0xc0050dadb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0050dac00 sp=0xc0050dabe0 pc=0x441f16
runtime.selectgo(0xc0050daf68, 0xc0050dada8, 0xc02879d1c0?, 0x0, 0xc00e02e801?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0050dad40 sp=0xc0050dac00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816ed80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc0050dafc8 sp=0xc0050dad40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc0050dafe0 sp=0xc0050dafc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0050dafe8 sp=0xc0050dafe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1140 [chan send, 39 minutes]:
runtime.gopark(0x0?, 0xc00bbcba98?, 0x27?, 0x5e?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00bbcba68 sp=0xc00bbcba48 pc=0x441f16
runtime.chansend(0xc007bf2300, 0xc00bbcbb78, 0x1, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:259 +0x42e fp=0xc00bbcbaf0 sp=0xc00bbcba68 pc=0x40df2e
runtime.chansend1(0x7459a0?, 0xc00bbcb99b?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:145 +0x1d fp=0xc00bbcbb20 sp=0xc00bbcbaf0 pc=0x40dadd
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc00315f7a0?, {0x0?, 0x12366e9?}, {0x13b5b20, 0xc0000a3270})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x11e fp=0xc00bbcbb60 sp=0xc00bbcbb20 pc=0xcada9e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x423 fp=0xc00bbcbc58 sp=0xc00bbcbb60 pc=0xcb1f83
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44f fp=0xc00bbcbd50 sp=0xc00bbcbc58 pc=0xcb1faf
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00053fb00, 0xc0089db8a0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x35a fp=0xc00bbcbfc0 sp=0xc00bbcbd50 pc=0xcb105a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc00bbcbfe0 sp=0xc00bbcbfc0 pc=0xcad94a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00bbcbfe8 sp=0xc00bbcbfe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0xb1c
goroutine 939 [sleep]:
runtime.gopark(0x3467c43e3b24?, 0x294a09c69cc?, 0x20?, 0x8c?, 0xc12c1cdee7f81709?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000e9de60 sp=0xc000e9de40 pc=0x441f16
time.Sleep(0x12a05cf24)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/time.go:195 +0x135 fp=0xc000e9dea0 sp=0xc000e9de60 pc=0x471e75
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00053fb00, {0xc00292f520, 0xf})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc000e9df00 sp=0xc000e9dea0 pc=0xcc3c37
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc00292f520?, 0xc0004c5f01?})
:1 +0x34 fp=0xc000e9df28 sp=0xc000e9df00 pc=0xcdb6b4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc000e9df48 sp=0xc000e9df28 pc=0xcca545
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc000efc800)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc000e9dfc8 sp=0xc000e9df48 pc=0xccf73b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc000e9dfe0 sp=0xc000e9dfc8 pc=0xccdc06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000e9dfe8 sp=0xc000e9dfe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 938 [sleep]:
runtime.gopark(0x346711ca9804?, 0x293ee28cb3e?, 0x20?, 0x8c?, 0xc12c1cde2854d7f0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc003af5e60 sp=0xc003af5e40 pc=0x441f16
time.Sleep(0x12a05d363)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/time.go:195 +0x135 fp=0xc003af5ea0 sp=0xc003af5e60 pc=0x471e75
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00053fb00, {0xc0099aa8d0, 0x12})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc003af5f00 sp=0xc003af5ea0 pc=0xcc3c37
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc0099aa8d0?, 0xc0000fdf01?})
:1 +0x34 fp=0xc003af5f28 sp=0xc003af5f00 pc=0xcdb6b4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc003af5f48 sp=0xc003af5f28 pc=0xcca545
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc000efc000)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc003af5fc8 sp=0xc003af5f48 pc=0xccf73b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc003af5fe0 sp=0xc003af5fc8 pc=0xccdc06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc003af5fe8 sp=0xc003af5fe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 1139 [select]:
runtime.gopark(0xc0290f9f98?, 0x2?, 0x30?, 0x8b?, 0xc0290f9f94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0290f9e20 sp=0xc0290f9e00 pc=0x441f16
runtime.selectgo(0xc0290f9f98, 0xc0290f9f90, 0x1d68c20?, 0x0, 0x292ca0fb4f9?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0290f9f60 sp=0xc0290f9e20 pc=0x4521be
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc00047b860)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc0290f9fc8 sp=0xc0290f9f60 pc=0xce4605
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc0290f9fe0 sp=0xc0290f9fc8 pc=0xce4526
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0290f9fe8 sp=0xc0290f9fe0 pc=0x475001
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 1109 [select, 39 minutes]:
runtime.gopark(0xc000374f90?, 0x2?, 0xf8?, 0x4d?, 0xc000374f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000374db0 sp=0xc000374d90 pc=0x441f16
runtime.selectgo(0xc000374f90, 0xc000374f30, 0xc004598b00?, 0x0, 0xc002f09b90?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000374ef0 sp=0xc000374db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc006a39b00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc000374fc8 sp=0xc000374ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc000374fe0 sp=0xc000374fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000374fe8 sp=0xc000374fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1557 [select, 38 minutes]:
runtime.gopark(0xc00550df68?, 0x4?, 0x3?, 0x0?, 0xc00550ddb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00550dc00 sp=0xc00550dbe0 pc=0x441f16
runtime.selectgo(0xc00550df68, 0xc00550dda8, 0xc006acfa00?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00550dd40 sp=0xc00550dc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc002c00d80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00550dfc8 sp=0xc00550dd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00550dfe0 sp=0xc00550dfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00550dfe8 sp=0xc00550dfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1175 [select, 39 minutes]:
runtime.gopark(0xc000082f90?, 0x2?, 0xf8?, 0x2d?, 0xc000082f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000082db0 sp=0xc000082d90 pc=0x441f16
runtime.selectgo(0xc000082f90, 0xc000082f30, 0xc0021bb600?, 0x0, 0xc003089770?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000082ef0 sp=0xc000082db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc00677cb40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc000082fc8 sp=0xc000082ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1558 [select, 38 minutes]:
runtime.gopark(0xc005509f90?, 0x2?, 0xf8?, 0x9d?, 0xc005509f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc005509db0 sp=0xc005509d90 pc=0x441f16
runtime.selectgo(0xc005509f90, 0xc005509f30, 0xc006bef280?, 0x0, 0xc008180ed0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc005509ef0 sp=0xc005509db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc002c00d80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc005509fc8 sp=0xc005509ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc005509fe0 sp=0xc005509fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc005509fe8 sp=0xc005509fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1183 [select, 39 minutes]:
runtime.gopark(0xc008803f68?, 0x4?, 0xf8?, 0xe8?, 0xc008803db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008803c00 sp=0xc008803be0 pc=0x441f16
runtime.selectgo(0xc008803f68, 0xc008803da8, 0xc00227cc00?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008803d40 sp=0xc008803c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc00677d7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc008803fc8 sp=0xc008803d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc008803fe0 sp=0xc008803fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008803fe8 sp=0xc008803fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1184 [select, 39 minutes]:
runtime.gopark(0xc00817bf90?, 0x2?, 0xf8?, 0xbd?, 0xc00817bf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00817bdb0 sp=0xc00817bd90 pc=0x441f16
runtime.selectgo(0xc00817bf90, 0xc00817bf30, 0xc00227ca00?, 0x0, 0xc002fd46f0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00817bef0 sp=0xc00817bdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc00677d7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc00817bfc8 sp=0xc00817bef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc00817bfe0 sp=0xc00817bfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00817bfe8 sp=0xc00817bfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1203 [select, 39 minutes]:
runtime.gopark(0xc00817cf68?, 0x4?, 0x3?, 0x0?, 0xc00817cdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00817cc00 sp=0xc00817cbe0 pc=0x441f16
runtime.selectgo(0xc00817cf68, 0xc00817cda8, 0xc00227d600?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00817cd40 sp=0xc00817cc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc00677d8c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00817cfc8 sp=0xc00817cd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00817cfe0 sp=0xc00817cfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00817cfe8 sp=0xc00817cfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1204 [select, 39 minutes]:
runtime.gopark(0xc008806f90?, 0x2?, 0xf8?, 0x6d?, 0xc008806f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008806db0 sp=0xc008806d90 pc=0x441f16
runtime.selectgo(0xc008806f90, 0xc008806f30, 0xc00227d400?, 0x0, 0xc002fd4ea0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008806ef0 sp=0xc008806db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc00677d8c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc008806fc8 sp=0xc008806ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc008806fe0 sp=0xc008806fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008806fe8 sp=0xc008806fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1118 [chan send, 38 minutes]:
runtime.gopark(0x0?, 0xc0000ffa98?, 0x27?, 0x5e?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0000ffa68 sp=0xc0000ffa48 pc=0x441f16
runtime.chansend(0xc004df3200, 0xc0000ffb78, 0x1, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:259 +0x42e fp=0xc0000ffaf0 sp=0xc0000ffa68 pc=0x40df2e
runtime.chansend1(0x7459a0?, 0xc0000ff99b?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:145 +0x1d fp=0xc0000ffb20 sp=0xc0000ffaf0 pc=0x40dadd
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc00579afc0?, {0x0?, 0x12366e9?}, {0x13b5b20, 0xc0000a3270})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x11e fp=0xc0000ffb60 sp=0xc0000ffb20 pc=0xcada9e
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x423 fp=0xc0000ffc58 sp=0xc0000ffb60 pc=0xcb1f83
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44f fp=0xc0000ffd50 sp=0xc0000ffc58 pc=0xcb1faf
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00b6e6180, 0xc00032d520)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x35a fp=0xc0000fffc0 sp=0xc0000ffd50 pc=0xcb105a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc0000fffe0 sp=0xc0000fffc0 pc=0xcad94a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000fffe8 sp=0xc0000fffe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0xb1c
goroutine 1117 [select]:
runtime.gopark(0xc0004b7798?, 0x2?, 0xb8?, 0xd4?, 0xc0004b7794?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0004b7620 sp=0xc0004b7600 pc=0x441f16
runtime.selectgo(0xc0004b7798, 0xc0004b7790, 0x1d68c20?, 0x0, 0x294e0669068?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0004b7760 sp=0xc0004b7620 pc=0x4521be
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc00047a000)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc0004b77c8 sp=0xc0004b7760 pc=0xce4605
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc0004b77e0 sp=0xc0004b77c8 pc=0xce4526
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004b77e8 sp=0xc0004b77e0 pc=0x475001
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 1572 [select, 38 minutes]:
runtime.gopark(0xc004f3df90?, 0x2?, 0xf8?, 0xdd?, 0xc004f3df34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc004f3ddb0 sp=0xc004f3dd90 pc=0x441f16
runtime.selectgo(0xc004f3df90, 0xc004f3df30, 0xc006acf980?, 0x0, 0xc00a147d10?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc004f3def0 sp=0xc004f3ddb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc002afd8c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc004f3dfc8 sp=0xc004f3def0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc004f3dfe0 sp=0xc004f3dfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc004f3dfe8 sp=0xc004f3dfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 1438 [select, 38 minutes]:
runtime.gopark(0xc00562cf68?, 0x4?, 0x5?, 0x0?, 0xc00562cdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00562cc00 sp=0xc00562cbe0 pc=0x441f16
runtime.selectgo(0xc00562cf68, 0xc00562cda8, 0xc006beee00?, 0x0, 0xc004d70801?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00562cd40 sp=0xc00562cc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc002afd320)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00562cfc8 sp=0xc00562cd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00562cfe0 sp=0xc00562cfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00562cfe8 sp=0xc00562cfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1320 [sleep]:
runtime.gopark(0x3467102184ee?, 0x293ec7fb2db?, 0x20?, 0x8c?, 0xc12c1cde26abbf0b?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc003af3e60 sp=0xc003af3e40 pc=0x441f16
time.Sleep(0x12a05cf5b)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/time.go:195 +0x135 fp=0xc003af3ea0 sp=0xc003af3e60 pc=0x471e75
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00b6e6180, {0xc0081da9a8, 0x12})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc003af3f00 sp=0xc003af3ea0 pc=0xcc3c37
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc0081da9a8?, 0xc003af3f01?})
:1 +0x34 fp=0xc003af3f28 sp=0xc003af3f00 pc=0xcdb6b4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc003af3f48 sp=0xc003af3f28 pc=0xcca545
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc0067e5700)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc003af3fc8 sp=0xc003af3f48 pc=0xccf73b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc003af3fe0 sp=0xc003af3fc8 pc=0xccdc06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc003af3fe8 sp=0xc003af3fe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 1321 [sleep]:
runtime.gopark(0x346800e95918?, 0x294dd4783eb?, 0x20?, 0x8c?, 0xc12c1cdf29086823?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0000d9e60 sp=0xc0000d9e40 pc=0x441f16
time.Sleep(0x12a05cbfe)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/time.go:195 +0x135 fp=0xc0000d9ea0 sp=0xc0000d9e60 pc=0x471e75
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc00b6e6180, {0xc00b5a5c90, 0xf})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc0000d9f00 sp=0xc0000d9ea0 pc=0xcc3c37
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc00b5a5c90?, 0xc062b6bf01?})
:1 +0x34 fp=0xc0000d9f28 sp=0xc0000d9f00 pc=0xcdb6b4
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc0000d9f48 sp=0xc0000d9f28 pc=0xcca545
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc0067e5780)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc0000d9fc8 sp=0xc0000d9f48 pc=0xccf73b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0000d9fe0 sp=0xc0000d9fc8 pc=0xccdc06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000d9fe8 sp=0xc0000d9fe0 pc=0x475001
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 6195 [select, 28 minutes]:
runtime.gopark(0xc0078b5f68?, 0x4?, 0x3?, 0x0?, 0xc0078b5db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0078b5c00 sp=0xc0078b5be0 pc=0x441f16
runtime.selectgo(0xc0078b5f68, 0xc0078b5da8, 0xc0282014c0?, 0x0, 0xc037c51801?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0078b5d40 sp=0xc0078b5c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888ac60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc0078b5fc8 sp=0xc0078b5d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc0078b5fe0 sp=0xc0078b5fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0078b5fe8 sp=0xc0078b5fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6096 [select, 28 minutes]:
runtime.gopark(0xc0050dcf90?, 0x2?, 0xf8?, 0xcd?, 0xc0050dcf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0050dcdb0 sp=0xc0050dcd90 pc=0x441f16
runtime.selectgo(0xc0050dcf90, 0xc0050dcf30, 0xc028201480?, 0x0, 0xc02863c810?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0050dcef0 sp=0xc0050dcdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816eb40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0050dcfc8 sp=0xc0050dcef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0050dcfe0 sp=0xc0050dcfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0050dcfe8 sp=0xc0050dcfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6183 [select, 28 minutes]:
runtime.gopark(0xc005507f90?, 0x2?, 0xf8?, 0x7d?, 0xc005507f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc005507db0 sp=0xc005507d90 pc=0x441f16
runtime.selectgo(0xc005507f90, 0xc005507f30, 0xc0289369c0?, 0x0, 0xc028951200?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc005507ef0 sp=0xc005507db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc005507fc8 sp=0xc005507ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc005507fe0 sp=0xc005507fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc005507fe8 sp=0xc005507fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6260 [select, 28 minutes]:
runtime.gopark(0xc004f3bf90?, 0x2?, 0xf8?, 0xbd?, 0xc004f3bf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc004f3bdb0 sp=0xc004f3bd90 pc=0x441f16
runtime.selectgo(0xc004f3bf90, 0xc004f3bf30, 0xc028201a00?, 0x0, 0xc02863d440?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc004f3bef0 sp=0xc004f3bdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18900)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc004f3bfc8 sp=0xc004f3bef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc004f3bfe0 sp=0xc004f3bfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc004f3bfe8 sp=0xc004f3bfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6256 [select, 28 minutes]:
runtime.gopark(0xc028bbff68?, 0x4?, 0x3?, 0x0?, 0xc028bbfdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028bbfc00 sp=0xc028bbfbe0 pc=0x441f16
runtime.selectgo(0xc028bbff68, 0xc028bbfda8, 0xc028201d00?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028bbfd40 sp=0xc028bbfc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816f200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028bbffc8 sp=0xc028bbfd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028bbffe0 sp=0xc028bbffc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028bbffe8 sp=0xc028bbffe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 1571 [select, 38 minutes]:
runtime.gopark(0xc005508f68?, 0x4?, 0x3?, 0x0?, 0xc005508db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc005508c00 sp=0xc005508be0 pc=0x441f16
runtime.selectgo(0xc005508f68, 0xc005508da8, 0xc006bef080?, 0x0, 0xc00b5a4f01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc005508d40 sp=0xc005508c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc002afd8c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc005508fc8 sp=0xc005508d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc005508fe0 sp=0xc005508fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc005508fe8 sp=0xc005508fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6188 [select, 28 minutes]:
runtime.gopark(0xc0076c8f68?, 0x4?, 0x3?, 0x0?, 0xc0076c8db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0076c8c00 sp=0xc0076c8be0 pc=0x441f16
runtime.selectgo(0xc0076c8f68, 0xc0076c8da8, 0xc02879d540?, 0x0, 0xc01a185d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0076c8d40 sp=0xc0076c8c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888afc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc0076c8fc8 sp=0xc0076c8d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc0076c8fe0 sp=0xc0076c8fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0076c8fe8 sp=0xc0076c8fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6299 [select, 28 minutes]:
runtime.gopark(0xc028c85f90?, 0x2?, 0xf8?, 0x5d?, 0xc028c85f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028c85db0 sp=0xc028c85d90 pc=0x441f16
runtime.selectgo(0xc028c85f90, 0xc028c85f30, 0xc02879df40?, 0x0, 0xc028b32780?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028c85ef0 sp=0xc028c85db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028c85fc8 sp=0xc028c85ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028c85fe0 sp=0xc028c85fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028c85fe8 sp=0xc028c85fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6219 [select, 28 minutes]:
runtime.gopark(0xc0076c6f68?, 0x4?, 0x3?, 0x0?, 0xc0076c6db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0076c6c00 sp=0xc0076c6be0 pc=0x441f16
runtime.selectgo(0xc0076c6f68, 0xc0076c6da8, 0xc028936a00?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0076c6d40 sp=0xc0076c6c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816eea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc0076c6fc8 sp=0xc0076c6d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc0076c6fe0 sp=0xc0076c6fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0076c6fe8 sp=0xc0076c6fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6230 [select, 28 minutes]:
runtime.gopark(0xc00562bf90?, 0x2?, 0xf8?, 0xbd?, 0xc00562bf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00562bdb0 sp=0xc00562bd90 pc=0x441f16
runtime.selectgo(0xc00562bf90, 0xc00562bf30, 0xc02879d780?, 0x0, 0xc0289a17d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00562bef0 sp=0xc00562bdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc00562bfc8 sp=0xc00562bef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc00562bfe0 sp=0xc00562bfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00562bfe8 sp=0xc00562bfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6216 [select, 28 minutes]:
runtime.gopark(0xc0050d6f90?, 0x2?, 0xf8?, 0x6d?, 0xc0050d6f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0050d6db0 sp=0xc0050d6d90 pc=0x441f16
runtime.selectgo(0xc0050d6f90, 0xc0050d6f30, 0xc028201700?, 0x0, 0xc02863cdb0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0050d6ef0 sp=0xc0050d6db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816ed80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0050d6fc8 sp=0xc0050d6ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0050d6fe0 sp=0xc0050d6fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0050d6fe8 sp=0xc0050d6fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6277 [select, 28 minutes]:
runtime.gopark(0xc028adaf68?, 0x4?, 0x3?, 0x0?, 0xc028adadb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028adac00 sp=0xc028adabe0 pc=0x441f16
runtime.selectgo(0xc028adaf68, 0xc028adada8, 0xc028a605c0?, 0x0, 0x83bc01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028adad40 sp=0xc028adac00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816f440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028adafc8 sp=0xc028adad40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028adafe0 sp=0xc028adafc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028adafe8 sp=0xc028adafe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6339 [select, 28 minutes]:
runtime.gopark(0xc028c80f90?, 0x2?, 0xf8?, 0xd?, 0xc028c80f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028c80db0 sp=0xc028c80d90 pc=0x441f16
runtime.selectgo(0xc028c80f90, 0xc028c80f30, 0xc028b50240?, 0x0, 0xc028b32c60?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028c80ef0 sp=0xc028c80db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b9e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028c80fc8 sp=0xc028c80ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028c80fe0 sp=0xc028c80fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028c80fe8 sp=0xc028c80fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6212 [select, 28 minutes]:
runtime.gopark(0xc0050d8f90?, 0x2?, 0xf8?, 0x8d?, 0xc0050d8f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0050d8db0 sp=0xc0050d8d90 pc=0x441f16
runtime.selectgo(0xc0050d8f90, 0xc0050d8f30, 0xc0282015c0?, 0x0, 0xc02863cae0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0050d8ef0 sp=0xc0050d8db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816ec60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0050d8fc8 sp=0xc0050d8ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0050d8fe0 sp=0xc0050d8fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0050d8fe8 sp=0xc0050d8fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6209 [select, 28 minutes]:
runtime.gopark(0xc000083f68?, 0x4?, 0x3?, 0x0?, 0xc000083db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000083c00 sp=0xc000083be0 pc=0x441f16
runtime.selectgo(0xc000083f68, 0xc000083da8, 0xc028201880?, 0x0, 0xc02d7fab01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000083d40 sp=0xc000083c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b0e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc000083fc8 sp=0xc000083d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc000083fe0 sp=0xc000083fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000083fe8 sp=0xc000083fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6223 [select, 28 minutes]:
runtime.gopark(0xc007c0af68?, 0x4?, 0x3?, 0x0?, 0xc007c0adb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c0ac00 sp=0xc007c0abe0 pc=0x441f16
runtime.selectgo(0xc007c0af68, 0xc007c0ada8, 0xc028936b80?, 0x0, 0xc026b1a501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c0ad40 sp=0xc007c0ac00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816efc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc007c0afc8 sp=0xc007c0ad40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc007c0afe0 sp=0xc007c0afc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c0afe8 sp=0xc007c0afe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6303 [select, 28 minutes]:
runtime.gopark(0xc028ad4f90?, 0x2?, 0xf8?, 0x4d?, 0xc028ad4f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028ad4db0 sp=0xc028ad4d90 pc=0x441f16
runtime.selectgo(0xc028ad4f90, 0xc028ad4f30, 0xc028b500c0?, 0x0, 0xc028b329f0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028ad4ef0 sp=0xc028ad4db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b8c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028ad4fc8 sp=0xc028ad4ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028ad4fe0 sp=0xc028ad4fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028ad4fe8 sp=0xc028ad4fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6203 [select, 28 minutes]:
runtime.gopark(0xc00550cf68?, 0x4?, 0x3?, 0x0?, 0xc00550cdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00550cc00 sp=0xc00550cbe0 pc=0x441f16
runtime.selectgo(0xc00550cf68, 0xc00550cda8, 0xc028201740?, 0x0, 0xc02bf65401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00550cd40 sp=0xc00550cc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888aea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00550cfc8 sp=0xc00550cd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00550cfe0 sp=0xc00550cfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00550cfe8 sp=0xc00550cfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6220 [select, 28 minutes]:
runtime.gopark(0xc0076c9f90?, 0x2?, 0xf8?, 0x9d?, 0xc0076c9f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0076c9db0 sp=0xc0076c9d90 pc=0x441f16
runtime.selectgo(0xc0076c9f90, 0xc0076c9f30, 0xc028201840?, 0x0, 0xc02863d080?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0076c9ef0 sp=0xc0076c9db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816eea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0076c9fc8 sp=0xc0076c9ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0076c9fe0 sp=0xc0076c9fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0076c9fe8 sp=0xc0076c9fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6204 [select, 28 minutes]:
runtime.gopark(0xc007c08f90?, 0x2?, 0xf8?, 0x8d?, 0xc007c08f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c08db0 sp=0xc007c08d90 pc=0x441f16
runtime.selectgo(0xc007c08f90, 0xc007c08f30, 0xc02879d400?, 0x0, 0xc0289a1080?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c08ef0 sp=0xc007c08db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888aea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc007c08fc8 sp=0xc007c08ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc007c08fe0 sp=0xc007c08fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c08fe8 sp=0xc007c08fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6273 [select, 28 minutes]:
runtime.gopark(0xc028ad5f68?, 0x4?, 0x3?, 0x0?, 0xc028ad5db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028ad5c00 sp=0xc028ad5be0 pc=0x441f16
runtime.selectgo(0xc028ad5f68, 0xc028ad5da8, 0xc02879db40?, 0x0, 0xc009970901?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028ad5d40 sp=0xc028ad5c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816f320)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028ad5fc8 sp=0xc028ad5d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028ad5fe0 sp=0xc028ad5fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028ad5fe8 sp=0xc028ad5fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6186 [select, 28 minutes]:
runtime.gopark(0xc000018f68?, 0x4?, 0x3?, 0x0?, 0xc000018db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000018c00 sp=0xc000018be0 pc=0x441f16
runtime.selectgo(0xc000018f68, 0xc000018da8, 0xc02879d440?, 0x0, 0xc02bf65401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000018d40 sp=0xc000018c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a185a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc000018fc8 sp=0xc000018d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc000018fe0 sp=0xc000018fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000018fe8 sp=0xc000018fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6224 [select, 28 minutes]:
runtime.gopark(0xc000372f90?, 0x2?, 0xf8?, 0x2d?, 0xc000372f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000372db0 sp=0xc000372d90 pc=0x441f16
runtime.selectgo(0xc000372f90, 0xc000372f30, 0xc028201980?, 0x0, 0xc02863d320?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000372ef0 sp=0xc000372db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816efc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc000372fc8 sp=0xc000372ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc000372fe0 sp=0xc000372fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000372fe8 sp=0xc000372fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6211 [select, 28 minutes]:
runtime.gopark(0xc008805f68?, 0x4?, 0x3?, 0x0?, 0xc008805db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008805c00 sp=0xc008805be0 pc=0x441f16
runtime.selectgo(0xc008805f68, 0xc008805da8, 0xc028201600?, 0x0, 0x83bc01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008805d40 sp=0xc008805c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816ec60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc008805fc8 sp=0xc008805d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc008805fe0 sp=0xc008805fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008805fe8 sp=0xc008805fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6322 [select, 28 minutes]:
runtime.gopark(0xc008802f90?, 0x2?, 0xf8?, 0x2d?, 0xc008802f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008802db0 sp=0xc008802d90 pc=0x441f16
runtime.selectgo(0xc008802f90, 0xc008802f30, 0xc0145c0900?, 0x0, 0xc00d6eb5c0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008802ef0 sp=0xc008802db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc00d6edd40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc008802fc8 sp=0xc008802ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc008802fe0 sp=0xc008802fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008802fe8 sp=0xc008802fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6268 [select, 28 minutes]:
runtime.gopark(0xc007c30f90?, 0x2?, 0xf8?, 0xd?, 0xc007c30f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c30db0 sp=0xc007c30d90 pc=0x441f16
runtime.selectgo(0xc007c30f90, 0xc007c30f30, 0xc028201bc0?, 0x0, 0xc02863d800?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c30ef0 sp=0xc007c30db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816f0e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc007c30fc8 sp=0xc007c30ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc007c30fe0 sp=0xc007c30fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c30fe8 sp=0xc007c30fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 11694 [select, 11 minutes]:
runtime.gopark(0xc028dbbf90?, 0x2?, 0xf8?, 0xbd?, 0xc028dbbf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028dbbdb0 sp=0xc028dbbd90 pc=0x441f16
runtime.selectgo(0xc028dbbf90, 0xc028dbbf30, 0xc014871080?, 0x0, 0xc010fc8750?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028dbbef0 sp=0xc028dbbdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc0161d5c20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028dbbfc8 sp=0xc028dbbef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028dbbfe0 sp=0xc028dbbfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028dbbfe8 sp=0xc028dbbfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6092 [select, 28 minutes]:
runtime.gopark(0xc008178f90?, 0x2?, 0xf8?, 0x8d?, 0xc008178f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008178db0 sp=0xc008178d90 pc=0x441f16
runtime.selectgo(0xc008178f90, 0xc008178f30, 0xc028201340?, 0x0, 0xc02863c540?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008178ef0 sp=0xc008178db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816ea20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc008178fc8 sp=0xc008178ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc008178fe0 sp=0xc008178fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008178fe8 sp=0xc008178fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6199 [select, 28 minutes]:
runtime.gopark(0xc007c09f68?, 0x4?, 0x3?, 0x0?, 0xc007c09db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c09c00 sp=0xc007c09be0 pc=0x441f16
runtime.selectgo(0xc007c09f68, 0xc007c09da8, 0xc0289368c0?, 0x0, 0x83bc01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c09d40 sp=0xc007c09c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888ad80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc007c09fc8 sp=0xc007c09d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc007c09fe0 sp=0xc007c09fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c09fe8 sp=0xc007c09fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6267 [select, 28 minutes]:
runtime.gopark(0xc007c2ff68?, 0x4?, 0x3?, 0x0?, 0xc007c2fdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c2fc00 sp=0xc007c2fbe0 pc=0x441f16
runtime.selectgo(0xc007c2ff68, 0xc007c2fda8, 0xc0289370c0?, 0x0, 0xc0383ffb01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c2fd40 sp=0xc007c2fc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816f0e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc007c2ffc8 sp=0xc007c2fd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc007c2ffe0 sp=0xc007c2ffc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c2ffe8 sp=0xc007c2ffe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 11693 [select, 11 minutes]:
runtime.gopark(0xc037297f68?, 0x4?, 0x3?, 0x0?, 0xc037297db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc037297c00 sp=0xc037297be0 pc=0x441f16
runtime.selectgo(0xc037297f68, 0xc037297da8, 0xc001809c40?, 0x0, 0xc00bbb4d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc037297d40 sp=0xc037297c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc0161d5c20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc037297fc8 sp=0xc037297d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc037297fe0 sp=0xc037297fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc037297fe8 sp=0xc037297fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6342 [select, 28 minutes]:
runtime.gopark(0xc028c84f68?, 0x4?, 0x3?, 0x0?, 0xc028c84db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028c84c00 sp=0xc028c84be0 pc=0x441f16
runtime.selectgo(0xc028c84f68, 0xc028c84da8, 0xc0145c0a40?, 0x0, 0xc02b8e6401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028c84d40 sp=0xc028c84c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888bb00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028c84fc8 sp=0xc028c84d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028c84fe0 sp=0xc028c84fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028c84fe8 sp=0xc028c84fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6257 [select, 28 minutes]:
runtime.gopark(0xc007c2cf90?, 0x2?, 0xf8?, 0xcd?, 0xc007c2cf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c2cdb0 sp=0xc007c2cd90 pc=0x441f16
runtime.selectgo(0xc007c2cf90, 0xc007c2cf30, 0xc028937240?, 0x0, 0xc028a4c3f0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c2cef0 sp=0xc007c2cdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02816f200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc007c2cfc8 sp=0xc007c2cef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc007c2cfe0 sp=0xc007c2cfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c2cfe8 sp=0xc007c2cfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6229 [select, 28 minutes]:
runtime.gopark(0xc005628f68?, 0x4?, 0x3?, 0x0?, 0xc005628db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc005628c00 sp=0xc005628be0 pc=0x441f16
runtime.selectgo(0xc005628f68, 0xc005628da8, 0xc028936cc0?, 0x0, 0xc026a17001?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc005628d40 sp=0xc005628c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc005628fc8 sp=0xc005628d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc005628fe0 sp=0xc005628fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc005628fe8 sp=0xc005628fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 3552 [chan receive, 35 minutes]:
runtime.gopark(0xc0086e2240?, 0x1e?, 0x1e?, 0x0?, 0xc007c0cea8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c0ce28 sp=0xc007c0ce08 pc=0x441f16
runtime.chanrecv(0xc0098b1e00, 0xc007c0cfa0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc007c0ceb8 sp=0xc007c0ce28 pc=0x40ed3d
runtime.chanrecv2(0xc00a59d2b0?, 0xc0086e2240?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:447 +0x18 fp=0xc007c0cee0 sp=0xc007c0ceb8 pc=0x40e878
github.com/couchbase/gometa/common.(*PeerPipe).doSend(0xc00834b140)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:167 +0x9e fp=0xc007c0cfc8 sp=0xc007c0cee0 pc=0xcf5b1e
github.com/couchbase/gometa/common.NewPeerPipe.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x26 fp=0xc007c0cfe0 sp=0xc007c0cfc8 pc=0xcf5406
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c0cfe8 sp=0xc007c0cfe0 pc=0x475001
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x14d
goroutine 3553 [runnable]:
runtime.gopark(0xc0078bac98?, 0xb?, 0x0?, 0x0?, 0xc?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0078bac68 sp=0xc0078bac48 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0078baca0 sp=0xc0078bac68 pc=0x43a537
internal/poll.runtime_pollWait(0x7f9783e1e928, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0078bacc0 sp=0xc0078baca0 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc006980600?, 0xc0623aec00?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0078bace8 sp=0xc0078bacc0 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc006980600, {0xc0623aec00, 0x8, 0x8})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc0078bad80 sp=0xc0078bace8 pc=0x4adb79
net.(*netFD).Read(0xc006980600, {0xc0623aec00?, 0x7f97383e1218?, 0x7f9783f9af18?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc0078badc8 sp=0xc0078bad80 pc=0x68ada9
net.(*conn).Read(0xc00519fc20, {0xc0623aec00?, 0x1047460?, 0xc06eefee01?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc0078bae10 sp=0xc0078badc8 pc=0x69afe5
net.(*TCPConn).Read(0xcf797e?, {0xc0623aec00?, 0xc0078baed8?, 0xcf700f?})
:1 +0x29 fp=0xc0078bae40 sp=0xc0078bae10 pc=0x6ad849
github.com/couchbase/gometa/common.(*PeerPipe).readBytes(0xc00834b140, 0x13c2780?, {0x0?, 0xc0468e3dd0?, 0x174876e800?})
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:313 +0xcf fp=0xc0078baee8 sp=0xc0078bae40 pc=0xcf714f
github.com/couchbase/gometa/common.(*PeerPipe).doReceive(0xc00834b140)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:214 +0xd5 fp=0xc0078bafc8 sp=0xc0078baee8 pc=0xcf62f5
github.com/couchbase/gometa/common.NewPeerPipe.func2()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x26 fp=0xc0078bafe0 sp=0xc0078bafc8 pc=0xcf53a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0078bafe8 sp=0xc0078bafe0 pc=0x475001
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x18a
goroutine 6324 [select, 28 minutes]:
runtime.gopark(0xc028c82f90?, 0x2?, 0xf8?, 0x2d?, 0xc028c82f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028c82db0 sp=0xc028c82d90 pc=0x441f16
runtime.selectgo(0xc028c82f90, 0xc028c82f30, 0xc0145c0940?, 0x0, 0xc00d6eb650?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028c82ef0 sp=0xc028c82db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a19680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028c82fc8 sp=0xc028c82ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028c82fe0 sp=0xc028c82fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028c82fe8 sp=0xc028c82fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6343 [select, 28 minutes]:
runtime.gopark(0xc028d9cf90?, 0x2?, 0xf8?, 0xcd?, 0xc028d9cf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028d9cdb0 sp=0xc028d9cd90 pc=0x441f16
runtime.selectgo(0xc028d9cf90, 0xc028d9cf30, 0xc028b503c0?, 0x0, 0xc028b32f00?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028d9cef0 sp=0xc028d9cdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888bb00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028d9cfc8 sp=0xc028d9cef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028d9cfe0 sp=0xc028d9cfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028d9cfe8 sp=0xc028d9cfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6174 [select, 28 minutes]:
runtime.gopark(0xc000087f90?, 0x2?, 0xf8?, 0x7d?, 0xc000087f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000087db0 sp=0xc000087d90 pc=0x441f16
runtime.selectgo(0xc000087f90, 0xc000087f30, 0xc0145c0780?, 0x0, 0xc00d6eb350?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000087ef0 sp=0xc000087db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc00d6edc20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc000087fc8 sp=0xc000087ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc000087fe0 sp=0xc000087fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000087fe8 sp=0xc000087fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6233 [select, 28 minutes]:
runtime.gopark(0xc007c31f68?, 0x4?, 0x3?, 0x0?, 0xc007c31db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c31c00 sp=0xc007c31be0 pc=0x441f16
runtime.selectgo(0xc007c31f68, 0xc007c31da8, 0xc028936ec0?, 0x0, 0xc00a61f401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c31d40 sp=0xc007c31c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b320)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc007c31fc8 sp=0xc007c31d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc007c31fe0 sp=0xc007c31fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c31fe8 sp=0xc007c31fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6091 [select, 28 minutes]:
runtime.gopark(0xc008176f68?, 0x4?, 0x3?, 0x0?, 0xc008176db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008176c00 sp=0xc008176be0 pc=0x441f16
runtime.selectgo(0xc008176f68, 0xc008176da8, 0xc028936780?, 0x0, 0xc02dbccf01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008176d40 sp=0xc008176c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02816ea20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc008176fc8 sp=0xc008176d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc008176fe0 sp=0xc008176fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008176fe8 sp=0xc008176fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 3682 [runnable]:
runtime.gopark(0xc0076cdc98?, 0xb?, 0x0?, 0x0?, 0xd?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0076cdc68 sp=0xc0076cdc48 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc0076cdca0 sp=0xc0076cdc68 pc=0x43a537
internal/poll.runtime_pollWait(0x7f9783e1e838, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc0076cdcc0 sp=0xc0076cdca0 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc006980680?, 0xc0623095c0?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0076cdce8 sp=0xc0076cdcc0 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc006980680, {0xc0623095c0, 0x8, 0x8})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc0076cdd80 sp=0xc0076cdce8 pc=0x4adb79
net.(*netFD).Read(0xc006980680, {0xc0623095c0?, 0x7f970077b708?, 0x7f9783f9b3c8?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc0076cddc8 sp=0xc0076cdd80 pc=0x68ada9
net.(*conn).Read(0xc00909c870, {0xc0623095c0?, 0x1047460?, 0xc06e8de401?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc0076cde10 sp=0xc0076cddc8 pc=0x69afe5
net.(*TCPConn).Read(0xcf797e?, {0xc0623095c0?, 0xc0076cded8?, 0xcf700f?})
:1 +0x29 fp=0xc0076cde40 sp=0xc0076cde10 pc=0x6ad849
github.com/couchbase/gometa/common.(*PeerPipe).readBytes(0xc0078a79c0, 0x13c2780?, {0x0?, 0xc045381640?, 0xc0087b5c50?})
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:313 +0xcf fp=0xc0076cdee8 sp=0xc0076cde40 pc=0xcf714f
github.com/couchbase/gometa/common.(*PeerPipe).doReceive(0xc0078a79c0)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:214 +0xd5 fp=0xc0076cdfc8 sp=0xc0076cdee8 pc=0xcf62f5
github.com/couchbase/gometa/common.NewPeerPipe.func2()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x26 fp=0xc0076cdfe0 sp=0xc0076cdfc8 pc=0xcf53a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0076cdfe8 sp=0xc0076cdfe0 pc=0x475001
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x18a
goroutine 6173 [select, 28 minutes]:
runtime.gopark(0xc000080f68?, 0x4?, 0x3?, 0x0?, 0xc000080db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000080c00 sp=0xc000080be0 pc=0x441f16
runtime.selectgo(0xc000080f68, 0xc000080da8, 0xc0145c0800?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000080d40 sp=0xc000080c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc00d6edc20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc000080fc8 sp=0xc000080d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 2225 [chan receive]:
runtime.gopark(0xc075636480?, 0x3c?, 0x3c?, 0x0?, 0xc007c33ea8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c33e28 sp=0xc007c33e08 pc=0x441f16
runtime.chanrecv(0xc00ad075c0, 0xc007c33fa0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:583 +0x49d fp=0xc007c33eb8 sp=0xc007c33e28 pc=0x40ed3d
runtime.chanrecv2(0xc036801ee0?, 0xc075636480?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/chan.go:447 +0x18 fp=0xc007c33ee0 sp=0xc007c33eb8 pc=0x40e878
github.com/couchbase/gometa/common.(*PeerPipe).doSend(0xc0078a79c0)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:167 +0x9e fp=0xc007c33fc8 sp=0xc007c33ee0 pc=0xcf5b1e
github.com/couchbase/gometa/common.NewPeerPipe.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x26 fp=0xc007c33fe0 sp=0xc007c33fc8 pc=0xcf5406
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c33fe8 sp=0xc007c33fe0 pc=0x475001
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x14d
goroutine 6298 [select, 28 minutes]:
runtime.gopark(0xc028c81f68?, 0x4?, 0x3?, 0x0?, 0xc028c81db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028c81c00 sp=0xc028c81be0 pc=0x441f16
runtime.selectgo(0xc028c81f68, 0xc028c81da8, 0xc0145c0680?, 0x0, 0xc01d0d8201?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028c81d40 sp=0xc028c81c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028c81fc8 sp=0xc028c81d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028c81fe0 sp=0xc028c81fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028c81fe8 sp=0xc028c81fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6338 [select, 28 minutes]:
runtime.gopark(0xc028d9bf68?, 0x4?, 0x3?, 0x0?, 0xc028d9bdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028d9bc00 sp=0xc028d9bbe0 pc=0x441f16
runtime.selectgo(0xc028d9bf68, 0xc028d9bda8, 0xc028a60ec0?, 0x0, 0xc02b8e6401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028d9bd40 sp=0xc028d9bc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b9e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028d9bfc8 sp=0xc028d9bd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028d9bfe0 sp=0xc028d9bfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028d9bfe8 sp=0xc028d9bfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6237 [select, 28 minutes]:
runtime.gopark(0xc004f38f68?, 0x4?, 0x3?, 0x0?, 0xc004f38db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc004f38c00 sp=0xc004f38be0 pc=0x441f16
runtime.selectgo(0xc004f38f68, 0xc004f38da8, 0xc028201ac0?, 0x0, 0xc01a185d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc004f38d40 sp=0xc004f38c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc004f38fc8 sp=0xc004f38d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc004f38fe0 sp=0xc004f38fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc004f38fe8 sp=0xc004f38fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 5788 [select, 28 minutes]:
runtime.gopark(0xc008179f90?, 0x2?, 0xf8?, 0x9d?, 0xc008179f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc008179db0 sp=0xc008179d90 pc=0x441f16
runtime.selectgo(0xc008179f90, 0xc008179f30, 0xc0300ddf40?, 0x0, 0xc0289a0810?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc008179ef0 sp=0xc008179db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02a2538c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc008179fc8 sp=0xc008179ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc008179fe0 sp=0xc008179fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc008179fe8 sp=0xc008179fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 5787 [select, 28 minutes]:
runtime.gopark(0xc00817df68?, 0x4?, 0x3?, 0x0?, 0xc00817ddb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00817dc00 sp=0xc00817dbe0 pc=0x441f16
runtime.selectgo(0xc00817df68, 0xc00817dda8, 0xc028936640?, 0x0, 0xc0000a2001?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00817dd40 sp=0xc00817dc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02a2538c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00817dfc8 sp=0xc00817dd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00817dfe0 sp=0xc00817dfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00817dfe8 sp=0xc00817dfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 11890 [IO wait, 11 minutes]:
runtime.gopark(0xc017574810?, 0xb?, 0x0?, 0x0?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00569f8c8 sp=0xc00569f8a8 pc=0x441f16
runtime.netpollblock(0x4893a5?, 0x40b58f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:527 +0xf7 fp=0xc00569f900 sp=0xc00569f8c8 pc=0x43a537
internal/poll.runtime_pollWait(0x7f96c27245f0, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/netpoll.go:306 +0x89 fp=0xc00569f920 sp=0xc00569f900 pc=0x46f0a9
internal/poll.(*pollDesc).wait(0xc01625a900?, 0xc001852000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00569f948 sp=0xc00569f920 pc=0x4ac792
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc01625a900, {0xc001852000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/internal/poll/fd_unix.go:167 +0x299 fp=0xc00569f9e0 sp=0xc00569f948 pc=0x4adb79
net.(*netFD).Read(0xc01625a900, {0xc001852000?, 0x58e816?, 0xc004c29a98?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/fd_posix.go:55 +0x29 fp=0xc00569fa28 sp=0xc00569f9e0 pc=0x68ada9
net.(*conn).Read(0xc00b15a4b8, {0xc001852000?, 0xc004c29a98?, 0xc004c29a98?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/net.go:183 +0x45 fp=0xc00569fa70 sp=0xc00569fa28 pc=0x69afe5
net.(*TCPConn).Read(0xc004c29a98?, {0xc001852000?, 0x23c?, 0xc00569fb28?})
:1 +0x29 fp=0xc00569faa0 sp=0xc00569fa70 pc=0x6ad849
net/http.(*persistConn).Read(0xc049074b40, {0xc001852000?, 0x0?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1943 +0x4e fp=0xc00569fb00 sp=0xc00569faa0 pc=0x7a320e
bufio.(*Reader).fill(0xc014dff500)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:106 +0xff fp=0xc00569fb38 sp=0xc00569fb00 pc=0x53a95f
bufio.(*Reader).ReadSlice(0xc014dff500, 0x1?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:372 +0x2f fp=0xc00569fb88 sp=0xc00569fb38 pc=0x53b54f
net/http/internal.readChunkLine(0xd?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc00569fbd8 sp=0xc00569fb88 pc=0x7400c5
net/http/internal.(*chunkedReader).beginChunk(0xc013238150)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc00569fc08 sp=0xc00569fbd8 pc=0x73fb28
net/http/internal.(*chunkedReader).Read(0xc013238150, {0xc0150be000?, 0x2?, 0xc00569fea8?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc00569fc88 sp=0xc00569fc08 pc=0x73fdf6
net/http.(*body).readLocked(0xc0150ba000, {0xc0150be000?, 0xc044808408?, 0xd?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:839 +0x3c fp=0xc00569fcd8 sp=0xc00569fc88 pc=0x79809c
net/http.(*body).Read(0xc00005e778?, {0xc0150be000?, 0xc014dff260?, 0xc014dff260?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transfer.go:831 +0x125 fp=0xc00569fd50 sp=0xc00569fcd8 pc=0x797f65
net/http.(*bodyEOFSignal).Read(0xc0150ba040, {0xc0150be000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2792 +0x142 fp=0xc00569fdd0 sp=0xc00569fd50 pc=0x7a7902
bufio.(*Reader).fill(0xc036160060)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:106 +0xff fp=0xc00569fe08 sp=0xc00569fdd0 pc=0x53a95f
bufio.(*Reader).ReadSlice(0xc036160060, 0xe0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:372 +0x2f fp=0xc00569fe58 sp=0xc00569fe08 pc=0x53b54f
bufio.(*Reader).collectFragments(0xc00e43d1e0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:447 +0x74 fp=0xc00569ff18 sp=0xc00569fe58 pc=0x53b994
bufio.(*Reader).ReadBytes(0x1018d00?, 0xe0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/bufio/bufio.go:474 +0x1d fp=0xc00569ff98 sp=0xc00569ff18 pc=0x53bbbd
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:482 +0x4d fp=0xc00569ffe0 sp=0xc00569ff98 pc=0x86330d
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00569ffe8 sp=0xc00569ffe0 pc=0x475001
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:480 +0x6c5
goroutine 6302 [select, 28 minutes]:
runtime.gopark(0xc028c87f68?, 0x4?, 0x3?, 0x0?, 0xc028c87db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028c87c00 sp=0xc028c87be0 pc=0x441f16
runtime.selectgo(0xc028c87f68, 0xc028c87da8, 0xc028a60d80?, 0x0, 0xc02bf09801?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028c87d40 sp=0xc028c87c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b8c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028c87fc8 sp=0xc028c87d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028c87fe0 sp=0xc028c87fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028c87fe8 sp=0xc028c87fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6258 [select, 28 minutes]:
runtime.gopark(0xc000378f90?, 0x2?, 0xf8?, 0x8d?, 0xc000378f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000378db0 sp=0xc000378d90 pc=0x441f16
runtime.selectgo(0xc000378f90, 0xc000378f30, 0xc0282019c0?, 0x0, 0xc02863d3b0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000378ef0 sp=0xc000378db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a187e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc000378fc8 sp=0xc000378ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc000378fe0 sp=0xc000378fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000378fe8 sp=0xc000378fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6254 [select, 28 minutes]:
runtime.gopark(0xc028bb9f68?, 0x4?, 0x3?, 0x0?, 0xc028bb9db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028bb9c00 sp=0xc028bb9be0 pc=0x441f16
runtime.selectgo(0xc028bb9f68, 0xc028bb9da8, 0xc028201c00?, 0x0, 0xc019500901?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028bb9d40 sp=0xc028bb9c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc02888b560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028bb9fc8 sp=0xc028bb9d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028bb9fe0 sp=0xc028bb9fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028bb9fe8 sp=0xc028bb9fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6238 [select, 28 minutes]:
runtime.gopark(0xc004f3af90?, 0x2?, 0xf8?, 0xad?, 0xc004f3af34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc004f3adb0 sp=0xc004f3ad90 pc=0x441f16
runtime.selectgo(0xc004f3af90, 0xc004f3af30, 0xc02879da00?, 0x0, 0xc0289a1d10?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc004f3aef0 sp=0xc004f3adb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc004f3afc8 sp=0xc004f3aef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc004f3afe0 sp=0xc004f3afc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc004f3afe8 sp=0xc004f3afe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6226 [select, 28 minutes]:
runtime.gopark(0xc005629f90?, 0x2?, 0xf8?, 0x9d?, 0xc005629f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc005629db0 sp=0xc005629d90 pc=0x441f16
runtime.selectgo(0xc005629f90, 0xc005629f30, 0xc02879d640?, 0x0, 0xc0289a1530?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc005629ef0 sp=0xc005629db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b0e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc005629fc8 sp=0xc005629ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc005629fe0 sp=0xc005629fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc005629fe8 sp=0xc005629fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6187 [select, 28 minutes]:
runtime.gopark(0xc0076ccf90?, 0x2?, 0xf8?, 0xcd?, 0xc0076ccf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0076ccdb0 sp=0xc0076ccd90 pc=0x441f16
runtime.selectgo(0xc0076ccf90, 0xc0076ccf30, 0xc028936b00?, 0x0, 0xc0289514a0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0076ccef0 sp=0xc0076ccdb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a185a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc0076ccfc8 sp=0xc0076ccef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc0076ccfe0 sp=0xc0076ccfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0076ccfe8 sp=0xc0076ccfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6192 [select, 28 minutes]:
runtime.gopark(0xc0076c7f68?, 0x4?, 0x3?, 0x0?, 0xc0076c7db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc0076c7c00 sp=0xc0076c7be0 pc=0x441f16
runtime.selectgo(0xc0076c7f68, 0xc0076c7da8, 0xc02879d680?, 0x0, 0xc00a61f401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc0076c7d40 sp=0xc0076c7c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a186c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc0076c7fc8 sp=0xc0076c7d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc0076c7fe0 sp=0xc0076c7fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0076c7fe8 sp=0xc0076c7fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6193 [select, 28 minutes]:
runtime.gopark(0xc000376f90?, 0x2?, 0xf8?, 0x6d?, 0xc000376f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc000376db0 sp=0xc000376d90 pc=0x441f16
runtime.selectgo(0xc000376f90, 0xc000376f30, 0xc028936c80?, 0x0, 0xc0289517d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc000376ef0 sp=0xc000376db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a186c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc000376fc8 sp=0xc000376ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc000376fe0 sp=0xc000376fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000376fe8 sp=0xc000376fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6225 [select, 28 minutes]:
runtime.gopark(0xc00562ff68?, 0x4?, 0x3?, 0x0?, 0xc00562fdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00562fc00 sp=0xc00562fbe0 pc=0x441f16
runtime.selectgo(0xc00562ff68, 0xc00562fda8, 0xc028936dc0?, 0x0, 0xc00a61f401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00562fd40 sp=0xc00562fc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a187e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00562ffc8 sp=0xc00562fd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00562ffe0 sp=0xc00562ffc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00562ffe8 sp=0xc00562ffe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6262 [select, 28 minutes]:
runtime.gopark(0xc007c2df90?, 0x2?, 0xf8?, 0xdd?, 0xc007c2df34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c2ddb0 sp=0xc007c2dd90 pc=0x441f16
runtime.selectgo(0xc007c2df90, 0xc007c2df30, 0xc028201a40?, 0x0, 0xc02863d4d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c2def0 sp=0xc007c2ddb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18a20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc007c2dfc8 sp=0xc007c2def0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc007c2dfe0 sp=0xc007c2dfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c2dfe8 sp=0xc007c2dfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6259 [select, 28 minutes]:
runtime.gopark(0xc00562ef68?, 0x4?, 0x3?, 0x0?, 0xc00562edb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc00562ec00 sp=0xc00562ebe0 pc=0x441f16
runtime.selectgo(0xc00562ef68, 0xc00562eda8, 0xc02879d7c0?, 0x0, 0xc02bf65401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc00562ed40 sp=0xc00562ec00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18900)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc00562efc8 sp=0xc00562ed40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc00562efe0 sp=0xc00562efc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00562efe8 sp=0xc00562efe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6264 [select, 28 minutes]:
runtime.gopark(0xc004f37f90?, 0x2?, 0xf8?, 0x7d?, 0xc004f37f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc004f37db0 sp=0xc004f37d90 pc=0x441f16
runtime.selectgo(0xc004f37f90, 0xc004f37f30, 0xc028201a80?, 0x0, 0xc02863d560?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc004f37ef0 sp=0xc004f37db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18b40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc004f37fc8 sp=0xc004f37ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc004f37fe0 sp=0xc004f37fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc004f37fe8 sp=0xc004f37fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6261 [select, 28 minutes]:
runtime.gopark(0xc004f36f68?, 0x4?, 0x3?, 0x0?, 0xc004f36db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc004f36c00 sp=0xc004f36be0 pc=0x441f16
runtime.selectgo(0xc004f36f68, 0xc004f36da8, 0xc028936fc0?, 0x0, 0xc01a185d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc004f36d40 sp=0xc004f36c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18a20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc004f36fc8 sp=0xc004f36d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc004f36fe0 sp=0xc004f36fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc004f36fe8 sp=0xc004f36fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6326 [select, 28 minutes]:
runtime.gopark(0xc028da1f90?, 0x2?, 0xf8?, 0x1d?, 0xc028da1f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028da1db0 sp=0xc028da1d90 pc=0x441f16
runtime.selectgo(0xc028da1f90, 0xc028da1f30, 0xc0145c0980?, 0x0, 0xc00d6eb6e0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028da1ef0 sp=0xc028da1db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a197a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028da1fc8 sp=0xc028da1ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028da1fe0 sp=0xc028da1fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028da1fe8 sp=0xc028da1fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6263 [select, 28 minutes]:
runtime.gopark(0xc007c2ef68?, 0x4?, 0x3?, 0x0?, 0xc007c2edb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc007c2ec00 sp=0xc007c2ebe0 pc=0x441f16
runtime.selectgo(0xc007c2ef68, 0xc007c2eda8, 0xc02879d900?, 0x0, 0xc0383ffb01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc007c2ed40 sp=0xc007c2ec00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18b40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc007c2efc8 sp=0xc007c2ed40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc007c2efe0 sp=0xc007c2efc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc007c2efe8 sp=0xc007c2efe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6255 [select, 28 minutes]:
runtime.gopark(0xc028bbef90?, 0x2?, 0xf8?, 0xed?, 0xc028bbef34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028bbedb0 sp=0xc028bbed90 pc=0x441f16
runtime.selectgo(0xc028bbef90, 0xc028bbef30, 0xc028937200?, 0x0, 0xc028a4c360?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028bbeef0 sp=0xc028bbedb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028bbefc8 sp=0xc028bbeef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028bbefe0 sp=0xc028bbefc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028bbefe8 sp=0xc028bbefe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6252 [select, 28 minutes]:
runtime.gopark(0xc004f3cf68?, 0x4?, 0x3?, 0x0?, 0xc004f3cdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc004f3cc00 sp=0xc004f3cbe0 pc=0x441f16
runtime.selectgo(0xc004f3cf68, 0xc004f3cda8, 0xc02879da40?, 0x0, 0xc0339d7501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc004f3cd40 sp=0xc004f3cc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18c60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc004f3cfc8 sp=0xc004f3cd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc004f3cfe0 sp=0xc004f3cfc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc004f3cfe8 sp=0xc004f3cfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6253 [select, 28 minutes]:
runtime.gopark(0xc028bbdf90?, 0x2?, 0xf8?, 0xdd?, 0xc028bbdf34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028bbddb0 sp=0xc028bbdd90 pc=0x441f16
runtime.selectgo(0xc028bbdf90, 0xc028bbdf30, 0xc0289371c0?, 0x0, 0xc028a4c2d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028bbdef0 sp=0xc028bbddb0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18c60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028bbdfc8 sp=0xc028bbdef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028bbdfe0 sp=0xc028bbdfc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028bbdfe8 sp=0xc028bbdfe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6292 [select, 28 minutes]:
runtime.gopark(0xc028bbaf68?, 0x4?, 0x3?, 0x0?, 0xc028bbadb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028bbac00 sp=0xc028bbabe0 pc=0x441f16
runtime.selectgo(0xc028bbaf68, 0xc028bbada8, 0xc028a606c0?, 0x0, 0xc009970901?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028bbad40 sp=0xc028bbac00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18d80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028bbafc8 sp=0xc028bbad40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028bbafe0 sp=0xc028bbafc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028bbafe8 sp=0xc028bbafe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6313 [select, 28 minutes]:
runtime.gopark(0xc028ad8f90?, 0x2?, 0xf8?, 0x8d?, 0xc028ad8f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028ad8db0 sp=0xc028ad8d90 pc=0x441f16
runtime.selectgo(0xc028ad8f90, 0xc028ad8f30, 0xc028a60800?, 0x0, 0xc028a4ca80?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028ad8ef0 sp=0xc028ad8db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc02888b680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028ad8fc8 sp=0xc028ad8ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028ad8fe0 sp=0xc028ad8fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028ad8fe8 sp=0xc028ad8fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6310 [select, 28 minutes]:
runtime.gopark(0xc028ad6f68?, 0x4?, 0x3?, 0x0?, 0xc028ad6db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028ad6c00 sp=0xc028ad6be0 pc=0x441f16
runtime.selectgo(0xc028ad6f68, 0xc028ad6da8, 0xc02879dc80?, 0x0, 0xc02bf65401?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028ad6d40 sp=0xc028ad6c00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a18ea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028ad6fc8 sp=0xc028ad6d40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028ad6fe0 sp=0xc028ad6fc8 pc=0x7a27c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028ad6fe8 sp=0xc028ad6fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x16ea
goroutine 6311 [select, 28 minutes]:
runtime.gopark(0xc028ad7f90?, 0x2?, 0xf8?, 0x7d?, 0xc028ad7f34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028ad7db0 sp=0xc028ad7d90 pc=0x441f16
runtime.selectgo(0xc028ad7f90, 0xc028ad7f30, 0xc028a607c0?, 0x0, 0xc028a4c9f0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028ad7ef0 sp=0xc028ad7db0 pc=0x4521be
net/http.(*persistConn).writeLoop(0xc028a18ea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2410 +0xf2 fp=0xc028ad7fc8 sp=0xc028ad7ef0 pc=0x7a5cf2
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x26 fp=0xc028ad7fe0 sp=0xc028ad7fc8 pc=0x7a2766
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc028ad7fe8 sp=0xc028ad7fe0 pc=0x475001
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1766 +0x173d
goroutine 6323 [select, 28 minutes]:
runtime.gopark(0xc028d9ff68?, 0x4?, 0x0?, 0x0?, 0xc028d9fdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/proc.go:381 +0xd6 fp=0xc028d9fc00 sp=0xc028d9fbe0 pc=0x441f16
runtime.selectgo(0xc028d9ff68, 0xc028d9fda8, 0xc02879dfc0?, 0x0, 0xc015978501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/runtime/select.go:327 +0x7be fp=0xc028d9fd40 sp=0xc028d9fc00 pc=0x4521be
net/http.(*persistConn).readLoop(0xc028a19680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:2227 +0xd85 fp=0xc028d9ffc8 sp=0xc028d9fd40 pc=0x7a4c05
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.20.4/go/src/net/http/transport.go:1765 +0x26 fp=0xc028d9ffe0 sp=0xc028d9ffc8 pc=0x7a27c6
runtime.goexit()
/home/b