Building
Started building at 2023/09/12 09:30:55
Using pegged server, 1467 build
Calculating base
Updating mirror
Basing run on 7.6.0-1467 8820063a7b
Updating tree for run 12.09.2023-09.30
query is at fc4ec6b, changes since last good build: none
gometa is at 96e745a, changes since last good build: none
ns_server is at 57d74a0, changes since last good build: none
couchstore is at c392c9b, changes since last good build: none
forestdb is at 7af87ef, changes since last good build: none
kv_engine is at e36344c, changes since last good build: none
Switching indexing to unstable
indexing is at 8cc66e6, changes since last good build:
8cc66e67 MB-57860 - use config flag to honour `nodes` in with clause
Switching plasma to unstable
plasma is at 40f4da5, changes since last good build:
fatal: Invalid revision range 7276d1b24065c3e32bd0d28a9821f6bc45936e5d..HEAD
Switching nitro to unstable
nitro is at f6a9378, changes since last good build: none
Switching gometa to master
gometa is at 96e745a, changes since last good build: none
Switching testrunner to master
Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client'
Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI'
Submodule 'magma_loader/DocLoader' (https://github.com/couchbaselabs/DocLoader.git) registered for path 'magma_loader/DocLoader'
Cloning into '/opt/build/testrunner/java_sdk_client'...
Cloning into '/opt/build/testrunner/lib/capellaAPI'...
Cloning into '/opt/build/testrunner/magma_loader/DocLoader'...
Submodule path 'java_sdk_client': checked out 'de89b059ce28567dbac18afb032271a4eaa674ff'
Submodule path 'lib/capellaAPI': checked out '30b0c20e11643bac1a5b780a5efdaa04021cb944'
Submodule path 'magma_loader/DocLoader': checked out '0f32672eea77681939c9b26d43f60bd4b3478936'
testrunner is at 333d506, changes since last good build: none
Pulling in uncommitted change 191342 at refs/changes/42/191342/9
Total 8 (delta 5), reused 5 (delta 5)
[unstable 77b05ef9] MB-57427: disable array index tests
Author: Dhruvil Shah
Date: Mon May 22 10:24:11 2023 +0530
2 files changed, 7 insertions(+), 1 deletion(-)
Pulling in uncommitted change 193825 at refs/changes/25/193825/1
Total 6 (delta 5), reused 6 (delta 5)
[unstable 0e34263f] MB100: CIFail - Enable info level client logs after TestScheduleIndexBasic
Author: Sai Krishna Teja Kommaraju
Date: Fri Jul 14 00:58:44 2023 +0530
1 file changed, 3 insertions(+)
Pulling in uncommitted change 195279 at refs/changes/79/195279/2
Total 5 (delta 4), reused 5 (delta 4)
[unstable 5c393054] MB-57825: Enable LSS flush buffer tuning
Author: Saptarshi Sen
Date: Fri Aug 11 10:53:36 2023 -0700
1 file changed, 6 insertions(+), 6 deletions(-)
Pulling in uncommitted change 196757 at refs/changes/57/196757/4
Total 5 (delta 4), reused 5 (delta 4)
[unstable bf137b04] MB-58538 Handle failures during index recovery
Author: Varun Velamuri
Date: Wed Sep 6 14:38:00 2023 -0700
1 file changed, 22 insertions(+), 10 deletions(-)
Pulling in uncommitted change 196852 at refs/changes/52/196852/2
Total 10 (delta 7), reused 10 (delta 7)
[unstable 8eb64f1c] MB-57930 - move plasma dependencies to separate file
Author: Dhruvil Shah
Date: Fri Sep 8 16:31:05 2023 +0530
6 files changed, 134 insertions(+), 37 deletions(-)
create mode 100644 secondary/indexer/pause_copier_community.go
create mode 100644 secondary/indexer/pause_copier_enterprise.go
Pulling in uncommitted change 196894 at refs/changes/94/196894/2
Total 7 (delta 5), reused 7 (delta 5)
[unstable 51d5c763] MB-57930: Refactor Prometheus storage stats
Author: jineshparakh
Date: Sat Sep 9 18:43:17 2023 +0530
3 files changed, 173 insertions(+), 125 deletions(-)
create mode 100644 secondary/indexer/storage_stats_manager_community.go
create mode 100644 secondary/indexer/storage_stats_manager_enterprise.go
Pulling in uncommitted change 196039 at refs/changes/39/196039/4
Total 18 (delta 7), reused 7 (delta 7)
[unstable 2227f04] MB-58392: Add/update flush buffer unit tests
Author: Saptarshi Sen
Date: Thu Aug 24 15:55:02 2023 -0700
3 files changed, 173 insertions(+), 81 deletions(-)
Pulling in uncommitted change 196295 at refs/changes/95/196295/2
[unstable 84524fd] MB-58392: Fix a timer panic on zero LSSSampleInterval
Author: Saptarshi Sen
Date: Mon Aug 28 14:16:41 2023 -0700
1 file changed, 1 insertion(+), 1 deletion(-)
Pulling in uncommitted change 196296 at refs/changes/96/196296/2
[unstable f94db93] MB-57825: Do not exceed flush buffer limit on resumeIO for idleLSS
Author: Saptarshi Sen
Date: Mon Aug 28 16:12:34 2023 -0700
2 files changed, 108 insertions(+), 6 deletions(-)
Pulling in uncommitted change 196557 at refs/changes/57/196557/9
Total 11 (delta 9), reused 11 (delta 9)
[unstable 7431dcb] MB-58423: Perform tenant quota adjustment asynchronously
Author: jliang00
Date: Fri Sep 1 09:30:02 2023 -0700
6 files changed, 321 insertions(+), 48 deletions(-)
Building community edition
Building cmakefiles and deps [CE]
Building main product [CE]
Build CE finished
BUILD_ENTERPRISE empty. Building enterprise edition
Building Enterprise Edition
Building cmakefiles and deps [EE]
Building main product [EE]
Build EE finished
Testing
Started testing at 2023/09/12 10:26:20
Testing mode: sanity,unit,functional,serverless,integration
Using storage type: plasma
Setting ulimit to 200000
Simple Test
Sep 12 10:28:01 suite_setUp (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 12 10:32:33 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 12 10:37:00 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 12 10:41:32 b" 'stop_on_failure': 'True'}"
Sep 12 10:41:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=50000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True,doc_ops=create;update;delete'
Sep 12 10:41:32 b"{'nodes_in': '3', 'replicas': '1', 'items': '50000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 1, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_10-26-43/test_1'}"
Sep 12 10:41:32 b'-->result: '
Sep 12 10:41:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0'
Sep 12 10:41:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,bucket_type=ephemeral,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Sep 12 10:41:32 b"{'nodes_in': '3', 'bucket_type': 'ephemeral', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 2, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_10-26-43/test_2'}"
Sep 12 10:41:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 10:41:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t memcapable.WarmUpMemcachedTest.do_warmup_100k,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True'
Sep 12 10:41:32 b"{'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 3, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_10-26-43/test_3'}"
Sep 12 10:41:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 10:41:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 10:41:32 b'failures so far...'
Sep 12 10:41:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.createdeleteview.CreateDeleteViewTests.test_view_ops,ddoc_ops=create,test_with_view=True,num_ddocs=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,num_views_per_ddoc=10,items=1000,skip_cleanup=False,get-logs-cluster-run=True'
Sep 12 10:41:32 b"{'ddoc_ops': 'create', 'test_with_view': 'True', 'num_ddocs': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'num_views_per_ddoc': '10', 'items': '1000', 'skip_cleanup': 'False', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 4, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_10-26-43/test_4'}"
Sep 12 10:42:45 b'http://127.0.0.1:9003/pools/default with status False: unknown pool'ok
Sep 12 10:52:40 test_employee_dataset_startkey_endkey_queries_rebalance_in (view.viewquerytests.ViewQueryTests) ... ok
Sep 12 10:53:29 test_simple_dataset_stale_queries_data_modification (view.viewquerytests.ViewQueryTests) ... ok
Sep 12 10:57:46 load_with_ops (xdcr.uniXDCR.unidirectional) ... ok
Sep 12 10:59:57 load_with_failover (xdcr.uniXDCR.unidirectional) ...
Sep 12 10:59:57 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 10:59:57 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 10:59:57 b'failures so far...'
Sep 12 10:59:57 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 10:59:57 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,num_nodes_to_add=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,docs-per-day=1,timeout=1200,get-logs-cluster-run=True'
Sep 12 10:59:57 b"{'num_nodes_to_add': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'docs-per-day': '1', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 5, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_10-26-43/test_5'}"
Sep 12 10:59:57 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 10:59:57 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 10:59:57 b'failures so far...'
Sep 12 10:59:57 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 10:59:57 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0'
Sep 12 10:59:57 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'
Sep 12 10:59:57 b"{'num-docs': '1000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 6, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_10-26-43/test_6'}"
Sep 12 10:59:57 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 10:59:57 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 10:59:57 b'failures so far...'
Sep 12 10:59:57 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 10:59:57 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 12 10:59:57 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_ops,replicas=1,items=10000,value_size=128,ctopology=chain,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,rdirection=unidirection,doc-ops=update-delete,get-logs-cluster-run=True'
Sep 12 10:59:57 b"{'replicas': '1', 'items': '10000', 'value_size': '128', 'ctopology': 'chain', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 7, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_10-26-43/test_7'}"
Sep 12 10:59:57 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 10:59:57 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 10:59:57 b'failures so far...'
Sep 12 10:59:57 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 10:59:57 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 12 10:59:57 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0'
Sep 12 10:59:57 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Sep 12 10:59:57 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_10-26-43/test_8'}"
Sep 12 11:02:03 b'http://127.0.0.1:9001/pools/default with status False: unknown pool'ok
Sep 12 11:04:55 suite_tearDown (xdcr.uniXDCR.unidirectional) ... ok
Sep 12 11:04:57 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 11:04:57 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 11:04:57 b'failures so far...'
Sep 12 11:04:57 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 11:04:57 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 12 11:04:57 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0'
Sep 12 11:04:57 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Sep 12 11:04:57 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Sep 12 11:04:57 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Sep 12 11:04:57 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' fail ')"
Sep 12 11:04:57 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' pass')"
Sep 12 11:04:57 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' pass')"
Sep 12 11:04:57 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' pass')"
Sep 12 11:04:57 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' pass')"
Sep 12 11:04:57 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' pass')"
Sep 12 11:04:57 Makefile:30: recipe for target 'simple-test' failed
Unit tests
=== RUN TestMerger
--- PASS: TestMerger (0.02s)
=== RUN TestInsert
--- PASS: TestInsert (0.00s)
=== RUN TestInsertPerf
16000 items took 15.872589ms -> 1.0080271088730389e+06 items/s conflicts 2
--- PASS: TestInsertPerf (0.02s)
=== RUN TestGetPerf
16000 items took 9.345911ms -> 1.7119786396425131e+06 items/s
--- PASS: TestGetPerf (0.01s)
=== RUN TestGetRangeSplitItems
{
"node_count": 1000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3620,
"memory_used": 45792,
"node_allocs": 1000,
"node_frees": 0,
"level_node_distribution":{
"level0": 736,
"level1": 195,
"level2": 49,
"level3": 12,
"level4": 7,
"level5": 1,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Split range keys [264 296 550 792]
No of items in each range [264 32 254 242 208]
--- PASS: TestGetRangeSplitItems (0.00s)
=== RUN TestBuilder
{
"node_count": 50000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3343,
"memory_used": 2267440,
"node_allocs": 50000,
"node_frees": 0,
"level_node_distribution":{
"level0": 37548,
"level1": 9317,
"level2": 2310,
"level3": 597,
"level4": 173,
"level5": 36,
"level6": 18,
"level7": 1,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 6.723565ms to build 50000 items, 7.436531e+06 items/sec
Took 4.34271ms to iterate 50000 items
--- PASS: TestBuilder (0.01s)
=== RUN TestNodeDCAS
--- PASS: TestNodeDCAS (0.00s)
PASS
ok github.com/couchbase/nitro/skiplist 0.074s
=== RUN TestZstdSimple
--- PASS: TestZstdSimple (0.00s)
=== RUN TestZstdCompressBound
--- PASS: TestZstdCompressBound (3.07s)
=== RUN TestZstdErrors
--- PASS: TestZstdErrors (0.00s)
=== RUN TestZstdCompressLevels
--- PASS: TestZstdCompressLevels (0.77s)
=== RUN TestZstdEmptySrc
--- PASS: TestZstdEmptySrc (0.00s)
=== RUN TestZstdLargeSrc
--- PASS: TestZstdLargeSrc (0.00s)
PASS
ok github.com/couchbase/plasma/zstd 3.850s
go: downloading github.com/aws/aws-sdk-go-v2 v1.18.0
go: downloading github.com/aws/aws-sdk-go-v2/config v1.18.22
go: downloading github.com/aws/aws-sdk-go-v2/service/s3 v1.33.0
go: downloading github.com/aws/smithy-go v1.13.5
go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.18.10
go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.13.21
go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.3.34
go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.14.9
go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.13.3
go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.12.9
go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.9.11
go: downloading github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.4.10
go: downloading github.com/aws/aws-sdk-go-v2/internal/v4a v1.0.25
go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.9.27
go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.1.33
go: downloading github.com/aws/aws-sdk-go-v2/service/internal/checksum v1.1.28
go: downloading github.com/aws/aws-sdk-go-v2/service/internal/s3shared v1.14.2
go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.4.27
=== RUN TestAutoTunerWriteUsageStats
--- PASS: TestAutoTunerWriteUsageStats (12.03s)
=== RUN TestAutoTunerReadUsageStats
--- PASS: TestAutoTunerReadUsageStats (8.57s)
=== RUN TestAutoTunerCleanerUsageStats
--- PASS: TestAutoTunerCleanerUsageStats (9.44s)
=== RUN TestAutoTunerDiskStats
--- PASS: TestAutoTunerDiskStats (2.50s)
=== RUN TestAutoTunerTargetFragRatio
--- PASS: TestAutoTunerTargetFragRatio (0.00s)
=== RUN TestAutoTunerExcessUsedSpace
--- PASS: TestAutoTunerExcessUsedSpace (0.00s)
=== RUN TestAutoTunerUsedSpaceRatio
--- PASS: TestAutoTunerUsedSpaceRatio (0.00s)
=== RUN TestAutoTunerAdjustFragRatio
--- PASS: TestAutoTunerAdjustFragRatio (0.00s)
=== RUN TestAutoTuneFlushBufferAdjustMemQuotaSingleShard
--- PASS: TestAutoTuneFlushBufferAdjustMemQuotaSingleShard (16.57s)
=== RUN TestAutoTuneFlushBufferAdjustMemQuotaManyShards
--- PASS: TestAutoTuneFlushBufferAdjustMemQuotaManyShards (17.51s)
=== RUN TestAutoTuneFlushBufferRebalanceIdleShards
--- PASS: TestAutoTuneFlushBufferRebalanceIdleShards (15.26s)
=== RUN TestAutoTuneFlushBufferGetUsedMemory
--- PASS: TestAutoTuneFlushBufferGetUsedMemory (28.14s)
=== RUN TestAutoTuneFlushBufferIdleResume
--- PASS: TestAutoTuneFlushBufferIdleResume (1.52s)
=== RUN TestBloom
--- PASS: TestBloom (6.74s)
=== RUN TestBloomDisableEnable
--- PASS: TestBloomDisableEnable (3.93s)
=== RUN TestBloomDisable
--- PASS: TestBloomDisable (0.06s)
=== RUN TestBloomFreeDuringLookup
--- PASS: TestBloomFreeDuringLookup (0.04s)
=== RUN TestBloomRecoveryFreeDuringLookup
--- PASS: TestBloomRecoveryFreeDuringLookup (0.07s)
=== RUN TestBloomRecoverySwapInLookup
--- PASS: TestBloomRecoverySwapInLookup (0.11s)
=== RUN TestBloomRecoverySwapOutLookup
--- PASS: TestBloomRecoverySwapOutLookup (0.10s)
=== RUN TestBloomRecoveryInserts
--- PASS: TestBloomRecoveryInserts (0.09s)
=== RUN TestBloomRecovery
--- PASS: TestBloomRecovery (0.15s)
=== RUN TestBloomStats
--- PASS: TestBloomStats (3.89s)
=== RUN TestBloomStatsRecovery
--- PASS: TestBloomStatsRecovery (1.36s)
=== RUN TestBloomFilterSimple
--- PASS: TestBloomFilterSimple (0.00s)
=== RUN TestBloomFilterConcurrent
--- PASS: TestBloomFilterConcurrent (22.14s)
=== RUN TestBitArrayConcurrent
--- PASS: TestBitArrayConcurrent (1.05s)
=== RUN TestBloomCapacity
--- PASS: TestBloomCapacity (0.00s)
=== RUN TestBloomNumHashFuncs
--- PASS: TestBloomNumHashFuncs (0.00s)
=== RUN TestBloomTestAndAdd
--- PASS: TestBloomTestAndAdd (0.21s)
=== RUN TestBloomReset
--- PASS: TestBloomReset (0.00s)
=== RUN TestLFSCopier
--- PASS: TestLFSCopier (0.00s)
=== RUN TestNodeCopier
--- PASS: TestNodeCopier (0.02s)
=== RUN TestLFSCopierNumBytes
--- PASS: TestLFSCopierNumBytes (0.01s)
=== RUN TestNodeCopierNumBytes
--- PASS: TestNodeCopierNumBytes (0.04s)
=== RUN TestCopierRestoreFile
--- PASS: TestCopierRestoreFile (0.00s)
=== RUN TestCopierUploadDownloadBytes
--- PASS: TestCopierUploadDownloadBytes (0.02s)
=== RUN TestCopierKeyEncoding
--- PASS: TestCopierKeyEncoding (0.23s)
=== RUN TestS3CopierWithRetry
--- PASS: TestS3CopierWithRetry (0.00s)
=== RUN TestS3RateLimitUnsignedPayload
--- PASS: TestS3RateLimitUnsignedPayload (0.00s)
=== RUN TestSBCopyConcurrent
--- PASS: TestSBCopyConcurrent (1.33s)
=== RUN TestSBCopyCorrupt
--- PASS: TestSBCopyCorrupt (0.02s)
=== RUN TestLSSCopyHeadTailSingleSegment
--- PASS: TestLSSCopyHeadTailSingleSegment (0.06s)
=== RUN TestLSSCopyFullSegments
--- PASS: TestLSSCopyFullSegments (0.74s)
=== RUN TestLSSCopyPartialSegments
--- PASS: TestLSSCopyPartialSegments (1.11s)
=== RUN TestLSSCopyHolePunching
--- PASS: TestLSSCopyHolePunching (0.71s)
=== RUN TestLSSCopyConcurrent
--- PASS: TestLSSCopyConcurrent (1.03s)
=== RUN TestLSSCopyHeapUsage
--- PASS: TestLSSCopyHeapUsage (18.74s)
=== RUN TestLSSCopyWithError
--- PASS: TestLSSCopyWithError (0.00s)
=== RUN TestRateLimitReaderSeekOff
--- PASS: TestRateLimitReaderSeekOff (11.80s)
=== RUN TestRateLimitMaxIOPS
--- PASS: TestRateLimitMaxIOPS (15.58s)
=== RUN TestNodeRateLimiterUpdate
--- PASS: TestNodeRateLimiterUpdate (0.00s)
=== RUN TestNodeRateLimiterMaxIOPs
--- PASS: TestNodeRateLimiterMaxIOPs (78.13s)
=== RUN TestRateLimitConcurrentLSSCopy
--- PASS: TestRateLimitConcurrentLSSCopy (17.06s)
=== RUN TestRateLimitDynamicConcurrentLSSCopy
--- PASS: TestRateLimitDynamicConcurrentLSSCopy (13.17s)
=== RUN TestShardCopySimple
--- PASS: TestShardCopySimple (0.61s)
=== RUN TestShardCopyWithCancel
--- PASS: TestShardCopyWithCancel (10.66s)
=== RUN TestShardCopyNoRP
--- PASS: TestShardCopyNoRP (0.28s)
=== RUN TestShardCopyMetadataCorrupted
--- PASS: TestShardCopyMetadataCorrupted (0.03s)
=== RUN TestShardCopyMetadataCorruptedII
--- PASS: TestShardCopyMetadataCorruptedII (0.17s)
=== RUN TestShardCopyLSSMetadataCorrupted
--- PASS: TestShardCopyLSSMetadataCorrupted (0.08s)
=== RUN TestShardCopyBeforeRecovery
--- PASS: TestShardCopyBeforeRecovery (0.00s)
=== RUN TestShardCopySkipLog
--- PASS: TestShardCopySkipLog (1.20s)
=== RUN TestShardCopyAddInstance
--- PASS: TestShardCopyAddInstance (2.38s)
=== RUN TestShardCopyDestroyInstance
--- PASS: TestShardCopyDestroyInstance (0.47s)
=== RUN TestShardCopyRestoreShard
--- PASS: TestShardCopyRestoreShard (19.01s)
=== RUN TestShardCopyRestoreManyShards
--- PASS: TestShardCopyRestoreManyShards (10.65s)
=== RUN TestShardCopyRestoreConcurrentLogCleaning
--- PASS: TestShardCopyRestoreConcurrentLogCleaning (21.06s)
=== RUN TestShardCopyRestorePartialRollback
--- PASS: TestShardCopyRestorePartialRollback (24.32s)
=== RUN TestInvalidMVCCRollback
--- PASS: TestInvalidMVCCRollback (0.34s)
=== RUN TestShardCopyRestoreConcurrentPurges
--- PASS: TestShardCopyRestoreConcurrentPurges (20.38s)
=== RUN TestShardCopyRestoreRepairHdr
--- PASS: TestShardCopyRestoreRepairHdr (209.10s)
=== RUN TestShardCopyDuplicateIndex
--- PASS: TestShardCopyDuplicateIndex (0.28s)
=== RUN TestShardCopyEmptyIndex
--- PASS: TestShardCopyEmptyIndex (0.21s)
=== RUN TestTenantCopy
--- PASS: TestTenantCopy (6.77s)
=== RUN TestLockShardAddInstance
--- PASS: TestLockShardAddInstance (0.31s)
=== RUN TestLockShardAddInstanceMapping
--- PASS: TestLockShardAddInstanceMapping (0.28s)
=== RUN TestLockShardCloseInstance
--- PASS: TestLockShardCloseInstance (0.47s)
=== RUN TestLockShardEmptyShard
--- PASS: TestLockShardEmptyShard (0.20s)
=== RUN TestLockShardUseShardId
--- PASS: TestLockShardUseShardId (0.28s)
=== RUN TestLockShardUseShardIdII
--- PASS: TestLockShardUseShardIdII (0.06s)
=== RUN TestDestroyShardID
--- PASS: TestDestroyShardID (1.23s)
=== RUN TestDestroyShardIDConcurrent
--- PASS: TestDestroyShardIDConcurrent (0.19s)
=== RUN TestDestroyShardIDNumTenants
--- PASS: TestDestroyShardIDNumTenants (0.57s)
=== RUN TestDestroyShardIDTenantAddRemove
--- PASS: TestDestroyShardIDTenantAddRemove (0.24s)
=== RUN TestDestroyShardIDOnRestoreFailure
--- PASS: TestDestroyShardIDOnRestoreFailure (0.77s)
=== RUN TestDestroyShardIDOnRestoreFailure2
--- PASS: TestDestroyShardIDOnRestoreFailure2 (1.02s)
=== RUN TestTransferShardAPI
--- PASS: TestTransferShardAPI (272.95s)
=== RUN TestTransferShardAPICreateIndexes
--- PASS: TestTransferShardAPICreateIndexes (19.23s)
=== RUN TestTransferShardAPIWithDropIndexes
--- PASS: TestTransferShardAPIWithDropIndexes (6.30s)
=== RUN TestTransferShardAPIWithCancel
--- PASS: TestTransferShardAPIWithCancel (6.91s)
=== RUN TestTransferShardAPIWithCleanup
--- PASS: TestTransferShardAPIWithCleanup (89.53s)
=== RUN TestRestoreShardAPI
--- PASS: TestRestoreShardAPI (6.62s)
=== RUN TestRestoreShardNumShards
--- PASS: TestRestoreShardNumShards (0.34s)
=== RUN TestRestoreShardInvalidLocation
--- PASS: TestRestoreShardInvalidLocation (0.11s)
=== RUN TestRestoreShardReplicaRepair
--- PASS: TestRestoreShardReplicaRepair (19.71s)
=== RUN TestRestoreShardDone
--- PASS: TestRestoreShardDone (0.95s)
=== RUN TestRestoreShardDoneConcurrent
--- PASS: TestRestoreShardDoneConcurrent (1.74s)
=== RUN TestRestoreShardDoneDroppedInstances
--- PASS: TestRestoreShardDoneDroppedInstances (1.30s)
=== RUN TestShardDoCleanupAPI
--- PASS: TestShardDoCleanupAPI (1.23s)
=== RUN TestShardDoCleanupAPI2
--- PASS: TestShardDoCleanupAPI2 (25.59s)
=== RUN TestRestoreShardPauseResume
--- PASS: TestRestoreShardPauseResume (13.59s)
=== RUN TestRateLimitConcurrentTransferRestoreShard
--- PASS: TestRateLimitConcurrentTransferRestoreShard (384.28s)
=== RUN TestDiag
--- PASS: TestDiag (0.73s)
=== RUN TestDumpLog
--- PASS: TestDumpLog (0.10s)
=== RUN TestExtrasN1
=== RUN TestExtrasN2
=== RUN TestExtrasN3
=== RUN TestGMRecovery
--- PASS: TestGMRecovery (13.64s)
=== RUN TestIteratorSimple
--- PASS: TestIteratorSimple (4.93s)
=== RUN TestIteratorSeek
--- PASS: TestIteratorSeek (5.94s)
=== RUN TestPlasmaIteratorSeekFirst
--- PASS: TestPlasmaIteratorSeekFirst (0.52s)
=== RUN TestPlasmaIteratorSwapin
--- PASS: TestPlasmaIteratorSwapin (5.07s)
=== RUN TestIteratorSetEnd
--- PASS: TestIteratorSetEnd (0.76s)
=== RUN TestIterHiItm
--- PASS: TestIterHiItm (2.78s)
=== RUN TestIterDeleteSplitMerge
--- PASS: TestIterDeleteSplitMerge (0.03s)
=== RUN TestKeySamplingSingle
--- PASS: TestKeySamplingSingle (0.14s)
=== RUN TestKeySamplingAll
--- PASS: TestKeySamplingAll (0.17s)
=== RUN TestKeySamplingEmpty
--- PASS: TestKeySamplingEmpty (0.04s)
=== RUN TestKeySamplingExceed
--- PASS: TestKeySamplingExceed (0.15s)
=== RUN TestLogOperation
--- PASS: TestLogOperation (60.00s)
=== RUN TestLogLargeSize
--- PASS: TestLogLargeSize (0.16s)
=== RUN TestLogTrim
--- PASS: TestLogTrim (59.84s)
=== RUN TestLogSuperblockCorruption
--- PASS: TestLogSuperblockCorruption (59.52s)
=== RUN TestLogTrimHolePunch
--- PASS: TestLogTrimHolePunch (50.79s)
=== RUN TestLogMissingAndTruncatedSegments
--- PASS: TestLogMissingAndTruncatedSegments (0.07s)
=== RUN TestLogReadBeyondMaxFileIndex
--- PASS: TestLogReadBeyondMaxFileIndex (2.73s)
=== RUN TestLogReadEOFWithMMap
--- PASS: TestLogReadEOFWithMMap (0.00s)
=== RUN TestLogLargeTrim
--- PASS: TestLogLargeTrim (0.01s)
=== RUN TestLSSCleaningRewrite
--- PASS: TestLSSCleaningRewrite (0.69s)
=== RUN TestShardLSSCleaning
--- PASS: TestShardLSSCleaning (0.29s)
=== RUN TestShardLSSCleaningDeleteInstance
--- PASS: TestShardLSSCleaningDeleteInstance (0.23s)
=== RUN TestShardLSSCleaningCorruptInstance
--- PASS: TestShardLSSCleaningCorruptInstance (0.22s)
=== RUN TestPlasmaLSSCleaner
--- PASS: TestPlasmaLSSCleaner (218.53s)
=== RUN TestPlasmaLSSCleanerMinSize
--- PASS: TestPlasmaLSSCleanerMinSize (12.22s)
=== RUN TestSharedLSSCleanerAllDestroyedInstances
--- PASS: TestSharedLSSCleanerAllDestroyedInstances (252.37s)
=== RUN TestLSSCleanerSyncWithConcurrentWriterRecovery
--- PASS: TestLSSCleanerSyncWithConcurrentWriterRecovery (256.84s)
=== RUN TestLSSCleanerSyncWithConcurrentWriterRecoveryDGM
--- PASS: TestLSSCleanerSyncWithConcurrentWriterRecoveryDGM (276.76s)
=== RUN TestLSSCleanerSyncWithMultiWriterRecovery
--- PASS: TestLSSCleanerSyncWithMultiWriterRecovery (112.06s)
=== RUN TestLSSCleanerSyncWithMultiWriterRecoveryBigKeys
--- PASS: TestLSSCleanerSyncWithMultiWriterRecoveryBigKeys (91.92s)
=== RUN TestLSSBasic
--- PASS: TestLSSBasic (0.10s)
=== RUN TestLSSConcurrent
--- PASS: TestLSSConcurrent (0.96s)
=== RUN TestLSSCleaner
--- PASS: TestLSSCleaner (13.09s)
=== RUN TestLSSSuperBlock
--- PASS: TestLSSSuperBlock (1.20s)
=== RUN TestLSSLargeSinglePayload
--- PASS: TestLSSLargeSinglePayload (0.88s)
=== RUN TestLSSUnstableEnvironment
--- PASS: TestLSSUnstableEnvironment (10.24s)
=== RUN TestLSSSmallFlushBuffer
--- PASS: TestLSSSmallFlushBuffer (0.01s)
=== RUN TestLSSTrimFlushBufferGC
--- PASS: TestLSSTrimFlushBufferGC (1.53s)
=== RUN TestLSSTrimFlushBufferNoIO
--- PASS: TestLSSTrimFlushBufferNoIO (10.01s)
=== RUN TestLSSTrimFlushBufferSlowIO
--- PASS: TestLSSTrimFlushBufferSlowIO (5.01s)
=== RUN TestLSSTrimFlushBufferWithIO
--- PASS: TestLSSTrimFlushBufferWithIO (17.35s)
=== RUN TestLSSExtendFlushBufferWithIO
--- PASS: TestLSSExtendFlushBufferWithIO (62.01s)
=== RUN TestLSSCtxTrimFlushBuffer
--- PASS: TestLSSCtxTrimFlushBuffer (5.42s)
=== RUN TestLSSNegativeGetFlushBufferMemory
--- PASS: TestLSSNegativeGetFlushBufferMemory (0.01s)
=== RUN TestLSSNegativeGetFlushBufferMemoryII
--- PASS: TestLSSNegativeGetFlushBufferMemoryII (0.02s)
=== RUN TestLSSTrimFlushBufferSizeUnAligned
--- PASS: TestLSSTrimFlushBufferSizeUnAligned (0.00s)
=== RUN TestMem
Plasma: Adaptive memory quota tuning (decrementing): RSS:5488615424, freePercent:62.69614783059586, currentQuota=1099511627776, newQuota=1073741824, netGrowth=0, percent=99, heap=0, active=0, alloc=0, stats=6716, go=65437696Plasma: Adaptive memory quota tuning (incrementing): RSS:5488254976, freePercent: 62.69744546366019, currentQuota=0, newQuota=10995116277, heap=0, stats=6716, go=65036288--- PASS: TestMem (1.58s)
=== RUN TestCpu
--- PASS: TestCpu (14.50s)
=== RUN TestTopTen20
--- PASS: TestTopTen20 (0.86s)
=== RUN TestTopTen5
--- PASS: TestTopTen5 (0.22s)
=== RUN TestMemAtLowResident
--- PASS: TestMemAtLowResident (3.58s)
=== RUN TestMVCCSimple
--- PASS: TestMVCCSimple (0.28s)
=== RUN TestMVCCLookup
--- PASS: TestMVCCLookup (0.19s)
=== RUN TestMVCCIteratorRefresh
--- PASS: TestMVCCIteratorRefresh (5.35s)
=== RUN TestMVCCIteratorRefreshEveryRow
--- PASS: TestMVCCIteratorRefreshEveryRow (1.31s)
=== RUN TestMVCCGarbageCollection
--- PASS: TestMVCCGarbageCollection (0.13s)
=== RUN TestMVCCRecoveryPoint
--- PASS: TestMVCCRecoveryPoint (2.78s)
=== RUN TestMVCCRollbackMergeSibling
--- PASS: TestMVCCRollbackMergeSibling (0.07s)
=== RUN TestMVCCRollbackCompact
--- PASS: TestMVCCRollbackCompact (0.06s)
=== RUN TestMVCCRollbackSplit
--- PASS: TestMVCCRollbackSplit (0.09s)
=== RUN TestMVCCRollbackItemsNotInSnapshot
--- PASS: TestMVCCRollbackItemsNotInSnapshot (0.18s)
=== RUN TestMVCCRecoveryPointRollbackedSnapshot
--- PASS: TestMVCCRecoveryPointRollbackedSnapshot (1.40s)
=== RUN TestMVCCRollbackBetweenRecoveryPoint
--- PASS: TestMVCCRollbackBetweenRecoveryPoint (1.41s)
=== RUN TestMVCCRecoveryPointCrash
--- PASS: TestMVCCRecoveryPointCrash (0.08s)
=== RUN TestMVCCIntervalGC
--- PASS: TestMVCCIntervalGC (0.30s)
=== RUN TestMVCCItemsCount
--- PASS: TestMVCCItemsCount (0.48s)
=== RUN TestLargeItems
--- PASS: TestLargeItems (105.56s)
=== RUN TestTooLargeKey
--- PASS: TestTooLargeKey (3.45s)
=== RUN TestMVCCItemUpdateSize
--- PASS: TestMVCCItemUpdateSize (0.32s)
=== RUN TestEvictionStats
--- PASS: TestEvictionStats (0.67s)
=== RUN TestReaderCacheStats
--- PASS: TestReaderCacheStats (1.18s)
=== RUN TestInvalidSnapshot
--- PASS: TestInvalidSnapshot (1.38s)
=== RUN TestEmptyKeyInsert
--- PASS: TestEmptyKeyInsert (0.06s)
=== RUN TestMVCCRecoveryPointError
--- PASS: TestMVCCRecoveryPointError (0.05s)
=== RUN TestMVCCReaderPurgeSequential
--- PASS: TestMVCCReaderPurgeSequential (0.29s)
=== RUN TestMVCCReaderNoPurge
--- PASS: TestMVCCReaderNoPurge (0.32s)
=== RUN TestMVCCReaderPurgeAfterUpdate
--- PASS: TestMVCCReaderPurgeAfterUpdate (0.30s)
=== RUN TestMVCCReaderPurgeAfterRollback
--- PASS: TestMVCCReaderPurgeAfterRollback (0.35s)
=== RUN TestMVCCReaderPurgeSimple
--- PASS: TestMVCCReaderPurgeSimple (0.05s)
=== RUN TestMVCCReaderPurgeRandom
--- PASS: TestMVCCReaderPurgeRandom (0.32s)
=== RUN TestMVCCReaderPurgePageFlag
--- PASS: TestMVCCReaderPurgePageFlag (0.16s)
=== RUN TestMVCCPurgeRatioWithRollback
--- PASS: TestMVCCPurgeRatioWithRollback (16.35s)
=== RUN TestComputeItemsCountMVCCWithRollbackI
--- PASS: TestComputeItemsCountMVCCWithRollbackI (0.10s)
=== RUN TestComputeItemsCountMVCCWithRollbackII
--- PASS: TestComputeItemsCountMVCCWithRollbackII (0.10s)
=== RUN TestComputeItemsCountMVCCWithRollbackIII
--- PASS: TestComputeItemsCountMVCCWithRollbackIII (0.07s)
=== RUN TestComputeItemsCountMVCCWithRollbackIV
--- PASS: TestComputeItemsCountMVCCWithRollbackIV (0.11s)
=== RUN TestMVCCPurgedRecordsWithCompactFullMarshalAndCascadedEmptyPagesMerge
--- PASS: TestMVCCPurgedRecordsWithCompactFullMarshalAndCascadedEmptyPagesMerge (2.78s)
=== RUN TestMaxDeltaChainLenWithCascadedEmptyPagesMerge
--- PASS: TestMaxDeltaChainLenWithCascadedEmptyPagesMerge (2.52s)
=== RUN TestAutoHoleCleaner
--- PASS: TestAutoHoleCleaner (48.71s)
=== RUN TestAutoHoleCleaner5Indexes
--- PASS: TestAutoHoleCleaner5Indexes (283.72s)
=== RUN TestIteratorReportedHoleRegionBoundary
--- PASS: TestIteratorReportedHoleRegionBoundary (0.17s)
=== RUN TestFullRangeHoleScans
--- PASS: TestFullRangeHoleScans (0.54s)
=== RUN TestOverlappingRangeHoleScans
--- PASS: TestOverlappingRangeHoleScans (0.53s)
=== RUN TestMVCCIteratorSMRRefreshOnHoleScan
--- PASS: TestMVCCIteratorSMRRefreshOnHoleScan (13.06s)
=== RUN TestAutoHoleCleanerWithRecovery
--- PASS: TestAutoHoleCleanerWithRecovery (2.44s)
=== RUN TestPageMergeCorrectness2
--- PASS: TestPageMergeCorrectness2 (0.00s)
=== RUN TestPageMergeCorrectness
--- PASS: TestPageMergeCorrectness (0.01s)
=== RUN TestPageMarshalFull
--- PASS: TestPageMarshalFull (0.01s)
=== RUN TestPageMergeMarshal
--- PASS: TestPageMergeMarshal (0.00s)
=== RUN TestPageOperations
--- PASS: TestPageOperations (0.03s)
=== RUN TestPageIterator
--- PASS: TestPageIterator (0.00s)
=== RUN TestPageMarshal
--- PASS: TestPageMarshal (0.02s)
=== RUN TestPageMergeCorrectness3
--- PASS: TestPageMergeCorrectness3 (0.00s)
=== RUN TestPageHasDataRecords
--- PASS: TestPageHasDataRecords (0.00s)
=== RUN TestPlasmaPageVisitor
--- PASS: TestPlasmaPageVisitor (4.68s)
=== RUN TestPageRingVisitor
--- PASS: TestPageRingVisitor (4.44s)
=== RUN TestPauseVisitorOnLowMemory
--- PASS: TestPauseVisitorOnLowMemory (1.18s)
=== RUN TestCheckpointRecovery
--- PASS: TestCheckpointRecovery (13.11s)
=== RUN TestPageCorruption
--- PASS: TestPageCorruption (1.35s)
=== RUN TestCheckPointRecoveryFollowCleaning
--- PASS: TestCheckPointRecoveryFollowCleaning (0.12s)
=== RUN TestFragmentationWithZeroItems
--- PASS: TestFragmentationWithZeroItems (1.16s)
=== RUN TestEvictOnPersist
--- PASS: TestEvictOnPersist (0.22s)
=== RUN TestPlasmaSimple
--- PASS: TestPlasmaSimple (13.81s)
=== RUN TestPlasmaCompression
--- PASS: TestPlasmaCompression (0.03s)
=== RUN TestPlasmaCompressionWrong
--- PASS: TestPlasmaCompressionWrong (0.04s)
=== RUN TestPlasmaInMemCompression
--- PASS: TestPlasmaInMemCompression (0.04s)
=== RUN TestPlasmaInMemCompressionZstd
--- PASS: TestPlasmaInMemCompressionZstd (0.04s)
=== RUN TestPlasmaInMemCompressionWrong
--- PASS: TestPlasmaInMemCompressionWrong (0.03s)
=== RUN TestSpoiledConfig
--- PASS: TestSpoiledConfig (0.06s)
=== RUN TestPlasmaErrorFile
--- PASS: TestPlasmaErrorFile (0.04s)
=== RUN TestPlasmaPersistor
--- PASS: TestPlasmaPersistor (9.81s)
=== RUN TestPlasmaEvictionLSSDataSize
--- PASS: TestPlasmaEvictionLSSDataSize (0.04s)
=== RUN TestPlasmaEviction
--- PASS: TestPlasmaEviction (30.06s)
=== RUN TestConcurrDelOps
--- PASS: TestConcurrDelOps (71.55s)
=== RUN TestPlasmaDataSize
--- PASS: TestPlasmaDataSize (0.06s)
=== RUN TestLargeBasePage
--- PASS: TestLargeBasePage (40.37s)
=== RUN TestLargeValue
--- PASS: TestLargeValue (100.26s)
=== RUN TestPlasmaTooLargeKey
--- PASS: TestPlasmaTooLargeKey (3.43s)
=== RUN TestEvictAfterMerge
--- PASS: TestEvictAfterMerge (0.16s)
=== RUN TestEvictDirty
--- PASS: TestEvictDirty (0.21s)
=== RUN TestEvictUnderQuota
--- PASS: TestEvictUnderQuota (60.18s)
=== RUN TestEvictSetting
--- PASS: TestEvictSetting (1.27s)
=== RUN TestBasePageAfterCompaction
--- PASS: TestBasePageAfterCompaction (0.19s)
=== RUN TestSwapout
--- PASS: TestSwapout (0.04s)
=== RUN TestSwapoutSplitBasePage
--- PASS: TestSwapoutSplitBasePage (0.03s)
=== RUN TestCompactFullMarshal
--- PASS: TestCompactFullMarshal (0.11s)
=== RUN TestPageStats
--- PASS: TestPageStats (3.04s)
=== RUN TestPageStatsTinyIndex
--- PASS: TestPageStatsTinyIndex (0.14s)
=== RUN TestPageStatsTinyIndexOnRecovery
--- PASS: TestPageStatsTinyIndexOnRecovery (0.13s)
=== RUN TestPageStatsTinyIndexOnSplitAndMerge
--- PASS: TestPageStatsTinyIndexOnSplitAndMerge (0.05s)
=== RUN TestPageCompress
--- PASS: TestPageCompress (0.08s)
=== RUN TestPageCompressSwapin
--- PASS: TestPageCompressSwapin (0.07s)
=== RUN TestPageCompressStats
--- PASS: TestPageCompressStats (1.16s)
=== RUN TestPageDecompressStats
--- PASS: TestPageDecompressStats (0.05s)
=== RUN TestSharedDedicatedDataSize
--- PASS: TestSharedDedicatedDataSize (5.19s)
=== RUN TestLastRpSns
--- PASS: TestLastRpSns (0.05s)
=== RUN TestPageCompressState
--- PASS: TestPageCompressState (0.08s)
=== RUN TestPageCompressDuringBurst
--- PASS: TestPageCompressDuringBurst (0.05s)
=== RUN TestPageDontDecompressDuringScan
--- PASS: TestPageDontDecompressDuringScan (0.16s)
=== RUN TestPageDecompressAndCompressSwapin
--- PASS: TestPageDecompressAndCompressSwapin (2.08s)
=== RUN TestPageCompressibleStat
--- PASS: TestPageCompressibleStat (0.53s)
=== RUN TestPageCompressibleStatRecovery
--- PASS: TestPageCompressibleStatRecovery (0.22s)
=== RUN TestPageCompressBeforeEvictPercent
--- PASS: TestPageCompressBeforeEvictPercent (1.21s)
=== RUN TestPageCompressDecompressAfterDisable
--- PASS: TestPageCompressDecompressAfterDisable (1.20s)
=== RUN TestPageKeepSwapinChainCompressed
--- PASS: TestPageKeepSwapinChainCompressed (0.05s)
=== RUN TestEnforceSameCompressionAlgo
--- PASS: TestEnforceSameCompressionAlgo (0.25s)
=== RUN TestPageCompressChangeAlgo
--- PASS: TestPageCompressChangeAlgo (0.76s)
=== RUN TestPageCompressAlgoMixedWithScan
--- PASS: TestPageCompressAlgoMixedWithScan (6.26s)
=== RUN TestWrittenDataSz
--- PASS: TestWrittenDataSz (4.12s)
=== RUN TestWrittenDataSzAfterRecoveryCleaning
--- PASS: TestWrittenDataSzAfterRecoveryCleaning (4.60s)
=== RUN TestWrittenHdrSz
--- PASS: TestWrittenHdrSz (3.95s)
=== RUN TestPersistConfigUpgrade
--- PASS: TestPersistConfigUpgrade (0.01s)
=== RUN TestLSSSegmentSize
--- PASS: TestLSSSegmentSize (0.23s)
=== RUN TestPlasmaFlushBufferSzCfg
--- PASS: TestPlasmaFlushBufferSzCfg (0.17s)
=== RUN TestCompactionCountwithCompactFullMarshal
--- PASS: TestCompactionCountwithCompactFullMarshal (0.09s)
=== RUN TestCompactionCountwithCompactFullMarshalSMO
--- PASS: TestCompactionCountwithCompactFullMarshalSMO (0.06s)
=== RUN TestPageHasDataRecordsOnCompactFullMarshal
--- PASS: TestPageHasDataRecordsOnCompactFullMarshal (0.09s)
=== RUN TestPauseReaderOnLowMemory
--- PASS: TestPauseReaderOnLowMemory (1.05s)
=== RUN TestRecoveryCleanerFragRatio
--- PASS: TestRecoveryCleanerFragRatio (224.79s)
=== RUN TestRecoveryCleanerRelocation
--- PASS: TestRecoveryCleanerRelocation (224.78s)
=== RUN TestRecoveryCleanerDataSize
--- PASS: TestRecoveryCleanerDataSize (229.74s)
=== RUN TestRecoveryCleanerDeleteInstance
--- PASS: TestRecoveryCleanerDeleteInstance (441.87s)
=== RUN TestRecoveryCleanerRecoveryPoint
--- PASS: TestRecoveryCleanerRecoveryPoint (41.66s)
=== RUN TestRecoveryCleanerCorruptInstance
--- PASS: TestRecoveryCleanerCorruptInstance (0.23s)
=== RUN TestRecoveryCleanerAhead
--- PASS: TestRecoveryCleanerAhead (4.30s)
=== RUN TestRecoveryCleanerAheadAfterRecovery
--- PASS: TestRecoveryCleanerAheadAfterRecovery (2.24s)
=== RUN TestCleaningUncommittedData
--- PASS: TestCleaningUncommittedData (0.04s)
=== RUN TestPlasmaRecoverySimple
--- PASS: TestPlasmaRecoverySimple (0.06s)
=== RUN TestPlasmaRecovery
--- PASS: TestPlasmaRecovery (26.28s)
=== RUN TestRecoverDedicatedAsShared
--- PASS: TestRecoverDedicatedAsShared (0.11s)
=== RUN TestRecoverDedicatedAsSharedDeleteShardMeta
--- PASS: TestRecoverDedicatedAsSharedDeleteShardMeta (0.10s)
=== RUN TestRecoverDedicatedAsSharedCorruptDataLog
--- PASS: TestRecoverDedicatedAsSharedCorruptDataLog (0.06s)
=== RUN TestShardRecoveryShared
--- PASS: TestShardRecoveryShared (15.63s)
=== RUN TestShardRecoveryRecoveryLogAhead
--- PASS: TestShardRecoveryRecoveryLogAhead (47.90s)
=== RUN TestShardRecoveryDataLogAhead
--- PASS: TestShardRecoveryDataLogAhead (32.09s)
=== RUN TestShardRecoveryDestroyBlksInDataLog
--- PASS: TestShardRecoveryDestroyBlksInDataLog (14.85s)
=== RUN TestShardRecoveryDestroyBlksInRecoveryLog
--- PASS: TestShardRecoveryDestroyBlksInRecoveryLog (15.05s)
=== RUN TestShardRecoveryDestroyBlksInBothLog
--- PASS: TestShardRecoveryDestroyBlksInBothLog (14.71s)
=== RUN TestShardRecoveryRecoveryLogCorruption
--- PASS: TestShardRecoveryRecoveryLogCorruption (14.49s)
=== RUN TestShardRecoveryRecoveryLogCorruptionServerless
--- PASS: TestShardRecoveryRecoveryLogCorruptionServerless (14.55s)
=== RUN TestShardRecoveryDataLogCorruption
--- PASS: TestShardRecoveryDataLogCorruption (15.31s)
=== RUN TestShardRecoveryDataLogCorruptionServerless
--- PASS: TestShardRecoveryDataLogCorruptionServerless (15.90s)
=== RUN TestShardRecoverySharedNoRP
--- PASS: TestShardRecoverySharedNoRP (15.14s)
=== RUN TestShardRecoveryNotEnoughMem
--- PASS: TestShardRecoveryNotEnoughMem (39.50s)
=== RUN TestShardRecoveryCleanup
--- PASS: TestShardRecoveryCleanup (0.48s)
=== RUN TestShardRecoveryRebuildSharedLog
--- PASS: TestShardRecoveryRebuildSharedLog (1.85s)
=== RUN TestShardRecoveryUpgradeWithCheckpoint
--- PASS: TestShardRecoveryUpgradeWithCheckpoint (0.62s)
=== RUN TestShardRecoveryUpgradeWithLogReplay
--- PASS: TestShardRecoveryUpgradeWithLogReplay (0.57s)
=== RUN TestShardRecoveryRebuildAfterError
--- PASS: TestShardRecoveryRebuildAfterError (1.80s)
=== RUN TestShardRecoveryRebuildAfterConcurrentDelete
--- PASS: TestShardRecoveryRebuildAfterConcurrentDelete (2.66s)
=== RUN TestShardRecoveryAfterDeleteInstance
--- PASS: TestShardRecoveryAfterDeleteInstance (0.13s)
=== RUN TestShardRecoveryDestroyShard
--- PASS: TestShardRecoveryDestroyShard (0.24s)
=== RUN TestHeaderRepair
--- PASS: TestHeaderRepair (0.09s)
=== RUN TestCheckpointWithWriter
--- PASS: TestCheckpointWithWriter (4.78s)
=== RUN TestPlasmaRecoveryWithRepairFullReplay
--- PASS: TestPlasmaRecoveryWithRepairFullReplay (23.95s)
=== RUN TestPlasmaRecoveryWithInsertRepairCheckpoint
--- PASS: TestPlasmaRecoveryWithInsertRepairCheckpoint (32.74s)
=== RUN TestPlasmaRecoveryWithDeleteRepairCheckpoint
--- PASS: TestPlasmaRecoveryWithDeleteRepairCheckpoint (20.97s)
=== RUN TestShardRecoverySharedFullReplayOnError
--- PASS: TestShardRecoverySharedFullReplayOnError (17.19s)
=== RUN TestShardRecoverySharedFullReplayOnErrorServerless
--- PASS: TestShardRecoverySharedFullReplayOnErrorServerless (17.98s)
=== RUN TestShardRecoveryDedicatedFullReplayOnError
--- PASS: TestShardRecoveryDedicatedFullReplayOnError (17.01s)
=== RUN TestShardRecoveryDedicatedFullReplayOnErrorServerless
--- PASS: TestShardRecoveryDedicatedFullReplayOnErrorServerless (17.98s)
=== RUN TestShardRecoverySharedFullReplayOnErrorWithRepair
--- PASS: TestShardRecoverySharedFullReplayOnErrorWithRepair (19.26s)
=== RUN TestGlobalWorkContextForRecovery
--- PASS: TestGlobalWorkContextForRecovery (0.47s)
=== RUN TestShardRecoveryPartialMetadata
--- PASS: TestShardRecoveryPartialMetadata (0.12s)
=== RUN TestShardRecoveryPartialLSSMetadata
--- PASS: TestShardRecoveryPartialLSSMetadata (0.08s)
=== RUN TestShardRecoveryPartialSkiplog
--- PASS: TestShardRecoveryPartialSkiplog (0.13s)
=== RUN TestShardRecoveryTempSkiplog
--- PASS: TestShardRecoveryTempSkiplog (0.25s)
=== RUN TestPageRemovalLargeKey
--- PASS: TestPageRemovalLargeKey (0.03s)
=== RUN TestRpVersionOverflow
--- PASS: TestRpVersionOverflow (0.11s)
=== RUN TestRecoveryCancelHeaderReplay
--- PASS: TestRecoveryCancelHeaderReplay (2.44s)
=== RUN TestRecoveryCancelWithDelay
--- PASS: TestRecoveryCancelWithDelay (2.56s)
=== RUN TestRecoveryCancelWithDataReplay
--- PASS: TestRecoveryCancelWithDataReplay (0.32s)
=== RUN TestShardRecoveryInstPathErrorString
--- PASS: TestShardRecoveryInstPathErrorString (0.05s)
=== RUN TestSkipLogSimple
--- PASS: TestSkipLogSimple (0.00s)
=== RUN TestSkipLogLoadStore
--- PASS: TestSkipLogLoadStore (0.03s)
=== RUN TestRPCSimple
--- PASS: TestRPCSimple (0.02s)
=== RUN TestRPCOpenClose
--- PASS: TestRPCOpenClose (4.05s)
=== RUN TestRPCWritePartialPart
--- PASS: TestRPCWritePartialPart (0.03s)
=== RUN TestRPCWriteMultiPart
--- PASS: TestRPCWriteMultiPart (17.56s)
=== RUN TestRPCWriteUnAlignedHeadTailWithChecksum
--- PASS: TestRPCWriteUnAlignedHeadTailWithChecksum (11.47s)
=== RUN TestRPCDoubleOpenWithStaleWrites
--- PASS: TestRPCDoubleOpenWithStaleWrites (19.57s)
=== RUN TestRPCRmDirBusy
--- PASS: TestRPCRmDirBusy (4.36s)
=== RUN TestRPCServerGCIdleHandle
--- PASS: TestRPCServerGCIdleHandle (15.01s)
=== RUN TestRPCServerShutdownWithIO
--- PASS: TestRPCServerShutdownWithIO (10.17s)
=== RUN TestRPCServerShutdownBusy
--- PASS: TestRPCServerShutdownBusy (10.03s)
=== RUN TestRPCServerBindWithRetry
--- PASS: TestRPCServerBindWithRetry (1.50s)
=== RUN TestRPCClientWithCorruptRequest
--- PASS: TestRPCClientWithCorruptRequest (2.22s)
=== RUN TestRPCClientWithCorruptReqHeaders
--- PASS: TestRPCClientWithCorruptReqHeaders (0.02s)
=== RUN TestRPCWithCorruptResponse
--- PASS: TestRPCWithCorruptResponse (0.01s)
=== RUN TestRPCVersion
--- PASS: TestRPCVersion (0.00s)
=== RUN TestRPCSyncFileIdempotent
--- PASS: TestRPCSyncFileIdempotent (10.07s)
=== RUN TestRPCSyncFileError
--- PASS: TestRPCSyncFileError (0.01s)
=== RUN TestRPCOpenWithRetry
--- PASS: TestRPCOpenWithRetry (5.01s)
=== RUN TestRPCOpenWithDialTimeout
--- PASS: TestRPCOpenWithDialTimeout (0.02s)
=== RUN TestRPCWriteRetryWithDigest
--- PASS: TestRPCWriteRetryWithDigest (40.60s)
=== RUN TestRPCWithThrottle
--- PASS: TestRPCWithThrottle (42.60s)
=== RUN TestRPCRateControl
--- PASS: TestRPCRateControl (175.77s)
=== RUN TestRPCRateControlII
--- PASS: TestRPCRateControlII (17.37s)
=== RUN TestRPCWriteEmptyFile
--- PASS: TestRPCWriteEmptyFile (0.02s)
=== RUN TestRPCPersistentConnections
--- PASS: TestRPCPersistentConnections (2.04s)
=== RUN TestRPCClientEOF
--- PASS: TestRPCClientEOF (9.28s)
=== RUN TestRPCServerWithHTTPS
--- PASS: TestRPCServerWithHTTPS (8.93s)
=== RUN TestRPCServerQuota
--- PASS: TestRPCServerQuota (11.40s)
=== RUN TestRPCServerChannelConfig
--- PASS: TestRPCServerChannelConfig (0.16s)
=== RUN TestShardMetadata
--- PASS: TestShardMetadata (0.83s)
=== RUN TestPlasmaId
--- PASS: TestPlasmaId (0.04s)
=== RUN TestShardPersistence
--- PASS: TestShardPersistence (0.30s)
=== RUN TestShardDestroy
--- PASS: TestShardDestroy (0.04s)
=== RUN TestShardClose
--- PASS: TestShardClose (5.03s)
=== RUN TestShardMgrRecovery
--- PASS: TestShardMgrRecovery (0.08s)
=== RUN TestShardDeadData
--- PASS: TestShardDeadData (0.32s)
=== RUN TestShardDeadDataNegativeFlushDataSize
--- PASS: TestShardDeadDataNegativeFlushDataSize (0.53s)
=== RUN TestShardConfigUpdate
--- PASS: TestShardConfigUpdate (0.04s)
=== RUN TestShardWriteAmp
--- PASS: TestShardWriteAmp (10.17s)
=== RUN TestShardStats
--- PASS: TestShardStats (0.25s)
=== RUN TestShardCompressionStats
--- PASS: TestShardCompressionStats (2.38s)
=== RUN TestShardMultipleWriters
--- PASS: TestShardMultipleWriters (0.19s)
=== RUN TestShardDestroyMultiple
--- PASS: TestShardDestroyMultiple (0.11s)
=== RUN TestShardBackupCorrupted
--- PASS: TestShardBackupCorrupted (0.13s)
=== RUN TestShardBackupCorruptedShare
--- PASS: TestShardBackupCorruptedShare (0.06s)
=== RUN TestShardCorruption
--- PASS: TestShardCorruption (0.11s)
=== RUN TestShardCorruptionAddInstance
--- PASS: TestShardCorruptionAddInstance (0.16s)
=== RUN TestShardCreateError
--- PASS: TestShardCreateError (0.23s)
=== RUN TestShardNumInsts
--- PASS: TestShardNumInsts (1.69s)
=== RUN TestShardInstanceGroup
--- PASS: TestShardInstanceGroup (0.09s)
=== RUN TestShardLeak
--- PASS: TestShardLeak (2.04s)
=== RUN TestShardMemLeak
--- PASS: TestShardMemLeak (1.08s)
=== RUN TestShardFind
--- PASS: TestShardFind (0.24s)
=== RUN TestShardFileOpenDescCount
--- PASS: TestShardFileOpenDescCount (87.14s)
=== RUN TestShardShutdownSharedLSS
--- PASS: TestShardShutdownSharedLSS (11.75s)
=== RUN TestShardUUIDChange
--- PASS: TestShardUUIDChange (0.05s)
=== RUN TestShardUUIDStable
--- PASS: TestShardUUIDStable (0.04s)
=== RUN TestShardUUIDUpgradeDedicated
--- PASS: TestShardUUIDUpgradeDedicated (0.10s)
=== RUN TestShardUUIDUpgradeShared
--- PASS: TestShardUUIDUpgradeShared (0.07s)
=== RUN TestShardMetadataPersistenceOnPanic
--- PASS: TestShardMetadataPersistenceOnPanic (0.15s)
=== RUN TestShardAlternateId
--- PASS: TestShardAlternateId (0.11s)
=== RUN TestSMRSimple
--- PASS: TestSMRSimple (1.09s)
=== RUN TestSMRConcurrent
--- PASS: TestSMRConcurrent (74.40s)
=== RUN TestSMRComplex
--- PASS: TestSMRComplex (149.03s)
=== RUN TestDGMWithCASConflicts
--- PASS: TestDGMWithCASConflicts (40.43s)
=== RUN TestMaxSMRPendingMem
--- PASS: TestMaxSMRPendingMem (0.01s)
=== RUN TestStatsLogger
--- PASS: TestStatsLogger (20.47s)
=== RUN TestStatsSamplePercentile
--- PASS: TestStatsSamplePercentile (0.01s)
=== RUN TestPlasmaSwapper
--- PASS: TestPlasmaSwapper (21.63s)
=== RUN TestPlasmaAutoSwapper
--- PASS: TestPlasmaAutoSwapper (85.22s)
=== RUN TestSwapperAddInstance
--- PASS: TestSwapperAddInstance (4.29s)
=== RUN TestSwapperRemoveInstance
--- PASS: TestSwapperRemoveInstance (4.36s)
=== RUN TestSwapperJoinContext
--- PASS: TestSwapperJoinContext (4.85s)
=== RUN TestSwapperSplitContext
--- PASS: TestSwapperSplitContext (4.71s)
=== RUN TestSwapperGlobalClock
--- PASS: TestSwapperGlobalClock (29.79s)
=== RUN TestSwapperConflict
--- PASS: TestSwapperConflict (2.85s)
=== RUN TestSwapperRemoveInstanceWait
--- PASS: TestSwapperRemoveInstanceWait (3.43s)
=== RUN TestSwapperStats
--- PASS: TestSwapperStats (0.96s)
=== RUN TestSwapperSweepInterval
--- PASS: TestSwapperSweepInterval (0.46s)
=== RUN TestSweepCompress
--- PASS: TestSweepCompress (0.07s)
=== RUN TestTenantShardAssignment
--- PASS: TestTenantShardAssignment (4.19s)
=== RUN TestTenantShardAssignmentServerless
--- PASS: TestTenantShardAssignmentServerless (4.12s)
=== RUN TestTenantShardAssignmentOnPrem
--- PASS: TestTenantShardAssignmentOnPrem (4.21s)
=== RUN TestTenantShardAssignmentDedicated
--- PASS: TestTenantShardAssignmentDedicated (2.18s)
=== RUN TestTenantShardAssignmentDedicatedMainBackIndexes
--- PASS: TestTenantShardAssignmentDedicatedMainBackIndexes (0.08s)
=== RUN TestTenantShardRecovery
--- PASS: TestTenantShardRecovery (3.92s)
=== RUN TestTenantMemUsed
--- PASS: TestTenantMemUsed (3.78s)
=== RUN TestTenantSwitchController
--- PASS: TestTenantSwitchController (0.11s)
=== RUN TestTenantSwitchControllerActiveWCtx
--- PASS: TestTenantSwitchControllerActiveWCtx (0.27s)
=== RUN TestTenantSwitchControllerDuringFlush
--- PASS: TestTenantSwitchControllerDuringFlush (4.07s)
=== RUN TestTenantBuildController
--- PASS: TestTenantBuildController (2.18s)
=== RUN TestTenantBuildControllerOnPrem
--- PASS: TestTenantBuildControllerOnPrem (2.12s)
=== RUN TestTenantSingleController
--- PASS: TestTenantSingleController (2.14s)
=== RUN TestTenantControllerSwapperIncremental
--- PASS: TestTenantControllerSwapperIncremental (1.38s)
=== RUN TestTenantControllerSwapperInitial
--- PASS: TestTenantControllerSwapperInitial (1.36s)
=== RUN TestTenantControllerSwapperPeriodic
--- PASS: TestTenantControllerSwapperPeriodic (3.48s)
=== RUN TestTenantSwapperZeroResident
--- PASS: TestTenantSwapperZeroResident (2.77s)
=== RUN TestTenantSwapperZeroItem
--- PASS: TestTenantSwapperZeroItem (1.16s)
=== RUN TestTenantAssignMandatoryQuota
--- PASS: TestTenantAssignMandatoryQuota (0.61s)
=== RUN TestTenantNotifyQuotaChange
--- PASS: TestTenantNotifyQuotaChange (1.63s)
=== RUN TestTenantMutationQuota
--- PASS: TestTenantMutationQuota (0.16s)
=== RUN TestTenantMutationQuotaInitial
--- PASS: TestTenantMutationQuotaInitial (0.13s)
=== RUN TestTenantMutationQuotaEmpty
--- PASS: TestTenantMutationQuotaEmpty (0.10s)
=== RUN TestTenantMutationQuotaIncremental
--- PASS: TestTenantMutationQuotaIncremental (0.15s)
=== RUN TestTenantCalibrateMutationQuota
--- PASS: TestTenantCalibrateMutationQuota (0.04s)
=== RUN TestTenantMutationRate
--- PASS: TestTenantMutationRate (0.32s)
=== RUN TestTenantMutationQuotaAdjustRate
--- PASS: TestTenantMutationQuotaAdjustRate (0.48s)
=== RUN TestTenantBuildQuota
--- PASS: TestTenantBuildQuota (0.05s)
=== RUN TestTenantInitialBuildQuota
--- PASS: TestTenantInitialBuildQuota (0.04s)
=== RUN TestTenantInitialBuildNonDGM
--- PASS: TestTenantInitialBuildNonDGM (3.15s)
=== RUN TestTenantInitialBuildDGM
--- PASS: TestTenantInitialBuildDGM (3.15s)
=== RUN TestTenantInitialBuildZeroResident
--- PASS: TestTenantInitialBuildZeroResident (3.18s)
=== RUN TestTenantIncrementalBuildDGM
--- PASS: TestTenantIncrementalBuildDGM (5.08s)
=== RUN TestTenantInitialBuildTwoTenants
--- PASS: TestTenantInitialBuildTwoTenants (5.02s)
=== RUN TestTenantInitialBuildTwoControllers
--- PASS: TestTenantInitialBuildTwoControllers (5.01s)
=== RUN TestTenantIncrementalBuildTwoIndexes
--- PASS: TestTenantIncrementalBuildTwoIndexes (0.57s)
=== RUN TestTenantIncrementalBuildConcurrent
--- PASS: TestTenantIncrementalBuildConcurrent (7.57s)
=== RUN TestTenantMixedConcurrentSingleContainer
--- PASS: TestTenantMixedConcurrentSingleContainer (12.39s)
=== RUN TestTenantDecrementGlobalQuota
--- PASS: TestTenantDecrementGlobalQuota (3.80s)
=== RUN TestTenantInitialBuildNotEnoughQuota
--- PASS: TestTenantInitialBuildNotEnoughQuota (5.04s)
=== RUN TestTenantRecoveryResidentRatioHeaderReplay
--- PASS: TestTenantRecoveryResidentRatioHeaderReplay (0.19s)
=== RUN TestTenantRecoveryResidentRatioDataReplay
--- PASS: TestTenantRecoveryResidentRatioDataReplay (0.24s)
=== RUN TestTenantRecoveryController
--- PASS: TestTenantRecoveryController (2.55s)
=== RUN TestTenantRecoveryControllerOnPrem
--- PASS: TestTenantRecoveryControllerOnPrem (2.61s)
=== RUN TestTenantRecoveryQuotaWithLastCheckpoint
--- PASS: TestTenantRecoveryQuotaWithLastCheckpoint (1.29s)
=== RUN TestTenantRecoveryQuotaZeroResidentWithLastCheckpoint
--- PASS: TestTenantRecoveryQuotaZeroResidentWithLastCheckpoint (5.07s)
=== RUN TestTenantRecoveryQuotaWithFormula
--- PASS: TestTenantRecoveryQuotaWithFormula (5.05s)
=== RUN TestTenantRecoveryQuotaWithDataReplay
--- PASS: TestTenantRecoveryQuotaWithDataReplay (10.79s)
=== RUN TestTenantRecoveryEvictionNoCheckpoint
--- PASS: TestTenantRecoveryEvictionNoCheckpoint (24.48s)
=== RUN TestTenantRecoveryEvictionHeaderReplay
--- PASS: TestTenantRecoveryEvictionHeaderReplay (14.24s)
=== RUN TestTenantRecoveryEvictionDataReplaySequential
--- PASS: TestTenantRecoveryEvictionDataReplaySequential (13.37s)
=== RUN TestTenantRecoveryEvictionDataReplayInterleaved
--- PASS: TestTenantRecoveryEvictionDataReplayInterleaved (15.45s)
=== RUN TestTenantRecoveryEvictionDataReplayInterleavedSingleContainer
--- PASS: TestTenantRecoveryEvictionDataReplayInterleavedSingleContainer (9.25s)
=== RUN TestTenantRecoveryEvictionDataReplayInterleavedSingleContainerTwoTenants
--- PASS: TestTenantRecoveryEvictionDataReplayInterleavedSingleContainerTwoTenants (10.34s)
=== RUN TestTenantRecoveryEvictionDataReplayNoCheckpoint
--- PASS: TestTenantRecoveryEvictionDataReplayNoCheckpoint (15.38s)
=== RUN TestTenantRecoveryEvictionDataReplaySingle
--- PASS: TestTenantRecoveryEvictionDataReplaySingle (6.95s)
=== RUN TestTenantRecoveryLastCheckpoint
--- PASS: TestTenantRecoveryLastCheckpoint (8.17s)
=== RUN TestTenantRecoveryRequestQuota
--- PASS: TestTenantRecoveryRequestQuota (4.05s)
=== RUN TestTenantWorkingSetPageHits
--- PASS: TestTenantWorkingSetPageHits (0.02s)
=== RUN TestTenantWorkingSetConcurrent
--- PASS: TestTenantWorkingSetConcurrent (0.25s)
=== RUN TestTenantDiscretionaryQuotaNoScan
--- PASS: TestTenantDiscretionaryQuotaNoScan (3.27s)
=== RUN TestTenantDiscretionaryQuotaScan
--- PASS: TestTenantDiscretionaryQuotaScan (12.97s)
=== RUN TestTenantAssignDiscretionaryQuota
--- PASS: TestTenantAssignDiscretionaryQuota (37.04s)
=== RUN TestTenantMinimumQuota
--- PASS: TestTenantMinimumQuota (12.53s)
=== RUN TestTenantWorkingSetIdle
--- PASS: TestTenantWorkingSetIdle (0.02s)
=== RUN TestTenantWorkingSetSinceIdle
--- PASS: TestTenantWorkingSetSinceIdle (14.37s)
=== RUN TestTenantWorkingSetIdleTime
--- PASS: TestTenantWorkingSetIdleTime (1.02s)
=== RUN TestTenantAssignIdleQuota
--- PASS: TestTenantAssignIdleQuota (12.42s)
=== RUN TestTenantAssignIdleQuotaEmptyIndex
--- PASS: TestTenantAssignIdleQuotaEmptyIndex (0.14s)
=== RUN TestTenantActivateIdleTenant
--- PASS: TestTenantActivateIdleTenant (37.41s)
=== RUN TestTenantActivateIdleTenantWriter
--- PASS: TestTenantActivateIdleTenantWriter (36.47s)
=== RUN TestTenantActivateIdleTenantZeroQuota
--- PASS: TestTenantActivateIdleTenantZeroQuota (0.78s)
=== RUN TestTenantStatsInStr
--- PASS: TestTenantStatsInStr (0.01s)
=== RUN TestTenantRuntimeStats
--- PASS: TestTenantRuntimeStats (0.18s)
=== RUN TestTenantMandatoryQuotaLowResident
--- PASS: TestTenantMandatoryQuotaLowResident (62.00s)
=== RUN TestTenantMandatoryDeleteIndex
--- PASS: TestTenantMandatoryDeleteIndex (66.88s)
=== RUN TestTenantMandatoryQuotaSmallIndex
--- PASS: TestTenantMandatoryQuotaSmallIndex (0.05s)
=== RUN TestTenantNumShards
--- PASS: TestTenantNumShards (1.86s)
=== RUN TestTenantNumShardsMixedConfig
--- PASS: TestTenantNumShardsMixedConfig (2.99s)
=== RUN TestMVCCPurgeIdleTenant
--- PASS: TestMVCCPurgeIdleTenant (16.39s)
=== RUN TestTenantMemQuotaAfterRecoveryOnPrem
--- PASS: TestTenantMemQuotaAfterRecoveryOnPrem (1.31s)
=== RUN TestTenantShardLSSSegmentSizeOnPremVsServerless
--- PASS: TestTenantShardLSSSegmentSizeOnPremVsServerless (7.96s)
=== RUN TestWriteRenameFileWithSync
--- PASS: TestWriteRenameFileWithSync (0.01s)
=== RUN TestHistogram
--- PASS: TestHistogram (0.00s)
=== RUN TestSyncFilePanicUnstable
--- PASS: TestSyncFilePanicUnstable (0.00s)
=== RUN TestSyncFileNoPanicUnstable
--- PASS: TestSyncFileNoPanicUnstable (0.00s)
=== RUN TestSCtx
--- PASS: TestSCtx (17.19s)
=== RUN TestWCtxGeneric
--- PASS: TestWCtxGeneric (20.39s)
=== RUN TestWCtxWriter
--- PASS: TestWCtxWriter (21.43s)
=== RUN TestSCtxTrimWithReader
--- PASS: TestSCtxTrimWithReader (0.03s)
=== RUN TestSCtxTrimWithWriter
--- PASS: TestSCtxTrimWithWriter (0.03s)
=== RUN TestSCtxTrimEmpty
--- PASS: TestSCtxTrimEmpty (0.01s)
=== RUN TestWCtxTrimWithReader
--- PASS: TestWCtxTrimWithReader (0.03s)
=== RUN TestWCtxTrimWithWriter
--- PASS: TestWCtxTrimWithWriter (0.03s)
--- PASS: TestExtrasN1 (0.00s)
--- PASS: TestExtrasN3 (0.00s)
--- PASS: TestExtrasN2 (0.00s)
PASS
ok github.com/couchbase/plasma 7299.345s
=== RUN TestInteger
--- PASS: TestInteger (0.00s)
=== RUN TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN TestFloat
--- PASS: TestFloat (0.00s)
=== RUN TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN TestReference
--- PASS: TestReference (0.00s)
=== RUN TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618]
PASS
TESTING [0]
PASS
TESTING [0.0]
PASS
TESTING [0.0000]
PASS
TESTING [0.0000000]
PASS
TESTING [-0]
PASS
TESTING [-0.0]
PASS
TESTING [-0.0000]
PASS
TESTING [-0.0000000]
PASS
TESTING [1]
PASS
TESTING [20]
PASS
TESTING [3456]
PASS
TESTING [7645000]
PASS
TESTING [9223372036854775807]
PASS
TESTING [9223372036854775806]
PASS
TESTING [9223372036854775808]
PASS
TESTING [92233720368547758071234000]
PASS
TESTING [92233720368547758071234987437653]
PASS
TESTING [12300000000000000000000000000000056]
PASS
TESTING [12300000000000000000000000000000000]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [210690]
PASS
TESTING [90000]
PASS
TESTING [123000000]
PASS
TESTING [3.60e2]
PASS
TESTING [36e2]
PASS
TESTING [1.9999999999e10]
PASS
TESTING [1.99999e10]
PASS
TESTING [1.99999e5]
PASS
TESTING [0.00000000000012e15]
PASS
TESTING [7.64507352e8]
PASS
TESTING [9.2233720368547758071234987437653e31]
PASS
TESTING [2650e-1]
PASS
TESTING [26500e-1]
PASS
TESTING [-1]
PASS
TESTING [-20]
PASS
TESTING [-3456]
PASS
TESTING [-7645000]
PASS
TESTING [-9223372036854775808]
PASS
TESTING [-9223372036854775807]
PASS
TESTING [-9223372036854775806]
PASS
TESTING [-9223372036854775809]
PASS
TESTING [-92233720368547758071234000]
PASS
TESTING [-92233720368547758071234987437653]
PASS
TESTING [-12300000000000000000000000000000056]
PASS
TESTING [-12300000000000000000000000000000000]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [-210690]
PASS
TESTING [-90000]
PASS
TESTING [-123000000]
PASS
TESTING [-3.60e2]
PASS
TESTING [-36e2]
PASS
TESTING [-1.9999999999e10]
PASS
TESTING [-1.99999e10]
PASS
TESTING [-1.99999e5]
PASS
TESTING [-0.00000000000012e15]
PASS
TESTING [-2650e-1]
PASS
TESTING [-26500e-1]
PASS
TESTING [0.03]
PASS
TESTING [198.60]
PASS
TESTING [2000045.178]
PASS
TESTING [1.7976931348623157e+308]
PASS
TESTING [0.000000000000000000890]
PASS
TESTING [257953786.9864236576]
PASS
TESTING [257953786.9864236576e8]
PASS
TESTING [36.912e3]
PASS
TESTING [2761.67e0]
PASS
TESTING [2761.67e00]
PASS
TESTING [2761.67e000]
PASS
TESTING [7676546.67e-3]
PASS
TESTING [-0.03]
PASS
TESTING [-198.60]
PASS
TESTING [-2000045.178]
PASS
TESTING [-1.7976931348623157e+308]
PASS
TESTING [-0.000000000000000000890]
PASS
TESTING [-257953786.9864236576]
PASS
TESTING [-257953786.9864236576e8]
PASS
TESTING [-36.912e3]
PASS
TESTING [-2761.67e0]
PASS
TESTING [-2761.67e00]
PASS
TESTING [-2761.67e000]
PASS
TESTING [-7676546.67e-3]
PASS
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/collatejson 0.036s
=== RUN TestForestDBIterator
2023-09-12T13:07:24.393+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 5614 us
2023-09-12T13:07:24.394+05:30 [INFO][FDB] Forestdb opened database file test
2023-09-12T13:07:24.399+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.01s)
=== RUN TestForestDBIteratorSeek
2023-09-12T13:07:24.400+05:30 [INFO][FDB] Forestdb opened database file test
2023-09-12T13:07:24.403+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.00s)
=== RUN TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN TestMemDBInsertionPerf
Maximum number of file descriptors = 200000
Set IO Concurrency: 7200
2023-09-12T13:07:25.515+05:30 DEBU REGU.impl.init.0.func1() at aggrecorder.go:57 [id 29] will report aggregate recorder stats every 5m0s
Initial build: 10000000 items took 56.196387034s -> 177947.38287978887 items/s
Incr build: 10000000 items took 2m58.865330132s -> 55907.98391516202 items/s
Main Index: {
"node_count": 18000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 4,
"next_pointers_per_node": 1.3332,
"memory_used": 1695853452,
"node_allocs": 18000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 13499924,
"level1": 3377575,
"level2": 841759,
"level3": 210557,
"level4": 52655,
"level5": 13138,
"level6": 3275,
"level7": 846,
"level8": 200,
"level9": 49,
"level10": 15,
"level11": 5,
"level12": 1,
"level13": 1,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (235.06s)
=== RUN TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN TestDequeueA
--- PASS: TestDequeueA (1.21s)
=== RUN TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.01s)
=== RUN TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.01s)
PASS
ok github.com/couchbase/indexing/secondary/indexer 259.151s
=== RUN TestConnPoolBasicSanity
2023-09-12T13:11:46.941+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T13:11:46.941+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T13:11:47.169+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:11:47.169+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:11:47.941+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN TestCloseActiveConnectionsUnsetFlag
2023-09-12T13:11:51.944+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T13:11:51.944+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T13:11:52.159+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:11:52.159+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:11:52.944+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestCloseActiveConnectionsUnsetFlag (9.22s)
=== RUN TestCloseActiveConnectionsSetFlag
2023-09-12T13:12:01.162+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T13:12:01.162+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T13:12:01.381+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:12:01.381+05:30 [Info] Closing active connection from 127.0.0.1:59018 to 127.0.0.1:15151
2023-09-12T13:12:01.381+05:30 [Info] Closing active connection from 127.0.0.1:59020 to 127.0.0.1:15151
2023-09-12T13:12:01.381+05:30 [Info] Closing active connection from 127.0.0.1:59012 to 127.0.0.1:15151
2023-09-12T13:12:01.381+05:30 [Info] Closing active connection from 127.0.0.1:59014 to 127.0.0.1:15151
2023-09-12T13:12:01.381+05:30 [Info] Closing active connection from 127.0.0.1:59016 to 127.0.0.1:15151
2023-09-12T13:12:01.381+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:12:02.162+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestCloseActiveConnectionsSetFlag (4.22s)
=== RUN TestMaintainActiveConnections
2023-09-12T13:12:05.383+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T13:12:05.383+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T13:12:05.724+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:12:05.724+05:30 [Info] Closing active connection from 127.0.0.1:59034 to 127.0.0.1:15151
2023-09-12T13:12:05.724+05:30 [Info] Closing active connection from 127.0.0.1:59030 to 127.0.0.1:15151
2023-09-12T13:12:05.724+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:12:06.384+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestMaintainActiveConnections (4.34s)
=== RUN TestConnectionPoolRenew
2023-09-12T13:12:09.726+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T13:12:09.726+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T13:12:09.937+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:59042"
2023-09-12T13:12:09.938+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:59046"
2023-09-12T13:12:09.938+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:59038"
2023-09-12T13:12:09.940+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:59040"
2023-09-12T13:12:09.942+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:59044"
2023-09-12T13:12:09.943+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:12:09.943+05:30 [Info] Closing active connection from 127.0.0.1:59054 to 127.0.0.1:15151
2023-09-12T13:12:09.943+05:30 [Info] Closing active connection from 127.0.0.1:59056 to 127.0.0.1:15151
2023-09-12T13:12:09.943+05:30 [Info] Closing active connection from 127.0.0.1:59050 to 127.0.0.1:15151
2023-09-12T13:12:09.943+05:30 [Info] Closing active connection from 127.0.0.1:59048 to 127.0.0.1:15151
2023-09-12T13:12:09.943+05:30 [Info] Closing active connection from 127.0.0.1:59052 to 127.0.0.1:15151
2023-09-12T13:12:09.943+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:12:10.726+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
2023-09-12T13:12:11.946+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:59048"
2023-09-12T13:12:11.946+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing connection "127.0.0.1:59058" -> "127.0.0.1:15151" as the pool is closed
--- PASS: TestConnectionPoolRenew (4.22s)
=== RUN TestConnRelease
2023-09-12T13:12:13.947+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-12T13:12:13.947+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2023-09-12T13:12:53.760+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:12:53.760+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:12:53.965+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.82s)
=== RUN TestLongevity
2023-09-12T13:12:57.762+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-12T13:12:57.762+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Releasing 3 conns.
Getting 2 conns.
Releasing 3 conns.
Getting 3 conns.
Releasing 2 conns.
Getting 0 conns.
Releasing 1 conns.
Getting 2 conns.
Releasing 3 conns.
Getting 4 conns.
Releasing 4 conns.
Getting 0 conns.
Releasing 1 conns.
Getting 2 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 2 conns.
Getting 1 conns.
Releasing 4 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 2 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 0 conns.
Getting 0 conns.
Releasing 3 conns.
Getting 1 conns.
Releasing 2 conns.
Getting 3 conns.
2023-09-12T13:13:36.053+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:13:36.053+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:13:36.784+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.29s)
=== RUN TestSustainedHighConns
2023-09-12T13:13:40.055+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-12T13:13:40.055+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Allocating 22 Connections
Returning 3 Connections
cp.curActConns = 0
cp.curActConns = 11
Returning 2 Connections
cp.curActConns = 17
Returning 4 Connections
Allocating 18 Connections
cp.curActConns = 22
Returning 0 Connections
cp.curActConns = 31
Returning 0 Connections
Allocating 15 Connections
cp.curActConns = 34
Returning 4 Connections
cp.curActConns = 42
Returning 1 Connections
Allocating 6 Connections
cp.curActConns = 47
Returning 3 Connections
Allocating 6 Connections
cp.curActConns = 47
Returning 2 Connections
cp.curActConns = 48
Returning 3 Connections
Allocating 21 Connections
cp.curActConns = 59
Returning 3 Connections
cp.curActConns = 63
Returning 2 Connections
Allocating 8 Connections
cp.curActConns = 69
Returning 4 Connections
Allocating 18 Connections
cp.curActConns = 70
Returning 2 Connections
cp.curActConns = 81
Returning 2 Connections
Allocating 20 Connections
cp.curActConns = 81
Returning 3 Connections
cp.curActConns = 92
Returning 3 Connections
cp.curActConns = 93
Allocating 19 Connections
Returning 3 Connections
cp.curActConns = 103
Returning 2 Connections
cp.curActConns = 107
Returning 1 Connections
Allocating 18 Connections
cp.curActConns = 114
Returning 0 Connections
cp.curActConns = 124
Returning 4 Connections
Allocating 18 Connections
cp.curActConns = 126
Returning 1 Connections
cp.curActConns = 137
Returning 2 Connections
Allocating 10 Connections
cp.curActConns = 137
Returning 0 Connections
cp.curActConns = 145
Returning 1 Connections
Allocating 19 Connections
cp.curActConns = 149
Returning 1 Connections
cp.curActConns = 160
Returning 1 Connections
cp.curActConns = 161
Allocating 12 Connections
Returning 4 Connections
cp.curActConns = 169
Returning 0 Connections
Allocating 13 Connections
cp.curActConns = 171
Returning 1 Connections
cp.curActConns = 181
Returning 4 Connections
Allocating 9 Connections
cp.curActConns = 182
Returning 4 Connections
cp.curActConns = 182
Allocating 6 Connections
Returning 4 Connections
cp.curActConns = 184
Returning 3 Connections
Allocating 23 Connections
cp.curActConns = 193
Returning 1 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 3 Connections
cp.curActConns = 202
Allocating 4 Connections
Returning 3 Connections
cp.curActConns = 203
Allocating 2 Connections
Returning 2 Connections
cp.curActConns = 203
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 202
Allocating 4 Connections
Returning 1 Connections
cp.curActConns = 205
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 204
Allocating 4 Connections
Returning 4 Connections
cp.curActConns = 204
Allocating 3 Connections
Returning 2 Connections
cp.curActConns = 205
Allocating 2 Connections
Returning 3 Connections
cp.curActConns = 204
Allocating 1 Connections
Returning 3 Connections
cp.curActConns = 202
Returning 3 Connections
Allocating 12 Connections
cp.curActConns = 211
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 212
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 212
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 210
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 211
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 211
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 209
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 207
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 206
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 207
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 207
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 208
Returning 0 Connections
Allocating 2 Connections
cp.curActConns = 210
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 213
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 215
Returning 0 Connections
cp.curActConns = 217
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 220
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 218
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 217
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 219
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 222
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 223
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 220
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 222
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 220
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 217
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 218
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 216
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 216
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 217
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 217
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 215
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 214
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 212
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 211
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 215
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 216
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 217
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 221
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 222
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 223
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 226
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 223
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 220
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 221
Returning 4 Connections
Allocating 0 Connections
cp.curActConns = 217
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 214
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 214
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 215
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 215
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 213
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 212
Retuning from startDeallocatorRoutine
Retuning from startAllocatorRoutine
2023-09-12T13:14:35.127+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:14:35.127+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:14:36.093+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.07s)
=== RUN TestLowWM
2023-09-12T13:14:39.129+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2023-09-12T13:14:39.129+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T13:15:39.145+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-09-12T13:16:39.161+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-09-12T13:16:44.644+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:16:44.644+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:16:45.163+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.52s)
=== RUN TestTotalConns
2023-09-12T13:16:48.645+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2023-09-12T13:16:48.645+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T13:17:02.893+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:17:02.893+05:30 [Info] Closing active connection from 127.0.0.1:60540 to 127.0.0.1:15151
2023-09-12T13:17:02.893+05:30 [Info] Closing active connection from 127.0.0.1:60602 to 127.0.0.1:15151
2023-09-12T13:17:02.893+05:30 [Info] Closing active connection from 127.0.0.1:60486 to 127.0.0.1:15151
2023-09-12T13:17:02.893+05:30 [Info] Closing active connection from 127.0.0.1:60494 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60576 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60444 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60504 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60532 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60580 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60568 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60490 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60422 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60482 to 127.0.0.1:15151
2023-09-12T13:17:02.894+05:30 [Info] Closing active connection from 127.0.0.1:60612 to 127.0.0.1:15151
2023-09-12T13:17:02.895+05:30 [Info] Closing active connection from 127.0.0.1:60598 to 127.0.0.1:15151
2023-09-12T13:17:02.895+05:30 [Info] Closing active connection from 127.0.0.1:60584 to 127.0.0.1:15151
2023-09-12T13:17:02.895+05:30 [Info] Closing active connection from 127.0.0.1:60536 to 127.0.0.1:15151
2023-09-12T13:17:02.895+05:30 [Info] Closing active connection from 127.0.0.1:60586 to 127.0.0.1:15151
2023-09-12T13:17:02.895+05:30 [Info] Closing active connection from 127.0.0.1:60518 to 127.0.0.1:15151
2023-09-12T13:17:02.895+05:30 [Info] Closing active connection from 127.0.0.1:60570 to 127.0.0.1:15151
2023-09-12T13:17:02.895+05:30 [Info] Closing active connection from 127.0.0.1:60452 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60424 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60552 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60524 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60544 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60528 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60470 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60506 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60430 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60454 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60502 to 127.0.0.1:15151
2023-09-12T13:17:02.896+05:30 [Info] Closing active connection from 127.0.0.1:60456 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60550 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60554 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60614 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60516 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60538 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60450 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60478 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60498 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60464 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60542 to 127.0.0.1:15151
2023-09-12T13:17:02.897+05:30 [Info] Closing active connection from 127.0.0.1:60448 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60564 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60608 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60572 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60596 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60480 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60604 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60440 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60438 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60556 to 127.0.0.1:15151
2023-09-12T13:17:02.898+05:30 [Info] Closing active connection from 127.0.0.1:60592 to 127.0.0.1:15151
2023-09-12T13:17:02.899+05:30 [Info] Closing active connection from 127.0.0.1:60600 to 127.0.0.1:15151
2023-09-12T13:17:02.899+05:30 [Info] Closing active connection from 127.0.0.1:60426 to 127.0.0.1:15151
2023-09-12T13:17:02.899+05:30 [Info] Closing active connection from 127.0.0.1:60462 to 127.0.0.1:15151
2023-09-12T13:17:02.899+05:30 [Info] Closing active connection from 127.0.0.1:60578 to 127.0.0.1:15151
2023-09-12T13:17:02.899+05:30 [Info] Closing active connection from 127.0.0.1:60466 to 127.0.0.1:15151
2023-09-12T13:17:02.899+05:30 [Info] Closing active connection from 127.0.0.1:60468 to 127.0.0.1:15151
2023-09-12T13:17:02.899+05:30 [Info] Closing active connection from 127.0.0.1:60458 to 127.0.0.1:15151
2023-09-12T13:17:02.899+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:17:03.652+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.26s)
=== RUN TestUpdateTickRate
2023-09-12T13:17:06.902+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2023-09-12T13:17:06.902+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T13:17:27.761+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T13:17:27.762+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T13:17:27.918+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.86s)
PASS
ok github.com/couchbase/indexing/secondary/queryport/client 344.871s
Starting server: attempt 1
Functional tests
2023/09/12 13:19:54 In TestMain()
2023/09/12 13:19:54 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2023/09/12 13:19:54 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2023/09/12 13:19:55 Initialising web UI on node: 127.0.0.1:9000
2023/09/12 13:19:56 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2023/09/12 13:19:57 Setting data quota of 1500M and Index quota of 1500M
2023/09/12 13:19:58 Adding node: https://127.0.0.1:19001 with role: kv,index to the cluster
2023/09/12 13:20:14 AddNode: Successfully added node: 127.0.0.1:9001 (role kv,index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 13:20:19 Rebalance progress: 0
2023/09/12 13:20:24 Rebalance progress: 0
2023/09/12 13:20:29 Rebalance progress: 75
2023/09/12 13:20:34 Rebalance progress: 100
2023/09/12 13:20:40 Created bucket default, responseBody:
2023/09/12 13:20:45 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 13:20:45 Successfully initialised cluster
2023/09/12 13:20:45 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 13:20:45 Changing config key queryport.client.settings.backfillLimit to value 0
2023/09/12 13:20:45 Changing config key queryport.client.log_level to value Warn
2023/09/12 13:20:45 Changing config key indexer.api.enableTestServer to value true
2023/09/12 13:20:45 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2023/09/12 13:20:45 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2023/09/12 13:20:45 Changing config key indexer.settings.log_level to value info
2023/09/12 13:20:45 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2023/09/12 13:20:45 Using plasma for creating indexes
2023/09/12 13:20:46 Changing config key indexer.settings.storage_mode to value plasma
2023/09/12 13:20:51 Data file exists. Skipping download
2023/09/12 13:20:51 Data file exists. Skipping download
2023/09/12 13:20:52 In DropAllSecondaryIndexes()
2023/09/12 13:20:52 Emptying the default bucket
2023/09/12 13:20:55 Flush Enabled on bucket default, responseBody:
2023/09/12 13:21:33 Flushed the bucket default, Response body:
2023/09/12 13:21:33 Create Index On the empty default Bucket()
2023/09/12 13:21:37 Created the secondary index index_eyeColor. Waiting for it become active
2023/09/12 13:21:37 Index is 12502443146185992100 now active
2023/09/12 13:21:37 Populating the default bucket
=== RUN TestScanAfterBucketPopulate
2023/09/12 13:21:46 In TestScanAfterBucketPopulate()
2023/09/12 13:21:46 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/09/12 13:21:46 Using n1ql client
2023-09-12T13:21:46.849+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2023/09/12 13:21:46 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.10s)
=== RUN TestRestartNilSnapshot
2023/09/12 13:21:46 In TestRestartNilSnapshot()
2023/09/12 13:21:51 Created the secondary index idx_age. Waiting for it become active
2023/09/12 13:21:51 Index is 3462021001478090721 now active
2023/09/12 13:21:51 Restarting indexer process ...
2023/09/12 13:21:51 []
2023-09-12T13:21:51.555+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-12T13:21:51.557+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/12 13:25:11 Using n1ql client
2023-09-12T13:25:11.537+05:30 [Error] transport error between 127.0.0.1:51674->127.0.0.1:9107: write tcp 127.0.0.1:51674->127.0.0.1:9107: write: broken pipe
2023-09-12T13:25:11.537+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -8503243034995103097 request transport failed `write tcp 127.0.0.1:51674->127.0.0.1:9107: write: broken pipe`
2023-09-12T13:25:11.537+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T13:25:11.537+05:30 [Error] metadataClient:PickRandom: Replicas - [8880545245561577801], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 13:25:11 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.65s)
=== RUN TestThreeIndexCreates
2023/09/12 13:25:11 In TestThreeIndexCreates()
2023/09/12 13:25:16 Created the secondary index index_balance. Waiting for it become active
2023/09/12 13:25:16 Index is 9465345447157934747 now active
2023/09/12 13:25:16 Create docs mutations
2023/09/12 13:25:16 Using n1ql client
2023/09/12 13:25:16 Expected and Actual scan responses are the same
2023/09/12 13:25:22 Created the secondary index index_email. Waiting for it become active
2023/09/12 13:25:22 Index is 10314228781105732703 now active
2023/09/12 13:25:22 Create docs mutations
2023/09/12 13:25:23 Using n1ql client
2023/09/12 13:25:23 Expected and Actual scan responses are the same
2023/09/12 13:25:29 Created the secondary index index_pin. Waiting for it become active
2023/09/12 13:25:29 Index is 16839901491969117256 now active
2023/09/12 13:25:29 Delete docs mutations
2023/09/12 13:25:29 Using n1ql client
2023/09/12 13:25:29 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (18.35s)
=== RUN TestMultipleIndexCreatesDropsWithMutations
2023/09/12 13:25:29 In TestThreeIndexCreates()
2023/09/12 13:25:36 Created the secondary index index_state. Waiting for it become active
2023/09/12 13:25:36 Index is 10946465718382329772 now active
2023/09/12 13:25:36 Create docs mutations
2023/09/12 13:25:36 Using n1ql client
2023/09/12 13:25:36 Expected and Actual scan responses are the same
2023/09/12 13:25:43 Created the secondary index index_registered. Waiting for it become active
2023/09/12 13:25:43 Index is 834892048041286663 now active
2023/09/12 13:25:43 Create docs mutations
2023/09/12 13:25:43 Using n1ql client
2023/09/12 13:25:43 Expected and Actual scan responses are the same
2023/09/12 13:25:50 Created the secondary index index_gender. Waiting for it become active
2023/09/12 13:25:50 Index is 8221713835314994875 now active
2023/09/12 13:25:50 Create docs mutations
2023/09/12 13:25:50 Using n1ql client
2023/09/12 13:25:50 Expected and Actual scan responses are the same
2023/09/12 13:25:50 Dropping the secondary index index_registered
2023/09/12 13:25:50 Index dropped
2023/09/12 13:25:50 Create docs mutations
2023/09/12 13:25:50 Delete docs mutations
2023/09/12 13:25:50 Using n1ql client
2023/09/12 13:25:50 Expected and Actual scan responses are the same
2023/09/12 13:25:56 Created the secondary index index_longitude. Waiting for it become active
2023/09/12 13:25:56 Index is 11613326225783133697 now active
2023/09/12 13:25:56 Create docs mutations
2023/09/12 13:25:56 Using n1ql client
2023/09/12 13:25:56 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (26.77s)
=== RUN TestCreateDropScan
2023/09/12 13:25:56 In TestCreateDropScan()
2023/09/12 13:26:03 Created the secondary index index_cd. Waiting for it become active
2023/09/12 13:26:03 Index is 7440464416488297302 now active
2023/09/12 13:26:03 Using n1ql client
2023/09/12 13:26:03 Expected and Actual scan responses are the same
2023/09/12 13:26:03 Dropping the secondary index index_cd
2023/09/12 13:26:03 Index dropped
2023/09/12 13:26:03 Using n1ql client
2023/09/12 13:26:03 Scan failed as expected with error: Index Not Found - cause: GSI index index_cd not found.
--- PASS: TestCreateDropScan (6.64s)
=== RUN TestCreateDropCreate
2023/09/12 13:26:03 In TestCreateDropCreate()
2023/09/12 13:26:09 Created the secondary index index_cdc. Waiting for it become active
2023/09/12 13:26:09 Index is 6060340301389607468 now active
2023/09/12 13:26:09 Using n1ql client
2023/09/12 13:26:09 Expected and Actual scan responses are the same
2023/09/12 13:26:09 Dropping the secondary index index_cdc
2023/09/12 13:26:09 Index dropped
2023/09/12 13:26:09 Using n1ql client
2023/09/12 13:26:09 Scan 2 failed as expected with error: Index Not Found - cause: GSI index index_cdc not found.
2023/09/12 13:26:16 Created the secondary index index_cdc. Waiting for it become active
2023/09/12 13:26:16 Index is 18345971149511965833 now active
2023/09/12 13:26:16 Using n1ql client
2023/09/12 13:26:16 Expected and Actual scan responses are the same
2023/09/12 13:26:16 (Inclusion 1) Lengths of expected and actual scan results are 5081 and 5081. Num of docs in bucket = 10402
2023/09/12 13:26:16 Using n1ql client
2023/09/12 13:26:16 Expected and Actual scan responses are the same
2023/09/12 13:26:16 (Inclusion 3) Lengths of expected and actual scan results are 5081 and 5081. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (13.22s)
=== RUN TestCreate2Drop1Scan2
2023/09/12 13:26:16 In TestCreate2Drop1Scan2()
2023/09/12 13:26:23 Created the secondary index index_i1. Waiting for it become active
2023/09/12 13:26:23 Index is 12069712464314531974 now active
2023/09/12 13:26:29 Created the secondary index index_i2. Waiting for it become active
2023/09/12 13:26:29 Index is 3830035246702419841 now active
2023/09/12 13:26:29 Using n1ql client
2023/09/12 13:26:29 Expected and Actual scan responses are the same
2023/09/12 13:26:29 Using n1ql client
2023/09/12 13:26:29 Expected and Actual scan responses are the same
2023/09/12 13:26:29 Dropping the secondary index index_i1
2023/09/12 13:26:29 Index dropped
2023/09/12 13:26:29 Using n1ql client
2023/09/12 13:26:29 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (13.15s)
=== RUN TestIndexNameCaseSensitivity
2023/09/12 13:26:29 In TestIndexNameCaseSensitivity()
2023/09/12 13:26:36 Created the secondary index index_age. Waiting for it become active
2023/09/12 13:26:36 Index is 5988255381865700298 now active
2023/09/12 13:26:36 Using n1ql client
2023/09/12 13:26:36 Expected and Actual scan responses are the same
2023/09/12 13:26:36 Using n1ql client
2023/09/12 13:26:36 Scan failed as expected with error: Index Not Found - cause: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (6.54s)
=== RUN TestCreateDuplicateIndex
2023/09/12 13:26:36 In TestCreateDuplicateIndex()
2023/09/12 13:26:42 Created the secondary index index_di1. Waiting for it become active
2023/09/12 13:26:42 Index is 13202395308128890192 now active
2023/09/12 13:26:42 Index found: index_di1
2023/09/12 13:26:42 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (6.45s)
=== RUN TestDropNonExistingIndex
2023/09/12 13:26:42 In TestDropNonExistingIndex()
2023/09/12 13:26:42 Dropping the secondary index 123456
2023/09/12 13:26:42 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.05s)
=== RUN TestCreateIndexNonExistentBucket
2023/09/12 13:26:42 In TestCreateIndexNonExistentBucket()
2023-09-12T13:26:43.266+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-09-12T13:26:54.268+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023/09/12 13:26:54 Index create failed as expected with error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- PASS: TestCreateIndexNonExistentBucket (11.51s)
=== RUN TestScanWithNoTimeout
2023/09/12 13:26:54 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/09/12 13:26:54 Changing config key indexer.settings.scan_timeout to value 0
2023/09/12 13:26:54 Using n1ql client
2023/09/12 13:26:54 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.40s)
=== RUN TestIndexingOnBinaryBucketMeta
2023/09/12 13:26:54 In TestIndexingOnBinaryBucketMeta()
2023/09/12 13:26:54 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2023/09/12 13:26:54 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2023/09/12 13:26:57 Modified parameters of bucket default, responseBody:
2023/09/12 13:26:57 Created bucket binaryBucket, responseBody:
2023/09/12 13:27:16 Created the secondary index index_binary_meta_id. Waiting for it become active
2023/09/12 13:27:16 Index is 12016113731632382790 now active
2023/09/12 13:27:21 items_count stat is 10 for index index_binary_meta_id
2023/09/12 13:27:21 Dropping the secondary index index_binary_meta_id
2023/09/12 13:27:21 Index dropped
2023/09/12 13:27:24 Created the secondary index index_binary_meta_cas. Waiting for it become active
2023/09/12 13:27:24 Index is 3992699982691145806 now active
2023/09/12 13:27:29 items_count stat is 10 for index index_binary_meta_cas
2023/09/12 13:27:29 Dropping the secondary index index_binary_meta_cas
2023/09/12 13:27:29 Index dropped
2023/09/12 13:27:32 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2023/09/12 13:27:32 Index is 6872728819493180714 now active
2023/09/12 13:27:37 items_count stat is 10 for index index_binary_meta_expiration
2023/09/12 13:27:37 Dropping the secondary index index_binary_meta_expiration
2023/09/12 13:27:37 Index dropped
2023/09/12 13:27:39 Deleted bucket binaryBucket, responseBody:
2023/09/12 13:27:42 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnBinaryBucketMeta (63.10s)
=== RUN TestRetainDeleteXATTRBinaryDocs
2023/09/12 13:27:57 In TestRetainDeleteXATTRBinaryDocs()
2023/09/12 13:27:57 1. Populate a bucket with binary docs having system XATTRS
2023/09/12 13:27:57 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2023/09/12 13:27:57 3. Delete the documents in the bucket
2023/09/12 13:27:57 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2023/09/12 13:28:00 Modified parameters of bucket default, responseBody:
2023/09/12 13:28:00 Created bucket binaryBucket, responseBody:
2023/09/12 13:28:19 Created the secondary index index_system_xattr. Waiting for it become active
2023/09/12 13:28:19 Index is 10710736334699754708 now active
2023/09/12 13:28:24 Deleted all the documents in the bucket: binaryBucket successfully
2023/09/12 13:28:27 Deleted bucket binaryBucket, responseBody:
2023/09/12 13:28:30 Modified parameters of bucket default, responseBody:
--- PASS: TestRetainDeleteXATTRBinaryDocs (47.69s)
=== RUN TestIndexingOnXATTRs
2023/09/12 13:28:45 In TestIndexingOnXATTRs()
2023/09/12 13:28:48 Modified parameters of bucket default, responseBody:
2023/09/12 13:28:48 Created bucket bucket_xattrs, responseBody:
2023/09/12 13:29:07 Created the secondary index index_sync_rev. Waiting for it become active
2023/09/12 13:29:07 Index is 7240616358467145947 now active
2023/09/12 13:29:14 Created the secondary index index_sync_channels. Waiting for it become active
2023/09/12 13:29:14 Index is 9887736676045911730 now active
2023/09/12 13:29:21 Created the secondary index index_sync_test. Waiting for it become active
2023/09/12 13:29:21 Index is 17103346644808056649 now active
2023/09/12 13:29:26 items_count stat is 100 for index index_sync_rev
2023/09/12 13:29:26 items_count stat is 100 for index index_sync_channels
2023/09/12 13:29:26 items_count stat is 100 for index index_sync_test
2023/09/12 13:29:26 Using n1ql client
2023-09-12T13:29:26.149+05:30 [Info] GSIC[default/bucket_xattrs-_default-_default-1694505566144733861] started ...
2023/09/12 13:29:26 Dropping the secondary index index_sync_rev
2023/09/12 13:29:26 Index dropped
2023/09/12 13:29:26 Using n1ql client
2023/09/12 13:29:26 Dropping the secondary index index_sync_channels
2023/09/12 13:29:26 Index dropped
2023/09/12 13:29:26 Using n1ql client
2023/09/12 13:29:26 Dropping the secondary index index_sync_test
2023/09/12 13:29:26 Index dropped
2023/09/12 13:29:28 Deleted bucket bucket_xattrs, responseBody:
2023/09/12 13:29:31 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnXATTRs (61.16s)
=== RUN TestSimpleIndex_FloatDataType
2023/09/12 13:29:46 In TestSimpleIndex_FloatDataType()
2023/09/12 13:29:46 Index found: index_age
2023/09/12 13:29:46 Using n1ql client
2023/09/12 13:29:46 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.02s)
=== RUN TestSimpleIndex_StringDataType
2023/09/12 13:29:46 In TestSimpleIndex_StringDataType()
2023/09/12 13:29:51 Created the secondary index index_company. Waiting for it become active
2023/09/12 13:29:51 Index is 12169255535465032381 now active
2023/09/12 13:29:51 Using n1ql client
2023/09/12 13:29:51 Expected and Actual scan responses are the same
2023/09/12 13:29:51 Using n1ql client
2023/09/12 13:29:51 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.87s)
=== RUN TestSimpleIndex_FieldValueCaseSensitivity
2023/09/12 13:29:51 In TestSimpleIndex_StringCaseSensitivity()
2023/09/12 13:29:51 Index found: index_company
2023/09/12 13:29:51 Using n1ql client
2023/09/12 13:29:51 Expected and Actual scan responses are the same
2023/09/12 13:29:51 Using n1ql client
2023/09/12 13:29:51 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.09s)
=== RUN TestSimpleIndex_BoolDataType
2023/09/12 13:29:51 In TestSimpleIndex_BoolDataType()
2023/09/12 13:29:58 Created the secondary index index_isActive. Waiting for it become active
2023/09/12 13:29:58 Index is 1827208193960297905 now active
2023/09/12 13:29:58 Using n1ql client
2023/09/12 13:29:58 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (6.70s)
=== RUN TestBasicLookup
2023/09/12 13:29:58 In TestBasicLookup()
2023/09/12 13:29:58 Index found: index_company
2023/09/12 13:29:58 Using n1ql client
2023/09/12 13:29:58 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.01s)
=== RUN TestIndexOnNonExistentField
2023/09/12 13:29:58 In TestIndexOnNonExistentField()
2023/09/12 13:30:04 Created the secondary index index_height. Waiting for it become active
2023/09/12 13:30:04 Index is 9753659222773633117 now active
2023/09/12 13:30:04 Using n1ql client
2023/09/12 13:30:04 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (6.65s)
=== RUN TestIndexPartiallyMissingField
2023/09/12 13:30:04 In TestIndexPartiallyMissingField()
2023/09/12 13:30:11 Created the secondary index index_nationality. Waiting for it become active
2023/09/12 13:30:11 Index is 6223262004035376145 now active
2023/09/12 13:30:11 Using n1ql client
2023/09/12 13:30:12 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (7.62s)
=== RUN TestScanNonMatchingDatatype
2023/09/12 13:30:12 In TestScanNonMatchingDatatype()
2023/09/12 13:30:12 Index found: index_age
2023/09/12 13:30:12 Using n1ql client
2023/09/12 13:30:12 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.01s)
=== RUN TestInclusionNeither
2023/09/12 13:30:12 In TestInclusionNeither()
2023/09/12 13:30:12 Index found: index_age
2023/09/12 13:30:12 Using n1ql client
2023/09/12 13:30:12 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.01s)
=== RUN TestInclusionLow
2023/09/12 13:30:12 In TestInclusionLow()
2023/09/12 13:30:12 Index found: index_age
2023/09/12 13:30:12 Using n1ql client
2023/09/12 13:30:12 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.01s)
=== RUN TestInclusionHigh
2023/09/12 13:30:12 In TestInclusionHigh()
2023/09/12 13:30:12 Index found: index_age
2023/09/12 13:30:12 Using n1ql client
2023/09/12 13:30:12 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.02s)
=== RUN TestInclusionBoth
2023/09/12 13:30:12 In TestInclusionBoth()
2023/09/12 13:30:12 Index found: index_age
2023/09/12 13:30:12 Using n1ql client
2023/09/12 13:30:12 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.02s)
=== RUN TestNestedIndex_String
2023/09/12 13:30:12 In TestNestedIndex_String()
2023/09/12 13:30:18 Created the secondary index index_streetname. Waiting for it become active
2023/09/12 13:30:18 Index is 151451254349666570 now active
2023/09/12 13:30:18 Using n1ql client
2023/09/12 13:30:18 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (5.64s)
=== RUN TestNestedIndex_Float
2023/09/12 13:30:18 In TestNestedIndex_Float()
2023/09/12 13:30:25 Created the secondary index index_floor. Waiting for it become active
2023/09/12 13:30:25 Index is 7750088080380395356 now active
2023/09/12 13:30:25 Using n1ql client
2023/09/12 13:30:25 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (6.83s)
=== RUN TestNestedIndex_Bool
2023/09/12 13:30:25 In TestNestedIndex_Bool()
2023/09/12 13:30:31 Created the secondary index index_isresidential. Waiting for it become active
2023/09/12 13:30:31 Index is 1507883870193487841 now active
2023/09/12 13:30:31 Using n1ql client
2023/09/12 13:30:31 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (6.60s)
=== RUN TestLookupJsonObject
2023/09/12 13:30:31 In TestLookupJsonObject()
2023/09/12 13:30:38 Created the secondary index index_streetaddress. Waiting for it become active
2023/09/12 13:30:38 Index is 1049951328250085376 now active
2023/09/12 13:30:38 Using n1ql client
2023/09/12 13:30:38 Count of docScanResults is 1
2023/09/12 13:30:38 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/12 13:30:38 Count of scanResults is 1
2023/09/12 13:30:38 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/12 13:30:38 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.69s)
=== RUN TestLookupObjDifferentOrdering
2023/09/12 13:30:38 In TestLookupObjDifferentOrdering()
2023/09/12 13:30:38 Index found: index_streetaddress
2023/09/12 13:30:38 Using n1ql client
2023/09/12 13:30:38 Count of docScanResults is 1
2023/09/12 13:30:38 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/12 13:30:38 Count of scanResults is 1
2023/09/12 13:30:38 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/12 13:30:38 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.02s)
=== RUN TestRangeJsonObject
2023/09/12 13:30:38 In TestRangeJsonObject()
2023/09/12 13:30:38 Index found: index_streetaddress
2023/09/12 13:30:38 Using n1ql client
2023/09/12 13:30:38 Count of scanResults is 2
2023/09/12 13:30:38 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2023/09/12 13:30:38 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/12 13:30:38 Count of docScanResults is 2
2023/09/12 13:30:38 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/12 13:30:38 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2023/09/12 13:30:38 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.01s)
=== RUN TestLookupFloatDiffForms
2023/09/12 13:30:38 In TestLookupFloatDiffForms()
2023/09/12 13:30:45 Created the secondary index index_latitude. Waiting for it become active
2023/09/12 13:30:45 Index is 3218647461761700177 now active
2023/09/12 13:30:45 Scan 1
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 2
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 3
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 4
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 5
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 6
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (6.94s)
=== RUN TestRangeFloatInclVariations
2023/09/12 13:30:45 In TestRangeFloatInclVariations()
2023/09/12 13:30:45 Index found: index_latitude
2023/09/12 13:30:45 Scan 1
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 2
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 3
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 4
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 5
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
2023/09/12 13:30:45 Scan 6
2023/09/12 13:30:45 Using n1ql client
2023/09/12 13:30:45 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.04s)
=== RUN TestScanAll
2023/09/12 13:30:45 In TestScanAll()
2023/09/12 13:30:52 Created the secondary index index_name. Waiting for it become active
2023/09/12 13:30:52 Index is 12839399485219364148 now active
2023/09/12 13:30:52 Length of docScanResults = 10502
2023/09/12 13:30:52 Using n1ql client
2023/09/12 13:30:52 Length of scanResults = 10502
2023/09/12 13:30:52 Expected and Actual scan responses are the same
--- PASS: TestScanAll (6.85s)
=== RUN TestScanAllNestedField
2023/09/12 13:30:52 In TestScanAllNestedField()
2023/09/12 13:30:52 Index found: index_streetname
2023/09/12 13:30:52 Length of docScanResults = 2
2023/09/12 13:30:52 Using n1ql client
2023/09/12 13:30:52 Length of scanResults = 2
2023/09/12 13:30:52 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN TestBasicPrimaryIndex
2023/09/12 13:30:52 In TestBasicPrimaryIndex()
2023/09/12 13:30:58 Created the secondary index index_p1. Waiting for it become active
2023/09/12 13:30:58 Index is 2440318443299714705 now active
2023-09-12T13:30:58.590+05:30 [Error] transport error between 127.0.0.1:51338->127.0.0.1:9107: write tcp 127.0.0.1:51338->127.0.0.1:9107: write: broken pipe
2023-09-12T13:30:58.590+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:51338->127.0.0.1:9107: write: broken pipe`
2023-09-12T13:30:58.590+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T13:30:58.590+05:30 [Error] metadataClient:PickRandom: Replicas - [17265146907912774622], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 13:30:58 Expected and Actual scan responses are the same
2023/09/12 13:30:58 CountRange() expected and actual is: 1891 and 1891
2023/09/12 13:30:58 lookupkey for CountLookup() = User72fe6a53-51f7-4534-a00c-c43a69206135
2023/09/12 13:30:58 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (6.47s)
=== RUN TestBasicNullDataType
2023/09/12 13:30:58 In TestBasicNullDataType()
2023/09/12 13:30:58 Index found: index_email
2023/09/12 13:30:58 Using n1ql client
2023/09/12 13:30:58 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.02s)
=== RUN TestBasicArrayDataType_ScanAll
2023/09/12 13:30:58 In TestBasicArrayDataType_ScanAll()
2023/09/12 13:31:05 Created the secondary index index_tags. Waiting for it become active
2023/09/12 13:31:05 Index is 8658523729966673360 now active
2023/09/12 13:31:05 Using n1ql client
2023/09/12 13:31:05 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (7.00s)
=== RUN TestBasicArrayDataType_Lookup
2023/09/12 13:31:05 In TestBasicArrayDataType_Lookup()
2023/09/12 13:31:07 Index found: index_tags
2023/09/12 13:31:07 Count of scanResults is 1
2023/09/12 13:31:07 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75 Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN TestArrayDataType_LookupMissingArrayValue
2023/09/12 13:31:07 In TestArrayDataType_LookupMissingArrayValue()
2023/09/12 13:31:07 Index found: index_tags
2023/09/12 13:31:07 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.00s)
=== RUN TestArrayDataType_LookupWrongOrder
2023/09/12 13:31:07 In TestArrayDataType_LookupWrongOrder()
2023/09/12 13:31:07 Index found: index_tags
2023/09/12 13:31:07 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN TestArrayDataType_LookupSubset
2023/09/12 13:31:07 In TestArrayDataType_LookupSubset()
2023/09/12 13:31:07 Index found: index_tags
2023/09/12 13:31:07 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN TestScanLimitParameter
2023/09/12 13:31:07 In TestScanLimitParameter()
2023/09/12 13:31:07 Index found: index_age
2023/09/12 13:31:07 Using n1ql client
2023/09/12 13:31:07 Using n1ql client
--- PASS: TestScanLimitParameter (0.01s)
=== RUN TestCountRange
2023/09/12 13:31:07 In TestRangeCount()
2023/09/12 13:31:07 Index found: index_age
2023/09/12 13:31:07 Count of expected and actual Range is: 2378 and 2378
2023/09/12 13:31:07 Count of expected and actual Range is: 10002 and 10002
2023/09/12 13:31:07 Count of expected and actual Range are: 0 and 0
2023/09/12 13:31:07 Count of expected and actual Range are: 489 and 489
2023/09/12 13:31:07 Testing CountRange() for key <= val
2023/09/12 13:31:07 Count of expected and actual CountRange for key <= 30 are: 5206 and 5206
2023/09/12 13:31:07 Testing CountRange() for key >= val
2023/09/12 13:31:07 Count of expected and actual CountRange for key >= 25 are: 7701 and 7701
2023/09/12 13:31:07 Testing CountRange() for null < key <= val
2023/09/12 13:31:07 Count of expected and actual CountRange for key > null && key <= 30 are: 5206 and 5206
2023/09/12 13:31:07 Testing CountRange() for val <= key < null
2023/09/12 13:31:07 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2023/09/12 13:31:07 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.09s)
=== RUN TestCountLookup
2023/09/12 13:31:07 In TestCountLookup()
2023/09/12 13:31:07 Index found: index_age
2023/09/12 13:31:07 Count of expected and actual Range are: 501 and 501
2023/09/12 13:31:07 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.01s)
=== RUN TestRangeStatistics
2023/09/12 13:31:07 In TestRangeCount()
2023/09/12 13:31:07 Index found: index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN TestIndexCreateWithWhere
2023/09/12 13:31:07 In TestIndexCreateWithWhere()
2023/09/12 13:31:12 Created the secondary index index_ageabove30. Waiting for it become active
2023/09/12 13:31:12 Index is 12958681520245806547 now active
2023/09/12 13:31:12 Using n1ql client
2023/09/12 13:31:12 Expected and Actual scan responses are the same
2023/09/12 13:31:12 Lengths of expected and actual scanReuslts are: 4307 and 4307
2023/09/12 13:31:19 Created the secondary index index_ageteens. Waiting for it become active
2023/09/12 13:31:19 Index is 17185804253660160899 now active
2023/09/12 13:31:19 Using n1ql client
2023/09/12 13:31:19 Expected and Actual scan responses are the same
2023/09/12 13:31:19 Lengths of expected and actual scanReuslts are: 0 and 0
2023/09/12 13:31:25 Created the secondary index index_age35to45. Waiting for it become active
2023/09/12 13:31:25 Index is 9169436945990981189 now active
2023/09/12 13:31:25 Using n1ql client
2023/09/12 13:31:25 Expected and Actual scan responses are the same
2023/09/12 13:31:25 Lengths of expected and actual scanReuslts are: 2867 and 2867
--- PASS: TestIndexCreateWithWhere (17.79s)
=== RUN TestDeferredIndexCreate
2023/09/12 13:31:25 In TestDeferredIndexCreate()
2023/09/12 13:31:25 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2023/09/12 13:31:27 Build the deferred index index_deferred. Waiting for the index to become active
2023/09/12 13:31:27 Waiting for index 10752754661516437066 to go active ...
2023/09/12 13:31:28 Waiting for index 10752754661516437066 to go active ...
2023/09/12 13:31:29 Waiting for index 10752754661516437066 to go active ...
2023/09/12 13:31:30 Waiting for index 10752754661516437066 to go active ...
2023/09/12 13:31:31 Waiting for index 10752754661516437066 to go active ...
2023/09/12 13:31:32 Index is 10752754661516437066 now active
2023/09/12 13:31:32 Using n1ql client
2023/09/12 13:31:32 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (7.16s)
=== RUN TestCompositeIndex_NumAndString
2023/09/12 13:31:32 In TestCompositeIndex()
2023/09/12 13:31:39 Created the secondary index index_composite1. Waiting for it become active
2023/09/12 13:31:39 Index is 746061931691294049 now active
2023/09/12 13:31:39 Using n1ql client
2023/09/12 13:31:39 Using n1ql client
2023/09/12 13:31:39 Using n1ql client
2023/09/12 13:31:39 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (6.70s)
=== RUN TestCompositeIndex_TwoNumberFields
2023/09/12 13:31:39 In TestCompositeIndex()
2023/09/12 13:31:46 Created the secondary index index_composite2. Waiting for it become active
2023/09/12 13:31:46 Index is 7980630796398160658 now active
2023/09/12 13:31:46 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (7.80s)
=== RUN TestNumbers_Int64_Float64
2023/09/12 13:31:47 In TestNumbers_Int64_Float64()
2023/09/12 13:31:52 Created the secondary index idx_numbertest. Waiting for it become active
2023/09/12 13:31:52 Index is 11188119500814203291 now active
2023/09/12 13:31:52
==== Int64 test #0
2023/09/12 13:31:52 Using n1ql client
2023/09/12 13:31:52 Expected and Actual scan responses are the same
2023/09/12 13:31:52
==== Int64 test #1
2023/09/12 13:31:52 Using n1ql client
2023/09/12 13:31:52 Expected and Actual scan responses are the same
2023/09/12 13:31:52
==== Int64 test #2
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Int64 test #3
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Int64 test #4
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Int64 test #5
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Int64 test #6
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Int64 test #7
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Int64 test #8
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Float64 test #0
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Float64 test #1
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Float64 test #2
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
2023/09/12 13:31:53
==== Float64 test #3
2023/09/12 13:31:53 Using n1ql client
2023/09/12 13:31:53 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (6.33s)
=== RUN TestRestartIndexer
2023/09/12 13:31:53 In TestRestartIndexer()
2023/09/12 13:31:53 []
2023-09-12T13:31:53.770+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-12T13:31:53.770+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/12 13:32:13 Using n1ql client
2023-09-12T13:32:13.705+05:30 [Error] transport error between 127.0.0.1:52226->127.0.0.1:9107: write tcp 127.0.0.1:52226->127.0.0.1:9107: write: broken pipe
2023-09-12T13:32:13.705+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 4991389858713985002 request transport failed `write tcp 127.0.0.1:52226->127.0.0.1:9107: write: broken pipe`
2023/09/12 13:32:13 Len of expected and actual scan results are : 10002 and 10002
2023/09/12 13:32:13 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.14s)
=== RUN TestCreateDocsMutation
2023/09/12 13:32:13 In TestCreateDocsMutation()
2023/09/12 13:32:13 Index found: index_age
2023/09/12 13:32:13 Using n1ql client
2023/09/12 13:32:13 Len of expected and actual scan results are : 10002 and 10002
2023/09/12 13:32:13 Expected and Actual scan responses are the same
2023/09/12 13:32:14 Using n1ql client
2023/09/12 13:32:14 Index Scan after mutations took 197.697147ms
2023/09/12 13:32:14 Len of expected and actual scan results are : 10102 and 10102
2023/09/12 13:32:14 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.50s)
=== RUN TestRestartProjector
2023/09/12 13:32:14 In TestRestartProjector()
2023/09/12 13:32:14 []
2023/09/12 13:32:34 Using n1ql client
2023/09/12 13:32:34 Len of expected and actual scan results are : 10102 and 10102
2023/09/12 13:32:34 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.08s)
=== RUN TestDeleteDocsMutation
2023/09/12 13:32:34 In TestDeleteDocsMutation()
2023/09/12 13:32:34 Index found: index_age
2023/09/12 13:32:34 Using n1ql client
2023/09/12 13:32:34 Len of expected and actual scan results are : 10102 and 10102
2023/09/12 13:32:34 Expected and Actual scan responses are the same
2023/09/12 13:32:34 Using n1ql client
2023/09/12 13:32:35 Index Scan after mutations took 353.334954ms
2023/09/12 13:32:35 Len of expected and actual scan results are : 9902 and 9902
2023/09/12 13:32:35 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (0.77s)
=== RUN TestUpdateDocsMutation
2023/09/12 13:32:35 In TestUpdateDocsMutation()
2023/09/12 13:32:35 Index found: index_age
2023/09/12 13:32:35 Using n1ql client
2023/09/12 13:32:35 Len of expected and actual scan results are : 9445 and 9445
2023/09/12 13:32:35 Expected and Actual scan responses are the same
2023/09/12 13:32:35 Num of keysFromMutDocs: 100
2023/09/12 13:32:35 Updating number of documents: 100
2023/09/12 13:32:35 Using n1ql client
2023/09/12 13:32:35 Index Scan after mutations took 194.126947ms
2023/09/12 13:32:35 Len of expected and actual scan results are : 9442 and 9442
2023/09/12 13:32:35 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.51s)
=== RUN TestLargeMutations
2023/09/12 13:32:35 In TestLargeMutations()
2023/09/12 13:32:35 In DropAllSecondaryIndexes()
2023/09/12 13:32:35 Index found: index_longitude
2023/09/12 13:32:35 Dropped index index_longitude
2023/09/12 13:32:35 Index found: idx_age
2023/09/12 13:32:35 Dropped index idx_age
2023/09/12 13:32:35 Index found: index_age
2023/09/12 13:32:35 Dropped index index_age
2023/09/12 13:32:35 Index found: index_floor
2023/09/12 13:32:36 Dropped index index_floor
2023/09/12 13:32:36 Index found: index_age35to45
2023/09/12 13:32:36 Dropped index index_age35to45
2023/09/12 13:32:36 Index found: index_p1
2023/09/12 13:32:36 Dropped index index_p1
2023/09/12 13:32:36 Index found: index_isActive
2023/09/12 13:32:36 Dropped index index_isActive
2023/09/12 13:32:36 Index found: index_deferred
2023/09/12 13:32:36 Dropped index index_deferred
2023/09/12 13:32:36 Index found: index_cdc
2023/09/12 13:32:36 Dropped index index_cdc
2023/09/12 13:32:36 Index found: index_name
2023/09/12 13:32:36 Dropped index index_name
2023/09/12 13:32:36 Index found: index_eyeColor
2023/09/12 13:32:36 Dropped index index_eyeColor
2023/09/12 13:32:36 Index found: index_tags
2023/09/12 13:32:36 Dropped index index_tags
2023/09/12 13:32:36 Index found: idx_numbertest
2023/09/12 13:32:36 Dropped index idx_numbertest
2023/09/12 13:32:36 Index found: index_company
2023/09/12 13:32:36 Dropped index index_company
2023/09/12 13:32:36 Index found: index_streetaddress
2023/09/12 13:32:36 Dropped index index_streetaddress
2023/09/12 13:32:36 Index found: index_latitude
2023/09/12 13:32:37 Dropped index index_latitude
2023/09/12 13:32:37 Index found: index_streetname
2023/09/12 13:32:37 Dropped index index_streetname
2023/09/12 13:32:37 Index found: index_i2
2023/09/12 13:32:37 Dropped index index_i2
2023/09/12 13:32:37 Index found: index_composite1
2023/09/12 13:32:37 Dropped index index_composite1
2023/09/12 13:32:37 Index found: index_email
2023/09/12 13:32:37 Dropped index index_email
2023/09/12 13:32:37 Index found: index_di1
2023/09/12 13:32:37 Dropped index index_di1
2023/09/12 13:32:37 Index found: index_gender
2023/09/12 13:32:37 Dropped index index_gender
2023/09/12 13:32:37 Index found: index_ageteens
2023/09/12 13:32:37 Dropped index index_ageteens
2023/09/12 13:32:37 Index found: index_height
2023/09/12 13:32:37 Dropped index index_height
2023/09/12 13:32:37 Index found: index_ageabove30
2023/09/12 13:32:37 Dropped index index_ageabove30
2023/09/12 13:32:37 Index found: index_nationality
2023/09/12 13:32:37 Dropped index index_nationality
2023/09/12 13:32:37 Index found: index_state
2023/09/12 13:32:37 Dropped index index_state
2023/09/12 13:32:37 Index found: index_composite2
2023/09/12 13:32:38 Dropped index index_composite2
2023/09/12 13:32:38 Index found: index_balance
2023/09/12 13:32:38 Dropped index index_balance
2023/09/12 13:32:38 Index found: index_isresidential
2023/09/12 13:32:38 Dropped index index_isresidential
2023/09/12 13:32:38 Index found: index_pin
2023/09/12 13:32:38 Dropped index index_pin
2023/09/12 13:32:58 Created the secondary index indexmut_1. Waiting for it become active
2023/09/12 13:32:58 Index is 12835181036170073312 now active
2023/09/12 13:32:58 Using n1ql client
2023/09/12 13:32:58 Expected and Actual scan responses are the same
2023/09/12 13:32:58 Len of expected and actual scan results are : 29902 and 29902
2023/09/12 13:32:58 ITERATION 0
2023/09/12 13:33:16 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:33:16 Index is 10742171316521625271 now active
2023/09/12 13:33:16 Using n1ql client
2023/09/12 13:33:16 Expected and Actual scan responses are the same
2023/09/12 13:33:16 Len of expected and actual scan results are : 39902 and 39902
2023/09/12 13:33:16 Using n1ql client
2023/09/12 13:33:16 Expected and Actual scan responses are the same
2023/09/12 13:33:16 Len of expected and actual scan results are : 39902 and 39902
2023/09/12 13:33:16 Dropping the secondary index indexmut_2
2023/09/12 13:33:16 Index dropped
2023/09/12 13:33:16 ITERATION 1
2023/09/12 13:33:34 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:33:34 Index is 14132568464197251100 now active
2023/09/12 13:33:34 Using n1ql client
2023/09/12 13:33:34 Expected and Actual scan responses are the same
2023/09/12 13:33:34 Len of expected and actual scan results are : 49902 and 49902
2023/09/12 13:33:34 Using n1ql client
2023/09/12 13:33:34 Expected and Actual scan responses are the same
2023/09/12 13:33:34 Len of expected and actual scan results are : 49902 and 49902
2023/09/12 13:33:34 Dropping the secondary index indexmut_2
2023/09/12 13:33:34 Index dropped
2023/09/12 13:33:34 ITERATION 2
2023/09/12 13:33:52 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:33:52 Index is 16967025546619115879 now active
2023/09/12 13:33:52 Using n1ql client
2023/09/12 13:33:53 Expected and Actual scan responses are the same
2023/09/12 13:33:53 Len of expected and actual scan results are : 59902 and 59902
2023/09/12 13:33:53 Using n1ql client
2023/09/12 13:33:53 Expected and Actual scan responses are the same
2023/09/12 13:33:53 Len of expected and actual scan results are : 59902 and 59902
2023/09/12 13:33:53 Dropping the secondary index indexmut_2
2023/09/12 13:33:53 Index dropped
2023/09/12 13:33:53 ITERATION 3
2023/09/12 13:34:12 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:34:12 Index is 5655854498174450119 now active
2023/09/12 13:34:12 Using n1ql client
2023/09/12 13:34:13 Expected and Actual scan responses are the same
2023/09/12 13:34:13 Len of expected and actual scan results are : 69902 and 69902
2023/09/12 13:34:13 Using n1ql client
2023/09/12 13:34:14 Expected and Actual scan responses are the same
2023/09/12 13:34:14 Len of expected and actual scan results are : 69902 and 69902
2023/09/12 13:34:14 Dropping the secondary index indexmut_2
2023/09/12 13:34:14 Index dropped
2023/09/12 13:34:14 ITERATION 4
2023/09/12 13:34:36 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:34:36 Index is 508677650054438221 now active
2023/09/12 13:34:36 Using n1ql client
2023/09/12 13:34:37 Expected and Actual scan responses are the same
2023/09/12 13:34:37 Len of expected and actual scan results are : 79902 and 79902
2023/09/12 13:34:37 Using n1ql client
2023/09/12 13:34:38 Expected and Actual scan responses are the same
2023/09/12 13:34:38 Len of expected and actual scan results are : 79902 and 79902
2023/09/12 13:34:38 Dropping the secondary index indexmut_2
2023/09/12 13:34:38 Index dropped
2023/09/12 13:34:38 ITERATION 5
2023/09/12 13:34:57 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:34:57 Index is 15258012266813393702 now active
2023/09/12 13:34:57 Using n1ql client
2023/09/12 13:34:58 Expected and Actual scan responses are the same
2023/09/12 13:34:58 Len of expected and actual scan results are : 89902 and 89902
2023/09/12 13:34:58 Using n1ql client
2023/09/12 13:34:59 Expected and Actual scan responses are the same
2023/09/12 13:34:59 Len of expected and actual scan results are : 89902 and 89902
2023/09/12 13:34:59 Dropping the secondary index indexmut_2
2023/09/12 13:34:59 Index dropped
2023/09/12 13:34:59 ITERATION 6
2023/09/12 13:35:19 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:35:19 Index is 6616120224796613789 now active
2023/09/12 13:35:19 Using n1ql client
2023/09/12 13:35:20 Expected and Actual scan responses are the same
2023/09/12 13:35:20 Len of expected and actual scan results are : 99902 and 99902
2023/09/12 13:35:20 Using n1ql client
2023/09/12 13:35:21 Expected and Actual scan responses are the same
2023/09/12 13:35:21 Len of expected and actual scan results are : 99902 and 99902
2023/09/12 13:35:21 Dropping the secondary index indexmut_2
2023/09/12 13:35:21 Index dropped
2023/09/12 13:35:21 ITERATION 7
2023/09/12 13:35:41 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:35:41 Index is 11779015492799787832 now active
2023/09/12 13:35:42 Using n1ql client
2023/09/12 13:35:43 Expected and Actual scan responses are the same
2023/09/12 13:35:43 Len of expected and actual scan results are : 109902 and 109902
2023/09/12 13:35:43 Using n1ql client
2023/09/12 13:35:44 Expected and Actual scan responses are the same
2023/09/12 13:35:44 Len of expected and actual scan results are : 109902 and 109902
2023/09/12 13:35:44 Dropping the secondary index indexmut_2
2023/09/12 13:35:44 Index dropped
2023/09/12 13:35:44 ITERATION 8
2023/09/12 13:36:08 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:36:08 Index is 13178282099958835888 now active
2023/09/12 13:36:09 Using n1ql client
2023/09/12 13:36:10 Expected and Actual scan responses are the same
2023/09/12 13:36:10 Len of expected and actual scan results are : 119902 and 119902
2023/09/12 13:36:10 Using n1ql client
2023/09/12 13:36:11 Expected and Actual scan responses are the same
2023/09/12 13:36:11 Len of expected and actual scan results are : 119902 and 119902
2023/09/12 13:36:11 Dropping the secondary index indexmut_2
2023/09/12 13:36:11 Index dropped
2023/09/12 13:36:11 ITERATION 9
2023/09/12 13:36:33 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:36:33 Index is 282658777130779810 now active
2023/09/12 13:36:34 Using n1ql client
2023/09/12 13:36:34 Expected and Actual scan responses are the same
2023/09/12 13:36:34 Len of expected and actual scan results are : 129902 and 129902
2023/09/12 13:36:35 Using n1ql client
2023/09/12 13:36:35 Expected and Actual scan responses are the same
2023/09/12 13:36:35 Len of expected and actual scan results are : 129902 and 129902
2023/09/12 13:36:35 Dropping the secondary index indexmut_2
2023/09/12 13:36:35 Index dropped
2023/09/12 13:36:35 ITERATION 10
2023/09/12 13:37:03 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 13:37:03 Index is 10972083948907939507 now active
2023/09/12 13:37:03 Using n1ql client
2023/09/12 13:37:04 Expected and Actual scan responses are the same
2023/09/12 13:37:04 Len of expected and actual scan results are : 139902 and 139902
2023/09/12 13:37:05 Using n1ql client
2023/09/12 13:37:05 Expected and Actual scan responses are the same
2023/09/12 13:37:05 Len of expected and actual scan results are : 139902 and 139902
2023/09/12 13:37:05 Dropping the secondary index indexmut_2
2023/09/12 13:37:06 Index dropped
--- PASS: TestLargeMutations (270.39s)
=== RUN TestPlanner
2023/09/12 13:37:06 In TestPlanner()
2023/09/12 13:37:06 -------------------------------------------
2023/09/12 13:37:06 initial placement - 20-50M, 10 index, 3 replica, 2x
2023-09-12T13:37:06.055+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:06.073+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T13:37:06.073+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T13:37:06.073+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T13:37:06.073+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T13:37:06.075+05:30 [Info] switched currmeta from 485 -> 486 force true
2023-09-12T13:37:06.077+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-12T13:37:06.079+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T13:37:06.079+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T13:37:06.081+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T13:37:06.081+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T13:37:06.082+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-12T13:37:06.082+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-12T13:37:06.155+05:30 [Info] Score: 0.016064959119996166
2023-09-12T13:37:06.155+05:30 [Info] Memory Quota: 66218748058 (61.671G)
2023-09-12T13:37:06.155+05:30 [Info] CPU Quota: 12
2023-09-12T13:37:06.155+05:30 [Info] Indexer Memory Mean 41145286361 (38.3195G)
2023-09-12T13:37:06.155+05:30 [Info] Indexer Memory Deviation 1321994686 (1.2312G) (3.21%)
2023-09-12T13:37:06.155+05:30 [Info] Indexer Memory Utilization 0.6214
2023-09-12T13:37:06.155+05:30 [Info] Indexer CPU Mean 12.2424
2023-09-12T13:37:06.155+05:30 [Info] Indexer CPU Deviation 2.49 (20.32%)
2023-09-12T13:37:06.155+05:30 [Info] Indexer CPU Utilization 1.0202
2023-09-12T13:37:06.155+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:06.155+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:06.155+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:06.155+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:06.155+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:06.155+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:06.155+05:30 [Info] Indexer Data Size Mean 41145286361 (38.3195G)
2023-09-12T13:37:06.155+05:30 [Info] Indexer Data Size Deviation 1321994686 (1.2312G) (3.21%)
2023-09-12T13:37:06.155+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:06.155+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:06.155+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:06.155+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:06 -------------------------------------------
2023/09/12 13:37:06 initial placement - 20-50M, 30 index, 3 replica, 2x
2023-09-12T13:37:06.156+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:07.254+05:30 [Info] Score: 0.022701864479855664
2023-09-12T13:37:07.254+05:30 [Info] Memory Quota: 64043580682 (59.6452G)
2023-09-12T13:37:07.254+05:30 [Info] CPU Quota: 12
2023-09-12T13:37:07.254+05:30 [Info] Indexer Memory Mean 42388185519 (39.4771G)
2023-09-12T13:37:07.254+05:30 [Info] Indexer Memory Deviation 1924581686 (1.79241G) (4.54%)
2023-09-12T13:37:07.254+05:30 [Info] Indexer Memory Utilization 0.6619
2023-09-12T13:37:07.254+05:30 [Info] Indexer CPU Mean 12.0581
2023-09-12T13:37:07.254+05:30 [Info] Indexer CPU Deviation 2.55 (21.17%)
2023-09-12T13:37:07.254+05:30 [Info] Indexer CPU Utilization 1.0048
2023-09-12T13:37:07.254+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:07.254+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:07.254+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:07.254+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:07.254+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:07.254+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:07.254+05:30 [Info] Indexer Data Size Mean 42388185519 (39.4771G)
2023-09-12T13:37:07.254+05:30 [Info] Indexer Data Size Deviation 1924581686 (1.79241G) (4.54%)
2023-09-12T13:37:07.254+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:07.254+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:07.254+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:07.254+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:07 -------------------------------------------
2023/09/12 13:37:07 initial placement - 20-50M, 30 index, 3 replica, 4x
2023-09-12T13:37:07.254+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:07.529+05:30 [Info] Score: 0.01661400361353465
2023-09-12T13:37:07.530+05:30 [Info] Memory Quota: 121098967668 (112.782G)
2023-09-12T13:37:07.530+05:30 [Info] CPU Quota: 24
2023-09-12T13:37:07.530+05:30 [Info] Indexer Memory Mean 80370739448 (74.8511G)
2023-09-12T13:37:07.530+05:30 [Info] Indexer Memory Deviation 2670559511 (2.48715G) (3.32%)
2023-09-12T13:37:07.530+05:30 [Info] Indexer Memory Utilization 0.6637
2023-09-12T13:37:07.530+05:30 [Info] Indexer CPU Mean 22.9101
2023-09-12T13:37:07.530+05:30 [Info] Indexer CPU Deviation 5.01 (21.87%)
2023-09-12T13:37:07.530+05:30 [Info] Indexer CPU Utilization 0.9546
2023-09-12T13:37:07.530+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:07.530+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:07.530+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:07.530+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:07.530+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:07.530+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:07.530+05:30 [Info] Indexer Data Size Mean 80370739448 (74.8511G)
2023-09-12T13:37:07.530+05:30 [Info] Indexer Data Size Deviation 2670559511 (2.48715G) (3.32%)
2023-09-12T13:37:07.530+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:07.530+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:07.530+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:07.530+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:07 -------------------------------------------
2023/09/12 13:37:07 initial placement - 200-500M, 10 index, 3 replica, 2x
2023-09-12T13:37:07.530+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:07.579+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:07.579+05:30 [Info] Score: 0.037848160424619436
2023-09-12T13:37:07.579+05:30 [Info] Memory Quota: 423450729428 (394.369G)
2023-09-12T13:37:07.579+05:30 [Info] CPU Quota: 12
2023-09-12T13:37:07.579+05:30 [Info] Indexer Memory Mean 314192886520 (292.615G)
2023-09-12T13:37:07.579+05:30 [Info] Indexer Memory Deviation 23783245546 (22.1499G) (7.57%)
2023-09-12T13:37:07.579+05:30 [Info] Indexer Memory Utilization 0.7420
2023-09-12T13:37:07.579+05:30 [Info] Indexer CPU Mean 9.9308
2023-09-12T13:37:07.579+05:30 [Info] Indexer CPU Deviation 2.37 (23.84%)
2023-09-12T13:37:07.579+05:30 [Info] Indexer CPU Utilization 0.8276
2023-09-12T13:37:07.579+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:07.579+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:07.579+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:07.579+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:07.579+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:07.579+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:07.579+05:30 [Info] Indexer Data Size Mean 314192886520 (292.615G)
2023-09-12T13:37:07.579+05:30 [Info] Indexer Data Size Deviation 23783245546 (22.1499G) (7.57%)
2023-09-12T13:37:07.579+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:07.579+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:07.579+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:07.579+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:07 -------------------------------------------
2023/09/12 13:37:07 initial placement - 200-500M, 30 index, 3 replica, 2x
2023-09-12T13:37:07.580+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:08.408+05:30 [Info] Score: 0.0243683045847255
2023-09-12T13:37:08.408+05:30 [Info] Memory Quota: 540475406136 (503.357G)
2023-09-12T13:37:08.408+05:30 [Info] CPU Quota: 12
2023-09-12T13:37:08.408+05:30 [Info] Indexer Memory Mean 428006489937 (398.612G)
2023-09-12T13:37:08.408+05:30 [Info] Indexer Memory Deviation 20859585022 (19.427G) (4.87%)
2023-09-12T13:37:08.408+05:30 [Info] Indexer Memory Utilization 0.7919
2023-09-12T13:37:08.408+05:30 [Info] Indexer CPU Mean 12.3450
2023-09-12T13:37:08.408+05:30 [Info] Indexer CPU Deviation 2.80 (22.65%)
2023-09-12T13:37:08.408+05:30 [Info] Indexer CPU Utilization 1.0288
2023-09-12T13:37:08.408+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:08.408+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:08.408+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:08.408+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:08.408+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:08.408+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:08.408+05:30 [Info] Indexer Data Size Mean 428006489937 (398.612G)
2023-09-12T13:37:08.408+05:30 [Info] Indexer Data Size Deviation 20859585022 (19.427G) (4.87%)
2023-09-12T13:37:08.408+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:08.408+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:08.408+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:08.408+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:08 -------------------------------------------
2023/09/12 13:37:08 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2023-09-12T13:37:08.409+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:08.908+05:30 [Info] Score: 0.011752880338155714
2023-09-12T13:37:08.908+05:30 [Info] Memory Quota: 393505907269 (366.481G)
2023-09-12T13:37:08.908+05:30 [Info] CPU Quota: 12
2023-09-12T13:37:08.908+05:30 [Info] Indexer Memory Mean 310942555495 (289.588G)
2023-09-12T13:37:08.908+05:30 [Info] Indexer Memory Deviation 7308941293 (6.80698G) (2.35%)
2023-09-12T13:37:08.908+05:30 [Info] Indexer Memory Utilization 0.7902
2023-09-12T13:37:08.908+05:30 [Info] Indexer CPU Mean 8.0557
2023-09-12T13:37:08.908+05:30 [Info] Indexer CPU Deviation 4.43 (55.02%)
2023-09-12T13:37:08.908+05:30 [Info] Indexer CPU Utilization 0.6713
2023-09-12T13:37:08.908+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:08.908+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:08.908+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:08.908+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:08.908+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:08.908+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:08.908+05:30 [Info] Indexer Data Size Mean 310942555495 (289.588G)
2023-09-12T13:37:08.908+05:30 [Info] Indexer Data Size Deviation 7308941293 (6.80698G) (2.35%)
2023-09-12T13:37:08.908+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:08.908+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:08.908+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:08.908+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:08 -------------------------------------------
2023/09/12 13:37:08 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2023-09-12T13:37:08.909+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:09.159+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-12T13:37:09.164+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T13:37:09.164+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T13:37:09.166+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T13:37:09.166+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T13:37:09.167+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-12T13:37:09.168+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-12T13:37:09.481+05:30 [Info] Score: 0.04332034500958206
2023-09-12T13:37:09.481+05:30 [Info] Memory Quota: 279989828476 (260.761G)
2023-09-12T13:37:09.481+05:30 [Info] CPU Quota: 20
2023-09-12T13:37:09.481+05:30 [Info] Indexer Memory Mean 203847597535 (189.848G)
2023-09-12T13:37:09.481+05:30 [Info] Indexer Memory Deviation 17661496509 (16.4486G) (8.66%)
2023-09-12T13:37:09.481+05:30 [Info] Indexer Memory Utilization 0.7281
2023-09-12T13:37:09.481+05:30 [Info] Indexer CPU Mean 8.4099
2023-09-12T13:37:09.481+05:30 [Info] Indexer CPU Deviation 4.14 (49.25%)
2023-09-12T13:37:09.481+05:30 [Info] Indexer CPU Utilization 0.4205
2023-09-12T13:37:09.481+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:09.481+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:09.481+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:09.481+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.481+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:09.481+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.481+05:30 [Info] Indexer Data Size Mean 203847597535 (189.848G)
2023-09-12T13:37:09.481+05:30 [Info] Indexer Data Size Deviation 17661496509 (16.4486G) (8.66%)
2023-09-12T13:37:09.481+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:09.481+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:09.481+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:09.481+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:09 -------------------------------------------
2023/09/12 13:37:09 initial placement - 6 2M index, 1 replica, 2x
2023-09-12T13:37:09.491+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:09.505+05:30 [Info] Score: 0
2023-09-12T13:37:09.505+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2023-09-12T13:37:09.505+05:30 [Info] CPU Quota: 2
2023-09-12T13:37:09.505+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2023-09-12T13:37:09.505+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:09.505+05:30 [Info] Indexer Memory Utilization 0.4290
2023-09-12T13:37:09.505+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-12T13:37:09.505+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:09.505+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-12T13:37:09.505+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:09.505+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:09.505+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:09.505+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.505+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:09.505+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.505+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2023-09-12T13:37:09.505+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:09.505+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:09.505+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:09.505+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:09.506+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:09 -------------------------------------------
2023/09/12 13:37:09 initial placement - 5 20M primary index, 2 replica, 2x
2023-09-12T13:37:09.516+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:09.555+05:30 [Info] Score: 0
2023-09-12T13:37:09.555+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2023-09-12T13:37:09.555+05:30 [Info] CPU Quota: 2
2023-09-12T13:37:09.555+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2023-09-12T13:37:09.555+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:09.555+05:30 [Info] Indexer Memory Utilization 0.7659
2023-09-12T13:37:09.555+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-12T13:37:09.555+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:09.555+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-12T13:37:09.555+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:09.555+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:09.555+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:09.555+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.555+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:09.555+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.555+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2023-09-12T13:37:09.555+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:09.555+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:09.555+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:09.555+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:09.555+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:09 -------------------------------------------
2023/09/12 13:37:09 initial placement - 5 20M array index, 2 replica, 2x
2023-09-12T13:37:09.565+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:09.605+05:30 [Info] Score: 0
2023-09-12T13:37:09.605+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2023-09-12T13:37:09.605+05:30 [Info] CPU Quota: 2
2023-09-12T13:37:09.605+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2023-09-12T13:37:09.605+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:09.605+05:30 [Info] Indexer Memory Utilization 0.8063
2023-09-12T13:37:09.605+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-12T13:37:09.605+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:09.605+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-12T13:37:09.605+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:09.605+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:09.605+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:09.605+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.605+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:09.605+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.605+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2023-09-12T13:37:09.605+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:09.605+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:09.605+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:09.605+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:09.605+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:09 -------------------------------------------
2023/09/12 13:37:09 initial placement - 3 replica constraint, 2 index, 2x
2023-09-12T13:37:09.610+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:09.646+05:30 [Info] Score: 0
2023-09-12T13:37:09.646+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-12T13:37:09.647+05:30 [Info] CPU Quota: 2
2023-09-12T13:37:09.647+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-12T13:37:09.647+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:09.647+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-12T13:37:09.647+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:09.647+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:09.647+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:09.647+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:09.647+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:09.647+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:09.647+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.647+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:09.647+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.647+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-12T13:37:09.647+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:09.647+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:09.647+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:09.647+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:09.647+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:09 -------------------------------------------
2023/09/12 13:37:09 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2023-09-12T13:37:09.657+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.02148089679202831
2023-09-12T13:37:09.786+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:09.786+05:30 [Info] Score: 0.007189938568471697
2023-09-12T13:37:09.786+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2023-09-12T13:37:09.786+05:30 [Info] CPU Quota: 27
2023-09-12T13:37:09.786+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2023-09-12T13:37:09.786+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2023-09-12T13:37:09.786+05:30 [Info] Indexer Memory Utilization 0.5679
2023-09-12T13:37:09.786+05:30 [Info] Indexer CPU Mean 20.1734
2023-09-12T13:37:09.786+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2023-09-12T13:37:09.786+05:30 [Info] Indexer CPU Utilization 0.7472
2023-09-12T13:37:09.786+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:09.786+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:09.786+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:09.786+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.786+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:09.786+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:09.786+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2023-09-12T13:37:09.786+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2023-09-12T13:37:09.786+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:09.786+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:09.786+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:09.786+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:09 -------------------------------------------
2023/09/12 13:37:09 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2023-09-12T13:37:09.798+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0030227966926389127
2023-09-12T13:37:10.023+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:10.023+05:30 [Info] Score: 0.00043718596495524715
2023-09-12T13:37:10.023+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-12T13:37:10.024+05:30 [Info] CPU Quota: 20
2023-09-12T13:37:10.024+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2023-09-12T13:37:10.024+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2023-09-12T13:37:10.024+05:30 [Info] Indexer Memory Utilization 0.7321
2023-09-12T13:37:10.024+05:30 [Info] Indexer CPU Mean 14.2305
2023-09-12T13:37:10.024+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2023-09-12T13:37:10.024+05:30 [Info] Indexer CPU Utilization 0.7115
2023-09-12T13:37:10.024+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:10.024+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:10.024+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:10.024+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.024+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:10.024+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.024+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2023-09-12T13:37:10.024+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2023-09-12T13:37:10.024+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:10.024+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:10.024+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:10.024+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:10 -------------------------------------------
2023/09/12 13:37:10 incr placement - 3 server group, 3 replica, 1x
2023-09-12T13:37:10.027+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:10.040+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:10.040+05:30 [Info] Score: 0
2023-09-12T13:37:10.040+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-12T13:37:10.040+05:30 [Info] CPU Quota: 16
2023-09-12T13:37:10.040+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-12T13:37:10.040+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:10.040+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-12T13:37:10.040+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:10.040+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:10.040+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:10.040+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:10.040+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:10.040+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:10.040+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.040+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:10.040+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.040+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-12T13:37:10.040+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:10.040+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:10.040+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:10.040+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:10.040+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:10 -------------------------------------------
2023/09/12 13:37:10 incr placement - 2 server group, 3 replica, 1x
2023-09-12T13:37:10.042+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2023-09-12T13:37:10.042+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2023-09-12T13:37:10.042+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2023-09-12T13:37:10.042+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:10.055+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:10.055+05:30 [Info] Score: 0
2023-09-12T13:37:10.055+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-12T13:37:10.055+05:30 [Info] CPU Quota: 16
2023-09-12T13:37:10.055+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-12T13:37:10.055+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:10.055+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-12T13:37:10.055+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:10.055+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:10.056+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:10.056+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:10.056+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:10.056+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:10.056+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.056+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:10.056+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.056+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-12T13:37:10.056+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:10.056+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:10.056+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:10.056+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:10.056+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:10 -------------------------------------------
2023/09/12 13:37:10 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2023-09-12T13:37:10.058+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2647383572028943
2023-09-12T13:37:10.058+05:30 [Info] Planner::initial temperature: initial resource variation 0.2647383572028943 temp 0.02647383572028943
2023-09-12T13:37:10.227+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:10.227+05:30 [Info] Score: 0.20769340618202306
2023-09-12T13:37:10.227+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-09-12T13:37:10.227+05:30 [Info] CPU Quota: 30
2023-09-12T13:37:10.227+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-09-12T13:37:10.227+05:30 [Info] Indexer Memory Deviation 3490405425 (3.25069G) (3.93%)
2023-09-12T13:37:10.227+05:30 [Info] Indexer Memory Utilization 0.6367
2023-09-12T13:37:10.227+05:30 [Info] Indexer CPU Mean 24.0538
2023-09-12T13:37:10.227+05:30 [Info] Indexer CPU Deviation 3.86 (16.06%)
2023-09-12T13:37:10.227+05:30 [Info] Indexer CPU Utilization 0.8018
2023-09-12T13:37:10.227+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:10.227+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:10.227+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:10.227+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.227+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:10.227+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.227+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-09-12T13:37:10.227+05:30 [Info] Indexer Data Size Deviation 3490405425 (3.25069G) (3.93%)
2023-09-12T13:37:10.227+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2023-09-12T13:37:10.227+05:30 [Info] Index Data Moved (exclude new node) 391.438G (39.41%)
2023-09-12T13:37:10.227+05:30 [Info] No. Index (from non-deleted node) 90
2023-09-12T13:37:10.227+05:30 [Info] No. Index Moved (exclude new node) 35 (38.89%)
2023/09/12 13:37:10 -------------------------------------------
2023/09/12 13:37:10 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2023-09-12T13:37:10.229+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.34266245764929143
2023-09-12T13:37:10.229+05:30 [Info] Planner::initial temperature: initial resource variation 0.34266245764929143 temp 0.03426624576492914
2023-09-12T13:37:10.472+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:10.472+05:30 [Info] Score: 0.20854574103529805
2023-09-12T13:37:10.472+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-12T13:37:10.472+05:30 [Info] CPU Quota: 20
2023-09-12T13:37:10.472+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-09-12T13:37:10.472+05:30 [Info] Indexer Memory Deviation 29563336837 (27.533G) (7.53%)
2023-09-12T13:37:10.472+05:30 [Info] Indexer Memory Utilization 0.7311
2023-09-12T13:37:10.472+05:30 [Info] Indexer CPU Mean 13.9305
2023-09-12T13:37:10.472+05:30 [Info] Indexer CPU Deviation 3.02 (21.67%)
2023-09-12T13:37:10.472+05:30 [Info] Indexer CPU Utilization 0.6965
2023-09-12T13:37:10.472+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:10.472+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:10.472+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:10.472+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.472+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:10.472+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.472+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-09-12T13:37:10.472+05:30 [Info] Indexer Data Size Deviation 29563336837 (27.533G) (7.53%)
2023-09-12T13:37:10.472+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2023-09-12T13:37:10.472+05:30 [Info] Index Data Moved (exclude new node) 2.02432T (47.26%)
2023-09-12T13:37:10.472+05:30 [Info] No. Index (from non-deleted node) 90
2023-09-12T13:37:10.472+05:30 [Info] No. Index Moved (exclude new node) 24 (26.67%)
2023/09/12 13:37:10 -------------------------------------------
2023/09/12 13:37:10 rebalance - travel sample, 10% shuffle, 1x
2023-09-12T13:37:10.473+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.23680133137265638
2023-09-12T13:37:10.473+05:30 [Info] Planner::initial temperature: initial resource variation 0.23680133137265638 temp 0.02368013313726564
2023-09-12T13:37:10.498+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:10.498+05:30 [Info] Score: 0.04715225965046212
2023-09-12T13:37:10.498+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-12T13:37:10.498+05:30 [Info] CPU Quota: 8
2023-09-12T13:37:10.498+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-09-12T13:37:10.498+05:30 [Info] Indexer Memory Deviation 1632564 (1.55693M) (9.33%)
2023-09-12T13:37:10.498+05:30 [Info] Indexer Memory Utilization 0.0326
2023-09-12T13:37:10.498+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:10.498+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:10.498+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:10.498+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:10.498+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:10.498+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:10.498+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.498+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:10.498+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.498+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T13:37:10.498+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:10.498+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:10.498+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:10.498+05:30 [Info] No. Index (from non-deleted node) 10
2023-09-12T13:37:10.499+05:30 [Info] No. Index Moved (exclude new node) 1 (10.00%)
2023/09/12 13:37:10 -------------------------------------------
2023/09/12 13:37:10 rebalance - 20-50M, 90 index, swap 2, 1x
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-09-12T13:37:10.500+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-09-12T13:37:10.501+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4095843409677649
2023-09-12T13:37:10.501+05:30 [Info] Planner::initial temperature: initial resource variation 0.4095843409677649 temp 0.04095843409677649
2023-09-12T13:37:10.719+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:10.719+05:30 [Info] Score: 0.015144261015027008
2023-09-12T13:37:10.719+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-09-12T13:37:10.719+05:30 [Info] CPU Quota: 30
2023-09-12T13:37:10.719+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-09-12T13:37:10.719+05:30 [Info] Indexer Memory Deviation 2691939909 (2.50706G) (3.03%)
2023-09-12T13:37:10.719+05:30 [Info] Indexer Memory Utilization 0.6367
2023-09-12T13:37:10.719+05:30 [Info] Indexer CPU Mean 24.0538
2023-09-12T13:37:10.719+05:30 [Info] Indexer CPU Deviation 3.57 (14.84%)
2023-09-12T13:37:10.720+05:30 [Info] Indexer CPU Utilization 0.8018
2023-09-12T13:37:10.720+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:10.720+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:10.720+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:10.720+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.720+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:10.720+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.720+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-09-12T13:37:10.720+05:30 [Info] Indexer Data Size Deviation 2691939909 (2.50706G) (3.03%)
2023-09-12T13:37:10.720+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:10.720+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:10.720+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:10.720+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:10 -------------------------------------------
2023/09/12 13:37:10 rebalance - mixed small/medium, 90 index, swap 2, 1x
2023-09-12T13:37:10.721+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-12T13:37:10.721+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-12T13:37:10.721+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-09-12T13:37:10.722+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-09-12T13:37:10.722+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4082556623939647
2023-09-12T13:37:10.722+05:30 [Info] Planner::initial temperature: initial resource variation 0.4082556623939647 temp 0.040825566239396475
2023-09-12T13:37:10.945+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:10.945+05:30 [Info] Score: 0.0011357071492739945
2023-09-12T13:37:10.945+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-12T13:37:10.945+05:30 [Info] CPU Quota: 20
2023-09-12T13:37:10.945+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-09-12T13:37:10.945+05:30 [Info] Indexer Memory Deviation 891542837 (850.242M) (0.23%)
2023-09-12T13:37:10.945+05:30 [Info] Indexer Memory Utilization 0.7311
2023-09-12T13:37:10.945+05:30 [Info] Indexer CPU Mean 13.9305
2023-09-12T13:37:10.945+05:30 [Info] Indexer CPU Deviation 0.62 (4.46%)
2023-09-12T13:37:10.945+05:30 [Info] Indexer CPU Utilization 0.6965
2023-09-12T13:37:10.945+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:10.945+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:10.945+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:10.945+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.945+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:10.945+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:10.945+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-09-12T13:37:10.945+05:30 [Info] Indexer Data Size Deviation 891542837 (850.242M) (0.23%)
2023-09-12T13:37:10.945+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:10.946+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:10.946+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:10.946+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:10 -------------------------------------------
2023/09/12 13:37:10 rebalance - travel sample, swap 2, 1x
2023-09-12T13:37:10.946+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 192.168.1.8:9000
2023-09-12T13:37:10.946+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-12T13:37:10.946+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0086622738872069
2023-09-12T13:37:10.946+05:30 [Info] Planner::initial temperature: initial resource variation 1.0086622738872069 temp 0.1008662273887207
2023-09-12T13:37:11.093+05:30 [Info] Score: 0.0003181929343700274
2023-09-12T13:37:11.093+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-12T13:37:11.093+05:30 [Info] CPU Quota: 8
2023-09-12T13:37:11.093+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-09-12T13:37:11.093+05:30 [Info] Indexer Memory Deviation 22277 (21.7549K) (0.13%)
2023-09-12T13:37:11.094+05:30 [Info] Indexer Memory Utilization 0.0326
2023-09-12T13:37:11.094+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:11.094+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:11.094+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:11.094+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:11.094+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:11.094+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:11.094+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:11.094+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:11.094+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:11.094+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T13:37:11.094+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:11.094+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:11.094+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:11.094+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:11.094+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:11 -------------------------------------------
2023/09/12 13:37:11 rebalance - 8 identical index, add 4, 1x
2023-09-12T13:37:11.094+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-12T13:37:11.094+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-12T13:37:11.095+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-12T13:37:11.095+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-12T13:37:11.095+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1
2023-09-12T13:37:11.095+05:30 [Info] Planner::initial temperature: initial resource variation 1 temp 0.1
2023-09-12T13:37:15.498+05:30 [Info] Score: 0
2023-09-12T13:37:15.498+05:30 [Info] Memory Quota: 930294000 (887.197M)
2023-09-12T13:37:15.498+05:30 [Info] CPU Quota: 2
2023-09-12T13:37:15.498+05:30 [Info] Indexer Memory Mean 260000000 (247.955M)
2023-09-12T13:37:15.498+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:15.498+05:30 [Info] Indexer Memory Utilization 0.2795
2023-09-12T13:37:15.498+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:15.498+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:15.498+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:15.498+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:15.498+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:15.498+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:15.498+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:15.498+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:15.498+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:15.498+05:30 [Info] Indexer Data Size Mean 260000000 (247.955M)
2023-09-12T13:37:15.498+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:15.498+05:30 [Info] Total Index Data (from non-deleted node) 1.93715G
2023-09-12T13:37:15.498+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:15.498+05:30 [Info] No. Index (from non-deleted node) 8
2023-09-12T13:37:15.498+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:15 -------------------------------------------
2023/09/12 13:37:15 rebalance - 8 identical index, delete 2, 2x
2023-09-12T13:37:15.499+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:15.499+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023-09-12T13:37:15.547+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:15.547+05:30 [Info] Score: 0
2023-09-12T13:37:15.547+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2023-09-12T13:37:15.547+05:30 [Info] CPU Quota: 4
2023-09-12T13:37:15.547+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2023-09-12T13:37:15.547+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:15.547+05:30 [Info] Indexer Memory Utilization 0.0098
2023-09-12T13:37:15.547+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:15.547+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:15.547+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:15.547+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:15.547+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:15.547+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:15.547+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:15.547+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:15.547+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:15.547+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2023-09-12T13:37:15.547+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:15.547+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:15.547+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:15.547+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:15.547+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:15 -------------------------------------------
2023/09/12 13:37:15 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2023-09-12T13:37:15.548+05:30 [Warn] There is more replica than available nodes. Will not move index replica (default,,,country) from ejected node 127.0.0.1:9003
2023-09-12T13:37:15.548+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-12T13:37:15.548+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-12T13:37:15.548+05:30 [Info] Score: 0
2023-09-12T13:37:15.548+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-12T13:37:15.548+05:30 [Info] CPU Quota: 16
2023-09-12T13:37:15.548+05:30 [Info] Indexer Memory Mean 0 (0)
2023-09-12T13:37:15.548+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:15.548+05:30 [Info] Indexer Memory Utilization 0.0000
2023-09-12T13:37:15.548+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:15.548+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:15.548+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:15.549+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:15.549+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:15 -------------------------------------------
2023/09/12 13:37:15 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2023-09-12T13:37:15.549+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-12T13:37:15.549+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-12T13:37:15.549+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9003
2023-09-12T13:37:15.549+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-12T13:37:15.549+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-12T13:37:15.549+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T13:37:15.549+05:30 [Info] Score: 0
2023-09-12T13:37:15.549+05:30 [Info] Memory Quota: 268435456 (256M)
2023-09-12T13:37:15.549+05:30 [Info] CPU Quota: 8
2023-09-12T13:37:15.549+05:30 [Info] Indexer Memory Mean 0 (0)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Memory Utilization 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:15.549+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T13:37:15.549+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:15.549+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:15.549+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:15.549+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 13:37:15 -------------------------------------------
2023/09/12 13:37:15 Minimum memory test 1: min memory = 0
2023-09-12T13:37:15.550+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-12T13:37:15.550+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-12T13:37:15.552+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/12 13:37:15 -------------------------------------------
2023/09/12 13:37:15 Minimum memory test 2: min memory > quota
2023-09-12T13:37:15.553+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-12T13:37:15.553+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-09-12T13:37:15.553+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=4us
2023-09-12T13:37:15.553+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-12T13:37:15.553+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/09/12 13:37:16 -------------------------------------------
2023/09/12 13:37:16 Minimum memory test 3: min memory < quota
2023-09-12T13:37:16.509+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-12T13:37:16.509+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Minimum memory test 4: replica repair with min memory > quota
2023-09-12T13:37:17.472+05:30 [Info] Rebuilding lost replica for (default,,,country,0,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.472+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=10us
2023-09-12T13:37:17.472+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=10us
2023-09-12T13:37:17.472+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=9us
2023-09-12T13:37:17.472+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-12T13:37:17.472+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-12T13:37:17.472+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T13:37:17.472+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:17.473+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=274us
2023-09-12T13:37:17.473+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-12T13:37:17.473+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-12T13:37:17.473+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T13:37:17.473+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:17.473+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=266us
2023-09-12T13:37:17.473+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster. Will not rebuild lost replica.
2023-09-12T13:37:17.473+05:30 [Warn]
MemoryQuota: 200
CpuQuota: 8
--- Violations for index (mem 130, cpu 0) at node 127.0.0.1:9003
Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2023-09-12T13:37:17.473+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T13:37:17.473+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0 is less than threshold: 0. No nodes have been added or deleted and there are no violations observed
2023-09-12T13:37:17.473+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Minimum memory test 5: replica repair with min memory < quota
2023-09-12T13:37:17.473+05:30 [Info] Rebuilding lost replica for (default,,,country,0,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.473+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-12T13:37:17.474+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-12T13:37:17.488+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Minimum memory test 6: rebalance with min memory > quota
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=7us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=7us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=6us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=7us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=7us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=7us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=7us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=7us
2023-09-12T13:37:17.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=7us
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Minimum memory test 7: rebalance-out with min memory > quota
2023-09-12T13:37:17.489+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-12T13:37:17.489+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-12T13:37:17.489+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=7us
2023-09-12T13:37:17.489+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-12T13:37:17.489+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=7us
2023-09-12T13:37:17.489+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=9us
2023-09-12T13:37:17.489+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T13:37:17.489+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-12T13:37:17.489+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-12T13:37:17.490+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Minimum memory test 8: plan with min memory > quota
2023-09-12T13:37:17.492+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-09-12T13:37:17.493+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T13:37:17.493+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:17.493+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=967us
2023-09-12T13:37:17.493+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-12T13:37:17.493+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=8us
2023-09-12T13:37:17.493+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-12T13:37:17.493+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=6us
2023-09-12T13:37:17.493+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=7us
2023-09-12T13:37:17.493+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T13:37:17.493+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-09-12T13:37:17.493+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Minimum memory test 9: single node rebalance with min memory > quota
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=8us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=7us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=6us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=8us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=6us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=6us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=6us
2023-09-12T13:37:17.494+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=7us
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Minimum memory test 10: plan with partitioned index on empty cluster
2023-09-12T13:37:17.496+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.2247448713915892
2023-09-12T13:37:17.532+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 iterationTest :: Remove one node - failure
2023-09-12T13:37:17.533+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.23739973762250358
2023-09-12T13:37:17.617+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:17.617+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.617+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.617+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.617+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.617+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.10055756484940416).
2023-09-12T13:37:17.618+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=412us
2023-09-12T13:37:17.618+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.618+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.618+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.618+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.618+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.11320949461799149).
2023-09-12T13:37:17.618+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=401us
2023-09-12T13:37:17.618+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.618+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.618+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.618+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.618+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1666796167565393).
2023-09-12T13:37:17.618+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=371us
2023-09-12T13:37:17.619+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.619+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.619+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.619+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.619+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.09068795579715536).
2023-09-12T13:37:17.619+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=329us
2023-09-12T13:37:17.619+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.619+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.619+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.619+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.619+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12180191305925446).
2023-09-12T13:37:17.619+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=484us
2023-09-12T13:37:17.619+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.620+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.620+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.620+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.620+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.11420597315732096).
2023-09-12T13:37:17.620+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=363us
2023-09-12T13:37:17.620+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T13:37:17.620+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.620+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.620+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.620+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.620+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1125116870432798).
2023-09-12T13:37:17.620+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=362us
2023-09-12T13:37:17.620+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.620+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.620+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.621+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.621+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.10470604171267381).
2023-09-12T13:37:17.621+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=490us
2023-09-12T13:37:17.621+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.621+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.621+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.621+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.621+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.09699853804360489).
2023-09-12T13:37:17.621+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=476us
2023-09-12T13:37:17.621+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.621+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.622+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.622+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.622+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1743362911950269).
2023-09-12T13:37:17.622+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=386us
2023-09-12T13:37:17.622+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.622+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.622+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.622+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.622+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.11131584442866883).
2023-09-12T13:37:17.622+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=355us
2023-09-12T13:37:17.622+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01415187477278236
2023-09-12T13:37:17.622+05:30 [Info] Planner::initial temperature: initial resource variation 0.01415187477278236 temp 0.03358481252272177
2023-09-12T13:37:17.622+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.622+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T13:37:17.622+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1488828282075126).
2023-09-12T13:37:17.622+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=338us
2023-09-12T13:37:17.623+05:30 [Error]
MemoryQuota: 5302940000000
CpuQuota: 6
--- Violations for index <8939418217985643481, bucket1, , > (mem 15.9518G, cpu 1.2263199999999999) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
--- Violations for index <27500040549562326, bucket1, , > (mem 13.1639G, cpu 1.7370400000000001) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
--- Violations for index <7840290569924788264, bucket1, , > (mem 22.2208G, cpu 2.45992) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
--- Violations for index <12644999887639976545, bucket1, , > (mem 12.2642G, cpu 1.85928) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
--- Violations for index <3256200830806404478, bucket1, , > (mem 12.2003G, cpu 2.9463600000000003) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
--- Violations for index <13453600626725519010, bucket1, , > (mem 17.5322G, cpu 3.17428) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
--- Violations for index <3090554735833720611, bucket1, , > (mem 10.9344G, cpu 1.94044) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
--- Violations for index <2446106988989179121, bucket1, , > (mem 9.67356G, cpu 2.86064) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
--- Violations for index <8872706459579697254, bucket1, , > (mem 12.0554G, cpu 2.2694400000000003) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64651T, free cpu -20.007759999999998)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.66051T, free cpu -29.72059999999999)
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 iterationTest :: Remove one node - success
2023-09-12T13:37:17.623+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6080141850360304
2023-09-12T13:37:17.696+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:17.696+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002913212846516222
2023-09-12T13:37:17.696+05:30 [Info] Planner::initial temperature: initial resource variation 0.002913212846516222 temp 0.02470867871534838
2023-09-12T13:37:17.696+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T13:37:17.696+05:30 [Info] Planner::Finished planner run after 10 iterations.
2023-09-12T13:37:17.697+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.20311999085787769).
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 iterationTest :: Index rebuild - success
2023-09-12T13:37:17.699+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i5,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.699+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i10,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.699+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i13,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i15,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i18,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i22,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i0,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i24,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i26,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i28,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i4,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i8,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i11,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i12,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i14,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i20,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i23,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i27,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i6,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i21,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i25,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T13:37:17.700+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i29,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-12T13:37:17.701+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i7,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-12T13:37:17.701+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i9,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-12T13:37:17.701+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i16,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-12T13:37:17.701+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i17,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T13:37:17.701+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i19,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-12T13:37:17.701+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5792715732327589
2023-09-12T13:37:17.701+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0.5792715732327589 is less than threshold: 0.8. No nodes have been added or deleted and there are no violations observed
2023-09-12T13:37:17.701+05:30 [Info] Planner::initial temperature: initial resource variation 0.5792715732327589 temp 0.022072842676724116
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 iterationTest :: Index rebuild - initial placement - success
2023-09-12T13:37:17.702+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-09-12T13:37:17.702+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-12T13:37:17.702+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-12T13:37:17.702+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.702+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.702+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.702+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6236095644623236
2023-09-12T13:37:17.702+05:30 [Info] Planner::initial temperature: initial resource variation 0.6236095644623236 temp 0.03663904355376764
2023-09-12T13:37:17.702+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:17.702+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:17.702+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.6236095644623236).
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 iterationTest :: Index rebuild - initial placement - numReplica > numSG - success
2023-09-12T13:37:17.703+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-09-12T13:37:17.703+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-12T13:37:17.703+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-12T13:37:17.703+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.703+05:30 [Info] Rebuilding lost replica for (default,,,idx1,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T13:37:17.703+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.703+05:30 [Info] Rebuilding lost replica for (default,,,idx2,2,0) with initial placement on node: 127.0.0.1:9000
2023-09-12T13:37:17.703+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:17.703+05:30 [Info] Rebuilding lost replica for (default,,,idx3,2,0) with initial placement on node: 127.0.0.1:9000
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T13:37:17.703+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3333333333333333
2023-09-12T13:37:17.703+05:30 [Info] Planner::initial temperature: initial resource variation 0.3333333333333333 temp 0.06566666666666668
2023-09-12T13:37:17.703+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:17.703+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:17.703+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.3333333333333333).
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 scaling with excludeIn - 8 identical index, add 1, 1x
2023-09-12T13:37:17.704+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-09-12T13:37:17.704+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 swap with excludeIn - 8 identical index, add 1, 1x
2023-09-12T13:37:17.857+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-09-12T13:37:17.857+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023-09-12T13:37:17.857+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 replica repair with excludeIn - 3 replica, 4 zone, delete 1, 1x
2023-09-12T13:37:17.858+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-12T13:37:17.858+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 heterogenous rebalance - keep vertically scaled Node, swap 1, 1x
2023-09-12T13:37:17.859+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.1237823254333867
2023-09-12T13:37:17.859+05:30 [Info] Planner::initial temperature: initial resource variation 1.1237823254333867 temp 0.11237823254333867
2023-09-12T13:37:17.859+05:30 [Info] Planner::finalizing the solution as final solution is found.
--- PASS: TestPlanner (11.81s)
=== RUN TestGreedyPlanner
2023/09/12 13:37:17 In TestGreedyPlanner()
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Single Index Instance - 3 empty nodes - 1 SG
2023-09-12T13:37:17.863+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Single Index Instance - 2 empty nodes, 1 non-empty node - 1 SG
2023-09-12T13:37:17.865+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Single Index Instance - 1 empty node, 2 non-empty nodes - 1 SG
2023-09-12T13:37:17.867+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Single Index Instance - 3 non-empty nodes - 1 SG
2023-09-12T13:37:17.869+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 1 Replica - 3 empty nodes - 1 SG
2023-09-12T13:37:17.871+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 1 SG
2023-09-12T13:37:17.872+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 1 SG
2023-09-12T13:37:17.874+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 1 Replica - 3 non-empty nodes - 1 SG
2023-09-12T13:37:17.876+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 2 Replica - 3 empty nodes - 1 SG
2023-09-12T13:37:17.878+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 2 Replica - 3 non-empty nodes - 1 SG
2023-09-12T13:37:17.879+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 2 SG
2023-09-12T13:37:17.881+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 2 SG
2023-09-12T13:37:17.883+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Index With 1 Replica - 3 non-empty nodes - 2 SG
2023-09-12T13:37:17.885+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Equivalent Index Without any replica - 3 non-empty nodes - 1 SG
2023-09-12T13:37:17.887+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Skip least loaded node
2023-09-12T13:37:17.889+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Use least loaded node
2023-09-12T13:37:17.892+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:17 -------------------------------------------
2023/09/12 13:37:17 Place 60 index instaces on 3 empty nodes - 1 SG
2023-09-12T13:37:17.893+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T13:37:17.895+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T13:37:17.896+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T13:37:17.898+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T13:37:17.899+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T13:37:17.901+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-12T13:37:17.903+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-12T13:37:17.904+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-12T13:37:17.906+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-12T13:37:17.908+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-12T13:37:17.910+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-12T13:37:17.911+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-12T13:37:17.913+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-12T13:37:17.915+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-12T13:37:17.917+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-12T13:37:17.919+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-12T13:37:17.921+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-12T13:37:17.922+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-12T13:37:17.924+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-12T13:37:17.926+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-12T13:37:17.927+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-12T13:37:17.929+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-12T13:37:17.931+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-12T13:37:17.933+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-12T13:37:17.934+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-12T13:37:17.936+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-12T13:37:17.938+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-12T13:37:17.940+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-12T13:37:17.941+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-12T13:37:17.943+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-12T13:37:17.944+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-12T13:37:17.946+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-12T13:37:17.948+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-12T13:37:17.950+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-12T13:37:17.952+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-12T13:37:17.954+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-12T13:37:17.955+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-12T13:37:17.957+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-12T13:37:17.960+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-12T13:37:17.962+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-12T13:37:17.964+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-12T13:37:17.967+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-12T13:37:17.969+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-12T13:37:17.971+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-12T13:37:17.973+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-12T13:37:17.974+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-12T13:37:17.977+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-12T13:37:17.979+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-12T13:37:17.981+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-12T13:37:17.983+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-12T13:37:17.985+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-12T13:37:17.987+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-12T13:37:17.989+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-12T13:37:17.990+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-12T13:37:17.993+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-12T13:37:17.995+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-12T13:37:17.997+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-12T13:37:17.999+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-12T13:37:18.001+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-12T13:37:18.003+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-12T13:37:18.003+05:30 [Info] Actual variance of deferred index count across nodes is 0
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place 60 index instaces on 1 empty and 1 10 percent filled node - 1 SG
2023-09-12T13:37:18.006+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T13:37:18.008+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T13:37:18.010+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T13:37:18.012+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T13:37:18.015+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T13:37:18.017+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-12T13:37:18.019+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-12T13:37:18.021+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-12T13:37:18.022+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-12T13:37:18.024+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-12T13:37:18.026+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-12T13:37:18.028+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-12T13:37:18.030+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-12T13:37:18.032+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-12T13:37:18.034+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-12T13:37:18.035+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-12T13:37:18.037+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-12T13:37:18.039+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-12T13:37:18.041+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-12T13:37:18.043+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-12T13:37:18.045+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-12T13:37:18.047+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-12T13:37:18.049+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-12T13:37:18.051+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-12T13:37:18.053+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-12T13:37:18.055+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-12T13:37:18.056+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-12T13:37:18.058+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-12T13:37:18.060+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-12T13:37:18.061+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-12T13:37:18.063+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-12T13:37:18.065+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-12T13:37:18.066+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-12T13:37:18.068+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-12T13:37:18.070+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-12T13:37:18.072+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-12T13:37:18.073+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-12T13:37:18.075+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-12T13:37:18.077+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-12T13:37:18.079+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-12T13:37:18.081+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-12T13:37:18.082+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-12T13:37:18.084+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-12T13:37:18.086+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-12T13:37:18.088+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-12T13:37:18.090+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-12T13:37:18.092+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-12T13:37:18.093+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-12T13:37:18.095+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-12T13:37:18.097+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-12T13:37:18.099+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-12T13:37:18.101+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-12T13:37:18.103+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-12T13:37:18.104+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-12T13:37:18.106+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-12T13:37:18.108+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-12T13:37:18.110+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-12T13:37:18.112+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-12T13:37:18.114+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-12T13:37:18.115+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-12T13:37:18.116+05:30 [Info] Actual variance of deferred index count across nodes is 8
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place 60 index instaces on 1 empty and 1 30 percent filled node - 1 SG
2023-09-12T13:37:18.118+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T13:37:18.120+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T13:37:18.121+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T13:37:18.123+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T13:37:18.125+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T13:37:18.127+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-12T13:37:18.129+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-12T13:37:18.130+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-12T13:37:18.132+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-12T13:37:18.134+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-12T13:37:18.136+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-12T13:37:18.137+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-12T13:37:18.139+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-12T13:37:18.141+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-12T13:37:18.143+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-12T13:37:18.145+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-12T13:37:18.146+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-12T13:37:18.148+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-12T13:37:18.150+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-12T13:37:18.152+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-12T13:37:18.153+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-12T13:37:18.155+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-12T13:37:18.157+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-12T13:37:18.158+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-12T13:37:18.160+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-12T13:37:18.162+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-12T13:37:18.164+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-12T13:37:18.166+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-12T13:37:18.167+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-12T13:37:18.169+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-12T13:37:18.171+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-12T13:37:18.173+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-12T13:37:18.174+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-12T13:37:18.176+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-12T13:37:18.178+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-12T13:37:18.180+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-12T13:37:18.182+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-12T13:37:18.183+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-12T13:37:18.185+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-12T13:37:18.187+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-12T13:37:18.188+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-12T13:37:18.190+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-12T13:37:18.192+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-12T13:37:18.193+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-12T13:37:18.195+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-12T13:37:18.197+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-12T13:37:18.199+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-12T13:37:18.200+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-12T13:37:18.202+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-12T13:37:18.204+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-12T13:37:18.206+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-12T13:37:18.207+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-12T13:37:18.209+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-12T13:37:18.211+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-12T13:37:18.213+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-12T13:37:18.214+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-12T13:37:18.216+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-12T13:37:18.218+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-12T13:37:18.220+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-12T13:37:18.222+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-12T13:37:18.222+05:30 [Info] Actual variance of deferred index count across nodes is 98
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place 5 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-09-12T13:37:18.224+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T13:37:18.226+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T13:37:18.227+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T13:37:18.229+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T13:37:18.230+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T13:37:18.231+05:30 [Info] Actual variance of deferred index count across nodes is 4.5
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place 60 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-09-12T13:37:18.232+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T13:37:18.234+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T13:37:18.235+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T13:37:18.237+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T13:37:18.239+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T13:37:18.240+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-12T13:37:18.242+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-12T13:37:18.244+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-12T13:37:18.245+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-12T13:37:18.247+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-12T13:37:18.249+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-12T13:37:18.250+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-12T13:37:18.252+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-12T13:37:18.253+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-12T13:37:18.255+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-12T13:37:18.257+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-12T13:37:18.258+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-12T13:37:18.260+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-12T13:37:18.262+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-12T13:37:18.264+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-12T13:37:18.265+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-12T13:37:18.267+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-12T13:37:18.268+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-12T13:37:18.270+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-12T13:37:18.272+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-12T13:37:18.273+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-12T13:37:18.275+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-12T13:37:18.277+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-12T13:37:18.278+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-12T13:37:18.280+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-12T13:37:18.282+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-12T13:37:18.283+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-12T13:37:18.285+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-12T13:37:18.287+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-12T13:37:18.289+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-12T13:37:18.290+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-12T13:37:18.292+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-12T13:37:18.294+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-12T13:37:18.296+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-12T13:37:18.298+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-12T13:37:18.300+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-12T13:37:18.302+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-12T13:37:18.304+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-12T13:37:18.305+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-12T13:37:18.307+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-12T13:37:18.309+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-12T13:37:18.310+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-12T13:37:18.312+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-12T13:37:18.314+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-12T13:37:18.316+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-12T13:37:18.317+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-12T13:37:18.319+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-12T13:37:18.321+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-12T13:37:18.323+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-12T13:37:18.325+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-12T13:37:18.326+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-12T13:37:18.328+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-12T13:37:18.330+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-12T13:37:18.332+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-12T13:37:18.334+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-12T13:37:18.334+05:30 [Info] Actual variance of deferred index count across nodes is 648
--- PASS: TestGreedyPlanner (0.47s)
=== RUN TestTenantAwarePlanner
2023/09/12 13:37:18 In TestTenantAwarePlanner()
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 1 empty node - 1 SG
2023-09-12T13:37:18.336+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-09-12T13:37:18.336+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.336+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 empty nodes - 2 SG
2023-09-12T13:37:18.338+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9003 127.0.0.1:9002]]
2023-09-12T13:37:18.338+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.338+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9002]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 1 node - 1 SG
2023-09-12T13:37:18.340+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.340+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-09-12T13:37:18.340+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-09-12T13:37:18.340+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 2 nodes - 1 SG
2023-09-12T13:37:18.342+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.342+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.342+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-09-12T13:37:18.342+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-09-12T13:37:18.342+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(a)
2023-09-12T13:37:18.344+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.344+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.344+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9004 127.0.0.1:9003]]
2023-09-12T13:37:18.344+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9002]
2023-09-12T13:37:18.344+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(b)
2023-09-12T13:37:18.346+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.346+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.346+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9002]]
2023-09-12T13:37:18.346+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.346+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(c)
2023-09-12T13:37:18.348+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.348+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.348+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.348+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.348+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-12T13:37:18.348+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.348+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Memory Above LWM
2023-09-12T13:37:18.350+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.350+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-12T13:37:18.350+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.350+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-12T13:37:18.350+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.350+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.350+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Units Above LWM
2023-09-12T13:37:18.353+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.353+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-12T13:37:18.353+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.353+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5000 Tenants 0
2023-09-12T13:37:18.353+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.353+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.353+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(a)
2023-09-12T13:37:18.355+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.355+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-12T13:37:18.355+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.355+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-12T13:37:18.355+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.355+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.355+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(b)
2023-09-12T13:37:18.358+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.358+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-12T13:37:18.358+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.358+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-12T13:37:18.358+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.358+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.358+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Units HWM
2023-09-12T13:37:18.360+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 8000 Tenants 0
2023-09-12T13:37:18.360+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.360+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.360+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 8000 Tenants 0
2023-09-12T13:37:18.360+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-12T13:37:18.360+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.360+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-09-12T13:37:18.362+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-12T13:37:18.362+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-09-12T13:37:18.362+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-12T13:37:18.362+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-09-12T13:37:18.362+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.362+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.362+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-09-12T13:37:18.364+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.365+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.365+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.365+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-12T13:37:18.365+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.365+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-12T13:37:18.365+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.365+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-09-12T13:37:18.367+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.367+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.367+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.367+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.367+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-12T13:37:18.367+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.367+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-09-12T13:37:18.369+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.369+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.369+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.369+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-12T13:37:18.369+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.369+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-12T13:37:18.369+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.369+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-09-12T13:37:18.372+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.372+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.372+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.372+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.372+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-12T13:37:18.372+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.372+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 2 empty nodes - 1 SG
2023-09-12T13:37:18.374+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-09-12T13:37:18.374+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.374+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9002]
2023-09-12T13:37:18.374+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9001]
2023-09-12T13:37:18.374+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Unable to find any valid SubCluster
2023/09/12 13:37:18 Expected error Planner not able to find any node for placement - Unable to find any valid SubCluster
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Memory HWM
2023-09-12T13:37:18.374+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-09-12T13:37:18.374+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.374+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.374+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-09-12T13:37:18.374+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-12T13:37:18.374+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.374+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2023/09/12 13:37:18 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Memory Above LWM
2023-09-12T13:37:18.375+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 680000000 Units 1000 Tenants 0
2023-09-12T13:37:18.375+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-12T13:37:18.375+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 680000000 Units 1000 Tenants 0
2023-09-12T13:37:18.375+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-12T13:37:18.375+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.375+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T13:37:18.375+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2023/09/12 13:37:18 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 0 Units 4500 Tenants 0
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-09-12T13:37:18.376+05:30 [Error] Planner::validateSubClusterGrouping Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/09/12 13:37:18 Expected error Planner Constraint Violation. Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-12T13:37:18.376+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/12 13:37:18 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-09-12T13:37:18.377+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.377+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.377+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/12 13:37:18 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-09-12T13:37:18.377+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.377+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.377+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T13:37:18.377+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-12T13:37:18.377+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/12 13:37:18 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-09-12T13:37:18.378+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.378+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.378+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9004 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/12 13:37:18 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 3 SG, 1 empty, 1 Memory Above HWM
2023-09-12T13:37:18.379+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.379+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-09-12T13:37:18.379+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.379+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-09-12T13:37:18.379+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.379+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.379+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.379+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500
2023-09-12T13:37:18.379+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.379+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 3 SG, 1 empty, 1 Units Above HWM
2023-09-12T13:37:18.380+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 8000 Tenants 0
2023-09-12T13:37:18.380+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 400000000 Units 1000 Tenants 0
2023-09-12T13:37:18.380+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 8000 Tenants 0
2023-09-12T13:37:18.380+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 400000000 Units 1000 Tenants 0
2023-09-12T13:37:18.380+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.380+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.380+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.380+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000
2023-09-12T13:37:18.380+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.380+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 3 SG, 1 empty, Both Memory/Units Above HWM
2023-09-12T13:37:18.381+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.381+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.381+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.381+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.381+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.381+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.381+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.381+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.382+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T13:37:18.382+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.382+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.382+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 3 SG, Multiple tenants to move, single source, multiple destination
2023-09-12T13:37:18.382+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.383+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.383+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.383+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.383+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.383+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.383+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.383+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000
2023-09-12T13:37:18.383+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000
2023-09-12T13:37:18.383+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.383+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.383+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 3 SG, Multiple tenants to move, no nodes below LWM
2023-09-12T13:37:18.384+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-12T13:37:18.384+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-09-12T13:37:18.384+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 700000000 Units 3000 Tenants 0
2023-09-12T13:37:18.384+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-12T13:37:18.384+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-09-12T13:37:18.384+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 700000000 Units 3000 Tenants 0
2023-09-12T13:37:18.384+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.384+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.384+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.384+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-09-12T13:37:18.384+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-09-12T13:37:18.384+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-09-12T13:37:18.385+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.385+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.385+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.385+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.385+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.385+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000
2023-09-12T13:37:18.385+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.385+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.385+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.385+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.385+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.385+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.385+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.385+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.385+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-09-12T13:37:18.386+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.386+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.386+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.386+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.386+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.386+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-12T13:37:18.387+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.387+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.387+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.387+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.387+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.387+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.387+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.387+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.387+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 3 SG, Single Large Tenant, Nothing to move
2023-09-12T13:37:18.388+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-09-12T13:37:18.388+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 2000 Tenants 0
2023-09-12T13:37:18.388+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-09-12T13:37:18.388+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 2000 Tenants 0
2023-09-12T13:37:18.388+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.388+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.388+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.388+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000
2023-09-12T13:37:18.388+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.388+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(zero usage tenants)
2023-09-12T13:37:18.389+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.389+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.389+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.389+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.389+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.389+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.389+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.389+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.390+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.390+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.390+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.390+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.390+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.390+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 3 SG, 1 Partial Subcluster
2023-09-12T13:37:18.390+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.390+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-09-12T13:37:18.390+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.391+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-09-12T13:37:18.391+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003]]
2023-09-12T13:37:18.391+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.391+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.391+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.391+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-09-12T13:37:18.391+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-09-12T13:37:18.391+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9003]
2023-09-12T13:37:18.391+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.391+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.391+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Replica Repair - 4 SG, Missing Replicas for multiple tenants in SG
2023-09-12T13:37:18.392+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.392+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.392+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.392+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.392+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.392+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.392+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.392+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-12T13:37:18.392+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-09-12T13:37:18.392+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-12T13:37:18.392+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-12T13:37:18.392+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over
2023-09-12T13:37:18.393+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.393+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.393+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.393+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.393+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.393+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-09-12T13:37:18.393+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9004
2023-09-12T13:37:18.393+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-12T13:37:18.393+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9004
2023-09-12T13:37:18.393+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-12T13:37:18.393+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-12T13:37:18.393+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.393+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over, No replacement
2023-09-12T13:37:18.394+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.394+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.394+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.394+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.394+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.394+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.394+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9001] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.394+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Replica Repair - 4 SG, Missing Replicas, one replica missing with pendingDelete true
2023-09-12T13:37:18.395+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.395+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.395+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.395+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.395+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.395+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.395+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.395+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-12T13:37:18.395+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-09-12T13:37:18.395+05:30 [Info] Planner::findMissingReplicaForIndexerNode Skipping Replica Repair for 88883:81813:0. PendingDelete true
2023-09-12T13:37:18.395+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx2,1) on 127.0.0.1:9005
2023-09-12T13:37:18.395+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Replica Repair - 2 SG, Missing Replicas with Nodes over HWM
2023-09-12T13:37:18.396+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 7000 Tenants 0
2023-09-12T13:37:18.396+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.396+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 7000 Tenants 0
2023-09-12T13:37:18.396+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.396+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket9,,,idx2,1) on 127.0.0.1:9005
2023-09-12T13:37:18.396+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.396+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.396+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-09-12T13:37:18.397+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700
2023-09-12T13:37:18.397+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-09-12T13:37:18.397+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000
2023-09-12T13:37:18.397+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.397+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.397+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.397+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.397+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes
2023-09-12T13:37:18.398+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9004]
2023-09-12T13:37:18.398+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9004]
2023-09-12T13:37:18.398+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9001]
2023-09-12T13:37:18.398+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006 127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.398+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9008 127.0.0.1:9006 127.0.0.1:9007]
2023-09-12T13:37:18.398+05:30 [Info] Moving index 7777:7171:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T13:37:18.398+05:30 [Info] Moving index 8888:8181:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T13:37:18.398+05:30 [Info] Moving index 9999:9191:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T13:37:18.398+05:30 [Info] Moving index 101010:101101:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T13:37:18.398+05:30 [Info] Moving index 111111:112112:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T13:37:18.398+05:30 [Info] Moving index 121212:121121:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T13:37:18.398+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.398+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.398+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.398+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.398+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.398+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.398+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-09-12T13:37:18.398+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T13:37:18.398+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.398+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.398+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.398+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 1100000000 Units 8100 Tenants 0
2023-09-12T13:37:18.398+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008] [127.0.0.1:9003 127.0.0.1:9005] [127.0.0.1:9006] [127.0.0.1:9007]]
2023-09-12T13:37:18.398+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9006] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.398+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.398+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes(different SG)
2023-09-12T13:37:18.400+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004 127.0.0.1:9005]
2023-09-12T13:37:18.400+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004 127.0.0.1:9005]
2023-09-12T13:37:18.400+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-12T13:37:18.400+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.400+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.400+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.400+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.400+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.400+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.400+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.400+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.400+05:30 [Info] Moving index 7777:17171:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T13:37:18.400+05:30 [Info] Moving index 8888:18181:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T13:37:18.400+05:30 [Info] Moving index 9999:19191:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T13:37:18.400+05:30 [Info] Moving index 101010:1101101:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T13:37:18.400+05:30 [Info] Moving index 111111:1112112:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T13:37:18.400+05:30 [Info] Moving index 121212:1121121:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T13:37:18.400+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T13:37:18.400+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-09-12T13:37:18.400+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.400+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.400+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.400+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.400+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.400+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.400+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9003] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.400+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Swap Rebalance - 4 SG, Swap 1 SG with 2 new nodes
2023-09-12T13:37:18.401+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.401+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.401+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T13:37:18.401+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.401+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.401+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T13:37:18.401+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T13:37:18.401+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T13:37:18.401+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T13:37:18.401+05:30 [Info] Moving index 5555:5151:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T13:37:18.401+05:30 [Info] Moving index 6666:6161:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T13:37:18.401+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.401+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.401+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.401+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.401+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.401+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.401+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-09-12T13:37:18.401+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T13:37:18.401+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.401+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.401+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.401+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.401+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.401+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.401+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.401+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Swap Rebalance - 4 SG, Swap 1 node with 2 new nodes
2023-09-12T13:37:18.402+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-12T13:37:18.402+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-12T13:37:18.402+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-12T13:37:18.402+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008 127.0.0.1:9006]
2023-09-12T13:37:18.402+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.402+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.402+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.402+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.402+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.402+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.402+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T13:37:18.402+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T13:37:18.402+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.402+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.402+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.402+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.402+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003] [127.0.0.1:9008] [127.0.0.1:9007]]
2023-09-12T13:37:18.402+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.402+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9008] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.402+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.402+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Swap Rebalance - 4 SG, Swap 1 empty node with 2 new nodes
2023-09-12T13:37:18.403+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-12T13:37:18.403+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-09-12T13:37:18.403+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T13:37:18.403+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.403+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.403+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.403+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.403+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.403+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-09-12T13:37:18.403+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9006
2023-09-12T13:37:18.403+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9006
2023-09-12T13:37:18.403+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9006
2023-09-12T13:37:18.403+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9006
2023-09-12T13:37:18.403+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9006
2023-09-12T13:37:18.403+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket6,,,idx2,1) on 127.0.0.1:9006
2023-09-12T13:37:18.404+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.404+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Swap Rebalance - 1 SG, Swap 1 node - Failed swap rebalance
2023-09-12T13:37:18.404+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-12T13:37:18.404+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-12T13:37:18.405+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-12T13:37:18.405+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.405+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-12T13:37:18.405+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.405+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T13:37:18.405+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.405+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9008 as replacement node for deleted node 127.0.0.1:9004.
2023-09-12T13:37:18.405+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.405+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.405+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.405+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.405+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 600000000 Units 4000
2023-09-12T13:37:18.405+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.405+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 500000000 Units 4100 Tenants 0
2023-09-12T13:37:18.405+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008]]
2023-09-12T13:37:18.405+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Swap Rebalance - 1 SG, Swap 2 node - server group mismatch
2023-09-12T13:37:18.405+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-12T13:37:18.405+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-12T13:37:18.405+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9002 127.0.0.1:9001]
2023-09-12T13:37:18.405+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9004]
2023/09/12 13:37:18 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 subcluster, Enough Capacity
2023-09-12T13:37:18.407+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.407+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 600000000 Units 4500 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 600000000 Units 4500 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 600000000 Units 4100 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 600000000 Units 4100 Tenants 0
2023-09-12T13:37:18.407+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.407+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.408+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.408+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T13:37:18.408+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-12T13:37:18.408+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-12T13:37:18.408+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.408+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-12T13:37:18.408+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.408+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity
2023-09-12T13:37:18.409+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-12T13:37:18.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T13:37:18.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.409+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.409+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 on any target
2023-09-12T13:37:18.409+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 on any target
2023-09-12T13:37:18.409+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 on any target
2023-09-12T13:37:18.409+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.409+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.409+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 13:37:18 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 node, Pair node not deleted(Failed swap rebalance of 1 node)
2023-09-12T13:37:18.410+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001]
2023-09-12T13:37:18.411+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001]
2023-09-12T13:37:18.411+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004]
2023-09-12T13:37:18.411+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.411+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9009 as replacement node for deleted node 127.0.0.1:9001.
2023-09-12T13:37:18.411+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-12T13:37:18.411+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-12T13:37:18.411+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-12T13:37:18.411+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-12T13:37:18.411+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 600000000 Units 4000
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 500000000 Units 4100 Tenants 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9004 127.0.0.1:9009] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9004 127.0.0.1:9009]]
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9009]
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.411+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.411+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.412+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 node, Pair node already deleted
2023-09-12T13:37:18.412+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002]
2023-09-12T13:37:18.412+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002]
2023-09-12T13:37:18.412+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes []
2023-09-12T13:37:18.412+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.412+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-12T13:37:18.412+05:30 [Info] Planner::moveTenantsFromDeletedNodes Pair node not found for deleted node 127.0.0.1:9002.
2023-09-12T13:37:18.412+05:30 [Error] Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/09/12 13:37:18 Expected error Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 subcluster, empty nodes
2023-09-12T13:37:18.413+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9005 127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T13:37:18.413+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-09-12T13:37:18.413+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-09-12T13:37:18.413+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-09-12T13:37:18.413+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-09-12T13:37:18.413+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-12T13:37:18.413+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 800000000 Units 7000 Tenants 0
2023-09-12T13:37:18.413+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.413+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-12T13:37:18.413+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.413+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.413+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9002] with len 1. Skipping replica repair attempt.
2023-09-12T13:37:18.413+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 subcluster, Deleted Nodes more than added nodes
2023-09-12T13:37:18.414+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.414+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.414+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T13:37:18.414+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-09-12T13:37:18.414+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 1
2023-09-12T13:37:18.414+05:30 [Error] Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/09/12 13:37:18 Expected error Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 node, Add 1 node in, server group mismatch
2023-09-12T13:37:18.414+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9006]
2023-09-12T13:37:18.414+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9006]
2023-09-12T13:37:18.414+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9003]
2023-09-12T13:37:18.414+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9007]
2023/09/12 13:37:18 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 node, Pair node exists
2023-09-12T13:37:18.415+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-12T13:37:18.415+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-12T13:37:18.415+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-12T13:37:18.415+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.415+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-12T13:37:18.415+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.415+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.415+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.415+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T13:37:18.415+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.415+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.415+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.415+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.415+05:30 [Info] Planner::moveTenantsFromDeletedNodes No replacement node found for deleted node 127.0.0.1:9004.
2023-09-12T13:37:18.415+05:30 [Error] Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/09/12 13:37:18 Expected error Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 subcluster, No nodes under LWM
2023-09-12T13:37:18.416+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T13:37:18.416+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-12T13:37:18.416+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.416+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T13:37:18.416+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.416+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-12T13:37:18.416+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 13:37:18 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity, Partial Subcluster
2023-09-12T13:37:18.417+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.417+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.417+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T13:37:18.417+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.417+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T13:37:18.417+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.417+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 100000000 UnitsUsage 500
2023-09-12T13:37:18.417+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 500
2023-09-12T13:37:18.417+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 200000000 Units 1000
2023-09-12T13:37:18.417+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.417+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 200000000 Units 1000
2023-09-12T13:37:18.417+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.417+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T13:37:18.417+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9006]
2023-09-12T13:37:18.417+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-12T13:37:18.417+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 13:37:18 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 2 SG, Move out 1 non-empty and 1 empty node
2023-09-12T13:37:18.418+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9007 127.0.0.1:9004]
2023-09-12T13:37:18.418+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-12T13:37:18.418+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-12T13:37:18.418+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-09-12T13:37:18.418+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9008]
2023-09-12T13:37:18.418+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.419+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.419+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.419+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.419+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.419+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.419+05:30 [Info] Moving index 171717:1171171:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.419+05:30 [Info] Moving index 141414:1141141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T13:37:18.419+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 0 Units 0
2023-09-12T13:37:18.419+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T13:37:18.419+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-12T13:37:18.419+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-12T13:37:18.419+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9008 127.0.0.1:9001]]
2023-09-12T13:37:18.419+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM
2023-09-12T13:37:18.420+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.420+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.420+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.420+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.420+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.420+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.420+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T13:37:18.420+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.420+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.420+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-12T13:37:18.420+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-12T13:37:18.420+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-12T13:37:18.420+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-12T13:37:18.420+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-12T13:37:18.420+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.420+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 2 Subclusters, 1 below LWM, 1 above HWM
2023-09-12T13:37:18.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.421+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.421+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.421+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.421+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.421+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T13:37:18.421+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.421+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.421+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-12T13:37:18.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-12T13:37:18.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 600000000 Units 4000 Tenants 0
2023-09-12T13:37:18.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-12T13:37:18.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 600000000 Units 4000 Tenants 0
2023-09-12T13:37:18.421+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.421+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 3 Subclusters, 1 empty, 1 Above HWM, 1 below LWM
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.422+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.422+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.422+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.422+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T13:37:18.422+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.422+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.422+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.422+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.422+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.422+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.422+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.422+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.422+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.422+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-09-12T13:37:18.422+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-09-12T13:37:18.422+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-12T13:37:18.422+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 2 Subclusters, 1 above LWM/below HWM, 1 empty
2023-09-12T13:37:18.423+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-12T13:37:18.423+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-12T13:37:18.423+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.423+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 2 Subclusters, Both above LWM/below HWM
2023-09-12T13:37:18.424+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-12T13:37:18.424+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-09-12T13:37:18.424+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-12T13:37:18.424+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-09-12T13:37:18.424+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.424+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-12T13:37:18.424+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-12T13:37:18.424+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-09-12T13:37:18.424+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-12T13:37:18.424+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-09-12T13:37:18.424+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.424+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM (partial replica repair)
2023-09-12T13:37:18.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 550000000 Units 5500 Tenants 0
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.425+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-09-12T13:37:18.425+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.425+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.425+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-12T13:37:18.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-12T13:37:18.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-12T13:37:18.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-12T13:37:18.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-12T13:37:18.425+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.425+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM(full replica repair)
2023-09-12T13:37:18.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.425+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx1,1) on 127.0.0.1:9001
2023-09-12T13:37:18.425+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9001
2023-09-12T13:37:18.425+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx1,1) on 127.0.0.1:9001
2023-09-12T13:37:18.425+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9001
2023-09-12T13:37:18.425+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9001
2023-09-12T13:37:18.425+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,1) on 127.0.0.1:9001
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9004 127.0.0.1:9001]]
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T13:37:18.425+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.426+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.426+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.426+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 ScaleIn- 2 Subclusters, Both below LWM, Positive Case
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.426+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.426+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.426+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.426+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.426+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.426+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.426+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T13:37:18.426+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2023-09-12T13:37:18.426+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T13:37:18.426+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.426+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9003 SG sg1 Memory 0 Units 0
2023-09-12T13:37:18.426+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9006 SG sg3 Memory 0 Units 0
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 ScaleIn- 2 Subclusters, One below LWM/ 1 Empty
2023-09-12T13:37:18.427+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.427+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T13:37:18.427+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.427+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. No ScaleIn.
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.428+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.428+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.428+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.428+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-09-12T13:37:18.428+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.428+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.428+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.428+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.428+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.428+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.428+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-09-12T13:37:18.428+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.428+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.428+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-09-12T13:37:18.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.428+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-12T13:37:18.428+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. ScaleIn.
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.429+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.429+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.429+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T13:37:18.429+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-09-12T13:37:18.429+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.429+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.429+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.429+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.429+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.429+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.429+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-09-12T13:37:18.429+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T13:37:18.429+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T13:37:18.429+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-09-12T13:37:18.429+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T13:37:18.429+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T13:37:18.429+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-09-12T13:37:18.429+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Rebalance - 1 Subcluster, Below HWM (partial replica repair)
2023-09-12T13:37:18.430+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-09-12T13:37:18.430+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 350000000 Units 500 Tenants 0
2023-09-12T13:37:18.430+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.430+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-09-12T13:37:18.430+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-09-12T13:37:18.430+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-12T13:37:18.430+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-09-12T13:37:18.430+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 500000000 Units 800 Tenants 0
2023-09-12T13:37:18.430+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T13:37:18.430+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Resume - 1 tenant, Empty node in cluster.
2023-09-12T13:37:18.431+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-12T13:37:18.431+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.431+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.431+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.431+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.432+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.432+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.432+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.432+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-12T13:37:18.432+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T13:37:18.432+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Resume - 1 tenant, No empty node in cluster.
2023-09-12T13:37:18.433+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-12T13:37:18.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.433+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.433+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-12T13:37:18.433+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.433+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Resume - 1 tenant, No node below LWM in the cluster.
2023-09-12T13:37:18.435+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-12T13:37:18.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 5000 Tenants 0
2023-09-12T13:37:18.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 5000 Tenants 0
2023-09-12T13:37:18.435+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.435+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-12T13:37:18.435+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM []
2023/09/12 13:37:18 Expected error No SubCluster Below Low Usage Threshold
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Resume - 1 tenant, Not enough capacity in the cluster.
2023-09-12T13:37:18.436+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-12T13:37:18.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T13:37:18.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T13:37:18.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T13:37:18.436+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.436+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250
2023-09-12T13:37:18.436+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T13:37:18.436+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250 on any target
2023/09/12 13:37:18 Expected error Not Enough Capacity To Place Tenant
--- PASS: TestTenantAwarePlanner (0.10s)
=== RUN TestPlanDuringHeterogenousScaleup
2023/09/12 13:37:18 In TestPlanDuringHeterogenousScaleup()
=== RUN TestPlanDuringHeterogenousScaleup/GreedyPlanner
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T13:37:18.439+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T13:37:18.441+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T13:37:18.443+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-09-12T13:37:18.445+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-09-12T13:37:18.447+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T13:37:18.449+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-09-12T13:37:18.451+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-09-12T13:37:18.453+05:30 [Info] Using greedy index placement for index 987654
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T13:37:18.456+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.9600026378237889
2023-09-12T13:37:18.561+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:18.561+05:30 [Info] Score: 0.5118702120133598
2023-09-12T13:37:18.561+05:30 [Info] variation: 1.0237404240267196
2023-09-12T13:37:18.561+05:30 [Info] ElapsedTime: 105ms
2023-09-12T13:37:18.561+05:30 [Info] ConvergenceTime: 103ms
2023-09-12T13:37:18.561+05:30 [Info] Iteration: 7000
2023-09-12T13:37:18.561+05:30 [Info] Move: 3911
2023-09-12T13:37:18.561+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.561+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.561+05:30 [Info] Indexer Memory Mean 126888575449 (118.174G)
2023-09-12T13:37:18.561+05:30 [Info] Indexer Memory Deviation 80354383758 (74.8359G) (63.33%)
2023-09-12T13:37:18.561+05:30 [Info] Indexer Memory Utilization 2.3004
2023-09-12T13:37:18.561+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:18.561+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:18.561+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:18.561+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.561+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.561+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.561+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.561+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.561+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.561+05:30 [Info] Indexer Data Size Mean 18082106963 (16.8403G)
2023-09-12T13:37:18.561+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (141.42%)
2023-09-12T13:37:18.561+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.561+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.561+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.561+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.561+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.561+05:30 [Info] Number of indexes: 13
2023-09-12T13:37:18.561+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.561+05:30 [Info] Avg Index Size: 29281978949 (27.271G)
2023-09-12T13:37:18.561+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:18.561+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T13:37:18.561+05:30 [Info] Avg Index Cpu: 3.5385
2023-09-12T13:37:18.561+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:18.561+05:30 [Info] Num Estimation Run: 11
2023-09-12T13:37:18.561+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.561+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:18.561+05:30 [Info] CPU Quota 27
2023-09-12T13:37:18.561+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.562+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.562+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Total iteration: 7010
2023-09-12T13:37:18.562+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.562+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.562+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.562+05:30 [Info] RandomMove time: 0ns
2023-09-12T13:37:18.562+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T13:37:18.562+05:30 [Info] ExhaustMove time: 44ms
2023-09-12T13:37:18.562+05:30 [Info] ExhaustMove call: 7010
2023-09-12T13:37:18.562+05:30 [Info] ExhaustMove average time: 6us
2023-09-12T13:37:18.562+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.562+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.562+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.562+05:30 [Info]
2023-09-12T13:37:18.562+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:18.562+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T13:37:18.562+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.37390490588193165 allowDDLDuringScaleup:true
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info]
2023-09-12T13:37:18.562+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:18.562+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.562+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7501886306380632 allowDDLDuringScaleup:true
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:7800794020279486472, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info]
2023-09-12T13:37:18.562+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:18.562+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:0 (0), data:0 (0) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T13:37:18.562+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.07590646348000514 allowDDLDuringScaleup:true
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.562+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.562+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.562+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.562+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T13:37:18.565+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6856271841119315
2023-09-12T13:37:18.629+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:18.629+05:30 [Info] Score: 0.28937833136341934
2023-09-12T13:37:18.629+05:30 [Info] variation: 0.5787566627268387
2023-09-12T13:37:18.629+05:30 [Info] ElapsedTime: 63ms
2023-09-12T13:37:18.629+05:30 [Info] ConvergenceTime: 62ms
2023-09-12T13:37:18.629+05:30 [Info] Iteration: 4200
2023-09-12T13:37:18.629+05:30 [Info] Move: 2591
2023-09-12T13:37:18.629+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.629+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.629+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-12T13:37:18.629+05:30 [Info] Indexer Memory Deviation 65295744085 (60.8114G) (45.04%)
2023-09-12T13:37:18.629+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-12T13:37:18.629+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:18.629+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:18.629+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:18.629+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.629+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.629+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.629+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.629+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.629+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.629+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-12T13:37:18.629+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-12T13:37:18.629+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.629+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.629+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.629+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.629+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.629+05:30 [Info] Number of indexes: 14
2023-09-12T13:37:18.629+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.629+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-09-12T13:37:18.629+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:18.629+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T13:37:18.629+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-12T13:37:18.629+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:18.629+05:30 [Info] Num Estimation Run: 11
2023-09-12T13:37:18.629+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.629+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:18.629+05:30 [Info] CPU Quota 27
2023-09-12T13:37:18.629+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.629+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.629+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.629+05:30 [Info] Total iteration: 4500
2023-09-12T13:37:18.629+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.629+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.629+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.629+05:30 [Info] RandomMove time: 21ms
2023-09-12T13:37:18.629+05:30 [Info] RandomMove call: 4199 (empty index 0)
2023-09-12T13:37:18.629+05:30 [Info] RandomMove average time: 5us
2023-09-12T13:37:18.629+05:30 [Info] ExhaustMove time: 7us
2023-09-12T13:37:18.629+05:30 [Info] ExhaustMove call: 1
2023-09-12T13:37:18.629+05:30 [Info] ExhaustMove average time: 7us
2023-09-12T13:37:18.629+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.629+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.629+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.629+05:30 [Info]
2023-09-12T13:37:18.629+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:18.629+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T13:37:18.629+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32726796943638176 allowDDLDuringScaleup:true
2023-09-12T13:37:18.629+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.629+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.629+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.629+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.629+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info]
2023-09-12T13:37:18.630+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:18.630+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.630+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:1730692767902257141, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info]
2023-09-12T13:37:18.630+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:18.630+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.630+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.630+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.630+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1730692767902257141, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.630+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.630+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T13:37:18.633+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.7080370846629772
2023-09-12T13:37:18.636+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T13:37:18.636+05:30 [Info] Score: 0.13929460298637122
2023-09-12T13:37:18.636+05:30 [Info] variation: 0.27858920597274245
2023-09-12T13:37:18.636+05:30 [Info] ElapsedTime: 3ms
2023-09-12T13:37:18.636+05:30 [Info] ConvergenceTime: 1ms
2023-09-12T13:37:18.636+05:30 [Info] Iteration: 1
2023-09-12T13:37:18.636+05:30 [Info] Move: 1
2023-09-12T13:37:18.636+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.636+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.636+05:30 [Info] Indexer Memory Mean 163052789375 (151.855G)
2023-09-12T13:37:18.636+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (55.72%)
2023-09-12T13:37:18.636+05:30 [Info] Indexer Memory Utilization 2.9561
2023-09-12T13:37:18.636+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:18.636+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:18.636+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:18.636+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.636+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.636+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.636+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.636+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.636+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.636+05:30 [Info] Indexer Data Size Mean 54246320889 (50.5208G)
2023-09-12T13:37:18.636+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:18.636+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.636+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.636+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.636+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.636+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.636+05:30 [Info] Number of indexes: 15
2023-09-12T13:37:18.636+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.636+05:30 [Info] Avg Index Size: 21761293697 (20.2668G)
2023-09-12T13:37:18.636+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:18.636+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T13:37:18.636+05:30 [Info] Avg Index Cpu: 3.0667
2023-09-12T13:37:18.636+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:18.636+05:30 [Info] Num Estimation Run: 230
2023-09-12T13:37:18.636+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.636+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:18.636+05:30 [Info] CPU Quota 27
2023-09-12T13:37:18.636+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.636+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.636+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.636+05:30 [Info] Total iteration: 521
2023-09-12T13:37:18.636+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.636+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.636+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.636+05:30 [Info] RandomMove time: 6us
2023-09-12T13:37:18.636+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-09-12T13:37:18.636+05:30 [Info] RandomMove average time: 6us
2023-09-12T13:37:18.636+05:30 [Info] ExhaustMove time: 1ms
2023-09-12T13:37:18.636+05:30 [Info] ExhaustMove call: 220
2023-09-12T13:37:18.636+05:30 [Info] ExhaustMove average time: 4us
2023-09-12T13:37:18.636+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.636+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.636+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.636+05:30 [Info]
2023-09-12T13:37:18.636+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:18.636+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.636+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.5575132033129112 allowDDLDuringScaleup:true
2023-09-12T13:37:18.636+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.636+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.636+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.636+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.636+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.636+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.636+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.636+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.636+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.636+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.636+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.636+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.636+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.636+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.636+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.636+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6294866053465673034, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info]
2023-09-12T13:37:18.637+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:18.637+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.637+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3168776165275712 allowDDLDuringScaleup:true
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6294866053465673034, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info]
2023-09-12T13:37:18.637+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:18.637+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.637+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3256091801595177 allowDDLDuringScaleup:true
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.637+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.637+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:6294866053465673034, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.637+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.637+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-09-12T13:37:18.639+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6856271841119315
2023-09-12T13:37:18.643+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T13:37:18.644+05:30 [Info] Score: 0.36056429186996203
2023-09-12T13:37:18.644+05:30 [Info] variation: 0.7211285837399241
2023-09-12T13:37:18.644+05:30 [Info] ElapsedTime: 4ms
2023-09-12T13:37:18.644+05:30 [Info] ConvergenceTime: 1ms
2023-09-12T13:37:18.644+05:30 [Info] Iteration: 1
2023-09-12T13:37:18.644+05:30 [Info] Move: 1
2023-09-12T13:37:18.644+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.644+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.644+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-12T13:37:18.644+05:30 [Info] Indexer Memory Deviation 106575253176 (99.2559G) (73.52%)
2023-09-12T13:37:18.644+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-12T13:37:18.644+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:18.644+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:18.644+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:18.644+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.644+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.644+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.644+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.644+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.644+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.644+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-12T13:37:18.644+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-12T13:37:18.644+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.644+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.644+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.644+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.644+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.644+05:30 [Info] Number of indexes: 14
2023-09-12T13:37:18.644+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.644+05:30 [Info] Avg Index Size: 23315671818 (21.7144G)
2023-09-12T13:37:18.644+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:18.644+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T13:37:18.644+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-12T13:37:18.644+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:18.644+05:30 [Info] Num Estimation Run: 230
2023-09-12T13:37:18.644+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.644+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:18.644+05:30 [Info] CPU Quota 27
2023-09-12T13:37:18.644+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.644+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.644+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.644+05:30 [Info] Total iteration: 521
2023-09-12T13:37:18.644+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.644+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.644+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.644+05:30 [Info] RandomMove time: 12us
2023-09-12T13:37:18.644+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-09-12T13:37:18.644+05:30 [Info] RandomMove average time: 12us
2023-09-12T13:37:18.644+05:30 [Info] ExhaustMove time: 1ms
2023-09-12T13:37:18.644+05:30 [Info] ExhaustMove call: 220
2023-09-12T13:37:18.644+05:30 [Info] ExhaustMove average time: 6us
2023-09-12T13:37:18.644+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.644+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.644+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.644+05:30 [Info]
2023-09-12T13:37:18.644+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:18.644+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.644+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.7021056124497257 allowDDLDuringScaleup:true
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:16922241658256684852, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info]
2023-09-12T13:37:18.645+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:18.645+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:0 (0), data:0 (0) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T13:37:18.645+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.05661804908412874 allowDDLDuringScaleup:true
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info]
2023-09-12T13:37:18.645+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:18.645+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.645+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.645+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.645+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16922241658256684852, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.645+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.645+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-09-12T13:37:18.647+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6856271841119315
2023-09-12T13:37:18.742+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:18.742+05:30 [Info] Score: 0.28937833136341934
2023-09-12T13:37:18.742+05:30 [Info] variation: 0.5787566627268387
2023-09-12T13:37:18.742+05:30 [Info] ElapsedTime: 95ms
2023-09-12T13:37:18.742+05:30 [Info] ConvergenceTime: 91ms
2023-09-12T13:37:18.742+05:30 [Info] Iteration: 3900
2023-09-12T13:37:18.742+05:30 [Info] Move: 2464
2023-09-12T13:37:18.742+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.742+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.742+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-12T13:37:18.742+05:30 [Info] Indexer Memory Deviation 65295744085 (60.8114G) (45.04%)
2023-09-12T13:37:18.742+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-12T13:37:18.743+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:18.743+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:18.743+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:18.743+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.743+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.743+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.743+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.743+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.743+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.743+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-12T13:37:18.743+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-12T13:37:18.743+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.743+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.743+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.743+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.743+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.743+05:30 [Info] Number of indexes: 14
2023-09-12T13:37:18.743+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.743+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-09-12T13:37:18.743+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:18.743+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T13:37:18.743+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-12T13:37:18.743+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:18.743+05:30 [Info] Num Estimation Run: 11
2023-09-12T13:37:18.743+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.743+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:18.743+05:30 [Info] CPU Quota 27
2023-09-12T13:37:18.743+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.743+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.743+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.743+05:30 [Info] Total iteration: 7726
2023-09-12T13:37:18.743+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.743+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.743+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.743+05:30 [Info] RandomMove time: 25ms
2023-09-12T13:37:18.743+05:30 [Info] RandomMove call: 3899 (empty index 0)
2023-09-12T13:37:18.743+05:30 [Info] RandomMove average time: 6us
2023-09-12T13:37:18.743+05:30 [Info] ExhaustMove time: 8us
2023-09-12T13:37:18.743+05:30 [Info] ExhaustMove call: 1
2023-09-12T13:37:18.743+05:30 [Info] ExhaustMove average time: 8us
2023-09-12T13:37:18.743+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.743+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.743+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.743+05:30 [Info]
2023-09-12T13:37:18.743+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:18.743+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T13:37:18.743+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32726796943638176 allowDDLDuringScaleup:true
2023-09-12T13:37:18.743+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.743+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.743+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.743+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.743+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.743+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.743+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.743+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.743+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.743+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.743+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.743+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info]
2023-09-12T13:37:18.744+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:18.744+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.744+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:2534596586268938963, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info]
2023-09-12T13:37:18.744+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:18.744+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T13:37:18.744+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.744+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:2534596586268938963, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.744+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.744+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T13:37:18.747+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.9611163603287702
2023-09-12T13:37:18.747+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T13:37:18.747+05:30 [Info] Score: 0.4863052536963559
2023-09-12T13:37:18.747+05:30 [Info] variation: 0.9726105073927118
2023-09-12T13:37:18.747+05:30 [Info] ElapsedTime: 356us
2023-09-12T13:37:18.747+05:30 [Info] ConvergenceTime: 278us
2023-09-12T13:37:18.747+05:30 [Info] Iteration: 1
2023-09-12T13:37:18.747+05:30 [Info] Move: 1
2023-09-12T13:37:18.748+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.748+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.748+05:30 [Info] Indexer Memory Mean 14745215094 (13.7326G)
2023-09-12T13:37:18.748+05:30 [Info] Indexer Memory Deviation 7829819102 (7.29209G) (53.10%)
2023-09-12T13:37:18.748+05:30 [Info] Indexer Memory Utilization 1.6384
2023-09-12T13:37:18.748+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-12T13:37:18.748+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-12T13:37:18.748+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-12T13:37:18.748+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.748+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.748+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.748+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.748+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.748+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.748+05:30 [Info] Indexer Data Size Mean 2745215094 (2.55668G)
2023-09-12T13:37:18.748+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (141.42%)
2023-09-12T13:37:18.748+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.748+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.748+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.748+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.748+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.748+05:30 [Info] Number of indexes: 4
2023-09-12T13:37:18.748+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.748+05:30 [Info] Avg Index Size: 11058911320 (10.2994G)
2023-09-12T13:37:18.748+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-12T13:37:18.748+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-12T13:37:18.748+05:30 [Info] Avg Index Cpu: 0.7500
2023-09-12T13:37:18.748+05:30 [Info] Max Index Cpu: 1.0000
2023-09-12T13:37:18.748+05:30 [Info] Num Estimation Run: 7
2023-09-12T13:37:18.748+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.748+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-12T13:37:18.748+05:30 [Info] CPU Quota 8
2023-09-12T13:37:18.748+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.748+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.748+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.748+05:30 [Info] Total iteration: 8
2023-09-12T13:37:18.748+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.748+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.748+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.748+05:30 [Info] RandomMove time: 0ns
2023-09-12T13:37:18.748+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T13:37:18.748+05:30 [Info] ExhaustMove time: 76us
2023-09-12T13:37:18.748+05:30 [Info] ExhaustMove call: 8
2023-09-12T13:37:18.748+05:30 [Info] ExhaustMove average time: 9us
2023-09-12T13:37:18.748+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.748+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.748+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.748+05:30 [Info]
2023-09-12T13:37:18.748+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-12T13:37:18.748+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:18.748+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.3390930527717129 allowDDLDuringScaleup:true
2023-09-12T13:37:18.748+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.748+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.748+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.748+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.748+05:30 [Info]
2023-09-12T13:37:18.748+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-12T13:37:18.748+05:30 [Info] Indexer total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:0 (0), data:0 (0) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:18.748+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0813823326652111 allowDDLDuringScaleup:true
2023-09-12T13:37:18.748+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.748+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.748+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.748+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.749+05:30 [Info]
2023-09-12T13:37:18.749+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-12T13:37:18.749+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:18.749+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.779524614563076 allowDDLDuringScaleup:true
2023-09-12T13:37:18.749+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.749+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.749+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.749+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.749+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.749+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:3655242774606231095, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.749+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.749+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-09-12T13:37:18.751+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-12T13:37:18.751+05:30 [Warn] Definition 987654 Instance 7422166342329144640 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-09-12T13:37:18.751+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-12T13:37:18.751+05:30 [Warn] Definition 987654 Instance 7422166342329144640 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-09-12T13:37:18.751+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6782899285088768
2023-09-12T13:37:18.820+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:18.820+05:30 [Info] Score: 0.25290029571859646
2023-09-12T13:37:18.820+05:30 [Info] variation: 0.5058005914371929
2023-09-12T13:37:18.820+05:30 [Info] ElapsedTime: 69ms
2023-09-12T13:37:18.820+05:30 [Info] ConvergenceTime: 67ms
2023-09-12T13:37:18.820+05:30 [Info] Iteration: 3800
2023-09-12T13:37:18.820+05:30 [Info] Move: 2419
2023-09-12T13:37:18.820+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.820+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.820+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-09-12T13:37:18.820+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-09-12T13:37:18.820+05:30 [Info] Indexer Memory Utilization 1.9434
2023-09-12T13:37:18.820+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-12T13:37:18.820+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-12T13:37:18.820+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-12T13:37:18.820+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.820+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.820+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.820+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.821+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.821+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.821+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-09-12T13:37:18.821+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-09-12T13:37:18.821+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.821+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.821+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.821+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.821+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.821+05:30 [Info] Number of indexes: 5
2023-09-12T13:37:18.821+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.821+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-09-12T13:37:18.821+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-12T13:37:18.821+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-12T13:37:18.821+05:30 [Info] Avg Index Cpu: 0.6000
2023-09-12T13:37:18.821+05:30 [Info] Max Index Cpu: 1.0000
2023-09-12T13:37:18.821+05:30 [Info] Num Estimation Run: 7
2023-09-12T13:37:18.821+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.821+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-12T13:37:18.821+05:30 [Info] CPU Quota 8
2023-09-12T13:37:18.821+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.821+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.821+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.821+05:30 [Info] Total iteration: 3980
2023-09-12T13:37:18.821+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.821+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.821+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.821+05:30 [Info] RandomMove time: 22ms
2023-09-12T13:37:18.821+05:30 [Info] RandomMove call: 3799 (empty index 0)
2023-09-12T13:37:18.821+05:30 [Info] RandomMove average time: 5us
2023-09-12T13:37:18.821+05:30 [Info] ExhaustMove time: 13us
2023-09-12T13:37:18.821+05:30 [Info] ExhaustMove call: 1
2023-09-12T13:37:18.821+05:30 [Info] ExhaustMove average time: 13us
2023-09-12T13:37:18.821+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.821+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.821+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.821+05:30 [Info]
2023-09-12T13:37:18.821+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-12T13:37:18.821+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:18.821+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-09-12T13:37:18.821+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.821+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.821+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.821+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.821+05:30 [Info]
2023-09-12T13:37:18.821+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-12T13:37:18.821+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:18.821+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-09-12T13:37:18.821+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.821+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.821+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.821+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.821+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.821+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:7422166342329144640, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.821+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.821+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.821+05:30 [Info]
2023-09-12T13:37:18.821+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-12T13:37:18.821+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:18.821+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-09-12T13:37:18.821+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.821+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.821+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.821+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.821+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.821+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:7422166342329144640, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.821+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.821+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-09-12T13:37:18.824+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-12T13:37:18.824+05:30 [Warn] Definition 987654 Instance 4975663848651317182 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-09-12T13:37:18.824+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-12T13:37:18.824+05:30 [Warn] Definition 987654 Instance 4975663848651317182 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-09-12T13:37:18.824+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.2401371728156407
2023-09-12T13:37:18.882+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:18.882+05:30 [Info] Score: 0.25290029571859646
2023-09-12T13:37:18.882+05:30 [Info] variation: 0.5058005914371929
2023-09-12T13:37:18.882+05:30 [Info] ElapsedTime: 58ms
2023-09-12T13:37:18.882+05:30 [Info] ConvergenceTime: 56ms
2023-09-12T13:37:18.882+05:30 [Info] Iteration: 3900
2023-09-12T13:37:18.882+05:30 [Info] Move: 2431
2023-09-12T13:37:18.882+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.882+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.882+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-09-12T13:37:18.882+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-09-12T13:37:18.882+05:30 [Info] Indexer Memory Utilization 1.9434
2023-09-12T13:37:18.882+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-12T13:37:18.882+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-12T13:37:18.882+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-12T13:37:18.882+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.882+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.882+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.882+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.882+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.882+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.882+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-09-12T13:37:18.882+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-09-12T13:37:18.882+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.882+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.882+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.882+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.882+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.882+05:30 [Info] Number of indexes: 5
2023-09-12T13:37:18.882+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.882+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-09-12T13:37:18.882+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-12T13:37:18.882+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-12T13:37:18.882+05:30 [Info] Avg Index Cpu: 0.6000
2023-09-12T13:37:18.882+05:30 [Info] Max Index Cpu: 1.0000
2023-09-12T13:37:18.882+05:30 [Info] Num Estimation Run: 7
2023-09-12T13:37:18.882+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.882+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-12T13:37:18.882+05:30 [Info] CPU Quota 8
2023-09-12T13:37:18.882+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.882+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.882+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.882+05:30 [Info] Total iteration: 3906
2023-09-12T13:37:18.882+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.882+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.882+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.882+05:30 [Info] RandomMove time: 19ms
2023-09-12T13:37:18.882+05:30 [Info] RandomMove call: 3899 (empty index 0)
2023-09-12T13:37:18.882+05:30 [Info] RandomMove average time: 4us
2023-09-12T13:37:18.882+05:30 [Info] ExhaustMove time: 45us
2023-09-12T13:37:18.882+05:30 [Info] ExhaustMove call: 7
2023-09-12T13:37:18.882+05:30 [Info] ExhaustMove average time: 6us
2023-09-12T13:37:18.882+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.882+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.882+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.882+05:30 [Info]
2023-09-12T13:37:18.882+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-12T13:37:18.882+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:18.882+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-09-12T13:37:18.882+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.882+05:30 [Info] Index name:nonEquiv 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.882+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.882+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.882+05:30 [Info]
2023-09-12T13:37:18.883+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-12T13:37:18.883+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:18.883+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-09-12T13:37:18.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.883+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.883+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.883+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.883+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:4975663848651317182, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.883+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.883+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.883+05:30 [Info]
2023-09-12T13:37:18.883+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-12T13:37:18.883+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:18.883+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-09-12T13:37:18.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.883+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.883+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.883+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.883+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:4975663848651317182, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.883+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.883+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T13:37:18.885+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5469703451451706
2023-09-12T13:37:18.993+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:18.993+05:30 [Info] Score: 0.1784816836053567
2023-09-12T13:37:18.993+05:30 [Info] variation: 0.3569633672107134
2023-09-12T13:37:18.993+05:30 [Info] ElapsedTime: 108ms
2023-09-12T13:37:18.993+05:30 [Info] ConvergenceTime: 104ms
2023-09-12T13:37:18.993+05:30 [Info] Iteration: 4900
2023-09-12T13:37:18.993+05:30 [Info] Move: 3748
2023-09-12T13:37:18.993+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.993+05:30 [Info] Using SAPlanner
2023-09-12T13:37:18.993+05:30 [Info] Indexer Memory Mean 154201322596 (143.611G)
2023-09-12T13:37:18.994+05:30 [Info] Indexer Memory Deviation 82829246465 (77.1407G) (53.72%)
2023-09-12T13:37:18.994+05:30 [Info] Indexer Memory Utilization 2.7956
2023-09-12T13:37:18.994+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:18.994+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:18.994+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:18.994+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:18.994+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:18.994+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:18.994+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.994+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:18.994+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:18.994+05:30 [Info] Indexer Data Size Mean 45394854109 (42.2773G)
2023-09-12T13:37:18.994+05:30 [Info] Indexer Data Size Deviation 8024752292 (7.47363G) (17.68%)
2023-09-12T13:37:18.994+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:18.994+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.994+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:18.994+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:18.994+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.994+05:30 [Info] Number of indexes: 20
2023-09-12T13:37:18.994+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:18.994+05:30 [Info] Avg Index Size: 23130198389 (21.5417G)
2023-09-12T13:37:18.994+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:18.994+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T13:37:18.994+05:30 [Info] Avg Index Cpu: 2.3000
2023-09-12T13:37:18.994+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:18.994+05:30 [Info] Num Estimation Run: 22
2023-09-12T13:37:18.994+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.994+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:18.994+05:30 [Info] CPU Quota 27
2023-09-12T13:37:18.994+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:18.994+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:18.994+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.994+05:30 [Info] Total iteration: 7993
2023-09-12T13:37:18.994+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:18.994+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:18.994+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:18.994+05:30 [Info] RandomMove time: 28ms
2023-09-12T13:37:18.994+05:30 [Info] RandomMove call: 4899 (empty index 0)
2023-09-12T13:37:18.994+05:30 [Info] RandomMove average time: 5us
2023-09-12T13:37:18.994+05:30 [Info] ExhaustMove time: 45us
2023-09-12T13:37:18.994+05:30 [Info] ExhaustMove call: 5
2023-09-12T13:37:18.994+05:30 [Info] ExhaustMove average time: 9us
2023-09-12T13:37:18.994+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:18.994+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:18.994+05:30 [Info] ----------------------------------------
2023-09-12T13:37:18.994+05:30 [Info]
2023-09-12T13:37:18.994+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:18.994+05:30 [Info] Indexer total memory:301827829691 (281.099G), mem:271267444887 (252.637G), overhead:30560384804 (28.4616G), min:34046140582 (31.7079G), data:34046140582 (31.7079G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:6
2023-09-12T13:37:18.994+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5018354321742201 allowDDLDuringScaleup:true
2023-09-12T13:37:18.994+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.994+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.994+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.994+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.994+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.994+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.994+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.994+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.994+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.994+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.994+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.994+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.994+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.994+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.994+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.994+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.994+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.994+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:7235105101565506439, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.994+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:7235105101565506439, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info]
2023-09-12T13:37:18.995+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:18.995+05:30 [Info] Indexer total memory:108440151874 (100.993G), mem:92108996936 (85.7832G), overhead:16331154938 (15.2096G), min:51069210873 (47.5619G), data:51069210873 (47.5619G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-12T13:37:18.995+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3444658974194678 allowDDLDuringScaleup:true
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:7235105101565506439, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:7235105101565506439, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:7235105101565506439, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info]
2023-09-12T13:37:18.995+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:18.995+05:30 [Info] Indexer total memory:122670760385 (114.246G), mem:99227525965 (92.4128G), overhead:23443234420 (21.8332G), min:51069210873 (47.5619G), data:51069210873 (47.5619G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-12T13:37:18.995+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.35369867040631203 allowDDLDuringScaleup:true
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.995+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.995+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.995+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.995+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.996+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.996+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.996+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.996+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.996+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.996+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.996+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.996+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:7235105101565506439, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.996+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.996+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.996+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.996+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:7235105101565506439, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.996+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.996+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:18.996+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:18.996+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:7235105101565506439, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:18.996+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:18.996+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:18 -------------------------------------------
2023/09/12 13:37:18 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T13:37:18.999+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.21948680330955667
2023-09-12T13:37:19.160+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:19.160+05:30 [Info] Score: 0.13739736706800032
2023-09-12T13:37:19.160+05:30 [Info] variation: 0.27479473413600064
2023-09-12T13:37:19.160+05:30 [Info] ElapsedTime: 161ms
2023-09-12T13:37:19.160+05:30 [Info] ConvergenceTime: 156ms
2023-09-12T13:37:19.160+05:30 [Info] Iteration: 7000
2023-09-12T13:37:19.160+05:30 [Info] Move: 4820
2023-09-12T13:37:19.160+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.160+05:30 [Info] Using SAPlanner
2023-09-12T13:37:19.160+05:30 [Info] Indexer Memory Mean 208747525973 (194.411G)
2023-09-12T13:37:19.160+05:30 [Info] Indexer Memory Deviation 77823744009 (72.479G) (37.28%)
2023-09-12T13:37:19.160+05:30 [Info] Indexer Memory Utilization 3.7845
2023-09-12T13:37:19.160+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:19.160+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:19.160+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:19.160+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:19.160+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:19.160+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:19.160+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:19.160+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:19.160+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:19.160+05:30 [Info] Indexer Data Size Mean 45221342736 (42.1157G)
2023-09-12T13:37:19.160+05:30 [Info] Indexer Data Size Deviation 7994079525 (7.44507G) (17.68%)
2023-09-12T13:37:19.161+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:19.161+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:19.161+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:19.161+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:19.161+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Number of indexes: 20
2023-09-12T13:37:19.161+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:19.161+05:30 [Info] Avg Index Size: 31312128896 (29.1617G)
2023-09-12T13:37:19.161+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:19.161+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-12T13:37:19.161+05:30 [Info] Avg Index Cpu: 2.3000
2023-09-12T13:37:19.161+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:19.161+05:30 [Info] Num Estimation Run: 23
2023-09-12T13:37:19.161+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:19.161+05:30 [Info] CPU Quota 27
2023-09-12T13:37:19.161+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:19.161+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:19.161+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Total iteration: 10766
2023-09-12T13:37:19.161+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:19.161+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:19.161+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:19.161+05:30 [Info] RandomMove time: 43ms
2023-09-12T13:37:19.161+05:30 [Info] RandomMove call: 6999 (empty index 0)
2023-09-12T13:37:19.161+05:30 [Info] RandomMove average time: 6us
2023-09-12T13:37:19.161+05:30 [Info] ExhaustMove time: 17us
2023-09-12T13:37:19.161+05:30 [Info] ExhaustMove call: 1
2023-09-12T13:37:19.161+05:30 [Info] ExhaustMove average time: 17us
2023-09-12T13:37:19.161+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:19.161+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:19.161+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.161+05:30 [Info]
2023-09-12T13:37:19.161+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:19.161+05:30 [Info] Indexer total memory:301697696161 (280.978G), mem:271137311357 (252.516G), overhead:30560384804 (28.4616G), min:33916007052 (31.5867G), data:33916007052 (31.5867G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:6
2023-09-12T13:37:19.161+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4097753531140166 allowDDLDuringScaleup:true
2023-09-12T13:37:19.161+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.161+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.161+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.161+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.161+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.161+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.161+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.161+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.161+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.161+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.161+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.161+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.161+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981232821204230518, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.161+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.161+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.161+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.161+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981232821204230518, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.161+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.161+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.161+05:30 [Info]
2023-09-12T13:37:19.162+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:19.162+05:30 [Info] Indexer total memory:337728715583 (314.534G), mem:256072940893 (238.487G), overhead:81655774690 (76.0479G), min:50874010578 (47.3801G), data:50874010578 (47.3801G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-12T13:37:19.162+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.470342252272453 allowDDLDuringScaleup:true
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.162+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.162+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.162+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.162+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981232821204230518, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.162+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981232821204230518, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.162+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981232821204230518, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.162+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.162+05:30 [Info]
2023-09-12T13:37:19.162+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:19.162+05:30 [Info] Indexer total memory:122475560090 (114.064G), mem:99032325670 (92.231G), overhead:23443234420 (21.8332G), min:50874010578 (47.3801G), data:50874010578 (47.3801G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-12T13:37:19.162+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3198823946135304 allowDDLDuringScaleup:true
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.162+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.162+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.162+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.162+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.163+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.163+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.163+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.163+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.163+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.163+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.163+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.163+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.163+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.163+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.163+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981232821204230518, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.163+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.163+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.163+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.163+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981232821204230518, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.163+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.163+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.163+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.163+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:16981232821204230518, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.163+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.163+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:19 -------------------------------------------
2023/09/12 13:37:19 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T13:37:19.167+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.08748608306987397
2023-09-12T13:37:19.743+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:19.743+05:30 [Info] Score: 0.16324776491504728
2023-09-12T13:37:19.743+05:30 [Info] variation: 0.32649552983009456
2023-09-12T13:37:19.743+05:30 [Info] ElapsedTime: 576ms
2023-09-12T13:37:19.743+05:30 [Info] ConvergenceTime: 573ms
2023-09-12T13:37:19.743+05:30 [Info] Iteration: 8600
2023-09-12T13:37:19.743+05:30 [Info] Move: 4635
2023-09-12T13:37:19.743+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.743+05:30 [Info] Using SAPlanner
2023-09-12T13:37:19.743+05:30 [Info] Indexer Memory Mean 157055841798 (146.27G)
2023-09-12T13:37:19.743+05:30 [Info] Indexer Memory Deviation 88674154216 (82.5842G) (56.46%)
2023-09-12T13:37:19.743+05:30 [Info] Indexer Memory Utilization 2.8474
2023-09-12T13:37:19.743+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:19.743+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:19.743+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:19.743+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:19.743+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:19.743+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:19.743+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:19.743+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:19.743+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:19.743+05:30 [Info] Indexer Data Size Mean 48249373312 (44.9357G)
2023-09-12T13:37:19.743+05:30 [Info] Indexer Data Size Deviation 4264682382 (3.97179G) (8.84%)
2023-09-12T13:37:19.743+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:19.743+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:19.744+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:19.744+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:19.744+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Number of indexes: 28
2023-09-12T13:37:19.744+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:19.744+05:30 [Info] Avg Index Size: 16827411621 (15.6717G)
2023-09-12T13:37:19.744+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:19.744+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T13:37:19.744+05:30 [Info] Avg Index Cpu: 1.6429
2023-09-12T13:37:19.744+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:19.744+05:30 [Info] Num Estimation Run: 28
2023-09-12T13:37:19.744+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:19.744+05:30 [Info] CPU Quota 27
2023-09-12T13:37:19.744+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:19.744+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:19.744+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Total iteration: 14086
2023-09-12T13:37:19.744+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:19.744+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:19.744+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:19.744+05:30 [Info] RandomMove time: 228ms
2023-09-12T13:37:19.744+05:30 [Info] RandomMove call: 8599 (empty index 0)
2023-09-12T13:37:19.744+05:30 [Info] RandomMove average time: 26us
2023-09-12T13:37:19.744+05:30 [Info] ExhaustMove time: 9us
2023-09-12T13:37:19.744+05:30 [Info] ExhaustMove call: 1
2023-09-12T13:37:19.744+05:30 [Info] ExhaustMove average time: 9us
2023-09-12T13:37:19.744+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:19.744+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:19.744+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.744+05:30 [Info]
2023-09-12T13:37:19.744+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:19.744+05:30 [Info] Indexer total memory:313015476589 (291.518G), mem:282455091785 (263.057G), overhead:30560384804 (28.4616G), min:45233787480 (42.1272G), data:45233787480 (42.1272G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-12T13:37:19.744+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5471874698199197 allowDDLDuringScaleup:true
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.744+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.744+05:30 [Info]
2023-09-12T13:37:19.744+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:19.744+05:30 [Info] Indexer total memory:111651485977 (103.984G), mem:95320331039 (88.774G), overhead:16331154938 (15.2096G), min:54280544976 (50.5527G), data:54280544976 (50.5527G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-09-12T13:37:19.744+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.346383999407285 allowDDLDuringScaleup:true
2023-09-12T13:37:19.744+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.744+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.744+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info]
2023-09-12T13:37:19.745+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:19.745+05:30 [Info] Indexer total memory:116835336992 (108.811G), mem:93392102572 (86.9782G), overhead:23443234420 (21.8332G), min:45233787480 (42.1272G), data:45233787480 (42.1272G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-12T13:37:19.745+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3064285307727953 allowDDLDuringScaleup:true
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.745+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.745+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1772037066480041327, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.745+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.745+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:19 -------------------------------------------
2023/09/12 13:37:19 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T13:37:19.748+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.35341942609037913
2023-09-12T13:37:19.917+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:19.917+05:30 [Info] Score: 0.11475962811811741
2023-09-12T13:37:19.917+05:30 [Info] variation: 0.22951925623623481
2023-09-12T13:37:19.917+05:30 [Info] ElapsedTime: 168ms
2023-09-12T13:37:19.917+05:30 [Info] ConvergenceTime: 164ms
2023-09-12T13:37:19.917+05:30 [Info] Iteration: 6300
2023-09-12T13:37:19.917+05:30 [Info] Move: 4068
2023-09-12T13:37:19.917+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.917+05:30 [Info] Using SAPlanner
2023-09-12T13:37:19.917+05:30 [Info] Indexer Memory Mean 211591134437 (197.06G)
2023-09-12T13:37:19.917+05:30 [Info] Indexer Memory Deviation 78426288854 (73.0402G) (37.07%)
2023-09-12T13:37:19.917+05:30 [Info] Indexer Memory Utilization 3.8361
2023-09-12T13:37:19.917+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:19.917+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:19.917+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:19.917+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:19.917+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:19.917+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:19.917+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:19.917+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:19.917+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:19.917+05:30 [Info] Indexer Data Size Mean 48064951200 (44.764G)
2023-09-12T13:37:19.917+05:30 [Info] Indexer Data Size Deviation 4248381616 (3.95661G) (8.84%)
2023-09-12T13:37:19.917+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:19.917+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:19.917+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:19.917+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:19.917+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Number of indexes: 28
2023-09-12T13:37:19.918+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:19.918+05:30 [Info] Avg Index Size: 22670478689 (21.1135G)
2023-09-12T13:37:19.918+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:19.918+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-12T13:37:19.918+05:30 [Info] Avg Index Cpu: 1.6429
2023-09-12T13:37:19.918+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:19.918+05:30 [Info] Num Estimation Run: 29
2023-09-12T13:37:19.918+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:19.918+05:30 [Info] CPU Quota 27
2023-09-12T13:37:19.918+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:19.918+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:19.918+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Total iteration: 10344
2023-09-12T13:37:19.918+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:19.918+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:19.918+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:19.918+05:30 [Info] RandomMove time: 46ms
2023-09-12T13:37:19.918+05:30 [Info] RandomMove call: 6298 (empty index 0)
2023-09-12T13:37:19.918+05:30 [Info] RandomMove average time: 7us
2023-09-12T13:37:19.918+05:30 [Info] ExhaustMove time: 32us
2023-09-12T13:37:19.918+05:30 [Info] ExhaustMove call: 3
2023-09-12T13:37:19.918+05:30 [Info] ExhaustMove average time: 10us
2023-09-12T13:37:19.918+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:19.918+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:19.918+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.918+05:30 [Info]
2023-09-12T13:37:19.918+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:19.918+05:30 [Info] Indexer total memory:312842580859 (291.357G), mem:282282196055 (262.896G), overhead:30560384804 (28.4616G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-12T13:37:19.918+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4543185477672772 allowDDLDuringScaleup:true
2023-09-12T13:37:19.918+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.918+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.918+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.918+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.918+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.918+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.918+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.918+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.918+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.918+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.918+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.918+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.918+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.918+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.918+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.918+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.918+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.918+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.918+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.918+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.918+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.918+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.918+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info]
2023-09-12T13:37:19.919+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:19.919+05:30 [Info] Indexer total memory:331915596755 (309.12G), mem:250259822065 (233.073G), overhead:81655774690 (76.0479G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-12T13:37:19.919+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.42405038546912194 allowDDLDuringScaleup:true
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info]
2023-09-12T13:37:19.919+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:19.919+05:30 [Info] Indexer total memory:125674619612 (117.044G), mem:102231385192 (95.2104G), overhead:23443234420 (21.8332G), min:54073070100 (50.3595G), data:54073070100 (50.3595G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-09-12T13:37:19.919+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32163106676360087 allowDDLDuringScaleup:true
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.919+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.919+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.919+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.919+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.920+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.920+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.920+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.920+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.920+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.920+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.920+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.920+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.920+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.920+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.920+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.920+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.920+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.920+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.920+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.920+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:35332375788390946, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.920+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.920+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:19 -------------------------------------------
2023/09/12 13:37:19 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T13:37:19.923+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.07657419497994714
2023-09-12T13:37:19.958+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:19.958+05:30 [Info] Score: 0.14532097559770876
2023-09-12T13:37:19.958+05:30 [Info] variation: 0.2906419511954175
2023-09-12T13:37:19.958+05:30 [Info] ElapsedTime: 35ms
2023-09-12T13:37:19.958+05:30 [Info] ConvergenceTime: 6ms
2023-09-12T13:37:19.958+05:30 [Info] Iteration: 7
2023-09-12T13:37:19.958+05:30 [Info] Move: 7
2023-09-12T13:37:19.958+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Using SAPlanner
2023-09-12T13:37:19.959+05:30 [Info] Indexer Memory Mean 156291089214 (145.557G)
2023-09-12T13:37:19.959+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (58.13%)
2023-09-12T13:37:19.959+05:30 [Info] Indexer Memory Utilization 2.8335
2023-09-12T13:37:19.959+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:19.959+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:19.959+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:19.959+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:19.959+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:19.959+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:19.959+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:19.959+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:19.959+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:19.959+05:30 [Info] Indexer Data Size Mean 47484620728 (44.2235G)
2023-09-12T13:37:19.959+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:19.959+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:19.959+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:19.959+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:19.959+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:19.959+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Number of indexes: 36
2023-09-12T13:37:19.959+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:19.959+05:30 [Info] Avg Index Size: 13024257434 (12.1298G)
2023-09-12T13:37:19.959+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:19.959+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T13:37:19.959+05:30 [Info] Avg Index Cpu: 1.2778
2023-09-12T13:37:19.959+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:19.959+05:30 [Info] Num Estimation Run: 32
2023-09-12T13:37:19.959+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:19.959+05:30 [Info] CPU Quota 27
2023-09-12T13:37:19.959+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:19.959+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:19.959+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Total iteration: 6739
2023-09-12T13:37:19.959+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:19.959+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:19.959+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:19.959+05:30 [Info] RandomMove time: 68us
2023-09-12T13:37:19.959+05:30 [Info] RandomMove call: 6 (empty index 0)
2023-09-12T13:37:19.959+05:30 [Info] RandomMove average time: 11us
2023-09-12T13:37:19.959+05:30 [Info] ExhaustMove time: 19us
2023-09-12T13:37:19.959+05:30 [Info] ExhaustMove call: 1
2023-09-12T13:37:19.959+05:30 [Info] ExhaustMove average time: 19us
2023-09-12T13:37:19.959+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:19.959+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:19.959+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.959+05:30 [Info]
2023-09-12T13:37:19.959+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:19.959+05:30 [Info] Indexer total memory:315266309837 (293.615G), mem:284705925033 (265.153G), overhead:30560384804 (28.4616G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T13:37:19.959+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5643277764120702 allowDDLDuringScaleup:true
2023-09-12T13:37:19.959+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.959+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.959+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.959+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.959+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.959+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.959+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.959+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.959+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.959+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.959+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.959+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.959+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.959+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.959+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.959+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.959+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.959+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.959+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.959+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info]
2023-09-12T13:37:19.960+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:19.960+05:30 [Info] Indexer total memory:104855561729 (97.6544G), mem:88524406791 (82.4448G), overhead:16331154938 (15.2096G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T13:37:19.960+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3132814509590003 allowDDLDuringScaleup:true
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.960+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.960+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.960+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.960+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info]
2023-09-12T13:37:19.961+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:19.961+05:30 [Info] Indexer total memory:119086170240 (110.908G), mem:95642935820 (89.0744G), overhead:23443234420 (21.8332G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T13:37:19.961+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3223907726289295 allowDDLDuringScaleup:true
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.961+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.961+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.961+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.961+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.962+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.962+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.962+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.962+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.962+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:19.962+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:19.962+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:6788950934481727523, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:19.962+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:19.962+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:19 -------------------------------------------
2023/09/12 13:37:19 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T13:37:19.964+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3083980591132722
2023-09-12T13:37:19.999+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:19.999+05:30 [Info] Score: 0.09796819540510597
2023-09-12T13:37:19.999+05:30 [Info] variation: 0.19593639081021194
2023-09-12T13:37:19.999+05:30 [Info] ElapsedTime: 35ms
2023-09-12T13:37:19.999+05:30 [Info] ConvergenceTime: 6ms
2023-09-12T13:37:19.999+05:30 [Info] Iteration: 7
2023-09-12T13:37:19.999+05:30 [Info] Move: 7
2023-09-12T13:37:19.999+05:30 [Info] ----------------------------------------
2023-09-12T13:37:19.999+05:30 [Info] Using SAPlanner
2023-09-12T13:37:19.999+05:30 [Info] Indexer Memory Mean 210829304949 (196.35G)
2023-09-12T13:37:19.999+05:30 [Info] Indexer Memory Deviation 82618266177 (76.9443G) (39.19%)
2023-09-12T13:37:19.999+05:30 [Info] Indexer Memory Utilization 3.8223
2023-09-12T13:37:19.999+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T13:37:19.999+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T13:37:20.000+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T13:37:20.000+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:20.000+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:20.000+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:20.000+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.000+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:20.000+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.000+05:30 [Info] Indexer Data Size Mean 47303121712 (44.0545G)
2023-09-12T13:37:20.000+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:20.000+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:20.000+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.000+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:20.000+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.000+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Number of indexes: 36
2023-09-12T13:37:20.000+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:20.000+05:30 [Info] Avg Index Size: 17569108745 (16.3625G)
2023-09-12T13:37:20.000+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T13:37:20.000+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-12T13:37:20.000+05:30 [Info] Avg Index Cpu: 1.2778
2023-09-12T13:37:20.000+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T13:37:20.000+05:30 [Info] Num Estimation Run: 33
2023-09-12T13:37:20.000+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:20.000+05:30 [Info] CPU Quota 27
2023-09-12T13:37:20.000+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:20.000+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:20.000+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Total iteration: 6772
2023-09-12T13:37:20.000+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:20.000+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:20.000+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:20.000+05:30 [Info] RandomMove time: 55us
2023-09-12T13:37:20.000+05:30 [Info] RandomMove call: 6 (empty index 0)
2023-09-12T13:37:20.000+05:30 [Info] RandomMove average time: 9us
2023-09-12T13:37:20.000+05:30 [Info] ExhaustMove time: 15us
2023-09-12T13:37:20.000+05:30 [Info] ExhaustMove call: 1
2023-09-12T13:37:20.000+05:30 [Info] ExhaustMove average time: 15us
2023-09-12T13:37:20.000+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:20.000+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:20.000+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.000+05:30 [Info]
2023-09-12T13:37:20.000+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T13:37:20.000+05:30 [Info] Indexer total memory:315084810821 (293.446G), mem:284524426017 (264.984G), overhead:30560384804 (28.4616G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T13:37:20.000+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4699097510048492 allowDDLDuringScaleup:true
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.000+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.000+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.000+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.000+05:30 [Info]
2023-09-12T13:37:20.000+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T13:37:20.000+05:30 [Info] Indexer total memory:334157826717 (311.209G), mem:252502052027 (235.161G), overhead:81655774690 (76.0479G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T13:37:20.001+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43953221501885753 allowDDLDuringScaleup:true
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info]
2023-09-12T13:37:20.001+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T13:37:20.001+05:30 [Info] Indexer total memory:118904671224 (110.739G), mem:95461436804 (88.9054G), overhead:23443234420 (21.8332G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T13:37:20.001+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.29055803397629315 allowDDLDuringScaleup:true
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.001+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.001+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.001+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.001+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.002+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.002+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.002+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.002+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.002+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.002+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.002+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.002+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.002+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.002+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1724079289344591214, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.002+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.002+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/CommandRepair
2023/09/12 13:37:20 -------------------------------------------
2023/09/12 13:37:20 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T13:37:20.003+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T13:37:20.003+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-12T13:37:20.003+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-09-12T13:37:20.003+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-09-12T13:37:20.003+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-12T13:37:20.003+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-09-12T13:37:20.003+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-09-12T13:37:20.003+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:20.003+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:20.003+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=136us
2023-09-12T13:37:20.003+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-09-12T13:37:20.003+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-09-12T13:37:20.003+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:20.003+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:20.003+05:30 [Info] Score: 0.22489777375378742
2023-09-12T13:37:20.003+05:30 [Info] variation: 0.8995910950151497
2023-09-12T13:37:20.003+05:30 [Info] ElapsedTime: 73us
2023-09-12T13:37:20.003+05:30 [Info] ConvergenceTime: 2us
2023-09-12T13:37:20.003+05:30 [Info] Iteration: 0
2023-09-12T13:37:20.003+05:30 [Info] Move: 0
2023-09-12T13:37:20.003+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.003+05:30 [Info] Using SAPlanner
2023-09-12T13:37:20.003+05:30 [Info] Indexer Memory Mean 122486397174 (114.074G)
2023-09-12T13:37:20.003+05:30 [Info] Indexer Memory Deviation 110187672158 (102.62G) (89.96%)
2023-09-12T13:37:20.003+05:30 [Info] Indexer Memory Utilization 2.2206
2023-09-12T13:37:20.003+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:20.003+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:20.003+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:20.003+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:20.003+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:20.003+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:20.003+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.003+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:20.003+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.003+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T13:37:20.003+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:20.003+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:20.003+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.003+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:20.003+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.003+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.003+05:30 [Info] Number of indexes: 4
2023-09-12T13:37:20.003+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:20.003+05:30 [Info] Avg Index Size: 91864797880 (85.5558G)
2023-09-12T13:37:20.003+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-12T13:37:20.003+05:30 [Info] Max Indexer Overhead: 46891539742 (43.6711G)
2023-09-12T13:37:20.003+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-12T13:37:20.003+05:30 [Info] Max Index Cpu: 0.0000
2023-09-12T13:37:20.003+05:30 [Info] Num Estimation Run: 0
2023-09-12T13:37:20.003+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.003+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:20.003+05:30 [Info] CPU Quota 27
2023-09-12T13:37:20.003+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:20.003+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:20.003+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.003+05:30 [Info] Total iteration: 0
2023-09-12T13:37:20.003+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:20.003+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:20.003+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:20.003+05:30 [Info] RandomMove time: 0ns
2023-09-12T13:37:20.003+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T13:37:20.003+05:30 [Info] ExhaustMove time: 0ns
2023-09-12T13:37:20.004+05:30 [Info] ExhaustMove call: 0
2023-09-12T13:37:20.004+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:20.004+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:20.004+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.004+05:30 [Info]
2023-09-12T13:37:20.004+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-12T13:37:20.004+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:20.004+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.45435427408637796 allowDDLDuringScaleup:true
2023-09-12T13:37:20.004+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.004+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.004+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.004+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.004+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.004+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:4633147835030083150, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.004+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.004+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.004+05:30 [Info]
2023-09-12T13:37:20.004+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-12T13:37:20.004+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:20.004+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.06701117350131312 allowDDLDuringScaleup:true
2023-09-12T13:37:20.004+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.004+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.004+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.004+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.004+05:30 [Info]
2023-09-12T13:37:20.004+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-12T13:37:20.004+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:20.004+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0786345524123089 allowDDLDuringScaleup:true
2023-09-12T13:37:20.004+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.004+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.004+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.004+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:20 -------------------------------------------
2023/09/12 13:37:20 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T13:37:20.004+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-12T13:37:20.004+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:20.004+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-12T13:37:20.004+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=4us
2023-09-12T13:37:20.004+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-12T13:37:20.004+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-09-12T13:37:20.004+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=6us
2023-09-12T13:37:20.004+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-09-12T13:37:20.004+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-09-12T13:37:20.004+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:20.004+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:20.004+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=124us
2023-09-12T13:37:20.005+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T13:37:20.005+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-09-12T13:37:20.005+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-09-12T13:37:20.005+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:20.005+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:20.005+05:30 [Info] Score: 0.019876174419669376
2023-09-12T13:37:20.005+05:30 [Info] variation: 0.0795046976786775
2023-09-12T13:37:20.005+05:30 [Info] ElapsedTime: 73us
2023-09-12T13:37:20.005+05:30 [Info] ConvergenceTime: 2us
2023-09-12T13:37:20.005+05:30 [Info] Iteration: 0
2023-09-12T13:37:20.005+05:30 [Info] Move: 0
2023-09-12T13:37:20.005+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Using SAPlanner
2023-09-12T13:37:20.005+05:30 [Info] Indexer Memory Mean 266954004690 (248.62G)
2023-09-12T13:37:20.005+05:30 [Info] Indexer Memory Deviation 21224097436 (19.7665G) (7.95%)
2023-09-12T13:37:20.005+05:30 [Info] Indexer Memory Utilization 4.8398
2023-09-12T13:37:20.005+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:20.005+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:20.005+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:20.005+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:20.005+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:20.005+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:20.005+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.005+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:20.005+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.005+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T13:37:20.005+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:20.005+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:20.005+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.005+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:20.005+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.005+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Number of indexes: 5
2023-09-12T13:37:20.005+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:20.005+05:30 [Info] Avg Index Size: 160172402814 (149.172G)
2023-09-12T13:37:20.005+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-12T13:37:20.005+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-09-12T13:37:20.005+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-12T13:37:20.005+05:30 [Info] Max Index Cpu: 0.0000
2023-09-12T13:37:20.005+05:30 [Info] Num Estimation Run: 0
2023-09-12T13:37:20.005+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:20.005+05:30 [Info] CPU Quota 27
2023-09-12T13:37:20.005+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:20.005+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:20.005+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Total iteration: 0
2023-09-12T13:37:20.005+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:20.005+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:20.005+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:20.005+05:30 [Info] RandomMove time: 0ns
2023-09-12T13:37:20.005+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T13:37:20.005+05:30 [Info] ExhaustMove time: 0ns
2023-09-12T13:37:20.005+05:30 [Info] ExhaustMove call: 0
2023-09-12T13:37:20.005+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:20.005+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:20.005+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.005+05:30 [Info]
2023-09-12T13:37:20.005+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-12T13:37:20.005+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:20.005+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1777244769790758 allowDDLDuringScaleup:true
2023-09-12T13:37:20.005+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.005+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.005+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.005+05:30 [Info]
2023-09-12T13:37:20.005+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-12T13:37:20.005+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:20.005+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.20847118640616036 allowDDLDuringScaleup:true
2023-09-12T13:37:20.005+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.005+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.005+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.005+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:8642848787241027909, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.005+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.005+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.005+05:30 [Info]
2023-09-12T13:37:20.005+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-12T13:37:20.005+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:20.005+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2138043366147638 allowDDLDuringScaleup:true
2023-09-12T13:37:20.005+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.005+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.005+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.005+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.005+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:2937430067848325497, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.005+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.005+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:20 -------------------------------------------
2023/09/12 13:37:20 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T13:37:20.006+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T13:37:20.006+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-12T13:37:20.006+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-09-12T13:37:20.006+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-09-12T13:37:20.006+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-12T13:37:20.006+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-09-12T13:37:20.006+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-09-12T13:37:20.006+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:20.006+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:20.006+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=163us
2023-09-12T13:37:20.006+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-09-12T13:37:20.006+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-09-12T13:37:20.006+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:20.007+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:20.007+05:30 [Info] Score: 0.17469212089072378
2023-09-12T13:37:20.007+05:30 [Info] variation: 0.6987684835628951
2023-09-12T13:37:20.007+05:30 [Info] ElapsedTime: 105us
2023-09-12T13:37:20.007+05:30 [Info] ConvergenceTime: 2us
2023-09-12T13:37:20.007+05:30 [Info] Iteration: 0
2023-09-12T13:37:20.007+05:30 [Info] Move: 0
2023-09-12T13:37:20.007+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.007+05:30 [Info] Using SAPlanner
2023-09-12T13:37:20.007+05:30 [Info] Indexer Memory Mean 231925826675 (215.998G)
2023-09-12T13:37:20.007+05:30 [Info] Indexer Memory Deviation 162062458205 (150.932G) (69.88%)
2023-09-12T13:37:20.007+05:30 [Info] Indexer Memory Utilization 4.2047
2023-09-12T13:37:20.007+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:20.007+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:20.007+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:20.007+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:20.007+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:20.007+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:20.007+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.007+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:20.007+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.007+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T13:37:20.007+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:20.007+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:20.007+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.007+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:20.007+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.007+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.007+05:30 [Info] Number of indexes: 4
2023-09-12T13:37:20.007+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:20.007+05:30 [Info] Avg Index Size: 173944370006 (161.998G)
2023-09-12T13:37:20.007+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-12T13:37:20.007+05:30 [Info] Max Indexer Overhead: 49341212983 (45.9526G)
2023-09-12T13:37:20.007+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-12T13:37:20.007+05:30 [Info] Max Index Cpu: 0.0000
2023-09-12T13:37:20.007+05:30 [Info] Num Estimation Run: 0
2023-09-12T13:37:20.007+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.007+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:20.007+05:30 [Info] CPU Quota 27
2023-09-12T13:37:20.007+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:20.007+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:20.007+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.007+05:30 [Info] Total iteration: 0
2023-09-12T13:37:20.007+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:20.007+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:20.007+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:20.007+05:30 [Info] RandomMove time: 0ns
2023-09-12T13:37:20.007+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T13:37:20.007+05:30 [Info] ExhaustMove time: 0ns
2023-09-12T13:37:20.007+05:30 [Info] ExhaustMove call: 0
2023-09-12T13:37:20.007+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:20.007+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:20.007+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.007+05:30 [Info]
2023-09-12T13:37:20.007+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-12T13:37:20.007+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:20.007+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.38151873032984485 allowDDLDuringScaleup:true
2023-09-12T13:37:20.007+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.007+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.007+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.007+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.007+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.007+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:12699163103074184580, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.007+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.007+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.007+05:30 [Info]
2023-09-12T13:37:20.007+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-12T13:37:20.007+05:30 [Info] Indexer total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:20.007+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1769522034317959 allowDDLDuringScaleup:true
2023-09-12T13:37:20.007+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.007+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.007+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.007+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.007+05:30 [Info]
2023-09-12T13:37:20.007+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-12T13:37:20.007+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:20.008+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0415290662383593 allowDDLDuringScaleup:true
2023-09-12T13:37:20.008+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.008+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.008+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.008+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 13:37:20 -------------------------------------------
2023/09/12 13:37:20 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T13:37:20.008+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-12T13:37:20.008+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T13:37:20.008+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-12T13:37:20.008+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-09-12T13:37:20.008+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-12T13:37:20.008+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=7us
2023-09-12T13:37:20.008+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=10us
2023-09-12T13:37:20.008+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-09-12T13:37:20.008+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-09-12T13:37:20.008+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:20.008+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:20.008+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=182us
2023-09-12T13:37:20.008+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T13:37:20.008+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-09-12T13:37:20.008+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-09-12T13:37:20.008+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T13:37:20.008+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T13:37:20.008+05:30 [Info] Score: 0.06809310854298714
2023-09-12T13:37:20.008+05:30 [Info] variation: 0.27237243417194856
2023-09-12T13:37:20.008+05:30 [Info] ElapsedTime: 75us
2023-09-12T13:37:20.008+05:30 [Info] ConvergenceTime: 2us
2023-09-12T13:37:20.008+05:30 [Info] Iteration: 0
2023-09-12T13:37:20.008+05:30 [Info] Move: 0
2023-09-12T13:37:20.009+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Using SAPlanner
2023-09-12T13:37:20.009+05:30 [Info] Indexer Memory Mean 321673719440 (299.582G)
2023-09-12T13:37:20.009+05:30 [Info] Indexer Memory Deviation 87615053973 (81.5979G) (27.24%)
2023-09-12T13:37:20.009+05:30 [Info] Indexer Memory Utilization 5.8318
2023-09-12T13:37:20.009+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T13:37:20.009+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T13:37:20.009+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T13:37:20.009+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T13:37:20.009+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T13:37:20.009+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T13:37:20.009+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.009+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T13:37:20.009+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T13:37:20.009+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T13:37:20.009+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T13:37:20.009+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T13:37:20.009+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.009+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T13:37:20.009+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T13:37:20.009+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Number of indexes: 5
2023-09-12T13:37:20.009+05:30 [Info] Number of indexers: 3
2023-09-12T13:37:20.009+05:30 [Info] Avg Index Size: 193004231664 (179.749G)
2023-09-12T13:37:20.009+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-12T13:37:20.009+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-09-12T13:37:20.009+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-12T13:37:20.009+05:30 [Info] Max Index Cpu: 0.0000
2023-09-12T13:37:20.009+05:30 [Info] Num Estimation Run: 0
2023-09-12T13:37:20.009+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T13:37:20.009+05:30 [Info] CPU Quota 27
2023-09-12T13:37:20.009+05:30 [Info] Max Cpu Utilization -1
2023-09-12T13:37:20.009+05:30 [Info] Max Memory Utilization -1
2023-09-12T13:37:20.009+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Total iteration: 0
2023-09-12T13:37:20.009+05:30 [Info] RandomSwap time: 0ns
2023-09-12T13:37:20.009+05:30 [Info] RandomSwap call: 0
2023-09-12T13:37:20.009+05:30 [Info] RandomSwap iteration: 0
2023-09-12T13:37:20.009+05:30 [Info] RandomMove time: 0ns
2023-09-12T13:37:20.009+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T13:37:20.009+05:30 [Info] ExhaustMove time: 0ns
2023-09-12T13:37:20.009+05:30 [Info] ExhaustMove call: 0
2023-09-12T13:37:20.009+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T13:37:20.009+05:30 [Info] ExhaustSwap call: 0
2023-09-12T13:37:20.009+05:30 [Info] ----------------------------------------
2023-09-12T13:37:20.009+05:30 [Info]
2023-09-12T13:37:20.009+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-12T13:37:20.009+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T13:37:20.009+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.14749187761902688 allowDDLDuringScaleup:true
2023-09-12T13:37:20.009+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.009+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.009+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.009+05:30 [Info]
2023-09-12T13:37:20.009+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-12T13:37:20.009+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:20.009+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.2750739074297335 allowDDLDuringScaleup:true
2023-09-12T13:37:20.009+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.009+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.009+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.009+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:15571212243250115151, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.009+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.009+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.009+05:30 [Info]
2023-09-12T13:37:20.009+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-12T13:37:20.009+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T13:37:20.009+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.17743421495123962 allowDDLDuringScaleup:true
2023-09-12T13:37:20.009+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.009+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.009+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T13:37:20.009+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T13:37:20.009+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:9891427849717996348, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T13:37:20.009+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T13:37:20.009+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
--- PASS: TestPlanDuringHeterogenousScaleup (1.57s)
--- PASS: TestPlanDuringHeterogenousScaleup/GreedyPlanner (0.02s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner (1.55s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests (0.43s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex (1.12s)
--- PASS: TestPlanDuringHeterogenousScaleup/CommandRepair (0.01s)
=== RUN TestRestfulAPI
2023/09/12 13:37:20 In TestRestfulAPI()
2023/09/12 13:37:20 In DropAllSecondaryIndexes()
2023/09/12 13:37:20 Index found: indexmut_1
2023/09/12 13:37:20 Dropped index indexmut_1
2023/09/12 13:37:20 Setting JSON docs in KV
2023/09/12 13:37:20 GET all indexes
2023/09/12 13:37:20 200 OK
2023/09/12 13:37:20 FOUND indexes: []
2023/09/12 13:37:20 DROP index: badindexid
2023/09/12 13:37:20 status: 400 Bad Request
2023/09/12 13:37:20 DROP index: 23544142
2023/09/12 13:37:21 status: 500 Internal Server Error
2023/09/12 13:37:21 TEST: malformed body
2023/09/12 13:37:21 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"
2023/09/12 13:37:21 TEST: missing field ``name``
2023/09/12 13:37:21 400 Bad Request "missing field name"
2023/09/12 13:37:21 TEST: empty field ``name``
2023/09/12 13:37:21 400 Bad Request "empty field name"
2023/09/12 13:37:21 TEST: missing field ``bucket``
2023/09/12 13:37:21 400 Bad Request "missing field bucket"
2023/09/12 13:37:21 TEST: empty field ``bucket``
2023/09/12 13:37:21 400 Bad Request "empty field bucket"
2023/09/12 13:37:21 TEST: missing field ``secExprs``
2023/09/12 13:37:21 400 Bad Request "missing field secExprs"
2023/09/12 13:37:21 TEST: empty field ``secExprs``
2023/09/12 13:37:21 400 Bad Request "empty field secExprs"
2023/09/12 13:37:21 TEST: incomplete field ``desc``
2023/09/12 13:37:21 400 Bad Request "incomplete desc information [true]"
2023/09/12 13:37:21 TEST: invalid field ``desc``
2023/09/12 13:37:21 400 Bad Request "incomplete desc information [1]"
2023/09/12 13:37:21
2023/09/12 13:37:21 CREATE INDEX: idx1
2023/09/12 13:37:33 status : 201 Created
2023/09/12 13:37:33 {"id": "14654009192972143932"}
2023/09/12 13:37:33 CREATE INDEX: idx2 (defer)
2023/09/12 13:37:33 status : 201 Created
2023/09/12 13:37:33 {"id": "339728723423335051"}
2023/09/12 13:37:33 CREATE INDEX: idx3 (defer)
2023/09/12 13:37:33 status : 201 Created
2023/09/12 13:37:33 {"id": "1897728339023262074"}
2023/09/12 13:37:33 CREATE INDEX: idx4 (defer)
2023/09/12 13:37:33 status : 201 Created
2023/09/12 13:37:33 {"id": "8437628451622334563"}
2023/09/12 13:37:33 CREATE INDEX: idx5
2023/09/12 13:37:46 status : 201 Created
2023/09/12 13:37:46 {"id": "1215052923873087820"}
2023/09/12 13:37:46 BUILD single deferred index
2023/09/12 13:37:46 202 Accepted
2023/09/12 13:37:46 GET all indexes
2023/09/12 13:37:46 200 OK
2023/09/12 13:37:46 index idx1 in INDEX_STATE_ACTIVE
2023/09/12 13:37:46 GET all indexes
2023/09/12 13:37:46 200 OK
2023/09/12 13:37:46 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:47 GET all indexes
2023/09/12 13:37:47 200 OK
2023/09/12 13:37:47 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:48 GET all indexes
2023/09/12 13:37:48 200 OK
2023/09/12 13:37:48 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:49 GET all indexes
2023/09/12 13:37:50 200 OK
2023/09/12 13:37:50 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:51 GET all indexes
2023/09/12 13:37:51 200 OK
2023/09/12 13:37:51 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:52 GET all indexes
2023/09/12 13:37:52 200 OK
2023/09/12 13:37:52 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:53 GET all indexes
2023/09/12 13:37:53 200 OK
2023/09/12 13:37:53 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:54 GET all indexes
2023/09/12 13:37:54 200 OK
2023/09/12 13:37:54 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:55 GET all indexes
2023/09/12 13:37:55 200 OK
2023/09/12 13:37:55 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:56 GET all indexes
2023/09/12 13:37:56 200 OK
2023/09/12 13:37:56 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:57 GET all indexes
2023/09/12 13:37:57 200 OK
2023/09/12 13:37:57 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:58 GET all indexes
2023/09/12 13:37:58 200 OK
2023/09/12 13:37:58 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:37:59 GET all indexes
2023/09/12 13:37:59 200 OK
2023/09/12 13:37:59 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:38:00 GET all indexes
2023/09/12 13:38:00 200 OK
2023/09/12 13:38:00 index idx2 in INDEX_STATE_INITIAL
2023/09/12 13:38:01 GET all indexes
2023/09/12 13:38:01 200 OK
2023/09/12 13:38:01 index idx2 in INDEX_STATE_CATCHUP
2023/09/12 13:38:02 GET all indexes
2023/09/12 13:38:02 200 OK
2023/09/12 13:38:02 index idx2 in INDEX_STATE_ACTIVE
2023/09/12 13:38:02 BUILD many deferred index
2023/09/12 13:38:02 202 Accepted
2023/09/12 13:38:02 GET all indexes
2023/09/12 13:38:02 200 OK
2023/09/12 13:38:02 index idx1 in INDEX_STATE_ACTIVE
2023/09/12 13:38:02 GET all indexes
2023/09/12 13:38:02 200 OK
2023/09/12 13:38:02 index idx2 in INDEX_STATE_ACTIVE
2023/09/12 13:38:02 GET all indexes
2023/09/12 13:38:02 200 OK
2023/09/12 13:38:02 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:03 GET all indexes
2023/09/12 13:38:03 200 OK
2023/09/12 13:38:03 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:04 GET all indexes
2023/09/12 13:38:04 200 OK
2023/09/12 13:38:04 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:05 GET all indexes
2023/09/12 13:38:05 200 OK
2023/09/12 13:38:05 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:06 GET all indexes
2023/09/12 13:38:06 200 OK
2023/09/12 13:38:06 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:07 GET all indexes
2023/09/12 13:38:07 200 OK
2023/09/12 13:38:07 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:08 GET all indexes
2023/09/12 13:38:08 200 OK
2023/09/12 13:38:08 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:09 GET all indexes
2023/09/12 13:38:09 200 OK
2023/09/12 13:38:09 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:10 GET all indexes
2023/09/12 13:38:10 200 OK
2023/09/12 13:38:10 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:12 GET all indexes
2023/09/12 13:38:12 200 OK
2023/09/12 13:38:12 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:13 GET all indexes
2023/09/12 13:38:13 200 OK
2023/09/12 13:38:13 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:14 GET all indexes
2023/09/12 13:38:14 200 OK
2023/09/12 13:38:14 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:15 GET all indexes
2023/09/12 13:38:15 200 OK
2023/09/12 13:38:15 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:16 GET all indexes
2023/09/12 13:38:16 200 OK
2023/09/12 13:38:16 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:17 GET all indexes
2023/09/12 13:38:17 200 OK
2023/09/12 13:38:17 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:18 GET all indexes
2023/09/12 13:38:18 200 OK
2023/09/12 13:38:18 index idx3 in INDEX_STATE_INITIAL
2023/09/12 13:38:19 GET all indexes
2023/09/12 13:38:19 200 OK
2023/09/12 13:38:19 index idx3 in INDEX_STATE_ACTIVE
2023/09/12 13:38:19 GET all indexes
2023/09/12 13:38:19 200 OK
2023/09/12 13:38:19 index idx4 in INDEX_STATE_ACTIVE
2023/09/12 13:38:19 GET all indexes
2023/09/12 13:38:19 200 OK
2023/09/12 13:38:19 index idx5 in INDEX_STATE_ACTIVE
2023/09/12 13:38:19 GET all indexes
2023/09/12 13:38:19 200 OK
2023/09/12 13:38:19 CREATED indexes: [14654009192972143932 339728723423335051 1897728339023262074 8437628451622334563 1215052923873087820]
2023/09/12 13:38:19
2023/09/12 13:38:19 LOOKUP missing index
2023/09/12 13:38:19 status : 404 Not Found
2023/09/12 13:38:19 LOOKUP Pyongyang
2023/09/12 13:38:19 status : 200 OK
2023/09/12 13:38:19 number of entries 554
2023/09/12 13:38:19 Expected and Actual scan responses are the same
2023/09/12 13:38:19 LOOKUP with stale as false
2023/09/12 13:38:19 status : 200 OK
2023/09/12 13:38:19 number of entries 554
2023/09/12 13:38:19 Expected and Actual scan responses are the same
2023/09/12 13:38:19 LOOKUP with Rome
2023/09/12 13:38:19 status : 200 OK
2023/09/12 13:38:19 number of entries 540
2023/09/12 13:38:20 Expected and Actual scan responses are the same
2023/09/12 13:38:20 RANGE missing index
2023/09/12 13:38:20 Status : 404 Not Found
2023/09/12 13:38:20 RANGE cities - none
2023/09/12 13:38:20 Status : 200 OK
2023/09/12 13:38:24 number of entries 140902
2023/09/12 13:38:26 Expected and Actual scan responses are the same
2023/09/12 13:38:26 RANGE cities -low
2023/09/12 13:38:26 Status : 200 OK
2023/09/12 13:38:30 number of entries 140902
2023/09/12 13:38:31 Expected and Actual scan responses are the same
2023/09/12 13:38:31 RANGE cities -high
2023/09/12 13:38:31 Status : 200 OK
2023/09/12 13:38:36 number of entries 140902
2023/09/12 13:38:37 Expected and Actual scan responses are the same
2023/09/12 13:38:37 RANGE cities - both
2023/09/12 13:38:37 Status : 200 OK
2023/09/12 13:38:41 number of entries 140902
2023/09/12 13:38:42 Expected and Actual scan responses are the same
2023/09/12 13:38:42 RANGE missing cities
2023/09/12 13:38:42 Status : 200 OK
2023/09/12 13:38:42 number of entries 0
2023/09/12 13:38:42 Expected and Actual scan responses are the same
2023/09/12 13:38:42
2023/09/12 13:38:42 SCANALL missing index
2023/09/12 13:38:42 {"limit":1000000,"stale":"ok"}
2023/09/12 13:38:42 Status : 404 Not Found
2023/09/12 13:38:42 SCANALL stale ok
2023/09/12 13:38:42 {"limit":1000000,"stale":"ok"}
2023/09/12 13:38:42 Status : 200 OK
2023/09/12 13:38:47 number of entries 140902
2023/09/12 13:38:48 Expected and Actual scan responses are the same
2023/09/12 13:38:48 SCANALL stale false
2023/09/12 13:38:48 {"limit":1000000,"stale":"false"}
2023/09/12 13:38:48 Status : 200 OK
2023/09/12 13:38:52 number of entries 140902
2023/09/12 13:38:54 Expected and Actual scan responses are the same
2023/09/12 13:38:54
2023/09/12 13:38:54 COUNT missing index
2023/09/12 13:38:54 Status : 404 Not Found
2023/09/12 13:38:54 COUNT cities - none
2023/09/12 13:38:54 Status : 200 OK
2023/09/12 13:38:54 number of entries 140902
2023/09/12 13:38:54 COUNT cities -low
2023/09/12 13:38:54 Status : 200 OK
2023/09/12 13:38:54 number of entries 140902
2023/09/12 13:38:55 COUNT cities -high
2023/09/12 13:38:55 Status : 200 OK
2023/09/12 13:38:55 number of entries 140902
2023/09/12 13:38:55 COUNT cities - both
2023/09/12 13:38:55 Status : 200 OK
2023/09/12 13:38:55 number of entries 140902
2023/09/12 13:38:55 COUNT missing cities
2023/09/12 13:38:55 Status : 200 OK
2023/09/12 13:38:55 number of entries 0
2023/09/12 13:38:55
2023/09/12 13:38:57 STATS: Testing URLs with valid authentication
2023/09/12 13:38:57 STATS: Testing URLs with invalid authentication
2023/09/12 13:38:57 STATS: Testing invalid URLs
2023/09/12 13:38:57 STATS: Testing unsupported methods
2023/09/12 13:38:57
--- PASS: TestRestfulAPI (97.24s)
=== RUN TestStatIndexInstFilter
2023/09/12 13:38:57 CREATE INDEX: statIdx1
2023/09/12 13:39:10 status : 201 Created
2023/09/12 13:39:10 {"id": "17629503919203517233"}
2023/09/12 13:39:10 CREATE INDEX: statIdx2
2023/09/12 13:39:24 status : 201 Created
2023/09/12 13:39:24 {"id": "2455931662630617981"}
2023/09/12 13:39:24 Instance Id for statIdx2 is 8458597105947948506, common.IndexInstId
--- PASS: TestStatIndexInstFilter (27.30s)
=== RUN TestBucketDefaultDelete
2023-09-12T13:39:24.715+05:30 [Warn] Client:runObserveStreamingEndpoint streaming endpoint for /pools/default/bs/default returned err EOF
2023-09-12T13:39:24.715+05:30 [Warn] serviceChangeNotifier: Connection terminated for collection manifest notifier instance of http://%40query@127.0.0.1:9000-default, bucket: default, (EOF)
2023/09/12 13:39:26 Deleted bucket default, responseBody:
2023/09/12 13:39:41 Created bucket default, responseBody:
2023/09/12 13:39:58 Populating the default bucket
2023/09/12 13:40:05 Using n1ql client
2023-09-12T13:40:05.880+05:30 [Info] GSIC[default/default-_default-_default-1694506205877799205] started ...
2023/09/12 13:40:05 Scan failed as expected with error: Index Not Found - cause: GSI index index_isActive not found.
2023/09/12 13:40:05 Populating the default bucket after it was deleted
2023/09/12 13:40:15 Created the secondary index index_isActive. Waiting for it become active
2023/09/12 13:40:15 Index is 7106962999810610897 now active
2023/09/12 13:40:15 Using n1ql client
2023/09/12 13:40:15 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (50.72s)
=== RUN TestMixedDatatypesScanAll
2023/09/12 13:40:15 In TestMixedDatatypesScanAll()
2023/09/12 13:40:15 Before test begin: Length of kv docs is 10002
2023/09/12 13:40:15 In DropAllSecondaryIndexes()
2023/09/12 13:40:15 Index found: index_isActive
2023/09/12 13:40:15 Dropped index index_isActive
2023/09/12 13:40:15 Number of number fields is: 285
2023/09/12 13:40:15 Number of string fields is: 233
2023/09/12 13:40:15 Number of json fields is: 255
2023/09/12 13:40:15 Number of true bool fields is: 111
2023/09/12 13:40:15 Number of false bool fields is: 116
2023/09/12 13:40:15 After generate docs: Length of kv docs is 11002
2023/09/12 13:40:15 Setting mixed datatypes JSON docs in KV
2023/09/12 13:40:20 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 13:40:20 Index is 5550751380665540829 now active
2023/09/12 13:40:20 Using n1ql client
2023/09/12 13:40:20 Expected and Actual scan responses are the same
2023/09/12 13:40:20 Lengths of expected and actual scan results are: 1000 and 1000
2023/09/12 13:40:20 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (5.48s)
=== RUN TestMixedDatatypesRange_Float
2023/09/12 13:40:20 In TestMixedDatatypesRange_Float()
2023/09/12 13:40:20 In DropAllSecondaryIndexes()
2023/09/12 13:40:20 Index found: index_mixeddt
2023/09/12 13:40:20 Dropped index index_mixeddt
2023/09/12 13:40:21 Number of number fields is: 252
2023/09/12 13:40:21 Number of string fields is: 241
2023/09/12 13:40:21 Number of json fields is: 243
2023/09/12 13:40:21 Number of true bool fields is: 139
2023/09/12 13:40:21 Number of false bool fields is: 125
2023/09/12 13:40:21 Setting mixed datatypes JSON docs in KV
2023/09/12 13:40:26 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 13:40:26 Index is 5291183428407029362 now active
2023/09/12 13:40:26 Using n1ql client
2023/09/12 13:40:26 Expected and Actual scan responses are the same
2023/09/12 13:40:26 Lengths of expected and actual scan results are: 22 and 22
2023/09/12 13:40:26 Using n1ql client
2023/09/12 13:40:26 Expected and Actual scan responses are the same
2023/09/12 13:40:26 Lengths of expected and actual scan results are: 0 and 0
2023/09/12 13:40:26 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (5.83s)
=== RUN TestMixedDatatypesRange_String
2023/09/12 13:40:26 In TestMixedDatatypesRange_String()
2023/09/12 13:40:26 In DropAllSecondaryIndexes()
2023/09/12 13:40:26 Index found: index_mixeddt
2023/09/12 13:40:26 Dropped index index_mixeddt
2023/09/12 13:40:26 Number of number fields is: 247
2023/09/12 13:40:26 Number of string fields is: 254
2023/09/12 13:40:26 Number of json fields is: 246
2023/09/12 13:40:26 Number of true bool fields is: 129
2023/09/12 13:40:26 Number of false bool fields is: 124
2023/09/12 13:40:26 Setting mixed datatypes JSON docs in KV
2023/09/12 13:40:31 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 13:40:31 Index is 980512415208233721 now active
2023/09/12 13:40:31 Using n1ql client
2023/09/12 13:40:32 Expected and Actual scan responses are the same
2023/09/12 13:40:32 Lengths of expected and actual scan results are: 192 and 192
2023/09/12 13:40:32 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (5.43s)
=== RUN TestMixedDatatypesRange_Json
2023/09/12 13:40:32 In TestMixedDatatypesRange_Json()
2023/09/12 13:40:32 In DropAllSecondaryIndexes()
2023/09/12 13:40:32 Index found: index_mixeddt
2023/09/12 13:40:32 Dropped index index_mixeddt
2023/09/12 13:40:32 Number of number fields is: 275
2023/09/12 13:40:32 Number of string fields is: 232
2023/09/12 13:40:32 Number of json fields is: 236
2023/09/12 13:40:32 Number of true bool fields is: 132
2023/09/12 13:40:32 Number of false bool fields is: 125
2023/09/12 13:40:32 Setting mixed datatypes JSON docs in KV
2023/09/12 13:40:38 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 13:40:38 Index is 13827811431637723312 now active
2023/09/12 13:40:38 Using n1ql client
2023/09/12 13:40:38 Expected and Actual scan responses are the same
2023/09/12 13:40:38 Lengths of expected and actual scan results are: 725 and 725
2023/09/12 13:40:38 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (6.12s)
=== RUN TestMixedDatatypesScan_Bool
2023/09/12 13:40:38 In TestMixedDatatypesScan_Bool()
2023/09/12 13:40:38 In DropAllSecondaryIndexes()
2023/09/12 13:40:38 Index found: index_mixeddt
2023/09/12 13:40:38 Dropped index index_mixeddt
2023/09/12 13:40:38 Number of number fields is: 243
2023/09/12 13:40:38 Number of string fields is: 245
2023/09/12 13:40:38 Number of json fields is: 254
2023/09/12 13:40:38 Number of true bool fields is: 138
2023/09/12 13:40:38 Number of false bool fields is: 120
2023/09/12 13:40:38 Setting mixed datatypes JSON docs in KV
2023/09/12 13:40:44 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 13:40:44 Index is 7126551984280117713 now active
2023/09/12 13:40:44 Using n1ql client
2023/09/12 13:40:44 Expected and Actual scan responses are the same
2023/09/12 13:40:44 Lengths of expected and actual scan results are: 538 and 538
2023/09/12 13:40:44 Using n1ql client
2023/09/12 13:40:44 Expected and Actual scan responses are the same
2023/09/12 13:40:44 Lengths of expected and actual scan results are: 494 and 494
2023/09/12 13:40:44 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (6.46s)
=== RUN TestLargeSecondaryKeyLength
2023/09/12 13:40:44 In TestLargeSecondaryKeyLength()
2023/09/12 13:40:44 In DropAllSecondaryIndexes()
2023/09/12 13:40:44 Index found: index_mixeddt
2023/09/12 13:40:44 Dropped index index_mixeddt
2023/09/12 13:40:44 Setting JSON docs in KV
2023/09/12 13:40:50 Created the secondary index index_LongSecField. Waiting for it become active
2023/09/12 13:40:50 Index is 649876262733847768 now active
2023/09/12 13:40:50 Using n1ql client
2023/09/12 13:40:50 ScanAll: Lengths of expected and actual scan results are: 1000 and 1000
2023/09/12 13:40:50 Expected and Actual scan responses are the same
2023/09/12 13:40:50 Using n1ql client
2023/09/12 13:40:50 Range: Lengths of expected and actual scan results are: 827 and 827
2023/09/12 13:40:50 Expected and Actual scan responses are the same
2023/09/12 13:40:50 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (6.23s)
=== RUN TestLargePrimaryKeyLength
2023/09/12 13:40:50 In TestLargePrimaryKeyLength()
2023/09/12 13:40:50 In DropAllSecondaryIndexes()
2023/09/12 13:40:50 Index found: index_LongSecField
2023/09/12 13:40:50 Dropped index index_LongSecField
2023/09/12 13:40:51 Setting JSON docs in KV
2023/09/12 13:40:57 Created the secondary index index_LongPrimaryField. Waiting for it become active
2023/09/12 13:40:57 Index is 2563787367362181138 now active
2023/09/12 13:40:57 Using n1ql client
2023/09/12 13:40:57 Lengths of num of docs and scanResults are: 17002 and 17002
2023/09/12 13:40:57 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (6.49s)
=== RUN TestUpdateMutations_DeleteField
2023/09/12 13:40:57 In TestUpdateMutations_DeleteField()
2023/09/12 13:40:57 Setting JSON docs in KV
2023/09/12 13:41:04 Created the secondary index index_bal. Waiting for it become active
2023/09/12 13:41:04 Index is 6927931371118260894 now active
2023/09/12 13:41:04 Using n1ql client
2023/09/12 13:41:05 Expected and Actual scan responses are the same
2023/09/12 13:41:05 Using n1ql client
2023/09/12 13:41:05 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (8.09s)
=== RUN TestUpdateMutations_AddField
2023/09/12 13:41:05 In TestUpdateMutations_AddField()
2023/09/12 13:41:05 Setting JSON docs in KV
2023/09/12 13:41:12 Created the secondary index index_newField. Waiting for it become active
2023/09/12 13:41:12 Index is 10014606355660710222 now active
2023/09/12 13:41:12 Using n1ql client
2023/09/12 13:41:12 Count of scan results before add field mutations: 0
2023/09/12 13:41:12 Expected and Actual scan responses are the same
2023/09/12 13:41:12 Using n1ql client
2023/09/12 13:41:12 Count of scan results after add field mutations: 300
2023/09/12 13:41:12 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (7.34s)
=== RUN TestUpdateMutations_DataTypeChange
2023/09/12 13:41:12 In TestUpdateMutations_DataTypeChange()
2023/09/12 13:41:13 Setting JSON docs in KV
2023/09/12 13:41:20 Created the secondary index index_isUserActive. Waiting for it become active
2023/09/12 13:41:20 Index is 3871880071384678948 now active
2023/09/12 13:41:21 Using n1ql client
2023/09/12 13:41:21 Expected and Actual scan responses are the same
2023/09/12 13:41:21 Using n1ql client
2023/09/12 13:41:21 Expected and Actual scan responses are the same
2023/09/12 13:41:21 Using n1ql client
2023/09/12 13:41:21 Expected and Actual scan responses are the same
2023/09/12 13:41:21 Using n1ql client
2023/09/12 13:41:21 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (8.75s)
=== RUN TestMultipleBuckets
2023/09/12 13:41:21 In TestMultipleBuckets()
2023/09/12 13:41:21 In DropAllSecondaryIndexes()
2023/09/12 13:41:21 Index found: index_LongPrimaryField
2023/09/12 13:41:21 Dropped index index_LongPrimaryField
2023/09/12 13:41:21 Index found: index_bal
2023/09/12 13:41:21 Dropped index index_bal
2023/09/12 13:41:21 Index found: index_isUserActive
2023/09/12 13:41:21 Dropped index index_isUserActive
2023/09/12 13:41:21 Index found: index_newField
2023/09/12 13:41:21 Dropped index index_newField
2023/09/12 13:42:00 Flushed the bucket default, Response body:
2023/09/12 13:42:03 Modified parameters of bucket default, responseBody:
2023/09/12 13:42:03 Created bucket testbucket2, responseBody:
2023/09/12 13:42:03 Created bucket testbucket3, responseBody:
2023/09/12 13:42:03 Created bucket testbucket4, responseBody:
2023/09/12 13:42:18 Generating docs and Populating all the buckets
2023/09/12 13:42:22 Created the secondary index bucket1_age. Waiting for it become active
2023/09/12 13:42:22 Index is 15625040734742603446 now active
2023/09/12 13:42:28 Created the secondary index bucket2_city. Waiting for it become active
2023/09/12 13:42:28 Index is 12727551714524941628 now active
2023/09/12 13:42:34 Created the secondary index bucket3_gender. Waiting for it become active
2023/09/12 13:42:34 Index is 7606374950988069885 now active
2023/09/12 13:42:41 Created the secondary index bucket4_balance. Waiting for it become active
2023/09/12 13:42:41 Index is 6148636852566279395 now active
2023/09/12 13:42:44 Using n1ql client
2023/09/12 13:42:44 Expected and Actual scan responses are the same
2023/09/12 13:42:44 Using n1ql client
2023-09-12T13:42:44.239+05:30 [Info] GSIC[default/testbucket2-_default-_default-1694506364236665152] started ...
2023/09/12 13:42:44 Expected and Actual scan responses are the same
2023/09/12 13:42:44 Using n1ql client
2023-09-12T13:42:44.262+05:30 [Info] GSIC[default/testbucket3-_default-_default-1694506364257105152] started ...
2023/09/12 13:42:44 Expected and Actual scan responses are the same
2023/09/12 13:42:44 Using n1ql client
2023-09-12T13:42:44.277+05:30 [Info] GSIC[default/testbucket4-_default-_default-1694506364274170346] started ...
2023/09/12 13:42:44 Expected and Actual scan responses are the same
2023/09/12 13:42:46 Deleted bucket testbucket2, responseBody:
2023/09/12 13:42:49 Deleted bucket testbucket3, responseBody:
2023/09/12 13:42:51 Deleted bucket testbucket4, responseBody:
2023/09/12 13:42:54 Modified parameters of bucket default, responseBody:
--- PASS: TestMultipleBuckets (108.47s)
=== RUN TestBucketFlush
2023/09/12 13:43:09 In TestBucketFlush()
2023/09/12 13:43:09 In DropAllSecondaryIndexes()
2023/09/12 13:43:09 Index found: bucket1_age
2023/09/12 13:43:10 Dropped index bucket1_age
2023/09/12 13:43:48 Flushed the bucket default, Response body:
2023/09/12 13:43:52 Created the secondary index index_age. Waiting for it become active
2023/09/12 13:43:52 Index is 12110539742730539875 now active
2023/09/12 13:43:52 Using n1ql client
2023/09/12 13:43:52 Expected and Actual scan responses are the same
2023/09/12 13:43:58 Created the secondary index index_gender. Waiting for it become active
2023/09/12 13:43:58 Index is 17027144830254180919 now active
2023/09/12 13:43:58 Using n1ql client
2023/09/12 13:43:58 Expected and Actual scan responses are the same
2023/09/12 13:44:04 Created the secondary index index_city. Waiting for it become active
2023/09/12 13:44:04 Index is 9927536227102643680 now active
2023/09/12 13:44:04 Using n1ql client
2023/09/12 13:44:05 Expected and Actual scan responses are the same
2023/09/12 13:44:43 Flushed the bucket default, Response body:
2023/09/12 13:44:43 TestBucketFlush:: Flushed the bucket
2023/09/12 13:44:43 Using n1ql client
2023/09/12 13:44:43 Using n1ql client
2023/09/12 13:44:43 Using n1ql client
--- PASS: TestBucketFlush (93.94s)
=== RUN TestLargeDocumentSize
2023/09/12 13:44:43 In TestLargeDocumentSize()
2023/09/12 13:44:43 Data file exists. Skipping download
2023/09/12 13:44:43 Length of docs and largeDocs = 200 and 200
2023/09/12 13:44:48 Created the secondary index index_userscreenname. Waiting for it become active
2023/09/12 13:44:48 Index is 5868142395731319524 now active
2023/09/12 13:44:48 Using n1ql client
2023/09/12 13:44:48 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (4.42s)
=== RUN TestFieldsWithSpecialCharacters
2023/09/12 13:44:48 In TestFieldsWithSpecialCharacters()
2023/09/12 13:44:54 Created the secondary index index_specialchar. Waiting for it become active
2023/09/12 13:44:54 Index is 9249352817814027396 now active
2023/09/12 13:44:54 Looking up for value †w€Š#yß
2023/09/12 13:44:54 Using n1ql client
2023/09/12 13:44:54 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (6.64s)
=== RUN TestLargeKeyLookup
2023/09/12 13:44:54 In TestLargeKeyLookup()
2023/09/12 13:45:02 Created the secondary index index_largeKeyLookup. Waiting for it become active
2023/09/12 13:45:02 Index is 122697961804387857 now active
2023/09/12 13:45:02 Looking up for a large key
2023/09/12 13:45:02 Using n1ql client
2023/09/12 13:45:02 Expected and Actual scan responses are the same
--- PASS: TestLargeKeyLookup (7.49s)
=== RUN TestIndexNameValidation
2023/09/12 13:45:02 In TestIndexNameValidation()
2023/09/12 13:45:02 Setting JSON docs in KV
2023/09/12 13:45:03 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected
2023/09/12 13:45:09 Created the secondary index #primary-Index_test. Waiting for it become active
2023/09/12 13:45:09 Index is 2814878998125458711 now active
2023/09/12 13:45:09 Using n1ql client
2023/09/12 13:45:09 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (6.75s)
=== RUN TestSameFieldNameAtDifferentLevels
2023/09/12 13:45:09 In TestSameFieldNameAtDifferentLevels()
2023/09/12 13:45:09 Setting JSON docs in KV
2023/09/12 13:45:16 Created the secondary index cityindex. Waiting for it become active
2023/09/12 13:45:16 Index is 2310551905089986639 now active
2023/09/12 13:45:16 Using n1ql client
2023/09/12 13:45:17 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (8.01s)
=== RUN TestSameIndexNameInTwoBuckets
2023/09/12 13:45:17 In TestSameIndexNameInTwoBuckets()
2023/09/12 13:45:17 In DropAllSecondaryIndexes()
2023/09/12 13:45:17 Index found: index_largeKeyLookup
2023/09/12 13:45:17 Dropped index index_largeKeyLookup
2023/09/12 13:45:17 Index found: #primary-Index_test
2023/09/12 13:45:17 Dropped index #primary-Index_test
2023/09/12 13:45:17 Index found: index_city
2023/09/12 13:45:17 Dropped index index_city
2023/09/12 13:45:17 Index found: index_userscreenname
2023/09/12 13:45:17 Dropped index index_userscreenname
2023/09/12 13:45:17 Index found: index_specialchar
2023/09/12 13:45:17 Dropped index index_specialchar
2023/09/12 13:45:17 Index found: index_age
2023/09/12 13:45:17 Dropped index index_age
2023/09/12 13:45:17 Index found: cityindex
2023/09/12 13:45:17 Dropped index cityindex
2023/09/12 13:45:17 Index found: index_gender
2023/09/12 13:45:17 Dropped index index_gender
2023/09/12 13:45:56 Flushed the bucket default, Response body:
2023/09/12 13:45:59 Modified parameters of bucket default, responseBody:
2023/09/12 13:45:59 Created bucket buck2, responseBody:
2023/09/12 13:46:14 Generating docs and Populating all the buckets
2023/09/12 13:46:18 Created the secondary index b_idx. Waiting for it become active
2023/09/12 13:46:18 Index is 13708472742310686829 now active
2023/09/12 13:46:24 Created the secondary index b_idx. Waiting for it become active
2023/09/12 13:46:24 Index is 8742665628105493892 now active
2023/09/12 13:46:27 Using n1ql client
2023/09/12 13:46:27 Expected and Actual scan responses are the same
2023/09/12 13:46:27 Using n1ql client
2023-09-12T13:46:27.665+05:30 [Info] GSIC[default/buck2-_default-_default-1694506587662357743] started ...
2023/09/12 13:46:27 Expected and Actual scan responses are the same
2023/09/12 13:46:30 Modified parameters of bucket default, responseBody:
2023/09/12 13:46:32 Deleted bucket buck2, responseBody:
--- PASS: TestSameIndexNameInTwoBuckets (90.61s)
=== RUN TestLargeKeysSplChars
2023/09/12 13:46:47 In TestLargeKeysSplChars()
2023/09/12 13:46:58 Created the secondary index idspl1. Waiting for it become active
2023/09/12 13:46:58 Index is 16006875498289676658 now active
2023/09/12 13:47:06 Created the secondary index idspl2. Waiting for it become active
2023/09/12 13:47:06 Index is 4101704658729431631 now active
2023/09/12 13:47:13 Created the secondary index idspl3. Waiting for it become active
2023/09/12 13:47:13 Index is 5638178342190136344 now active
2023/09/12 13:47:13 Using n1ql client
2023/09/12 13:47:13 Expected and Actual scan responses are the same
2023-09-12T13:47:13.476+05:30 [Error] transport error between 127.0.0.1:55136->127.0.0.1:9107: write tcp 127.0.0.1:55136->127.0.0.1:9107: write: broken pipe
2023-09-12T13:47:13.476+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:55136->127.0.0.1:9107: write: broken pipe`
2023-09-12T13:47:13.476+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T13:47:13.476+05:30 [Error] metadataClient:PickRandom: Replicas - [419602175382491438], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 13:47:13 Expected and Actual scan responses are the same
2023/09/12 13:47:13 Using n1ql client
2023/09/12 13:47:13 Expected and Actual scan responses are the same
--- PASS: TestLargeKeysSplChars (26.05s)
=== RUN TestVeryLargeIndexKey
2023/09/12 13:47:13 In DropAllSecondaryIndexes()
2023/09/12 13:47:13 Index found: idspl3
2023/09/12 13:47:13 Dropped index idspl3
2023/09/12 13:47:13 Index found: idspl1
2023/09/12 13:47:14 Dropped index idspl1
2023/09/12 13:47:14 Index found: b_idx
2023/09/12 13:47:14 Dropped index b_idx
2023/09/12 13:47:14 Index found: idspl2
2023/09/12 13:47:14 Dropped index idspl2
2023/09/12 13:47:52 Flushed the bucket default, Response body:
2023/09/12 13:47:52 TestVeryLargeIndexKey:: Flushed the bucket
2023/09/12 13:47:53 clusterconfig.KVAddress = 127.0.0.1:9000
2023/09/12 13:47:57 Created the secondary index i1. Waiting for it become active
2023/09/12 13:47:57 Index is 8253699925859735232 now active
2023/09/12 13:47:57 Using n1ql client
2023/09/12 13:47:58 Expected and Actual scan responses are the same
2023/09/12 13:48:04 Created the secondary index i2. Waiting for it become active
2023/09/12 13:48:04 Index is 12318450262082713965 now active
2023/09/12 13:48:04 Using n1ql client
2023/09/12 13:48:06 Expected and Actual scan responses are the same
2023/09/12 13:48:06 In DropAllSecondaryIndexes()
2023/09/12 13:48:06 Index found: i1
2023/09/12 13:48:06 Dropped index i1
2023/09/12 13:48:06 Index found: i2
2023/09/12 13:48:06 Dropped index i2
2023/09/12 13:48:44 Flushed the bucket default, Response body:
--- PASS: TestVeryLargeIndexKey (91.01s)
=== RUN TestTempBufScanResult
2023/09/12 13:48:44 In DropAllSecondaryIndexes()
2023/09/12 13:49:23 Flushed the bucket default, Response body:
2023/09/12 13:49:23 TestTempBufScanResult:: Flushed the bucket
2023/09/12 13:49:26 Created the secondary index index_idxKey. Waiting for it become active
2023/09/12 13:49:26 Index is 15090152321431429072 now active
2023/09/12 13:49:26 Using n1ql client
2023/09/12 13:49:27 Expected and Actual scan responses are the same
2023/09/12 13:49:27 In DropAllSecondaryIndexes()
2023/09/12 13:49:27 Index found: index_idxKey
2023/09/12 13:49:27 Dropped index index_idxKey
2023/09/12 13:50:05 Flushed the bucket default, Response body:
--- PASS: TestTempBufScanResult (80.78s)
=== RUN TestBuildDeferredAnotherBuilding
2023/09/12 13:50:05 In TestBuildDeferredAnotherBuilding()
2023/09/12 13:50:05 In DropAllSecondaryIndexes()
2023/09/12 13:50:49 Setting JSON docs in KV
2023/09/12 13:52:44 Build the deferred index id_age1. Waiting for the index to become active
2023/09/12 13:52:44 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:45 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:46 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:47 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:48 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:49 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:50 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:51 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:52 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:53 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:54 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:55 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:56 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:57 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:58 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:52:59 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:53:00 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:53:01 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:53:02 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:53:03 Waiting for index 5717190048322562213 to go active ...
2023/09/12 13:53:04 Index is 5717190048322562213 now active
2023/09/12 13:53:04 Build command issued for the deferred indexes [13560891020500687072]
2023/09/12 13:53:06 Build index failed as expected: Build index failed. Encountered transient error. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2023/09/12 13:53:06 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:07 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:08 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:09 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:10 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:11 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:12 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:13 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:14 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:15 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:16 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:17 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:18 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:19 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:20 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:21 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:22 Waiting for index 13560891020500687072 to go active ...
2023/09/12 13:53:23 Index is 13560891020500687072 now active
2023/09/12 13:53:23 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:24 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:25 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:26 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:27 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:28 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:29 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:30 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:31 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:32 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:33 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:34 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:35 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:36 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:37 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:38 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:39 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:40 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:41 Waiting for index 10965581722296985886 to go active ...
2023/09/12 13:53:42 Index is 10965581722296985886 now active
2023/09/12 13:53:42 Using n1ql client
2023/09/12 13:53:43 Expected and Actual scan responses are the same
2023/09/12 13:53:43 Using n1ql client
2023/09/12 13:53:44 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (218.54s)
=== RUN TestMultipleBucketsDeferredBuild
2023/09/12 13:53:44 In TestMultipleBucketsDeferredBuild()
2023/09/12 13:53:44 In DropAllSecondaryIndexes()
2023/09/12 13:53:44 Index found: id_age
2023/09/12 13:53:44 Dropped index id_age
2023/09/12 13:53:44 Index found: id_age1
2023/09/12 13:53:44 Dropped index id_age1
2023/09/12 13:53:44 Index found: id_company
2023/09/12 13:53:44 Dropped index id_company
2023/09/12 13:54:21 Flushed the bucket default, Response body:
2023/09/12 13:54:24 Modified parameters of bucket default, responseBody:
2023/09/12 13:54:24 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2023/09/12 13:54:24 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000d2000}
2023/09/12 13:54:24 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 08:24:24 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0007e7f80 31 [] false false map[] 0xc00a4f4000 }
2023/09/12 13:54:24 DeleteBucket failed for bucket defertest_buck2
2023/09/12 13:54:24 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2023/09/12 13:54:24 Created bucket defertest_buck2, responseBody:
2023/09/12 13:54:39 Setting JSON docs in KV
2023/09/12 13:55:53 Build command issued for the deferred indexes [4000632864959724946]
2023/09/12 13:55:54 Build command issued for the deferred indexes [6536456414485070504 16833378686033414873]
2023/09/12 13:55:54 Index state of 16833378686033414873 is INDEX_STATE_READY
2023/09/12 13:55:54 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:55:55 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:55:56 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:55:57 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:55:58 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:55:59 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:56:00 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:56:01 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:56:02 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:56:03 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:56:04 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:56:05 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:56:06 Waiting for index 4000632864959724946 to go active ...
2023/09/12 13:56:07 Index is 4000632864959724946 now active
2023/09/12 13:56:07 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:08 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:09 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:10 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:11 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:12 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:13 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:14 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:15 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:16 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:17 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:18 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:19 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:20 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:21 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:22 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:23 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:24 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:25 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:26 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:27 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:28 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:29 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:30 Waiting for index 6536456414485070504 to go active ...
2023/09/12 13:56:31 Index is 6536456414485070504 now active
2023/09/12 13:56:31 Using n1ql client
2023/09/12 13:56:31 Expected and Actual scan responses are the same
2023/09/12 13:56:31 Using n1ql client
2023/09/12 13:56:31 Expected and Actual scan responses are the same
2023/09/12 13:56:32 Using n1ql client
2023-09-12T13:56:32.168+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1694507192101195450] started ...
2023/09/12 13:56:32 Expected and Actual scan responses are the same
2023/09/12 13:56:35 Modified parameters of bucket default, responseBody:
2023/09/12 13:56:37 Deleted bucket defertest_buck2, responseBody:
--- PASS: TestMultipleBucketsDeferredBuild (178.67s)
=== RUN TestCreateDropCreateDeferredIndex
2023/09/12 13:56:42 In TestCreateDropCreateDeferredIndex()
2023/09/12 13:56:42 In DropAllSecondaryIndexes()
2023/09/12 13:56:42 Index found: buck1_id1
2023/09/12 13:56:42 Dropped index buck1_id1
2023/09/12 13:56:42 Index found: buck1_id2
2023/09/12 13:56:43 Dropped index buck1_id2
2023/09/12 13:56:45 Setting JSON docs in KV
2023/09/12 13:56:59 Created the secondary index id_company. Waiting for it become active
2023/09/12 13:56:59 Index is 14093672836181612479 now active
2023/09/12 13:57:00 Dropping the secondary index id_age
2023/09/12 13:57:00 Index dropped
2023/09/12 13:57:04 Setting JSON docs in KV
2023/09/12 13:57:12 Using n1ql client
2023/09/12 13:57:13 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (30.24s)
=== RUN TestMultipleDeferredIndexes_BuildTogether
2023/09/12 13:57:13 In TestMultipleDeferredIndexes_BuildTogether()
2023/09/12 13:57:13 In DropAllSecondaryIndexes()
2023/09/12 13:57:13 Index found: id_company
2023/09/12 13:57:13 Dropped index id_company
2023/09/12 13:57:15 Setting JSON docs in KV
2023/09/12 13:57:29 Created the secondary index id_company. Waiting for it become active
2023/09/12 13:57:29 Index is 6766187642288470701 now active
2023/09/12 13:57:31 Build command issued for the deferred indexes [id_age id_gender id_isActive], bucket: default, scope: _default, coll: _default
2023/09/12 13:57:31 Waiting for the index id_age to become active
2023/09/12 13:57:31 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:32 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:33 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:34 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:35 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:36 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:37 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:38 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:39 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:40 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:41 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:42 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:43 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:44 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:45 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:46 Waiting for index 7878284861487594893 to go active ...
2023/09/12 13:57:47 Index is 7878284861487594893 now active
2023/09/12 13:57:47 Waiting for the index id_gender to become active
2023/09/12 13:57:47 Index is 11324198653867869444 now active
2023/09/12 13:57:47 Waiting for the index id_isActive to become active
2023/09/12 13:57:47 Index is 7656240818216924667 now active
2023/09/12 13:57:47 Using n1ql client
2023/09/12 13:57:47 Expected and Actual scan responses are the same
2023/09/12 13:57:50 Setting JSON docs in KV
2023/09/12 13:58:01 Using n1ql client
2023/09/12 13:58:02 Expected and Actual scan responses are the same
2023/09/12 13:58:02 Using n1ql client
2023/09/12 13:58:02 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (49.38s)
=== RUN TestMultipleDeferredIndexes_BuildOneByOne
2023/09/12 13:58:02 In TestMultipleDeferredIndexes_BuildOneByOne()
2023/09/12 13:58:02 In DropAllSecondaryIndexes()
2023/09/12 13:58:02 Index found: id_gender
2023/09/12 13:58:02 Dropped index id_gender
2023/09/12 13:58:02 Index found: id_isActive
2023/09/12 13:58:02 Dropped index id_isActive
2023/09/12 13:58:02 Index found: id_company
2023/09/12 13:58:02 Dropped index id_company
2023/09/12 13:58:02 Index found: id_age
2023/09/12 13:58:02 Dropped index id_age
2023/09/12 13:58:05 Setting JSON docs in KV
2023/09/12 13:58:20 Created the secondary index id_company. Waiting for it become active
2023/09/12 13:58:20 Index is 3083614055929405576 now active
2023/09/12 13:58:22 Build command issued for the deferred indexes [id_age], bucket: default, scope: _default, coll: _default
2023/09/12 13:58:22 Waiting for the index id_age to become active
2023/09/12 13:58:22 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:23 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:24 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:25 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:26 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:27 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:28 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:29 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:30 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:31 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:32 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:33 Waiting for index 5770991485882326784 to go active ...
2023/09/12 13:58:34 Index is 5770991485882326784 now active
2023/09/12 13:58:34 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 13:58:34 Waiting for the index id_gender to become active
2023/09/12 13:58:34 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:35 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:36 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:37 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:38 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:39 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:40 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:41 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:42 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:43 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:44 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:45 Waiting for index 2819088148151161717 to go active ...
2023/09/12 13:58:46 Index is 2819088148151161717 now active
2023/09/12 13:58:46 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/09/12 13:58:46 Waiting for the index id_isActive to become active
2023/09/12 13:58:46 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:47 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:48 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:49 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:50 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:51 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:52 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:53 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:54 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:55 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:56 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:57 Waiting for index 15408139856601884320 to go active ...
2023/09/12 13:58:58 Index is 15408139856601884320 now active
2023/09/12 13:58:58 Using n1ql client
2023/09/12 13:58:59 Expected and Actual scan responses are the same
2023/09/12 13:59:01 Setting JSON docs in KV
2023/09/12 13:59:10 Using n1ql client
2023/09/12 13:59:11 Expected and Actual scan responses are the same
2023/09/12 13:59:11 Using n1ql client
2023/09/12 13:59:11 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (69.21s)
=== RUN TestDropDeferredIndexWhileOthersBuilding
2023/09/12 13:59:11 In TestDropDeferredIndexWhileOthersBuilding()
2023/09/12 13:59:11 In DropAllSecondaryIndexes()
2023/09/12 13:59:11 Index found: id_gender
2023/09/12 13:59:11 Dropped index id_gender
2023/09/12 13:59:11 Index found: id_company
2023/09/12 13:59:11 Dropped index id_company
2023/09/12 13:59:11 Index found: id_age
2023/09/12 13:59:11 Dropped index id_age
2023/09/12 13:59:11 Index found: id_isActive
2023/09/12 13:59:12 Dropped index id_isActive
2023/09/12 13:59:14 Setting JSON docs in KV
2023/09/12 13:59:33 Created the secondary index id_company. Waiting for it become active
2023/09/12 13:59:33 Index is 13478041303375067157 now active
2023/09/12 13:59:35 Build command issued for the deferred indexes [3979182723919394870 7421296305840531328]
2023/09/12 13:59:37 Dropping the secondary index id_isActive
2023/09/12 13:59:37 Index dropped
2023/09/12 13:59:37 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:38 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:39 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:40 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:41 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:42 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:43 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:44 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:45 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:46 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:47 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:48 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:49 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:50 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:51 Waiting for index 3979182723919394870 to go active ...
2023/09/12 13:59:52 Index is 3979182723919394870 now active
2023/09/12 13:59:52 Index is 7421296305840531328 now active
2023/09/12 13:59:53 Using n1ql client
2023/09/12 13:59:53 Expected and Actual scan responses are the same
2023/09/12 13:59:53 Using n1ql client
2023/09/12 13:59:53 Expected and Actual scan responses are the same
2023/09/12 13:59:55 Setting JSON docs in KV
2023/09/12 14:00:06 Using n1ql client
2023/09/12 14:00:07 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (55.55s)
=== RUN TestDropBuildingDeferredIndex
2023/09/12 14:00:07 In TestDropBuildingDeferredIndex()
2023/09/12 14:00:07 In DropAllSecondaryIndexes()
2023/09/12 14:00:07 Index found: id_age
2023/09/12 14:00:07 Dropped index id_age
2023/09/12 14:00:07 Index found: id_company
2023/09/12 14:00:07 Dropped index id_company
2023/09/12 14:00:07 Index found: id_gender
2023/09/12 14:00:07 Dropped index id_gender
2023/09/12 14:00:10 Setting JSON docs in KV
2023/09/12 14:00:16 Build command issued for the deferred indexes [10271301655204528820 6551775694229902840]
2023/09/12 14:00:17 Dropping the secondary index id_age
2023/09/12 14:00:17 Index dropped
2023/09/12 14:00:17 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:18 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:19 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:20 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:21 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:22 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:23 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:24 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:25 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:26 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:27 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:28 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:29 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:30 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:31 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:32 Waiting for index 10271301655204528820 to go active ...
2023/09/12 14:00:33 Index is 10271301655204528820 now active
2023/09/12 14:00:33 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 14:00:33 Waiting for the index id_gender to become active
2023/09/12 14:00:33 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:34 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:35 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:36 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:37 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:38 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:39 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:40 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:41 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:42 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:43 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:44 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:45 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:46 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:47 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:48 Waiting for index 1364267185239428840 to go active ...
2023/09/12 14:00:49 Index is 1364267185239428840 now active
2023/09/12 14:00:50 Using n1ql client
2023/09/12 14:00:51 Expected and Actual scan responses are the same
2023/09/12 14:00:51 Using n1ql client
2023/09/12 14:00:51 Expected and Actual scan responses are the same
2023/09/12 14:00:53 Setting JSON docs in KV
2023/09/12 14:01:03 Using n1ql client
2023/09/12 14:01:05 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (57.85s)
=== RUN TestDropMultipleBuildingDeferredIndexes
2023/09/12 14:01:05 In TestDropMultipleBuildingDeferredIndexes()
2023/09/12 14:01:05 In DropAllSecondaryIndexes()
2023/09/12 14:01:05 Index found: id_gender
2023/09/12 14:01:05 Dropped index id_gender
2023/09/12 14:01:05 Index found: id_company
2023/09/12 14:01:05 Dropped index id_company
2023/09/12 14:01:12 Setting JSON docs in KV
2023/09/12 14:01:45 Created the secondary index id_company. Waiting for it become active
2023/09/12 14:01:45 Index is 3513297854581076685 now active
2023/09/12 14:01:46 Build command issued for the deferred indexes [1402304119618376153 13896975089283970541]
2023/09/12 14:01:47 Dropping the secondary index id_age
2023/09/12 14:01:47 Index dropped
2023/09/12 14:01:47 Dropping the secondary index id_gender
2023/09/12 14:02:06 Index dropped
2023/09/12 14:02:07 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/09/12 14:02:07 Waiting for the index id_isActive to become active
2023/09/12 14:02:07 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:08 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:09 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:10 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:11 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:12 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:13 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:14 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:15 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:16 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:17 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:18 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:19 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:20 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:21 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:22 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:23 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:24 Waiting for index 4895204343001493477 to go active ...
2023/09/12 14:02:25 Index is 4895204343001493477 now active
2023/09/12 14:02:35 Using n1ql client
2023/09/12 14:02:36 Expected and Actual scan responses are the same
2023/09/12 14:02:36 Number of docScanResults and scanResults = 180000 and 180000
2023/09/12 14:02:37 Using n1ql client
2023/09/12 14:02:38 Expected and Actual scan responses are the same
2023/09/12 14:02:38 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (93.21s)
=== RUN TestDropOneIndexSecondDeferBuilding
2023/09/12 14:02:38 In TestDropOneIndexSecondDeferBuilding()
2023/09/12 14:02:38 In DropAllSecondaryIndexes()
2023/09/12 14:02:38 Index found: id_company
2023/09/12 14:02:38 Dropped index id_company
2023/09/12 14:02:38 Index found: id_isActive
2023/09/12 14:02:38 Dropped index id_isActive
2023/09/12 14:02:40 Setting JSON docs in KV
2023/09/12 14:02:46 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/09/12 14:02:46 Waiting for the index id_company to become active
2023/09/12 14:02:46 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:47 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:48 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:49 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:50 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:51 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:52 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:53 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:54 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:55 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:56 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:57 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:58 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:02:59 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:03:00 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:03:01 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:03:02 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:03:03 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:03:04 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:03:05 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:03:06 Waiting for index 4808661225979225742 to go active ...
2023/09/12 14:03:07 Index is 4808661225979225742 now active
2023/09/12 14:03:07 Build command issued for the deferred indexes [13093031893008982487]
2023/09/12 14:03:08 Dropping the secondary index id_company
2023/09/12 14:03:08 Index dropped
2023/09/12 14:03:13 Setting JSON docs in KV
2023/09/12 14:03:29 Waiting for index 13093031893008982487 to go active ...
2023/09/12 14:03:30 Waiting for index 13093031893008982487 to go active ...
2023/09/12 14:03:31 Waiting for index 13093031893008982487 to go active ...
2023/09/12 14:03:32 Index is 13093031893008982487 now active
2023/09/12 14:03:32 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 14:03:32 Waiting for the index id_gender to become active
2023/09/12 14:03:32 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:33 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:34 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:35 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:36 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:37 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:38 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:39 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:40 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:41 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:42 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:43 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:44 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:45 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:46 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:47 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:48 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:49 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:50 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:51 Waiting for index 16409338350729611973 to go active ...
2023/09/12 14:03:52 Index is 16409338350729611973 now active
2023/09/12 14:03:52 Using n1ql client
2023/09/12 14:03:53 Expected and Actual scan responses are the same
2023/09/12 14:03:53 Using n1ql client
2023/09/12 14:03:55 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (76.78s)
=== RUN TestDropSecondIndexSecondDeferBuilding
2023/09/12 14:03:55 In TestDropSecondIndexSecondDeferBuilding()
2023/09/12 14:03:55 In DropAllSecondaryIndexes()
2023/09/12 14:03:55 Index found: id_age
2023/09/12 14:03:55 Dropped index id_age
2023/09/12 14:03:55 Index found: id_gender
2023/09/12 14:03:55 Dropped index id_gender
2023/09/12 14:03:57 Setting JSON docs in KV
2023/09/12 14:04:03 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/09/12 14:04:03 Waiting for the index id_company to become active
2023/09/12 14:04:03 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:04 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:05 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:06 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:07 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:08 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:09 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:10 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:11 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:12 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:13 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:14 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:15 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:16 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:17 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:18 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:19 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:20 Waiting for index 17606438137417312358 to go active ...
2023/09/12 14:04:21 Index is 17606438137417312358 now active
2023/09/12 14:04:21 Build command issued for the deferred indexes [3079410000581277305]
2023/09/12 14:04:22 Dropping the secondary index id_age
2023/09/12 14:04:22 Index dropped
2023/09/12 14:04:26 Setting JSON docs in KV
2023/09/12 14:04:34 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 14:04:34 Waiting for the index id_gender to become active
2023/09/12 14:04:34 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:35 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:36 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:37 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:38 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:39 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:40 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:41 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:42 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:43 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:44 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:45 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:46 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:47 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:48 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:49 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:50 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:51 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:52 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:53 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:54 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:55 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:56 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:57 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:58 Waiting for index 3082777743286196225 to go active ...
2023/09/12 14:04:59 Index is 3082777743286196225 now active
2023/09/12 14:04:59 Using n1ql client
2023/09/12 14:04:59 Expected and Actual scan responses are the same
2023/09/12 14:05:00 Using n1ql client
2023/09/12 14:05:02 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (67.37s)
=== RUN TestCreateAfterDropWhileIndexBuilding
2023/09/12 14:05:02 In TestCreateAfterDropWhileIndexBuilding()
2023/09/12 14:05:02 In DropAllSecondaryIndexes()
2023/09/12 14:05:02 Index found: id_company
2023/09/12 14:05:02 Dropped index id_company
2023/09/12 14:05:02 Index found: id_gender
2023/09/12 14:05:02 Dropped index id_gender
2023/09/12 14:05:24 Setting JSON docs in KV
2023/09/12 14:06:21 Build command issued for the deferred indexes [5088874831647208317]
2023/09/12 14:06:22 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:23 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:24 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:25 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:26 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:27 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:28 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:29 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:30 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:31 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:32 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:33 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:34 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:35 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:36 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:37 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:38 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:39 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:40 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:41 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:42 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:43 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:44 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:45 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:46 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:47 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:48 Waiting for index 5088874831647208317 to go active ...
2023/09/12 14:06:49 Index is 5088874831647208317 now active
2023/09/12 14:06:49 Build command issued for the deferred indexes [4571472709272658326]
2023/09/12 14:06:50 Dropping the secondary index id_company
2023/09/12 14:06:51 Index dropped
2023/09/12 14:06:51 Dropping the secondary index id_age
2023/09/12 14:06:52 Index dropped
2023/09/12 14:07:00 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 14:07:00 Waiting for the index id_gender to become active
2023/09/12 14:07:00 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:01 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:02 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:03 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:04 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:05 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:06 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:07 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:08 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:09 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:10 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:11 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:12 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:13 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:14 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:15 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:16 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:17 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:18 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:19 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:20 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:21 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:22 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:23 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:24 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:25 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:26 Waiting for index 16487480603129231397 to go active ...
2023/09/12 14:07:27 Index is 16487480603129231397 now active
2023/09/12 14:07:28 Index is 16487480603129231397 now active
2023/09/12 14:07:29 Using n1ql client
2023/09/12 14:07:31 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (148.94s)
=== RUN TestDropBuildingIndex1
2023/09/12 14:07:31 In TestDropBuildingIndex1()
2023/09/12 14:07:31 In DropAllSecondaryIndexes()
2023/09/12 14:07:31 Index found: id_gender
2023/09/12 14:07:31 Dropped index id_gender
2023/09/12 14:07:36 Setting JSON docs in KV
2023/09/12 14:08:15 Created the secondary index id_company. Waiting for it become active
2023/09/12 14:08:15 Index is 10369501937967810647 now active
2023/09/12 14:08:47 Dropping the secondary index id_age
2023/09/12 14:08:47 Index dropped
2023/09/12 14:09:16 Created the secondary index id_age. Waiting for it become active
2023/09/12 14:09:16 Index is 4391562263120578781 now active
2023/09/12 14:09:18 Setting JSON docs in KV
2023/09/12 14:09:29 Using n1ql client
2023/09/12 14:09:29 Expected and Actual scan responses are the same
2023/09/12 14:09:29 Using n1ql client
2023/09/12 14:09:30 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex1 (119.02s)
=== RUN TestDropBuildingIndex2
2023/09/12 14:09:30 In TestDropBuildingIndex2()
2023/09/12 14:09:30 In DropAllSecondaryIndexes()
2023/09/12 14:09:30 Index found: id_age
2023/09/12 14:09:30 Dropped index id_age
2023/09/12 14:09:30 Index found: id_company
2023/09/12 14:09:30 Dropped index id_company
2023/09/12 14:09:34 Setting JSON docs in KV
2023/09/12 14:10:22 Created the secondary index id_company. Waiting for it become active
2023/09/12 14:10:22 Index is 9122390578996383704 now active
2023/09/12 14:10:56 Dropping the secondary index id_company
2023/09/12 14:10:56 Index dropped
2023/09/12 14:10:56 Index is 948474884719576547 now active
2023/09/12 14:11:27 Created the secondary index id_company. Waiting for it become active
2023/09/12 14:11:27 Index is 17899906156670125981 now active
2023/09/12 14:11:30 Setting JSON docs in KV
2023/09/12 14:11:39 Using n1ql client
2023/09/12 14:11:40 Expected and Actual scan responses are the same
2023/09/12 14:11:40 Using n1ql client
2023/09/12 14:11:41 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex2 (130.74s)
=== RUN TestDropIndexWithDataLoad
2023/09/12 14:11:41 In TestDropIndexWithDataLoad()
2023/09/12 14:11:41 In DropAllSecondaryIndexes()
2023/09/12 14:11:41 Index found: id_company
2023/09/12 14:11:41 Dropped index id_company
2023/09/12 14:11:41 Index found: id_age
2023/09/12 14:11:41 Dropped index id_age
2023/09/12 14:11:44 Setting JSON docs in KV
2023/09/12 14:12:23 Created the secondary index id_company. Waiting for it become active
2023/09/12 14:12:23 Index is 11671683580501192455 now active
2023/09/12 14:12:57 Created the secondary index id_age. Waiting for it become active
2023/09/12 14:12:57 Index is 7583184845015253796 now active
2023/09/12 14:13:30 Created the secondary index id_gender. Waiting for it become active
2023/09/12 14:13:30 Index is 8801711255134422939 now active
2023/09/12 14:14:05 Created the secondary index id_isActive. Waiting for it become active
2023/09/12 14:14:05 Index is 1174297100536943124 now active
2023/09/12 14:14:12 Setting JSON docs in KV
2023/09/12 14:14:12 In LoadKVBucket
2023/09/12 14:14:12 In DropIndexWhileKVLoad
2023/09/12 14:14:12 Bucket name = default
2023/09/12 14:14:13 Dropping the secondary index id_company
2023/09/12 14:14:13 Index dropped
2023/09/12 14:14:41 Using n1ql client
2023/09/12 14:14:42 Expected and Actual scan responses are the same
2023/09/12 14:14:42 Number of docScanResults and scanResults = 96712 and 96712
2023/09/12 14:14:43 Using n1ql client
2023/09/12 14:14:46 Expected and Actual scan responses are the same
2023/09/12 14:14:46 Number of docScanResults and scanResults = 420000 and 420000
--- PASS: TestDropIndexWithDataLoad (185.56s)
=== RUN TestDropAllIndexesWithDataLoad
2023/09/12 14:14:46 In TestDropAllIndexesWithDataLoad()
2023/09/12 14:14:46 In DropAllSecondaryIndexes()
2023/09/12 14:14:46 Index found: id_gender
2023/09/12 14:14:46 Dropped index id_gender
2023/09/12 14:14:46 Index found: id_isActive
2023/09/12 14:14:46 Dropped index id_isActive
2023/09/12 14:14:46 Index found: id_age
2023/09/12 14:14:47 Dropped index id_age
2023/09/12 14:14:49 Setting JSON docs in KV
2023/09/12 14:15:32 Created the secondary index id_company. Waiting for it become active
2023/09/12 14:15:32 Index is 236789911532117925 now active
2023/09/12 14:16:11 Created the secondary index id_age. Waiting for it become active
2023/09/12 14:16:11 Index is 8504956664108140815 now active
2023/09/12 14:16:47 Created the secondary index id_gender. Waiting for it become active
2023/09/12 14:16:47 Index is 5495930378010570177 now active
2023/09/12 14:17:26 Created the secondary index id_isActive. Waiting for it become active
2023/09/12 14:17:26 Index is 5674003346125163403 now active
2023/09/12 14:17:34 Setting JSON docs in KV
2023/09/12 14:17:34 In LoadKVBucket
2023/09/12 14:17:34 Bucket name = default
2023/09/12 14:17:34 In DropIndexWhileKVLoad
2023/09/12 14:17:34 In DropIndexWhileKVLoad
2023/09/12 14:17:34 In DropIndexWhileKVLoad
2023/09/12 14:17:34 In DropIndexWhileKVLoad
2023/09/12 14:17:35 Dropping the secondary index id_isActive
2023/09/12 14:17:35 Dropping the secondary index id_age
2023/09/12 14:17:35 Dropping the secondary index id_company
2023/09/12 14:17:35 Dropping the secondary index id_gender
2023/09/12 14:17:35 Index dropped
2023/09/12 14:17:36 Index dropped
2023/09/12 14:17:36 Index dropped
2023/09/12 14:17:36 Index dropped
2023/09/12 14:17:52 Using n1ql client
2023/09/12 14:17:52 Scan failed as expected with error: Index Not Found - cause: GSI index id_company not found.
--- PASS: TestDropAllIndexesWithDataLoad (185.82s)
=== RUN TestCreateBucket_AnotherIndexBuilding
2023/09/12 14:17:52 In TestCreateBucket_AnotherIndexBuilding()
2023/09/12 14:17:52 In DropAllSecondaryIndexes()
2023/09/12 14:18:31 Flushed the bucket default, Response body:
2023/09/12 14:18:34 Modified parameters of bucket default, responseBody:
2023/09/12 14:18:34 http://127.0.0.1:9000/pools/default/buckets/multi_buck2
2023/09/12 14:18:34 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000d2000}
2023/09/12 14:18:34 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 08:48:34 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc013c6f100 31 [] false false map[] 0xc005916400 }
2023/09/12 14:18:34 DeleteBucket failed for bucket multi_buck2
2023/09/12 14:18:34 Deleted bucket multi_buck2, responseBody: Requested resource not found.
2023/09/12 14:18:49 Setting JSON docs in KV
2023/09/12 14:20:56 Created bucket multi_buck2, responseBody:
2023/09/12 14:21:20 Index is 10918340563147682562 now active
2023/09/12 14:21:20 Index is 11530425467066316759 now active
2023/09/12 14:21:20 Using n1ql client
2023-09-12T14:21:20.350+05:30 [Info] GSIC[default/multi_buck2-_default-_default-1694508680304975381] started ...
2023/09/12 14:21:20 Expected and Actual scan responses are the same
2023/09/12 14:21:20 Number of docScanResults and scanResults = 10000 and 10000
2023/09/12 14:21:20 Using n1ql client
2023/09/12 14:21:24 Expected and Actual scan responses are the same
2023/09/12 14:21:24 Number of docScanResults and scanResults = 200000 and 200000
2023/09/12 14:21:26 Deleted bucket multi_buck2, responseBody:
2023/09/12 14:22:03 Flushed the bucket default, Response body:
--- PASS: TestCreateBucket_AnotherIndexBuilding (251.23s)
=== RUN TestDropBucket2Index_Bucket1IndexBuilding
2023/09/12 14:22:03 In TestDropBucket2Index_Bucket1IndexBuilding()
2023/09/12 14:22:03 In DropAllSecondaryIndexes()
2023/09/12 14:22:03 Index found: buck1_idx
2023/09/12 14:22:03 Dropped index buck1_idx
2023/09/12 14:22:42 Flushed the bucket default, Response body:
2023/09/12 14:22:45 Modified parameters of bucket default, responseBody:
2023/09/12 14:22:45 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3
2023/09/12 14:22:45 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000d2000}
2023/09/12 14:22:45 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 08:52:44 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0126c4280 31 [] false false map[] 0xc00012a100 }
2023/09/12 14:22:45 DeleteBucket failed for bucket multibucket_test3
2023/09/12 14:22:45 Deleted bucket multibucket_test3, responseBody: Requested resource not found.
2023/09/12 14:22:45 Created bucket multibucket_test3, responseBody:
2023/09/12 14:23:00 Setting JSON docs in KV
2023/09/12 14:23:59 Created the secondary index buck2_idx. Waiting for it become active
2023/09/12 14:23:59 Index is 14737361992505084962 now active
2023/09/12 14:24:14 Dropping the secondary index buck2_idx
2023/09/12 14:24:15 Index dropped
2023/09/12 14:24:15 Index is 2089558550232363681 now active
2023/09/12 14:24:15 Using n1ql client
2023/09/12 14:24:16 Expected and Actual scan responses are the same
2023/09/12 14:24:16 Number of docScanResults and scanResults = 100000 and 100000
2023/09/12 14:24:18 Deleted bucket multibucket_test3, responseBody:
2023/09/12 14:24:56 Flushed the bucket default, Response body:
--- PASS: TestDropBucket2Index_Bucket1IndexBuilding (172.47s)
=== RUN TestDeleteBucketWhileInitialIndexBuild
2023/09/12 14:24:56 In TestDeleteBucketWhileInitialIndexBuild()
2023/09/12 14:24:56 ============== DBG: Drop all indexes in all buckets
2023/09/12 14:24:56 In DropAllSecondaryIndexes()
2023/09/12 14:24:56 Index found: buck1_idx
2023/09/12 14:24:56 Dropped index buck1_idx
2023/09/12 14:24:56 ============== DBG: Delete bucket default
2023/09/12 14:24:59 Deleted bucket default, responseBody:
2023/09/12 14:24:59 ============== DBG: Create bucket default
2023/09/12 14:24:59 Created bucket default, responseBody:
2023/09/12 14:25:02 Flush Enabled on bucket default, responseBody:
2023/09/12 14:25:35 Flushed the bucket default, Response body:
2023/09/12 14:25:35 ============== DBG: Delete bucket testbucket2
2023/09/12 14:25:35 http://127.0.0.1:9000/pools/default/buckets/testbucket2
2023/09/12 14:25:35 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000d2000}
2023/09/12 14:25:35 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 08:55:35 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc019849880 31 [] false false map[] 0xc00a57e100 }
2023/09/12 14:25:35 DeleteBucket failed for bucket testbucket2
2023/09/12 14:25:35 Deleted bucket testbucket2, responseBody: Requested resource not found.
2023/09/12 14:25:35 ============== DBG: Create bucket testbucket2
2023/09/12 14:25:36 Created bucket testbucket2, responseBody:
2023/09/12 14:25:39 Flush Enabled on bucket testbucket2, responseBody:
2023/09/12 14:26:12 Flushed the bucket testbucket2, Response body:
2023/09/12 14:26:12 ============== DBG: Delete bucket testbucket3
2023/09/12 14:26:12 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2023/09/12 14:26:12 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000d2000}
2023/09/12 14:26:12 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 08:56:12 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc003946540 31 [] false false map[] 0xc00a57e100 }
2023/09/12 14:26:12 DeleteBucket failed for bucket testbucket3
2023/09/12 14:26:12 Deleted bucket testbucket3, responseBody: Requested resource not found.
2023/09/12 14:26:12 ============== DBG: Create bucket testbucket3
2023/09/12 14:26:12 Created bucket testbucket3, responseBody:
2023/09/12 14:26:15 Flush Enabled on bucket testbucket3, responseBody:
2023/09/12 14:26:49 Flushed the bucket testbucket3, Response body:
2023/09/12 14:26:49 ============== DBG: Delete bucket testbucket4
2023/09/12 14:26:49 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/09/12 14:26:49 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000d2000}
2023/09/12 14:26:49 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 08:56:49 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00ce8d6c0 31 [] false false map[] 0xc00a57e200 }
2023/09/12 14:26:49 DeleteBucket failed for bucket testbucket4
2023/09/12 14:26:49 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/09/12 14:26:49 ============== DBG: Create bucket testbucket4
2023/09/12 14:26:49 Created bucket testbucket4, responseBody:
2023/09/12 14:26:52 Flush Enabled on bucket testbucket4, responseBody:
2023/09/12 14:27:27 Flushed the bucket testbucket4, Response body:
2023/09/12 14:27:42 Generating docs and Populating all the buckets
2023/09/12 14:27:42 ============== DBG: Creating docs in bucket default
2023/09/12 14:27:43 ============== DBG: Creating index bucket1_age in bucket default
2023/09/12 14:27:46 Created the secondary index bucket1_age. Waiting for it become active
2023/09/12 14:27:46 Index is 10303169350677885997 now active
2023/09/12 14:27:46 ============== DBG: Creating index bucket1_gender in bucket default
2023/09/12 14:27:53 Created the secondary index bucket1_gender. Waiting for it become active
2023/09/12 14:27:53 Index is 3736040618484685518 now active
2023/09/12 14:27:54 ============== DBG: Creating docs in bucket testbucket2
2023/09/12 14:27:54 ============== DBG: Creating index bucket2_city in bucket testbucket2
2023/09/12 14:28:00 Created the secondary index bucket2_city. Waiting for it become active
2023/09/12 14:28:00 Index is 10414163474200227161 now active
2023/09/12 14:28:00 ============== DBG: Creating index bucket2_company in bucket testbucket2
2023/09/12 14:28:07 Created the secondary index bucket2_company. Waiting for it become active
2023/09/12 14:28:07 Index is 11196076933234406823 now active
2023/09/12 14:28:07 ============== DBG: Creating docs in bucket testbucket3
2023/09/12 14:28:08 ============== DBG: Creating index bucket3_gender in bucket testbucket3
2023/09/12 14:28:12 Created the secondary index bucket3_gender. Waiting for it become active
2023/09/12 14:28:12 Index is 10512498472115986696 now active
2023/09/12 14:28:12 ============== DBG: Creating index bucket3_address in bucket testbucket3
2023/09/12 14:28:20 Created the secondary index bucket3_address. Waiting for it become active
2023/09/12 14:28:20 Index is 1454352651227509828 now active
2023/09/12 14:28:20 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2023/09/12 14:28:20 Using n1ql client
2023-09-12T14:28:20.404+05:30 [Info] GSIC[default/default-_default-_default-1694509100401246954] started ...
2023/09/12 14:28:20 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2023/09/12 14:28:20 Expected and Actual scan responses are the same
2023/09/12 14:28:31 ============== DBG: Creating 50K docs in bucket testbucket4
2023/09/12 14:28:58 ============== DBG: Creating index bucket4_balance asynchronously in bucket testbucket4
2023/09/12 14:29:08 ============== DBG: Deleting bucket testbucket4
2023/09/12 14:29:11 Deleted bucket testbucket4, responseBody:
2023/09/12 14:29:11 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2023/09/12 14:29:11 Using n1ql client
2023/09/12 14:29:11 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2023/09/12 14:29:11 Expected and Actual scan responses are the same
2023/09/12 14:29:11 ============== DBG: Second bucket scan:: Scanning index bucket2_city in bucket testbucket2
2023/09/12 14:29:11 Using n1ql client
2023-09-12T14:29:11.325+05:30 [Info] GSIC[default/testbucket2-_default-_default-1694509151322944580] started ...
2023/09/12 14:29:11 ============== DBG: Second bucket scan:: Expected results = 392 Actual results = 392
2023/09/12 14:29:11 Expected and Actual scan responses are the same
2023/09/12 14:29:11 ============== DBG: Third bucket scan:: Scanning index bucket3_gender in bucket testbucket3
2023/09/12 14:29:11 Using n1ql client
2023-09-12T14:29:11.333+05:30 [Info] GSIC[default/testbucket3-_default-_default-1694509151330835484] started ...
2023/09/12 14:29:11 ============== DBG: Third bucket scan:: Expected results = 492 Actual results = 492
2023/09/12 14:29:11 Expected and Actual scan responses are the same
2023/09/12 14:29:11 ============== DBG: Deleting buckets testbucket2 testbucket3 testbucket4
2023/09/12 14:29:13 Deleted bucket testbucket2, responseBody:
2023/09/12 14:29:15 Deleted bucket testbucket3, responseBody:
2023/09/12 14:29:15 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/09/12 14:29:15 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000d2000}
2023/09/12 14:29:15 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 08:59:15 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0192dfa00 31 [] false false map[] 0xc0012aaf00 }
2023/09/12 14:29:15 DeleteBucket failed for bucket testbucket4
2023/09/12 14:29:15 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/09/12 14:29:18 Modified parameters of bucket default, responseBody:
--- PASS: TestDeleteBucketWhileInitialIndexBuild (277.74s)
=== RUN TestWherClause_UpdateDocument
2023/09/12 14:29:33 In TestWherClause_UpdateDocument()
2023/09/12 14:29:33 In DropAllSecondaryIndexes()
2023/09/12 14:29:33 Index found: bucket1_gender
2023/09/12 14:29:34 Dropped index bucket1_gender
2023/09/12 14:29:34 Index found: bucket1_age
2023/09/12 14:29:34 Dropped index bucket1_age
2023/09/12 14:30:12 Flushed the bucket default, Response body:
2023/09/12 14:30:14 Setting JSON docs in KV
2023/09/12 14:30:23 Created the secondary index id_ageGreaterThan40. Waiting for it become active
2023/09/12 14:30:23 Index is 16768984111010163118 now active
2023/09/12 14:30:23 Using n1ql client
2023/09/12 14:30:23 Expected and Actual scan responses are the same
2023/09/12 14:30:23 Number of docScanResults and scanResults = 5981 and 5981
2023/09/12 14:30:28 Using n1ql client
2023/09/12 14:30:28 Expected and Actual scan responses are the same
2023/09/12 14:30:28 Number of docScanResults and scanResults = 1981 and 1981
--- PASS: TestWherClause_UpdateDocument (54.59s)
=== RUN TestDeferFalse
2023/09/12 14:30:28 In TestDeferFalse()
2023/09/12 14:30:30 Setting JSON docs in KV
2023/09/12 14:30:44 Created the secondary index index_deferfalse1. Waiting for it become active
2023/09/12 14:30:44 Index is 12312594995997666540 now active
2023/09/12 14:30:44 Using n1ql client
2023/09/12 14:30:44 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse (16.18s)
=== RUN TestDeferFalse_CloseClientConnection
2023/09/12 14:30:44 In TestDeferFalse_CloseClientConnection()
2023/09/12 14:30:44 In CloseClientThread
2023/09/12 14:30:44 In CreateIndexThread
2023/09/12 14:30:46 Create Index call failed as expected due to error : Terminate Request due to client termination
2023/09/12 14:30:46 Waiting for index 4145670873821250811 to go active ...
2023/09/12 14:30:47 Waiting for index 4145670873821250811 to go active ...
2023/09/12 14:30:48 Waiting for index 4145670873821250811 to go active ...
2023/09/12 14:30:49 Waiting for index 4145670873821250811 to go active ...
2023/09/12 14:30:50 Waiting for index 4145670873821250811 to go active ...
2023/09/12 14:30:51 Waiting for index 4145670873821250811 to go active ...
2023/09/12 14:30:52 Index is 4145670873821250811 now active
2023/09/12 14:30:52 Using n1ql client
2023/09/12 14:30:52 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse_CloseClientConnection (8.13s)
=== RUN TestOrphanIndexCleanup
2023/09/12 14:30:52 In DropAllSecondaryIndexes()
2023/09/12 14:30:52 Index found: index_deferfalse1
2023/09/12 14:30:52 Dropped index index_deferfalse1
2023/09/12 14:30:52 Index found: index_deferfalse2
2023/09/12 14:30:53 Dropped index index_deferfalse2
2023/09/12 14:30:53 Index found: id_ageGreaterThan40
2023/09/12 14:30:53 Dropped index id_ageGreaterThan40
2023/09/12 14:31:07 Created the secondary index idx1_age_regular. Waiting for it become active
2023/09/12 14:31:07 Index is 8347192712252896602 now active
2023/09/12 14:31:15 Created the secondary index idx2_company_regular. Waiting for it become active
2023/09/12 14:31:15 Index is 2908063566015604109 now active
2023/09/12 14:31:25 Using n1ql client
2023/09/12 14:31:25 Query on idx1_age_regular is successful
2023/09/12 14:31:25 Using n1ql client
2023/09/12 14:31:25 Query on idx2_company_regular is successful
Restarting indexer process ...
2023/09/12 14:31:25 []
2023-09-12T14:31:25.642+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-12T14:31:25.642+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/12 14:31:45 Using n1ql client
2023-09-12T14:31:45.587+05:30 [Error] transport error between 127.0.0.1:55934->127.0.0.1:9107: write tcp 127.0.0.1:55934->127.0.0.1:9107: write: broken pipe
2023-09-12T14:31:45.587+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -2817833725878958701 request transport failed `write tcp 127.0.0.1:55934->127.0.0.1:9107: write: broken pipe`
2023-09-12T14:31:45.587+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T14:31:45.587+05:30 [Error] metadataClient:PickRandom: Replicas - [14324268927739664137], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 14:31:45 Query on idx1_age_regular is successful - after indexer restart.
2023/09/12 14:31:45 Using n1ql client
2023/09/12 14:31:45 Query on idx2_company_regular is successful - after indexer restart.
--- PASS: TestOrphanIndexCleanup (52.85s)
=== RUN TestOrphanPartitionCleanup
2023/09/12 14:31:51 Created the secondary index idx3_age_regular. Waiting for it become active
2023/09/12 14:31:51 Index is 17869903338580042752 now active
2023/09/12 14:32:01 Using n1ql client
2023/09/12 14:32:01 Query on idx3_age_regular is successful
Restarting indexer process ...
2023/09/12 14:32:01 []
2023-09-12T14:32:01.287+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-12T14:32:01.290+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/12 14:32:21 Using n1ql client
2023-09-12T14:32:21.255+05:30 [Error] transport error between 127.0.0.1:51784->127.0.0.1:9107: write tcp 127.0.0.1:51784->127.0.0.1:9107: write: broken pipe
2023-09-12T14:32:21.255+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -4556787690430987426 request transport failed `write tcp 127.0.0.1:51784->127.0.0.1:9107: write: broken pipe`
2023-09-12T14:32:21.256+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8. Partition with instances 0
2023-09-12T14:32:21.256+05:30 [Error] metadataClient:PickRandom: Replicas - [3815707669587731928], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 14:32:21 Query on idx3_age_regular is successful - after indexer restart.
--- PASS: TestOrphanPartitionCleanup (35.57s)
=== RUN TestIndexerSettings
2023/09/12 14:32:21 In TestIndexerSettings()
2023/09/12 14:32:21 Changing config key indexer.settings.max_cpu_percent to value 300
2023/09/12 14:32:21 Changing config key indexer.settings.inmemory_snapshot.interval to value 300
2023/09/12 14:32:21 Changing config key indexer.settings.persisted_snapshot.interval to value 20000
2023/09/12 14:32:21 Changing config key indexer.settings.recovery.max_rollbacks to value 3
2023/09/12 14:32:21 Changing config key indexer.settings.log_level to value error
--- PASS: TestIndexerSettings (0.59s)
=== RUN TestRestoreDefaultSettings
2023/09/12 14:32:21 In TestIndexerSettings_RestoreDefault()
2023/09/12 14:32:21 Changing config key indexer.settings.max_cpu_percent to value 0
2023/09/12 14:32:22 Changing config key indexer.settings.inmemory_snapshot.interval to value 200
2023/09/12 14:32:22 Changing config key indexer.settings.persisted_snapshot.interval to value 5000
2023/09/12 14:32:22 Changing config key indexer.settings.recovery.max_rollbacks to value 5
2023/09/12 14:32:22 Changing config key indexer.settings.log_level to value info
--- PASS: TestRestoreDefaultSettings (0.55s)
=== RUN TestStat_ItemsCount
2023/09/12 14:32:22 In TestStat_ItemsCount()
2023/09/12 14:32:22 In DropAllSecondaryIndexes()
2023/09/12 14:32:22 Index found: idx1_age_regular
2023/09/12 14:32:22 Dropped index idx1_age_regular
2023/09/12 14:32:22 Index found: idx3_age_regular
2023/09/12 14:32:22 Dropped index idx3_age_regular
2023/09/12 14:32:22 Index found: idx2_company_regular
2023/09/12 14:32:22 Dropped index idx2_company_regular
2023/09/12 14:32:22 Emptying the default bucket
2023/09/12 14:32:25 Flush Enabled on bucket default, responseBody:
2023/09/12 14:33:03 Flushed the bucket default, Response body:
2023/09/12 14:33:03 Generating JSON docs
2023/09/12 14:33:04 Setting initial JSON docs in KV
2023/09/12 14:33:08 Creating a 2i
2023/09/12 14:33:12 Created the secondary index index_test1. Waiting for it become active
2023/09/12 14:33:12 Index is 2483585974271342758 now active
2023/09/12 14:33:17 items_count stat is 10000
--- PASS: TestStat_ItemsCount (55.17s)
=== RUN TestRangeArrayIndex_Distinct
2023/09/12 14:33:17 In TestRangeArrayIndex_Distinct()
2023/09/12 14:33:17 In DropAllSecondaryIndexes()
2023/09/12 14:33:17 Index found: index_test1
2023/09/12 14:33:17 Dropped index index_test1
2023/09/12 14:33:55 Flushed the bucket default, Response body:
2023/09/12 14:33:59 Created the secondary index arridx_friends. Waiting for it become active
2023/09/12 14:33:59 Index is 15073232884688910178 now active
2023-09-12T14:33:59.676+05:30 [Error] transport error between 127.0.0.1:35088->127.0.0.1:9107: write tcp 127.0.0.1:35088->127.0.0.1:9107: write: broken pipe
2023-09-12T14:33:59.676+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:35088->127.0.0.1:9107: write: broken pipe`
2023-09-12T14:33:59.677+05:30 [Warn] scan failed: requestId queryport 127.0.0.1:9107 inst 13950678149432736368 partition [0]
2023-09-12T14:33:59.677+05:30 [Warn] Scan failed with error for index 15073232884688910178. Trying scan again with replica, reqId: : write tcp 127.0.0.1:35088->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2023-09-12T14:33:59.677+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T14:33:59.677+05:30 [Error] metadataClient:PickRandom: Replicas - [13950678149432736368], PrunedReplica - map[], FilteredReplica map[]
2023-09-12T14:33:59.677+05:30 [Warn] Fail to find indexers to satisfy query request. Trying scan again for index 15073232884688910178, reqId: : write tcp 127.0.0.1:35088->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2023/09/12 14:33:59 Expected and Actual scan responses are the same
2023/09/12 14:34:02 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Distinct (44.94s)
=== RUN TestUpdateArrayIndex_Distinct
2023/09/12 14:34:02 In TestUpdateArrayIndex_Distinct()
2023/09/12 14:34:02 In DropAllSecondaryIndexes()
2023/09/12 14:34:02 Index found: arridx_friends
2023/09/12 14:34:02 Dropped index arridx_friends
2023/09/12 14:34:41 Flushed the bucket default, Response body:
2023/09/12 14:34:45 Created the secondary index arridx_friends. Waiting for it become active
2023/09/12 14:34:45 Index is 10149572157232282395 now active
2023/09/12 14:34:45 Expected and Actual scan responses are the same
2023/09/12 14:34:48 Expected and Actual scan responses are the same
2023/09/12 14:34:48 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Distinct (45.95s)
=== RUN TestRangeArrayIndex_Duplicate
2023/09/12 14:34:48 In TestRangeArrayIndex_Duplicate()
2023/09/12 14:34:48 In DropAllSecondaryIndexes()
2023/09/12 14:34:48 Index found: arridx_friends
2023/09/12 14:34:48 Dropped index arridx_friends
2023/09/12 14:35:26 Flushed the bucket default, Response body:
2023/09/12 14:35:30 Created the secondary index arridx_friends. Waiting for it become active
2023/09/12 14:35:30 Index is 9662966060348395164 now active
2023/09/12 14:35:30 Expected and Actual scan responses are the same
2023/09/12 14:35:33 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Duplicate (44.54s)
=== RUN TestUpdateArrayIndex_Duplicate
2023/09/12 14:35:33 In TestUpdateArrayIndex_Duplicate()
2023/09/12 14:35:33 In DropAllSecondaryIndexes()
2023/09/12 14:35:33 Index found: arridx_friends
2023/09/12 14:35:33 Dropped index arridx_friends
2023/09/12 14:36:11 Flushed the bucket default, Response body:
2023/09/12 14:36:15 Created the secondary index arridx_friends. Waiting for it become active
2023/09/12 14:36:15 Index is 8717470628655648971 now active
2023/09/12 14:36:15 Expected and Actual scan responses are the same
2023/09/12 14:36:18 Expected and Actual scan responses are the same
2023/09/12 14:36:18 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Duplicate (45.33s)
=== RUN TestArrayIndexCornerCases
set09_arrayindex_test.go:193: Test disbaled
--- SKIP: TestArrayIndexCornerCases (0.00s)
=== RUN TestArraySizeIncreaseDecrease1
set09_arrayindex_test.go:249: Test disbaled
--- SKIP: TestArraySizeIncreaseDecrease1 (0.00s)
=== RUN TestArraySizeIncreaseDecrease2
set09_arrayindex_test.go:369: Test disbaled
--- SKIP: TestArraySizeIncreaseDecrease2 (0.00s)
=== RUN TestBufferedScan_BackfillDisabled
2023/09/12 14:36:18 In TestBufferedScan_BackfillDisabled()
2023/09/12 14:36:18 In DropAllSecondaryIndexes()
2023/09/12 14:36:18 Index found: arridx_friends
2023/09/12 14:36:18 Dropped index arridx_friends
2023/09/12 14:36:55 Flushed the bucket default, Response body:
2023/09/12 14:37:33 Changing config key queryport.client.settings.backfillLimit to value 0
2023/09/12 14:37:39 Created the secondary index addressidx. Waiting for it become active
2023/09/12 14:37:39 Index is 11177449103884183609 now active
2023-09-12T14:37:39.777+05:30 [Info] metadata provider version changed 1440 -> 1441
2023-09-12T14:37:39.777+05:30 [Info] switched currmeta from 1440 -> 1441 force false
2023-09-12T14:37:39.777+05:30 [Info] GSIC[default/default-_default-_default-1694509659770953243] started ...
2023-09-12T14:37:39.777+05:30 [Warn] MonitorIndexer: Indexer for default:_default:_default is already being monitored
2023/09/12 14:37:39 Non-backfill file found: /tmp/.ICE-unix
2023/09/12 14:37:39 Non-backfill file found: /tmp/.Test-unix
2023/09/12 14:37:39 Non-backfill file found: /tmp/.X11-unix
2023/09/12 14:37:39 Non-backfill file found: /tmp/.XIM-unix
2023/09/12 14:37:39 Non-backfill file found: /tmp/.font-unix
2023/09/12 14:37:39 Non-backfill file found: /tmp/445a92e9-0600-4469-a43c-7f357f7239f1.sock
2023/09/12 14:37:39 Non-backfill file found: /tmp/e015912c-7ca5-4240-8baf-fb3e80dd922f.sock
2023/09/12 14:37:39 Non-backfill file found: /tmp/f_445a92e9-0600-4469-a43c-7f357f7239f1.sock
2023/09/12 14:37:39 Non-backfill file found: /tmp/f_e015912c-7ca5-4240-8baf-fb3e80dd922f.sock
2023/09/12 14:37:39 Non-backfill file found: /tmp/go-build2597221792
2023/09/12 14:37:39 Non-backfill file found: /tmp/mdbslice
2023/09/12 14:37:39 Non-backfill file found: /tmp/systemd-private-2d645507dd4c4583a6c90296dc6dd5e7-apache2.service-LIJiJr
2023/09/12 14:37:39 Non-backfill file found: /tmp/systemd-private-2d645507dd4c4583a6c90296dc6dd5e7-systemd-timesyncd.service-itmBaV
2023/09/12 14:37:39 limit=1,chsize=256; received 1 items; took 5.527111ms
2023-09-12T14:37:39.803+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T14:37:39.803+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T14:37:39.803+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T14:37:39.803+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T14:37:39.807+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-12T14:37:39.807+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023-09-12T14:37:40.866+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-12T14:37:40.877+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T14:37:40.877+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T14:37:40.877+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T14:37:40.877+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T14:37:40.880+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-12T14:37:40.881+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023/09/12 14:37:42 limit=1000,chsize=256; received 1000 items; took 1.263339526s
2023-09-12T14:37:42.961+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[8929433602472261679:[0]]. New rollbacktime: 1694509322745012198, Old rollbacktime: 0
2023-09-12T14:37:42.961+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[8929433602472261679:[0]]. New rollbacktime: 1694509322745012198, Old rollbacktime: 0
2023-09-12T14:37:43.050+05:30 [Info] gsiKeyspace::Close Closing default:_default:_default
--- PASS: TestBufferedScan_BackfillDisabled (84.68s)
=== RUN TestBufferedScan_BackfillEnabled
2023/09/12 14:37:43 In TestBufferedScan_BackfillEnabled()
2023-09-12T14:37:43.150+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/12 14:37:43 Changing config key queryport.client.settings.backfillLimit to value 1
2023-09-12T14:37:43.161+05:30 [Info] GSIC[default/default-_default-_default-1694509663158240576] started ...
2023-09-12T14:37:43.170+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"plasma","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"warn","queryport.client.settings.backfillLimit":1,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023/09/12 14:37:43 limit=1,chsize=256; received 1 items; took 11.479482ms
2023/09/12 14:37:44 limit=1000,chsize=256; received 1000 items; took 10.579875ms
2023/09/12 14:37:56 limit=1000,chsize=256; received 1000 items; took 10.359389675s
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
2023/09/12 14:38:13 limit=1000,chsize=256; received 760 items; took 15.577817072s
2023/09/12 14:38:13 limit=1000,chsize=256; received 760 items; took 15.577941555s
2023/09/12 14:38:14 Changing config key queryport.client.settings.backfillLimit to value 0
--- PASS: TestBufferedScan_BackfillEnabled (31.19s)
=== RUN TestMultiScanSetup
2023/09/12 14:38:14 In TestMultiScanSetup()
2023/09/12 14:38:15 Emptying the default bucket
2023/09/12 14:38:18 Flush Enabled on bucket default, responseBody:
2023/09/12 14:38:56 Flushed the bucket default, Response body:
2023/09/12 14:38:56 Populating the default bucket
2023/09/12 14:39:10 Created the secondary index index_companyname. Waiting for it become active
2023/09/12 14:39:10 Index is 4026594654924841166 now active
2023/09/12 14:39:16 Created the secondary index index_company. Waiting for it become active
2023/09/12 14:39:16 Index is 8380399618149632127 now active
2023/09/12 14:39:23 Created the secondary index index_company_name_age. Waiting for it become active
2023/09/12 14:39:23 Index is 2576970076157377448 now active
2023/09/12 14:39:29 Created the secondary index index_primary. Waiting for it become active
2023/09/12 14:39:29 Index is 17798120332899502027 now active
2023/09/12 14:39:36 Created the secondary index index_company_name_age_address. Waiting for it become active
2023/09/12 14:39:36 Index is 13242882394871904540 now active
2023/09/12 14:39:43 Created the secondary index index_company_name_age_address_friends. Waiting for it become active
2023/09/12 14:39:43 Index is 2299412974156515001 now active
--- PASS: TestMultiScanSetup (89.39s)
=== RUN TestMultiScanCount
2023/09/12 14:39:43 In TestMultiScanCount()
2023/09/12 14:39:43
--------- Composite Index with 2 fields ---------
2023/09/12 14:39:43
--- ScanAllNoFilter ---
2023/09/12 14:39:43 distinct = false
2023/09/12 14:39:44 Using n1ql client
2023/09/12 14:39:44 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:39:44
--- ScanAllFilterNil ---
2023/09/12 14:39:44 distinct = false
2023/09/12 14:39:44 Using n1ql client
2023/09/12 14:39:44 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:39:44
--- ScanAll_AllFiltersNil ---
2023/09/12 14:39:44 distinct = false
2023/09/12 14:39:44 Using n1ql client
2023/09/12 14:39:44 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:39:44
--- SingleSeek ---
2023/09/12 14:39:44 distinct = false
2023/09/12 14:39:45 Using n1ql client
2023/09/12 14:39:45 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:39:45
--- MultipleSeek ---
2023/09/12 14:39:45 distinct = false
2023/09/12 14:39:45 Using n1ql client
2023/09/12 14:39:45 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 14:39:45
--- SimpleRange ---
2023/09/12 14:39:45 distinct = false
2023/09/12 14:39:46 Using n1ql client
2023/09/12 14:39:46 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/12 14:39:46
--- NonOverlappingRanges ---
2023/09/12 14:39:46 distinct = false
2023/09/12 14:39:46 Using n1ql client
2023/09/12 14:39:46 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2023/09/12 14:39:46
--- OverlappingRanges ---
2023/09/12 14:39:46 distinct = false
2023/09/12 14:39:47 Using n1ql client
2023/09/12 14:39:47 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2023/09/12 14:39:47
--- NonOverlappingFilters ---
2023/09/12 14:39:47 distinct = false
2023/09/12 14:39:47 Using n1ql client
2023/09/12 14:39:47 MultiScanCount = 337 ExpectedMultiScanCount = 337
2023/09/12 14:39:47
--- OverlappingFilters ---
2023/09/12 14:39:47 distinct = false
2023/09/12 14:39:47 Using n1ql client
2023/09/12 14:39:47 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2023/09/12 14:39:47
--- BoundaryFilters ---
2023/09/12 14:39:47 distinct = false
2023/09/12 14:39:48 Using n1ql client
2023/09/12 14:39:48 MultiScanCount = 499 ExpectedMultiScanCount = 499
2023/09/12 14:39:48
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:39:48 distinct = false
2023/09/12 14:39:48 Using n1ql client
2023/09/12 14:39:48 MultiScanCount = 256 ExpectedMultiScanCount = 256
2023/09/12 14:39:48
--- SeekAndFilters_Overlapping ---
2023/09/12 14:39:48 distinct = false
2023/09/12 14:39:49 Using n1ql client
2023/09/12 14:39:49 MultiScanCount = 255 ExpectedMultiScanCount = 255
2023/09/12 14:39:49
--- SimpleRangeLowUnbounded ---
2023/09/12 14:39:49 distinct = false
2023/09/12 14:39:49 Using n1ql client
2023/09/12 14:39:49 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/12 14:39:49
--- SimpleRangeHighUnbounded ---
2023/09/12 14:39:49 distinct = false
2023/09/12 14:39:49 Using n1ql client
2023/09/12 14:39:49 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/12 14:39:49
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:39:49 distinct = false
2023/09/12 14:39:50 Using n1ql client
2023/09/12 14:39:50 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:39:50
--- FiltersWithUnbounded ---
2023/09/12 14:39:50 distinct = false
2023/09/12 14:39:50 Using n1ql client
2023/09/12 14:39:50 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/12 14:39:50
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:39:50 distinct = false
2023/09/12 14:39:51 Using n1ql client
2023/09/12 14:39:51 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/12 14:39:51
--------- Simple Index with 1 field ---------
2023/09/12 14:39:51
--- SingleIndexSimpleRange ---
2023/09/12 14:39:51 distinct = false
2023/09/12 14:39:51 Using n1ql client
2023/09/12 14:39:51 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/12 14:39:51
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:39:51 distinct = false
2023/09/12 14:39:51 Using n1ql client
2023/09/12 14:39:51 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2023/09/12 14:39:51
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:39:51 distinct = false
2023/09/12 14:39:52 Using n1ql client
2023/09/12 14:39:52 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2023/09/12 14:39:52
--------- Composite Index with 3 fields ---------
2023/09/12 14:39:52
--- ScanAllNoFilter ---
2023/09/12 14:39:52 distinct = false
2023/09/12 14:39:52 Using n1ql client
2023/09/12 14:39:52 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:39:52
--- ScanAllFilterNil ---
2023/09/12 14:39:52 distinct = false
2023/09/12 14:39:53 Using n1ql client
2023/09/12 14:39:53 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:39:53
--- ScanAll_AllFiltersNil ---
2023/09/12 14:39:53 distinct = false
2023/09/12 14:39:53 Using n1ql client
2023/09/12 14:39:53 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:39:53
--- 3FieldsSingleSeek ---
2023/09/12 14:39:53 distinct = false
2023/09/12 14:39:53 Using n1ql client
2023/09/12 14:39:53 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:39:53
--- 3FieldsMultipleSeeks ---
2023/09/12 14:39:53 distinct = false
2023/09/12 14:39:54 Using n1ql client
2023/09/12 14:39:54 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/12 14:39:54
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:39:54 distinct = false
2023/09/12 14:39:54 Using n1ql client
2023/09/12 14:39:54 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 14:39:54
--------- New scenarios ---------
2023/09/12 14:39:54
--- CompIndexHighUnbounded1 ---
2023/09/12 14:39:54
--- Multi Scan 0 ---
2023/09/12 14:39:54 distinct = false
2023/09/12 14:39:55 Using n1ql client
2023/09/12 14:39:55 Using n1ql client
2023/09/12 14:39:55 len(scanResults) = 8 MultiScanCount = 8
2023/09/12 14:39:55 Expected and Actual scan responses are the same
2023/09/12 14:39:55
--- Multi Scan 1 ---
2023/09/12 14:39:55 distinct = false
2023/09/12 14:39:55 Using n1ql client
2023/09/12 14:39:55 Using n1ql client
2023/09/12 14:39:55 len(scanResults) = 0 MultiScanCount = 0
2023/09/12 14:39:55 Expected and Actual scan responses are the same
2023/09/12 14:39:55
--- Multi Scan 2 ---
2023/09/12 14:39:55 distinct = false
2023/09/12 14:39:56 Using n1ql client
2023/09/12 14:39:56 Using n1ql client
2023/09/12 14:39:56 len(scanResults) = 9 MultiScanCount = 9
2023/09/12 14:39:56 Expected and Actual scan responses are the same
2023/09/12 14:39:56
--- CompIndexHighUnbounded2 ---
2023/09/12 14:39:56
--- Multi Scan 0 ---
2023/09/12 14:39:56 distinct = false
2023/09/12 14:39:56 Using n1ql client
2023/09/12 14:39:56 Using n1ql client
2023/09/12 14:39:56 len(scanResults) = 4138 MultiScanCount = 4138
2023/09/12 14:39:56 Expected and Actual scan responses are the same
2023/09/12 14:39:56
--- Multi Scan 1 ---
2023/09/12 14:39:56 distinct = false
2023/09/12 14:39:56 Using n1ql client
2023/09/12 14:39:56 Using n1ql client
2023/09/12 14:39:56 len(scanResults) = 2746 MultiScanCount = 2746
2023/09/12 14:39:56 Expected and Actual scan responses are the same
2023/09/12 14:39:56
--- Multi Scan 2 ---
2023/09/12 14:39:56 distinct = false
2023/09/12 14:39:57 Using n1ql client
2023/09/12 14:39:57 Using n1ql client
2023/09/12 14:39:57 len(scanResults) = 4691 MultiScanCount = 4691
2023/09/12 14:39:57 Expected and Actual scan responses are the same
2023/09/12 14:39:57
--- CompIndexHighUnbounded3 ---
2023/09/12 14:39:57
--- Multi Scan 0 ---
2023/09/12 14:39:57 distinct = false
2023/09/12 14:39:57 Using n1ql client
2023/09/12 14:39:57 Using n1ql client
2023/09/12 14:39:57 len(scanResults) = 1329 MultiScanCount = 1329
2023/09/12 14:39:57 Expected and Actual scan responses are the same
2023/09/12 14:39:57
--- CompIndexHighUnbounded4 ---
2023/09/12 14:39:57
--- Multi Scan 0 ---
2023/09/12 14:39:57 distinct = false
2023/09/12 14:39:58 Using n1ql client
2023/09/12 14:39:58 Using n1ql client
2023/09/12 14:39:58 len(scanResults) = 5349 MultiScanCount = 5349
2023/09/12 14:39:58 Expected and Actual scan responses are the same
2023/09/12 14:39:58
--- CompIndexHighUnbounded5 ---
2023/09/12 14:39:58
--- Multi Scan 0 ---
2023/09/12 14:39:58 distinct = false
2023/09/12 14:39:58 Using n1ql client
2023/09/12 14:39:58 Using n1ql client
2023/09/12 14:39:58 len(scanResults) = 8210 MultiScanCount = 8210
2023/09/12 14:39:58 Expected and Actual scan responses are the same
2023/09/12 14:39:58
--- SeekBoundaries ---
2023/09/12 14:39:58
--- Multi Scan 0 ---
2023/09/12 14:39:58 distinct = false
2023/09/12 14:39:59 Using n1ql client
2023/09/12 14:39:59 Using n1ql client
2023/09/12 14:39:59 len(scanResults) = 175 MultiScanCount = 175
2023/09/12 14:39:59 Expected and Actual scan responses are the same
2023/09/12 14:39:59
--- Multi Scan 1 ---
2023/09/12 14:39:59 distinct = false
2023/09/12 14:39:59 Using n1ql client
2023/09/12 14:39:59 Using n1ql client
2023/09/12 14:39:59 len(scanResults) = 1 MultiScanCount = 1
2023/09/12 14:39:59 Expected and Actual scan responses are the same
2023/09/12 14:39:59
--- Multi Scan 2 ---
2023/09/12 14:39:59 distinct = false
2023/09/12 14:40:00 Using n1ql client
2023/09/12 14:40:00 Using n1ql client
2023/09/12 14:40:00 len(scanResults) = 555 MultiScanCount = 555
2023/09/12 14:40:00 Expected and Actual scan responses are the same
2023/09/12 14:40:00
--- Multi Scan 3 ---
2023/09/12 14:40:00 distinct = false
2023/09/12 14:40:00 Using n1ql client
2023/09/12 14:40:00 Using n1ql client
2023/09/12 14:40:00 len(scanResults) = 872 MultiScanCount = 872
2023/09/12 14:40:00 Expected and Actual scan responses are the same
2023/09/12 14:40:00
--- Multi Scan 4 ---
2023/09/12 14:40:00 distinct = false
2023/09/12 14:40:00 Using n1ql client
2023/09/12 14:40:00 Using n1ql client
2023/09/12 14:40:00 len(scanResults) = 287 MultiScanCount = 287
2023/09/12 14:40:00 Expected and Actual scan responses are the same
2023/09/12 14:40:00
--- Multi Scan 5 ---
2023/09/12 14:40:00 distinct = false
2023/09/12 14:40:01 Using n1ql client
2023/09/12 14:40:01 Using n1ql client
2023/09/12 14:40:01 len(scanResults) = 5254 MultiScanCount = 5254
2023/09/12 14:40:01 Expected and Actual scan responses are the same
2023/09/12 14:40:01
--- Multi Scan 6 ---
2023/09/12 14:40:01 distinct = false
2023/09/12 14:40:01 Using n1ql client
2023/09/12 14:40:01 Using n1ql client
2023/09/12 14:40:01 len(scanResults) = 5566 MultiScanCount = 5566
2023/09/12 14:40:01 Expected and Actual scan responses are the same
2023/09/12 14:40:01
--- Multi Scan 7 ---
2023/09/12 14:40:01 distinct = false
2023/09/12 14:40:02 Using n1ql client
2023/09/12 14:40:02 Using n1ql client
2023/09/12 14:40:02 len(scanResults) = 8 MultiScanCount = 8
2023/09/12 14:40:02 Expected and Actual scan responses are the same
2023/09/12 14:40:02
--------- With DISTINCT True ---------
2023/09/12 14:40:02
--- ScanAllNoFilter ---
2023/09/12 14:40:02 distinct = true
2023/09/12 14:40:02 Using n1ql client
2023/09/12 14:40:02 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:40:02
--- ScanAllFilterNil ---
2023/09/12 14:40:02 distinct = true
2023/09/12 14:40:03 Using n1ql client
2023/09/12 14:40:03 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:40:03
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:03 distinct = true
2023/09/12 14:40:03 Using n1ql client
2023/09/12 14:40:03 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:40:03
--- SingleSeek ---
2023/09/12 14:40:03 distinct = true
2023/09/12 14:40:04 Using n1ql client
2023/09/12 14:40:04 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:40:04
--- MultipleSeek ---
2023/09/12 14:40:04 distinct = true
2023/09/12 14:40:04 Using n1ql client
2023/09/12 14:40:04 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 14:40:04
--- SimpleRange ---
2023/09/12 14:40:04 distinct = true
2023/09/12 14:40:05 Using n1ql client
2023/09/12 14:40:05 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/12 14:40:05
--- NonOverlappingRanges ---
2023/09/12 14:40:05 distinct = true
2023/09/12 14:40:05 Using n1ql client
2023/09/12 14:40:05 MultiScanCount = 428 ExpectedMultiScanCount = 428
2023/09/12 14:40:05
--- OverlappingRanges ---
2023/09/12 14:40:05 distinct = true
2023/09/12 14:40:06 Using n1ql client
2023/09/12 14:40:06 MultiScanCount = 575 ExpectedMultiScanCount = 575
2023/09/12 14:40:06
--- NonOverlappingFilters ---
2023/09/12 14:40:06 distinct = true
2023/09/12 14:40:06 Using n1ql client
2023/09/12 14:40:06 MultiScanCount = 186 ExpectedMultiScanCount = 186
2023/09/12 14:40:06
--- NonOverlappingFilters2 ---
2023/09/12 14:40:06 distinct = true
2023/09/12 14:40:07 Using n1ql client
2023/09/12 14:40:07 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:40:07
--- OverlappingFilters ---
2023/09/12 14:40:07 distinct = true
2023/09/12 14:40:07 Using n1ql client
2023/09/12 14:40:07 MultiScanCount = 543 ExpectedMultiScanCount = 543
2023/09/12 14:40:07
--- BoundaryFilters ---
2023/09/12 14:40:07 distinct = true
2023/09/12 14:40:07 Using n1ql client
2023/09/12 14:40:07 MultiScanCount = 172 ExpectedMultiScanCount = 172
2023/09/12 14:40:07
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:40:07 distinct = true
2023/09/12 14:40:08 Using n1ql client
2023/09/12 14:40:08 MultiScanCount = 135 ExpectedMultiScanCount = 135
2023/09/12 14:40:08
--- SeekAndFilters_Overlapping ---
2023/09/12 14:40:08 distinct = true
2023/09/12 14:40:08 Using n1ql client
2023/09/12 14:40:08 MultiScanCount = 134 ExpectedMultiScanCount = 134
2023/09/12 14:40:08
--- SimpleRangeLowUnbounded ---
2023/09/12 14:40:08 distinct = false
2023/09/12 14:40:09 Using n1ql client
2023/09/12 14:40:09 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/12 14:40:09
--- SimpleRangeHighUnbounded ---
2023/09/12 14:40:09 distinct = false
2023/09/12 14:40:09 Using n1ql client
2023/09/12 14:40:09 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/12 14:40:09
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:40:09 distinct = false
2023/09/12 14:40:09 Using n1ql client
2023/09/12 14:40:09 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:40:09
--- FiltersWithUnbounded ---
2023/09/12 14:40:09 distinct = false
2023/09/12 14:40:10 Using n1ql client
2023/09/12 14:40:10 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/12 14:40:10
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:40:10 distinct = false
2023/09/12 14:40:10 Using n1ql client
2023/09/12 14:40:10 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/12 14:40:10
--------- Simple Index with 1 field ---------
2023/09/12 14:40:10
--- SingleIndexSimpleRange ---
2023/09/12 14:40:10 distinct = true
2023/09/12 14:40:11 Using n1ql client
2023/09/12 14:40:11 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/12 14:40:11
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:40:11 distinct = true
2023/09/12 14:40:11 Using n1ql client
2023/09/12 14:40:11 MultiScanCount = 713 ExpectedMultiScanCount = 713
2023/09/12 14:40:11
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:40:11 distinct = true
2023/09/12 14:40:11 Using n1ql client
2023/09/12 14:40:11 MultiScanCount = 869 ExpectedMultiScanCount = 869
2023/09/12 14:40:11
--------- Composite Index with 3 fields ---------
2023/09/12 14:40:11
--- ScanAllNoFilter ---
2023/09/12 14:40:11 distinct = true
2023/09/12 14:40:12 Using n1ql client
2023/09/12 14:40:12 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:40:12
--- ScanAllFilterNil ---
2023/09/12 14:40:12 distinct = true
2023/09/12 14:40:12 Using n1ql client
2023/09/12 14:40:12 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:40:12
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:12 distinct = true
2023/09/12 14:40:13 Using n1ql client
2023/09/12 14:40:13 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:40:13
--- 3FieldsSingleSeek ---
2023/09/12 14:40:13 distinct = true
2023/09/12 14:40:13 Using n1ql client
2023/09/12 14:40:13 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:40:13
--- 3FieldsMultipleSeeks ---
2023/09/12 14:40:13 distinct = true
2023/09/12 14:40:14 Using n1ql client
2023/09/12 14:40:14 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/12 14:40:14
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:40:14 distinct = true
2023/09/12 14:40:14 Using n1ql client
2023/09/12 14:40:14 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanCount (30.86s)
=== RUN TestMultiScanScenarios
2023/09/12 14:40:14 In TestMultiScanScenarios()
2023/09/12 14:40:14
--------- Composite Index with 2 fields ---------
2023/09/12 14:40:14
--- ScanAllNoFilter ---
2023/09/12 14:40:14 distinct = false
2023/09/12 14:40:14 Using n1ql client
2023/09/12 14:40:14 Expected and Actual scan responses are the same
2023/09/12 14:40:14
--- ScanAllFilterNil ---
2023/09/12 14:40:14 distinct = false
2023/09/12 14:40:15 Using n1ql client
2023/09/12 14:40:15 Expected and Actual scan responses are the same
2023/09/12 14:40:15
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:15 distinct = false
2023/09/12 14:40:15 Using n1ql client
2023/09/12 14:40:15 Expected and Actual scan responses are the same
2023/09/12 14:40:15
--- SingleSeek ---
2023/09/12 14:40:15 distinct = false
2023/09/12 14:40:16 Using n1ql client
2023/09/12 14:40:16 Expected and Actual scan responses are the same
2023/09/12 14:40:16
--- MultipleSeek ---
2023/09/12 14:40:16 distinct = false
2023/09/12 14:40:16 Using n1ql client
2023/09/12 14:40:16 Expected and Actual scan responses are the same
2023/09/12 14:40:16
--- SimpleRange ---
2023/09/12 14:40:16 distinct = false
2023/09/12 14:40:17 Using n1ql client
2023/09/12 14:40:17 Expected and Actual scan responses are the same
2023/09/12 14:40:17
--- NonOverlappingRanges ---
2023/09/12 14:40:17 distinct = false
2023/09/12 14:40:17 Using n1ql client
2023/09/12 14:40:17 Expected and Actual scan responses are the same
2023/09/12 14:40:17
--- OverlappingRanges ---
2023/09/12 14:40:17 distinct = false
2023/09/12 14:40:17 Using n1ql client
2023/09/12 14:40:17 Expected and Actual scan responses are the same
2023/09/12 14:40:17
--- NonOverlappingFilters ---
2023/09/12 14:40:17 distinct = false
2023/09/12 14:40:18 Using n1ql client
2023/09/12 14:40:18 Expected and Actual scan responses are the same
2023/09/12 14:40:18
--- OverlappingFilters ---
2023/09/12 14:40:18 distinct = false
2023/09/12 14:40:18 Using n1ql client
2023/09/12 14:40:18 Expected and Actual scan responses are the same
2023/09/12 14:40:18
--- BoundaryFilters ---
2023/09/12 14:40:18 distinct = false
2023/09/12 14:40:19 Using n1ql client
2023/09/12 14:40:19 Expected and Actual scan responses are the same
2023/09/12 14:40:19
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:40:19 distinct = false
2023/09/12 14:40:19 Using n1ql client
2023/09/12 14:40:19 Expected and Actual scan responses are the same
2023/09/12 14:40:19
--- SeekAndFilters_Overlapping ---
2023/09/12 14:40:19 distinct = false
2023/09/12 14:40:19 Using n1ql client
2023/09/12 14:40:19 Expected and Actual scan responses are the same
2023/09/12 14:40:19
--- SimpleRangeLowUnbounded ---
2023/09/12 14:40:19 distinct = false
2023/09/12 14:40:20 Using n1ql client
2023/09/12 14:40:20 Expected and Actual scan responses are the same
2023/09/12 14:40:20
--- SimpleRangeHighUnbounded ---
2023/09/12 14:40:20 distinct = false
2023/09/12 14:40:20 Using n1ql client
2023/09/12 14:40:20 Expected and Actual scan responses are the same
2023/09/12 14:40:20
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:40:20 distinct = false
2023/09/12 14:40:21 Using n1ql client
2023/09/12 14:40:21 Expected and Actual scan responses are the same
2023/09/12 14:40:21
--- FiltersWithUnbounded ---
2023/09/12 14:40:21 distinct = false
2023/09/12 14:40:21 Using n1ql client
2023/09/12 14:40:21 Expected and Actual scan responses are the same
2023/09/12 14:40:21
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:40:21 distinct = false
2023/09/12 14:40:22 Using n1ql client
2023/09/12 14:40:22 Expected and Actual scan responses are the same
2023/09/12 14:40:22
--------- Simple Index with 1 field ---------
2023/09/12 14:40:22
--- SingleIndexSimpleRange ---
2023/09/12 14:40:22 distinct = false
2023/09/12 14:40:22 Using n1ql client
2023/09/12 14:40:22 Expected and Actual scan responses are the same
2023/09/12 14:40:22
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:40:22 distinct = false
2023/09/12 14:40:22 Using n1ql client
2023/09/12 14:40:22 Expected and Actual scan responses are the same
2023/09/12 14:40:22
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:40:22 distinct = false
2023/09/12 14:40:23 Using n1ql client
2023/09/12 14:40:23 Expected and Actual scan responses are the same
2023/09/12 14:40:23
--------- Composite Index with 3 fields ---------
2023/09/12 14:40:23
--- ScanAllNoFilter ---
2023/09/12 14:40:23 distinct = false
2023/09/12 14:40:23 Using n1ql client
2023/09/12 14:40:23 Expected and Actual scan responses are the same
2023/09/12 14:40:23
--- ScanAllFilterNil ---
2023/09/12 14:40:23 distinct = false
2023/09/12 14:40:24 Using n1ql client
2023/09/12 14:40:24 Expected and Actual scan responses are the same
2023/09/12 14:40:24
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:24 distinct = false
2023/09/12 14:40:24 Using n1ql client
2023/09/12 14:40:24 Expected and Actual scan responses are the same
2023/09/12 14:40:24
--- 3FieldsSingleSeek ---
2023/09/12 14:40:24 distinct = false
2023/09/12 14:40:25 Using n1ql client
2023/09/12 14:40:25 Expected and Actual scan responses are the same
2023/09/12 14:40:25
--- 3FieldsMultipleSeeks ---
2023/09/12 14:40:25 distinct = false
2023/09/12 14:40:25 Using n1ql client
2023/09/12 14:40:25 Expected and Actual scan responses are the same
2023/09/12 14:40:25
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:40:25 distinct = false
2023/09/12 14:40:26 Using n1ql client
2023/09/12 14:40:26 Expected and Actual scan responses are the same
2023/09/12 14:40:26
--------- New scenarios ---------
2023/09/12 14:40:26
--- CompIndexHighUnbounded1 ---
2023/09/12 14:40:26
--- Multi Scan 0 ---
2023/09/12 14:40:26 distinct = false
2023/09/12 14:40:26 Using n1ql client
2023/09/12 14:40:26 Expected and Actual scan responses are the same
2023/09/12 14:40:26
--- Multi Scan 1 ---
2023/09/12 14:40:26 distinct = false
2023/09/12 14:40:27 Using n1ql client
2023/09/12 14:40:27 Expected and Actual scan responses are the same
2023/09/12 14:40:27
--- Multi Scan 2 ---
2023/09/12 14:40:27 distinct = false
2023/09/12 14:40:27 Using n1ql client
2023/09/12 14:40:27 Expected and Actual scan responses are the same
2023/09/12 14:40:27
--- CompIndexHighUnbounded2 ---
2023/09/12 14:40:27
--- Multi Scan 0 ---
2023/09/12 14:40:27 distinct = false
2023/09/12 14:40:27 Using n1ql client
2023/09/12 14:40:27 Expected and Actual scan responses are the same
2023/09/12 14:40:27
--- Multi Scan 1 ---
2023/09/12 14:40:27 distinct = false
2023/09/12 14:40:28 Using n1ql client
2023/09/12 14:40:28 Expected and Actual scan responses are the same
2023/09/12 14:40:28
--- Multi Scan 2 ---
2023/09/12 14:40:28 distinct = false
2023/09/12 14:40:28 Using n1ql client
2023/09/12 14:40:28 Expected and Actual scan responses are the same
2023/09/12 14:40:28
--- CompIndexHighUnbounded3 ---
2023/09/12 14:40:28
--- Multi Scan 0 ---
2023/09/12 14:40:28 distinct = false
2023/09/12 14:40:29 Using n1ql client
2023/09/12 14:40:29 Expected and Actual scan responses are the same
2023/09/12 14:40:29
--- CompIndexHighUnbounded4 ---
2023/09/12 14:40:29
--- Multi Scan 0 ---
2023/09/12 14:40:29 distinct = false
2023/09/12 14:40:29 Using n1ql client
2023/09/12 14:40:29 Expected and Actual scan responses are the same
2023/09/12 14:40:29
--- CompIndexHighUnbounded5 ---
2023/09/12 14:40:29
--- Multi Scan 0 ---
2023/09/12 14:40:29 distinct = false
2023/09/12 14:40:30 Using n1ql client
2023/09/12 14:40:30 Expected and Actual scan responses are the same
2023/09/12 14:40:30
--- SeekBoundaries ---
2023/09/12 14:40:30
--- Multi Scan 0 ---
2023/09/12 14:40:30 distinct = false
2023/09/12 14:40:30 Using n1ql client
2023/09/12 14:40:30 Expected and Actual scan responses are the same
2023/09/12 14:40:30
--- Multi Scan 1 ---
2023/09/12 14:40:30 distinct = false
2023/09/12 14:40:30 Using n1ql client
2023/09/12 14:40:30 Expected and Actual scan responses are the same
2023/09/12 14:40:30
--- Multi Scan 2 ---
2023/09/12 14:40:30 distinct = false
2023/09/12 14:40:31 Using n1ql client
2023/09/12 14:40:31 Expected and Actual scan responses are the same
2023/09/12 14:40:31
--- Multi Scan 3 ---
2023/09/12 14:40:31 distinct = false
2023/09/12 14:40:31 Using n1ql client
2023/09/12 14:40:31 Expected and Actual scan responses are the same
2023/09/12 14:40:31
--- Multi Scan 4 ---
2023/09/12 14:40:31 distinct = false
2023/09/12 14:40:32 Using n1ql client
2023/09/12 14:40:32 Expected and Actual scan responses are the same
2023/09/12 14:40:32
--- Multi Scan 5 ---
2023/09/12 14:40:32 distinct = false
2023/09/12 14:40:32 Using n1ql client
2023/09/12 14:40:32 Expected and Actual scan responses are the same
2023/09/12 14:40:32
--- Multi Scan 6 ---
2023/09/12 14:40:32 distinct = false
2023/09/12 14:40:32 Using n1ql client
2023/09/12 14:40:32 Expected and Actual scan responses are the same
2023/09/12 14:40:32
--- Multi Scan 7 ---
2023/09/12 14:40:32 distinct = false
2023/09/12 14:40:33 Using n1ql client
2023/09/12 14:40:33 Expected and Actual scan responses are the same
2023/09/12 14:40:33
--- PrefixSortVariations ---
2023/09/12 14:40:33
--- Multi Scan 0 ---
2023/09/12 14:40:33 distinct = false
2023/09/12 14:40:33 Using n1ql client
2023/09/12 14:40:33 Expected and Actual scan responses are the same
2023/09/12 14:40:33
--- Multi Scan 1 ---
2023/09/12 14:40:33 distinct = false
2023/09/12 14:40:34 Using n1ql client
2023/09/12 14:40:34 Expected and Actual scan responses are the same
--- PASS: TestMultiScanScenarios (19.78s)
=== RUN TestMultiScanOffset
2023/09/12 14:40:34 In TestMultiScanOffset()
2023/09/12 14:40:34
--------- Composite Index with 2 fields ---------
2023/09/12 14:40:34
--- ScanAllNoFilter ---
2023/09/12 14:40:34 distinct = false
2023/09/12 14:40:34 Using n1ql client
2023/09/12 14:40:34
--- ScanAllFilterNil ---
2023/09/12 14:40:34 distinct = false
2023/09/12 14:40:35 Using n1ql client
2023/09/12 14:40:35
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:35 distinct = false
2023/09/12 14:40:35 Using n1ql client
2023/09/12 14:40:35
--- SingleSeek ---
2023/09/12 14:40:35 distinct = false
2023/09/12 14:40:35 Using n1ql client
2023/09/12 14:40:35
--- MultipleSeek ---
2023/09/12 14:40:35 distinct = false
2023/09/12 14:40:36 Using n1ql client
2023/09/12 14:40:36
--- SimpleRange ---
2023/09/12 14:40:36 distinct = false
2023/09/12 14:40:36 Using n1ql client
2023/09/12 14:40:36
--- NonOverlappingRanges ---
2023/09/12 14:40:36 distinct = false
2023/09/12 14:40:37 Using n1ql client
2023/09/12 14:40:37
--- OverlappingRanges ---
2023/09/12 14:40:37 distinct = false
2023/09/12 14:40:37 Using n1ql client
2023/09/12 14:40:37
--- NonOverlappingFilters ---
2023/09/12 14:40:37 distinct = false
2023/09/12 14:40:38 Using n1ql client
2023/09/12 14:40:38
--- OverlappingFilters ---
2023/09/12 14:40:38 distinct = false
2023/09/12 14:40:38 Using n1ql client
2023/09/12 14:40:38
--- BoundaryFilters ---
2023/09/12 14:40:38 distinct = false
2023/09/12 14:40:38 Using n1ql client
2023/09/12 14:40:38
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:40:38 distinct = false
2023/09/12 14:40:39 Using n1ql client
2023/09/12 14:40:39
--- SeekAndFilters_Overlapping ---
2023/09/12 14:40:39 distinct = false
2023/09/12 14:40:39 Using n1ql client
2023/09/12 14:40:39
--- SimpleRangeLowUnbounded ---
2023/09/12 14:40:39 distinct = false
2023/09/12 14:40:40 Using n1ql client
2023/09/12 14:40:40 Expected and Actual scan responses are the same
2023/09/12 14:40:40
--- SimpleRangeHighUnbounded ---
2023/09/12 14:40:40 distinct = false
2023/09/12 14:40:40 Using n1ql client
2023/09/12 14:40:40 Expected and Actual scan responses are the same
2023/09/12 14:40:40
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:40:40 distinct = false
2023/09/12 14:40:40 Using n1ql client
2023/09/12 14:40:40 Expected and Actual scan responses are the same
2023/09/12 14:40:40
--- FiltersWithUnbounded ---
2023/09/12 14:40:40 distinct = false
2023/09/12 14:40:41 Using n1ql client
2023/09/12 14:40:41 Expected and Actual scan responses are the same
2023/09/12 14:40:41
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:40:41 distinct = false
2023/09/12 14:40:41 Using n1ql client
2023/09/12 14:40:41 Expected and Actual scan responses are the same
2023/09/12 14:40:41
--------- Simple Index with 1 field ---------
2023/09/12 14:40:41
--- SingleIndexSimpleRange ---
2023/09/12 14:40:41 distinct = false
2023/09/12 14:40:42 Using n1ql client
2023/09/12 14:40:42
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:40:42 distinct = false
2023/09/12 14:40:42 Using n1ql client
2023/09/12 14:40:42
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:40:42 distinct = false
2023/09/12 14:40:42 Using n1ql client
2023/09/12 14:40:42
--------- Composite Index with 3 fields ---------
2023/09/12 14:40:42
--- ScanAllNoFilter ---
2023/09/12 14:40:42 distinct = false
2023/09/12 14:40:43 Using n1ql client
2023/09/12 14:40:43
--- ScanAllFilterNil ---
2023/09/12 14:40:43 distinct = false
2023/09/12 14:40:43 Using n1ql client
2023/09/12 14:40:43
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:43 distinct = false
2023/09/12 14:40:44 Using n1ql client
2023/09/12 14:40:44
--- 3FieldsSingleSeek ---
2023/09/12 14:40:44 distinct = false
2023/09/12 14:40:44 Using n1ql client
2023/09/12 14:40:44
--- 3FieldsMultipleSeeks ---
2023/09/12 14:40:44 distinct = false
2023/09/12 14:40:45 Using n1ql client
2023/09/12 14:40:45
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:40:45 distinct = false
2023/09/12 14:40:45 Using n1ql client
--- PASS: TestMultiScanOffset (11.30s)
=== RUN TestMultiScanPrimaryIndex
2023/09/12 14:40:45 In TestMultiScanPrimaryIndex()
2023/09/12 14:40:45
--- PrimaryRange ---
2023/09/12 14:40:45 Using n1ql client
2023/09/12 14:40:45 Expected and Actual scan responses are the same
2023/09/12 14:40:45
--- PrimaryScanAllNoFilter ---
2023/09/12 14:40:45 Using n1ql client
2023/09/12 14:40:45 Expected and Actual scan responses are the same
--- PASS: TestMultiScanPrimaryIndex (0.08s)
=== RUN TestMultiScanDistinct
2023/09/12 14:40:45 In TestScansDistinct()
2023/09/12 14:40:45
--------- Composite Index with 2 fields ---------
2023/09/12 14:40:45
--- ScanAllNoFilter ---
2023/09/12 14:40:45 distinct = true
2023/09/12 14:40:46 Using n1ql client
2023/09/12 14:40:46 Expected and Actual scan responses are the same
2023/09/12 14:40:46
--- ScanAllFilterNil ---
2023/09/12 14:40:46 distinct = true
2023/09/12 14:40:46 Using n1ql client
2023/09/12 14:40:46 Expected and Actual scan responses are the same
2023/09/12 14:40:46
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:46 distinct = true
2023/09/12 14:40:46 Using n1ql client
2023/09/12 14:40:47 Expected and Actual scan responses are the same
2023/09/12 14:40:47
--- SingleSeek ---
2023/09/12 14:40:47 distinct = true
2023/09/12 14:40:47 Using n1ql client
2023/09/12 14:40:47 Expected and Actual scan responses are the same
2023/09/12 14:40:47
--- MultipleSeek ---
2023/09/12 14:40:47 distinct = true
2023/09/12 14:40:47 Using n1ql client
2023/09/12 14:40:47 Expected and Actual scan responses are the same
2023/09/12 14:40:47
--- SimpleRange ---
2023/09/12 14:40:47 distinct = true
2023/09/12 14:40:48 Using n1ql client
2023/09/12 14:40:48 Expected and Actual scan responses are the same
2023/09/12 14:40:48
--- NonOverlappingRanges ---
2023/09/12 14:40:48 distinct = true
2023/09/12 14:40:48 Using n1ql client
2023/09/12 14:40:48 Expected and Actual scan responses are the same
2023/09/12 14:40:48
--- OverlappingRanges ---
2023/09/12 14:40:48 distinct = true
2023/09/12 14:40:49 Using n1ql client
2023/09/12 14:40:49 Expected and Actual scan responses are the same
2023/09/12 14:40:49
--- NonOverlappingFilters ---
2023/09/12 14:40:49 distinct = true
2023/09/12 14:40:49 Using n1ql client
2023/09/12 14:40:49 Expected and Actual scan responses are the same
2023/09/12 14:40:49
--- OverlappingFilters ---
2023/09/12 14:40:49 distinct = true
2023/09/12 14:40:49 Using n1ql client
2023/09/12 14:40:49 Expected and Actual scan responses are the same
2023/09/12 14:40:49
--- BoundaryFilters ---
2023/09/12 14:40:49 distinct = true
2023/09/12 14:40:50 Using n1ql client
2023/09/12 14:40:50 Expected and Actual scan responses are the same
2023/09/12 14:40:50
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:40:50 distinct = true
2023/09/12 14:40:50 Using n1ql client
2023/09/12 14:40:50 Expected and Actual scan responses are the same
2023/09/12 14:40:50
--- SeekAndFilters_Overlapping ---
2023/09/12 14:40:50 distinct = true
2023/09/12 14:40:51 Using n1ql client
2023/09/12 14:40:51 Expected and Actual scan responses are the same
2023/09/12 14:40:51
--- SimpleRangeLowUnbounded ---
2023/09/12 14:40:51 distinct = false
2023/09/12 14:40:51 Using n1ql client
2023/09/12 14:40:51 Expected and Actual scan responses are the same
2023/09/12 14:40:51
--- SimpleRangeHighUnbounded ---
2023/09/12 14:40:51 distinct = false
2023/09/12 14:40:52 Using n1ql client
2023/09/12 14:40:52 Expected and Actual scan responses are the same
2023/09/12 14:40:52
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:40:52 distinct = false
2023/09/12 14:40:52 Using n1ql client
2023/09/12 14:40:52 Expected and Actual scan responses are the same
2023/09/12 14:40:52
--- FiltersWithUnbounded ---
2023/09/12 14:40:52 distinct = false
2023/09/12 14:40:52 Using n1ql client
2023/09/12 14:40:52 Expected and Actual scan responses are the same
2023/09/12 14:40:52
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:40:52 distinct = false
2023/09/12 14:40:53 Using n1ql client
2023/09/12 14:40:53 Expected and Actual scan responses are the same
2023/09/12 14:40:53
--------- Simple Index with 1 field ---------
2023/09/12 14:40:53
--- SingleIndexSimpleRange ---
2023/09/12 14:40:53 distinct = true
2023/09/12 14:40:53 Using n1ql client
2023/09/12 14:40:53 Expected and Actual scan responses are the same
2023/09/12 14:40:53
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:40:53 distinct = true
2023/09/12 14:40:54 Using n1ql client
2023/09/12 14:40:54 Expected and Actual scan responses are the same
2023/09/12 14:40:54
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:40:54 distinct = true
2023/09/12 14:40:54 Using n1ql client
2023/09/12 14:40:54 Expected and Actual scan responses are the same
2023/09/12 14:40:54
--------- Composite Index with 3 fields ---------
2023/09/12 14:40:54
--- ScanAllNoFilter ---
2023/09/12 14:40:54 distinct = true
2023/09/12 14:40:54 Using n1ql client
2023/09/12 14:40:54 Expected and Actual scan responses are the same
2023/09/12 14:40:54
--- ScanAllFilterNil ---
2023/09/12 14:40:54 distinct = true
2023/09/12 14:40:55 Using n1ql client
2023/09/12 14:40:55 Expected and Actual scan responses are the same
2023/09/12 14:40:55
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:55 distinct = true
2023/09/12 14:40:56 Using n1ql client
2023/09/12 14:40:56 Expected and Actual scan responses are the same
2023/09/12 14:40:56
--- 3FieldsSingleSeek ---
2023/09/12 14:40:56 distinct = true
2023/09/12 14:40:56 Using n1ql client
2023/09/12 14:40:56 Expected and Actual scan responses are the same
2023/09/12 14:40:56
--- 3FieldsMultipleSeeks ---
2023/09/12 14:40:56 distinct = true
2023/09/12 14:40:56 Using n1ql client
2023/09/12 14:40:56 Expected and Actual scan responses are the same
2023/09/12 14:40:56
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:40:56 distinct = true
2023/09/12 14:40:57 Using n1ql client
2023/09/12 14:40:57 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDistinct (11.83s)
=== RUN TestMultiScanProjection
2023/09/12 14:40:57 In TestMultiScanProjection()
2023/09/12 14:40:57
--------- Composite Index with 2 fields ---------
2023/09/12 14:40:57
--- ScanAllNoFilter ---
2023/09/12 14:40:57 distinct = true
2023/09/12 14:40:57 Using n1ql client
2023/09/12 14:40:57 Expected and Actual scan responses are the same
2023/09/12 14:40:57
--- ScanAllFilterNil ---
2023/09/12 14:40:57 distinct = true
2023/09/12 14:40:58 Using n1ql client
2023/09/12 14:40:58 Expected and Actual scan responses are the same
2023/09/12 14:40:58
--- ScanAll_AllFiltersNil ---
2023/09/12 14:40:58 distinct = true
2023/09/12 14:40:58 Using n1ql client
2023/09/12 14:40:58 Expected and Actual scan responses are the same
2023/09/12 14:40:58
--- SingleSeek ---
2023/09/12 14:40:58 distinct = true
2023/09/12 14:40:59 Using n1ql client
2023/09/12 14:40:59 Expected and Actual scan responses are the same
2023/09/12 14:40:59
--- MultipleSeek ---
2023/09/12 14:40:59 distinct = true
2023/09/12 14:40:59 Using n1ql client
2023/09/12 14:40:59 Expected and Actual scan responses are the same
2023/09/12 14:40:59
--- SimpleRange ---
2023/09/12 14:40:59 distinct = true
2023/09/12 14:41:00 Using n1ql client
2023/09/12 14:41:00 Expected and Actual scan responses are the same
2023/09/12 14:41:00
--- NonOverlappingRanges ---
2023/09/12 14:41:00 distinct = true
2023/09/12 14:41:00 Using n1ql client
2023/09/12 14:41:00 Expected and Actual scan responses are the same
2023/09/12 14:41:00
--- OverlappingRanges ---
2023/09/12 14:41:00 distinct = true
2023/09/12 14:41:00 Using n1ql client
2023/09/12 14:41:00 Expected and Actual scan responses are the same
2023/09/12 14:41:00
--- NonOverlappingFilters ---
2023/09/12 14:41:00 distinct = true
2023/09/12 14:41:01 Using n1ql client
2023/09/12 14:41:01 Expected and Actual scan responses are the same
2023/09/12 14:41:01
--- OverlappingFilters ---
2023/09/12 14:41:01 distinct = true
2023/09/12 14:41:01 Using n1ql client
2023/09/12 14:41:01 Expected and Actual scan responses are the same
2023/09/12 14:41:01
--- BoundaryFilters ---
2023/09/12 14:41:01 distinct = true
2023/09/12 14:41:02 Using n1ql client
2023/09/12 14:41:02 Expected and Actual scan responses are the same
2023/09/12 14:41:02
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:41:02 distinct = true
2023/09/12 14:41:02 Using n1ql client
2023/09/12 14:41:02 Expected and Actual scan responses are the same
2023/09/12 14:41:02
--- SeekAndFilters_Overlapping ---
2023/09/12 14:41:02 distinct = true
2023/09/12 14:41:03 Using n1ql client
2023/09/12 14:41:03 Expected and Actual scan responses are the same
2023/09/12 14:41:03
--- SimpleRangeLowUnbounded ---
2023/09/12 14:41:03 distinct = false
2023/09/12 14:41:03 Using n1ql client
2023/09/12 14:41:03 Expected and Actual scan responses are the same
2023/09/12 14:41:03
--- SimpleRangeHighUnbounded ---
2023/09/12 14:41:03 distinct = false
2023/09/12 14:41:04 Using n1ql client
2023/09/12 14:41:04 Expected and Actual scan responses are the same
2023/09/12 14:41:04
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:41:04 distinct = false
2023/09/12 14:41:04 Using n1ql client
2023/09/12 14:41:04 Expected and Actual scan responses are the same
2023/09/12 14:41:04
--- FiltersWithUnbounded ---
2023/09/12 14:41:04 distinct = false
2023/09/12 14:41:05 Using n1ql client
2023/09/12 14:41:05 Expected and Actual scan responses are the same
2023/09/12 14:41:05
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:41:05 distinct = false
2023/09/12 14:41:05 Using n1ql client
2023/09/12 14:41:05 Expected and Actual scan responses are the same
2023/09/12 14:41:05
--------- Simple Index with 1 field ---------
2023/09/12 14:41:05
--- SingleIndexSimpleRange ---
2023/09/12 14:41:05 distinct = true
2023/09/12 14:41:06 Using n1ql client
2023/09/12 14:41:06 Expected and Actual scan responses are the same
2023/09/12 14:41:06
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:41:06 distinct = true
2023/09/12 14:41:06 Using n1ql client
2023/09/12 14:41:06 Expected and Actual scan responses are the same
2023/09/12 14:41:06
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:41:06 distinct = true
2023/09/12 14:41:06 Using n1ql client
2023/09/12 14:41:06 Expected and Actual scan responses are the same
2023/09/12 14:41:06
--------- Composite Index with 3 fields ---------
2023/09/12 14:41:06
--- ScanAllNoFilter ---
2023/09/12 14:41:06 distinct = true
2023/09/12 14:41:07 Using n1ql client
2023/09/12 14:41:07 Expected and Actual scan responses are the same
2023/09/12 14:41:07
--- ScanAllFilterNil ---
2023/09/12 14:41:07 distinct = true
2023/09/12 14:41:08 Using n1ql client
2023/09/12 14:41:08 Expected and Actual scan responses are the same
2023/09/12 14:41:08
--- ScanAll_AllFiltersNil ---
2023/09/12 14:41:08 distinct = true
2023/09/12 14:41:08 Using n1ql client
2023/09/12 14:41:08 Expected and Actual scan responses are the same
2023/09/12 14:41:08
--- 3FieldsSingleSeek ---
2023/09/12 14:41:08 distinct = true
2023/09/12 14:41:08 Using n1ql client
2023/09/12 14:41:08 Expected and Actual scan responses are the same
2023/09/12 14:41:08
--- 3FieldsMultipleSeeks ---
2023/09/12 14:41:08 distinct = true
2023/09/12 14:41:09 Using n1ql client
2023/09/12 14:41:09 Expected and Actual scan responses are the same
2023/09/12 14:41:09
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:41:09 distinct = true
2023/09/12 14:41:09 Using n1ql client
2023/09/12 14:41:09 Expected and Actual scan responses are the same
2023/09/12 14:41:09 indexes are: index_company, index_companyname, index_company_name_age, index_company_name_age_address, index_company_name_age_address_friends
2023/09/12 14:41:09 fields are: [company], [company name], [company name age], [company name age address], [company name age address friends]
2023/09/12 14:41:09
--- SingleIndexProjectFirst ---
2023/09/12 14:41:09 distinct = true
2023/09/12 14:41:10 Using n1ql client
2023/09/12 14:41:10 Expected and Actual scan responses are the same
2023/09/12 14:41:10
--- 2FieldIndexProjectSecond ---
2023/09/12 14:41:10 distinct = true
2023/09/12 14:41:10 Using n1ql client
2023/09/12 14:41:10 Expected and Actual scan responses are the same
2023/09/12 14:41:10
--- 3FieldIndexProjectThird ---
2023/09/12 14:41:10 distinct = true
2023/09/12 14:41:11 Using n1ql client
2023/09/12 14:41:11 Expected and Actual scan responses are the same
2023/09/12 14:41:11
--- 4FieldIndexProjectFourth ---
2023/09/12 14:41:11 distinct = true
2023/09/12 14:41:12 Using n1ql client
2023/09/12 14:41:12 Expected and Actual scan responses are the same
2023/09/12 14:41:12
--- 5FieldIndexProjectFifth ---
2023/09/12 14:41:12 distinct = true
2023/09/12 14:41:16 Using n1ql client
2023/09/12 14:41:16 Expected and Actual scan responses are the same
2023/09/12 14:41:16
--- 2FieldIndexProjectTwo ---
2023/09/12 14:41:16 distinct = true
2023/09/12 14:41:16 Using n1ql client
2023/09/12 14:41:16 Expected and Actual scan responses are the same
2023/09/12 14:41:16
--- 3FieldIndexProjectTwo ---
2023/09/12 14:41:16 distinct = true
2023/09/12 14:41:17 Using n1ql client
2023/09/12 14:41:17 Expected and Actual scan responses are the same
2023/09/12 14:41:17
--- 3FieldIndexProjectTwo ---
2023/09/12 14:41:17 distinct = true
2023/09/12 14:41:17 Using n1ql client
2023/09/12 14:41:17 Expected and Actual scan responses are the same
2023/09/12 14:41:17
--- 3FieldIndexProjectTwo ---
2023/09/12 14:41:17 distinct = true
2023/09/12 14:41:18 Using n1ql client
2023/09/12 14:41:18 Expected and Actual scan responses are the same
2023/09/12 14:41:18
--- 4FieldIndexProjectTwo ---
2023/09/12 14:41:18 distinct = true
2023/09/12 14:41:19 Using n1ql client
2023/09/12 14:41:19 Expected and Actual scan responses are the same
2023/09/12 14:41:19
--- 4FieldIndexProjectTwo ---
2023/09/12 14:41:19 distinct = true
2023/09/12 14:41:21 Using n1ql client
2023/09/12 14:41:21 Expected and Actual scan responses are the same
2023/09/12 14:41:21
--- 4FieldIndexProjectTwo ---
2023/09/12 14:41:21 distinct = true
2023/09/12 14:41:22 Using n1ql client
2023/09/12 14:41:22 Expected and Actual scan responses are the same
2023/09/12 14:41:22
--- 4FieldIndexProjectTwo ---
2023/09/12 14:41:22 distinct = true
2023/09/12 14:41:24 Using n1ql client
2023/09/12 14:41:24 Expected and Actual scan responses are the same
2023/09/12 14:41:24
--- 4FieldIndexProjectTwo ---
2023/09/12 14:41:24 distinct = true
2023/09/12 14:41:26 Using n1ql client
2023/09/12 14:41:26 Expected and Actual scan responses are the same
2023/09/12 14:41:26
--- 5FieldIndexProjectTwo ---
2023/09/12 14:41:26 distinct = true
2023/09/12 14:41:29 Using n1ql client
2023/09/12 14:41:29 Expected and Actual scan responses are the same
2023/09/12 14:41:29
--- 5FieldIndexProjectTwo ---
2023/09/12 14:41:29 distinct = true
2023/09/12 14:41:32 Using n1ql client
2023/09/12 14:41:32 Expected and Actual scan responses are the same
2023/09/12 14:41:32
--- 5FieldIndexProjectTwo ---
2023/09/12 14:41:32 distinct = true
2023/09/12 14:41:36 Using n1ql client
2023/09/12 14:41:36 Expected and Actual scan responses are the same
2023/09/12 14:41:36
--- 5FieldIndexProjectTwo ---
2023/09/12 14:41:36 distinct = true
2023/09/12 14:41:39 Using n1ql client
2023/09/12 14:41:39 Expected and Actual scan responses are the same
2023/09/12 14:41:39
--- 5FieldIndexProjectThree ---
2023/09/12 14:41:39 distinct = true
2023/09/12 14:41:42 Using n1ql client
2023/09/12 14:41:43 Expected and Actual scan responses are the same
2023/09/12 14:41:43
--- 5FieldIndexProjectFour ---
2023/09/12 14:41:43 distinct = true
2023/09/12 14:41:46 Using n1ql client
2023/09/12 14:41:46 Expected and Actual scan responses are the same
2023/09/12 14:41:46
--- 5FieldIndexProjectAll ---
2023/09/12 14:41:46 distinct = true
2023/09/12 14:41:49 Using n1ql client
2023/09/12 14:41:49 Expected and Actual scan responses are the same
2023/09/12 14:41:49
--- 5FieldIndexProjectAlternate ---
2023/09/12 14:41:49 distinct = true
2023/09/12 14:41:53 Using n1ql client
2023/09/12 14:41:53 Expected and Actual scan responses are the same
2023/09/12 14:41:53
--- 5FieldIndexProjectEmptyEntryKeys ---
2023/09/12 14:41:53 distinct = true
2023/09/12 14:41:56 Using n1ql client
2023/09/12 14:41:56 Expected and Actual scan responses are the same
--- PASS: TestMultiScanProjection (59.01s)
=== RUN TestMultiScanRestAPI
2023/09/12 14:41:56 In TestMultiScanRestAPI()
2023/09/12 14:41:56 In DropAllSecondaryIndexes()
2023/09/12 14:41:56 Index found: index_company_name_age
2023/09/12 14:41:56 Dropped index index_company_name_age
2023/09/12 14:41:56 Index found: addressidx
2023/09/12 14:41:56 Dropped index addressidx
2023/09/12 14:41:56 Index found: index_company_name_age_address
2023/09/12 14:41:56 Dropped index index_company_name_age_address
2023/09/12 14:41:56 Index found: index_primary
2023/09/12 14:41:56 Dropped index index_primary
2023/09/12 14:41:56 Index found: index_company_name_age_address_friends
2023/09/12 14:41:56 Dropped index index_company_name_age_address_friends
2023/09/12 14:41:56 Index found: index_company
2023/09/12 14:41:56 Dropped index index_company
2023/09/12 14:41:56 Index found: index_companyname
2023/09/12 14:41:57 Dropped index index_companyname
2023/09/12 14:42:00 Created the secondary index index_companyname. Waiting for it become active
2023/09/12 14:42:00 Index is 9687704206471911384 now active
2023/09/12 14:42:00 GET all indexes
2023/09/12 14:42:00 200 OK
2023/09/12 14:42:00 getscans status : 200 OK
2023/09/12 14:42:00 number of entries 337
2023/09/12 14:42:00 Status : 200 OK
2023/09/12 14:42:00 Result from multiscancount API = 0
--- PASS: TestMultiScanRestAPI (4.36s)
=== RUN TestMultiScanPrimaryIndexVariations
2023/09/12 14:42:00 In TestMultiScanPrimaryIndexVariations()
2023/09/12 14:42:09 Created the secondary index index_pi. Waiting for it become active
2023/09/12 14:42:09 Index is 6961709093446920825 now active
2023/09/12 14:42:09
--- No Overlap ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09
--- Proper Overlap ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09
--- Low Boundary Overlap ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09
--- Complex Overlaps ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09
--- Multiple Equal Overlaps ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09
--- Boundary and Subset Overlaps ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09
--- Point Overlaps ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09
--- Boundary and Point Overlaps ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09
--- Primary index range null ---
2023/09/12 14:42:09 Using n1ql client
2023/09/12 14:42:09 Expected and Actual scan responses are the same
2023/09/12 14:42:09 Dropping the secondary index index_pi
2023/09/12 14:42:09 Index dropped
--- PASS: TestMultiScanPrimaryIndexVariations (9.08s)
=== RUN TestMultiScanDescSetup
2023/09/12 14:42:09 In TestMultiScanDescSetup()
2023/09/12 14:42:09 In DropAllSecondaryIndexes()
2023/09/12 14:42:09 Index found: index_companyname
2023/09/12 14:42:10 Dropped index index_companyname
2023/09/12 14:42:15 Created the secondary index index_companyname_desc. Waiting for it become active
2023/09/12 14:42:15 Index is 13709499142545955999 now active
2023/09/12 14:42:22 Created the secondary index index_company_desc. Waiting for it become active
2023/09/12 14:42:22 Index is 11657572075314920231 now active
2023/09/12 14:42:29 Created the secondary index index_company_name_age_desc. Waiting for it become active
2023/09/12 14:42:29 Index is 13583098618862948345 now active
--- PASS: TestMultiScanDescSetup (19.86s)
=== RUN TestMultiScanDescScenarios
2023/09/12 14:42:29 In TestMultiScanDescScenarios()
2023/09/12 14:42:29
--------- Composite Index with 2 fields ---------
2023/09/12 14:42:29
--- ScanAllNoFilter ---
2023/09/12 14:42:29 distinct = false
2023/09/12 14:42:30 Using n1ql client
2023/09/12 14:42:30 Expected and Actual scan responses are the same
2023/09/12 14:42:30
--- ScanAllFilterNil ---
2023/09/12 14:42:30 distinct = false
2023/09/12 14:42:30 Using n1ql client
2023/09/12 14:42:30 Expected and Actual scan responses are the same
2023/09/12 14:42:30
--- ScanAll_AllFiltersNil ---
2023/09/12 14:42:30 distinct = false
2023/09/12 14:42:31 Using n1ql client
2023/09/12 14:42:31 Expected and Actual scan responses are the same
2023/09/12 14:42:31
--- SingleSeek ---
2023/09/12 14:42:31 distinct = false
2023/09/12 14:42:31 Using n1ql client
2023/09/12 14:42:31 Expected and Actual scan responses are the same
2023/09/12 14:42:31
--- MultipleSeek ---
2023/09/12 14:42:31 distinct = false
2023/09/12 14:42:31 Using n1ql client
2023/09/12 14:42:31 Expected and Actual scan responses are the same
2023/09/12 14:42:31
--- SimpleRange ---
2023/09/12 14:42:31 distinct = false
2023/09/12 14:42:32 Using n1ql client
2023/09/12 14:42:32 Expected and Actual scan responses are the same
2023/09/12 14:42:32
--- NonOverlappingRanges ---
2023/09/12 14:42:32 distinct = false
2023/09/12 14:42:32 Using n1ql client
2023/09/12 14:42:32 Expected and Actual scan responses are the same
2023/09/12 14:42:32
--- OverlappingRanges ---
2023/09/12 14:42:32 distinct = false
2023/09/12 14:42:33 Using n1ql client
2023/09/12 14:42:33 Expected and Actual scan responses are the same
2023/09/12 14:42:33
--- NonOverlappingFilters ---
2023/09/12 14:42:33 distinct = false
2023/09/12 14:42:33 Using n1ql client
2023/09/12 14:42:33 Expected and Actual scan responses are the same
2023/09/12 14:42:33
--- OverlappingFilters ---
2023/09/12 14:42:33 distinct = false
2023/09/12 14:42:34 Using n1ql client
2023/09/12 14:42:34 Expected and Actual scan responses are the same
2023/09/12 14:42:34
--- BoundaryFilters ---
2023/09/12 14:42:34 distinct = false
2023/09/12 14:42:34 Using n1ql client
2023/09/12 14:42:34 Expected and Actual scan responses are the same
2023/09/12 14:42:34
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:42:34 distinct = false
2023/09/12 14:42:34 Using n1ql client
2023/09/12 14:42:34 Expected and Actual scan responses are the same
2023/09/12 14:42:34
--- SeekAndFilters_Overlapping ---
2023/09/12 14:42:34 distinct = false
2023/09/12 14:42:35 Using n1ql client
2023/09/12 14:42:35 Expected and Actual scan responses are the same
2023/09/12 14:42:35
--- SimpleRangeLowUnbounded ---
2023/09/12 14:42:35 distinct = false
2023/09/12 14:42:35 Using n1ql client
2023/09/12 14:42:35 Expected and Actual scan responses are the same
2023/09/12 14:42:35
--- SimpleRangeHighUnbounded ---
2023/09/12 14:42:35 distinct = false
2023/09/12 14:42:36 Using n1ql client
2023/09/12 14:42:36 Expected and Actual scan responses are the same
2023/09/12 14:42:36
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:42:36 distinct = false
2023/09/12 14:42:36 Using n1ql client
2023/09/12 14:42:36 Expected and Actual scan responses are the same
2023/09/12 14:42:36
--- FiltersWithUnbounded ---
2023/09/12 14:42:36 distinct = false
2023/09/12 14:42:37 Using n1ql client
2023/09/12 14:42:37 Expected and Actual scan responses are the same
2023/09/12 14:42:37
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:42:37 distinct = false
2023/09/12 14:42:37 Using n1ql client
2023/09/12 14:42:37 Expected and Actual scan responses are the same
2023/09/12 14:42:37
--------- Simple Index with 1 field ---------
2023/09/12 14:42:37
--- SingleIndexSimpleRange ---
2023/09/12 14:42:37 distinct = false
2023/09/12 14:42:37 Using n1ql client
2023/09/12 14:42:37 Expected and Actual scan responses are the same
2023/09/12 14:42:37
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:42:37 distinct = false
2023/09/12 14:42:38 Using n1ql client
2023/09/12 14:42:38 Expected and Actual scan responses are the same
2023/09/12 14:42:38
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:42:38 distinct = false
2023/09/12 14:42:38 Using n1ql client
2023/09/12 14:42:38 Expected and Actual scan responses are the same
2023/09/12 14:42:38
--------- Composite Index with 3 fields ---------
2023/09/12 14:42:38
--- ScanAllNoFilter ---
2023/09/12 14:42:38 distinct = false
2023/09/12 14:42:39 Using n1ql client
2023/09/12 14:42:39 Expected and Actual scan responses are the same
2023/09/12 14:42:39
--- ScanAllFilterNil ---
2023/09/12 14:42:39 distinct = false
2023/09/12 14:42:39 Using n1ql client
2023/09/12 14:42:39 Expected and Actual scan responses are the same
2023/09/12 14:42:39
--- ScanAll_AllFiltersNil ---
2023/09/12 14:42:39 distinct = false
2023/09/12 14:42:40 Using n1ql client
2023/09/12 14:42:40 Expected and Actual scan responses are the same
2023/09/12 14:42:40
--- 3FieldsSingleSeek ---
2023/09/12 14:42:40 distinct = false
2023/09/12 14:42:40 Using n1ql client
2023/09/12 14:42:40 Expected and Actual scan responses are the same
2023/09/12 14:42:40
--- 3FieldsMultipleSeeks ---
2023/09/12 14:42:40 distinct = false
2023/09/12 14:42:41 Using n1ql client
2023/09/12 14:42:41 Expected and Actual scan responses are the same
2023/09/12 14:42:41
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:42:41 distinct = false
2023/09/12 14:42:41 Using n1ql client
2023/09/12 14:42:41 Expected and Actual scan responses are the same
2023/09/12 14:42:41
--------- New scenarios ---------
2023/09/12 14:42:41
--- CompIndexHighUnbounded1 ---
2023/09/12 14:42:41
--- Multi Scan 0 ---
2023/09/12 14:42:41 distinct = false
2023/09/12 14:42:41 Using n1ql client
2023/09/12 14:42:41 Expected and Actual scan responses are the same
2023/09/12 14:42:41
--- Multi Scan 1 ---
2023/09/12 14:42:41 distinct = false
2023/09/12 14:42:42 Using n1ql client
2023/09/12 14:42:42 Expected and Actual scan responses are the same
2023/09/12 14:42:42
--- Multi Scan 2 ---
2023/09/12 14:42:42 distinct = false
2023/09/12 14:42:42 Using n1ql client
2023/09/12 14:42:42 Expected and Actual scan responses are the same
2023/09/12 14:42:42
--- CompIndexHighUnbounded2 ---
2023/09/12 14:42:42
--- Multi Scan 0 ---
2023/09/12 14:42:42 distinct = false
2023/09/12 14:42:43 Using n1ql client
2023/09/12 14:42:43 Expected and Actual scan responses are the same
2023/09/12 14:42:43
--- Multi Scan 1 ---
2023/09/12 14:42:43 distinct = false
2023/09/12 14:42:43 Using n1ql client
2023/09/12 14:42:43 Expected and Actual scan responses are the same
2023/09/12 14:42:43
--- Multi Scan 2 ---
2023/09/12 14:42:43 distinct = false
2023/09/12 14:42:44 Using n1ql client
2023/09/12 14:42:44 Expected and Actual scan responses are the same
2023/09/12 14:42:44
--- CompIndexHighUnbounded3 ---
2023/09/12 14:42:44
--- Multi Scan 0 ---
2023/09/12 14:42:44 distinct = false
2023/09/12 14:42:44 Using n1ql client
2023/09/12 14:42:44 Expected and Actual scan responses are the same
2023/09/12 14:42:44
--- CompIndexHighUnbounded4 ---
2023/09/12 14:42:44
--- Multi Scan 0 ---
2023/09/12 14:42:44 distinct = false
2023/09/12 14:42:44 Using n1ql client
2023/09/12 14:42:44 Expected and Actual scan responses are the same
2023/09/12 14:42:44
--- CompIndexHighUnbounded5 ---
2023/09/12 14:42:44
--- Multi Scan 0 ---
2023/09/12 14:42:44 distinct = false
2023/09/12 14:42:45 Using n1ql client
2023/09/12 14:42:45 Expected and Actual scan responses are the same
2023/09/12 14:42:45
--- SeekBoundaries ---
2023/09/12 14:42:45
--- Multi Scan 0 ---
2023/09/12 14:42:45 distinct = false
2023/09/12 14:42:45 Using n1ql client
2023/09/12 14:42:45 Expected and Actual scan responses are the same
2023/09/12 14:42:45
--- Multi Scan 1 ---
2023/09/12 14:42:45 distinct = false
2023/09/12 14:42:46 Using n1ql client
2023/09/12 14:42:46 Expected and Actual scan responses are the same
2023/09/12 14:42:46
--- Multi Scan 2 ---
2023/09/12 14:42:46 distinct = false
2023/09/12 14:42:46 Using n1ql client
2023/09/12 14:42:46 Expected and Actual scan responses are the same
2023/09/12 14:42:46
--- Multi Scan 3 ---
2023/09/12 14:42:46 distinct = false
2023/09/12 14:42:47 Using n1ql client
2023/09/12 14:42:47 Expected and Actual scan responses are the same
2023/09/12 14:42:47
--- Multi Scan 4 ---
2023/09/12 14:42:47 distinct = false
2023/09/12 14:42:47 Using n1ql client
2023/09/12 14:42:47 Expected and Actual scan responses are the same
2023/09/12 14:42:47
--- Multi Scan 5 ---
2023/09/12 14:42:47 distinct = false
2023/09/12 14:42:47 Using n1ql client
2023/09/12 14:42:47 Expected and Actual scan responses are the same
2023/09/12 14:42:47
--- Multi Scan 6 ---
2023/09/12 14:42:47 distinct = false
2023/09/12 14:42:48 Using n1ql client
2023/09/12 14:42:48 Expected and Actual scan responses are the same
2023/09/12 14:42:48
--- Multi Scan 7 ---
2023/09/12 14:42:48 distinct = false
2023/09/12 14:42:48 Using n1ql client
2023/09/12 14:42:48 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescScenarios (18.96s)
=== RUN TestMultiScanDescCount
2023/09/12 14:42:48 In TestMultiScanDescCount()
2023/09/12 14:42:48
--------- Composite Index with 2 fields ---------
2023/09/12 14:42:48
--- ScanAllNoFilter ---
2023/09/12 14:42:48 distinct = false
2023/09/12 14:42:49 Using n1ql client
2023/09/12 14:42:49 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:42:49
--- ScanAllFilterNil ---
2023/09/12 14:42:49 distinct = false
2023/09/12 14:42:49 Using n1ql client
2023/09/12 14:42:49 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:42:49
--- ScanAll_AllFiltersNil ---
2023/09/12 14:42:49 distinct = false
2023/09/12 14:42:49 Using n1ql client
2023/09/12 14:42:49 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:42:49
--- SingleSeek ---
2023/09/12 14:42:49 distinct = false
2023/09/12 14:42:50 Using n1ql client
2023/09/12 14:42:50 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:42:50
--- MultipleSeek ---
2023/09/12 14:42:50 distinct = false
2023/09/12 14:42:50 Using n1ql client
2023/09/12 14:42:50 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 14:42:50
--- SimpleRange ---
2023/09/12 14:42:50 distinct = false
2023/09/12 14:42:51 Using n1ql client
2023/09/12 14:42:51 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/12 14:42:51
--- NonOverlappingRanges ---
2023/09/12 14:42:51 distinct = false
2023/09/12 14:42:51 Using n1ql client
2023/09/12 14:42:51 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2023/09/12 14:42:51
--- OverlappingRanges ---
2023/09/12 14:42:51 distinct = false
2023/09/12 14:42:51 Using n1ql client
2023/09/12 14:42:51 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2023/09/12 14:42:51
--- NonOverlappingFilters ---
2023/09/12 14:42:51 distinct = false
2023/09/12 14:42:52 Using n1ql client
2023/09/12 14:42:52 MultiScanCount = 337 ExpectedMultiScanCount = 337
2023/09/12 14:42:52
--- OverlappingFilters ---
2023/09/12 14:42:52 distinct = false
2023/09/12 14:42:52 Using n1ql client
2023/09/12 14:42:52 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2023/09/12 14:42:52
--- BoundaryFilters ---
2023/09/12 14:42:52 distinct = false
2023/09/12 14:42:53 Using n1ql client
2023/09/12 14:42:53 MultiScanCount = 499 ExpectedMultiScanCount = 499
2023/09/12 14:42:53
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:42:53 distinct = false
2023/09/12 14:42:53 Using n1ql client
2023/09/12 14:42:53 MultiScanCount = 256 ExpectedMultiScanCount = 256
2023/09/12 14:42:53
--- SeekAndFilters_Overlapping ---
2023/09/12 14:42:53 distinct = false
2023/09/12 14:42:54 Using n1ql client
2023/09/12 14:42:54 MultiScanCount = 255 ExpectedMultiScanCount = 255
2023/09/12 14:42:54
--- SimpleRangeLowUnbounded ---
2023/09/12 14:42:54 distinct = false
2023/09/12 14:42:54 Using n1ql client
2023/09/12 14:42:54 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/12 14:42:54
--- SimpleRangeHighUnbounded ---
2023/09/12 14:42:54 distinct = false
2023/09/12 14:42:54 Using n1ql client
2023/09/12 14:42:54 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/12 14:42:54
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:42:54 distinct = false
2023/09/12 14:42:55 Using n1ql client
2023/09/12 14:42:55 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:42:55
--- FiltersWithUnbounded ---
2023/09/12 14:42:55 distinct = false
2023/09/12 14:42:55 Using n1ql client
2023/09/12 14:42:55 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/12 14:42:55
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:42:55 distinct = false
2023/09/12 14:42:56 Using n1ql client
2023/09/12 14:42:56 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/12 14:42:56
--------- Simple Index with 1 field ---------
2023/09/12 14:42:56
--- SingleIndexSimpleRange ---
2023/09/12 14:42:56 distinct = false
2023/09/12 14:42:56 Using n1ql client
2023/09/12 14:42:56 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/12 14:42:56
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:42:56 distinct = false
2023/09/12 14:42:56 Using n1ql client
2023/09/12 14:42:56 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2023/09/12 14:42:56
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:42:56 distinct = false
2023/09/12 14:42:57 Using n1ql client
2023/09/12 14:42:57 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2023/09/12 14:42:57
--------- Composite Index with 3 fields ---------
2023/09/12 14:42:57
--- ScanAllNoFilter ---
2023/09/12 14:42:57 distinct = false
2023/09/12 14:42:57 Using n1ql client
2023/09/12 14:42:57 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:42:57
--- ScanAllFilterNil ---
2023/09/12 14:42:57 distinct = false
2023/09/12 14:42:57 Using n1ql client
2023/09/12 14:42:57 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:42:57
--- ScanAll_AllFiltersNil ---
2023/09/12 14:42:57 distinct = false
2023/09/12 14:42:58 Using n1ql client
2023/09/12 14:42:58 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:42:58
--- 3FieldsSingleSeek ---
2023/09/12 14:42:58 distinct = false
2023/09/12 14:42:58 Using n1ql client
2023/09/12 14:42:58 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:42:58
--- 3FieldsMultipleSeeks ---
2023/09/12 14:42:58 distinct = false
2023/09/12 14:42:59 Using n1ql client
2023/09/12 14:42:59 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/12 14:42:59
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:42:59 distinct = false
2023/09/12 14:42:59 Using n1ql client
2023/09/12 14:42:59 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 14:42:59
--------- New scenarios ---------
2023/09/12 14:42:59
--- CompIndexHighUnbounded1 ---
2023/09/12 14:42:59
--- Multi Scan 0 ---
2023/09/12 14:42:59 distinct = false
2023/09/12 14:43:00 Using n1ql client
2023/09/12 14:43:00 Using n1ql client
2023/09/12 14:43:00 len(scanResults) = 8 MultiScanCount = 8
2023/09/12 14:43:00 Expected and Actual scan responses are the same
2023/09/12 14:43:00
--- Multi Scan 1 ---
2023/09/12 14:43:00 distinct = false
2023/09/12 14:43:00 Using n1ql client
2023/09/12 14:43:00 Using n1ql client
2023/09/12 14:43:00 len(scanResults) = 0 MultiScanCount = 0
2023/09/12 14:43:00 Expected and Actual scan responses are the same
2023/09/12 14:43:00
--- Multi Scan 2 ---
2023/09/12 14:43:00 distinct = false
2023/09/12 14:43:00 Using n1ql client
2023/09/12 14:43:00 Using n1ql client
2023/09/12 14:43:00 len(scanResults) = 9 MultiScanCount = 9
2023/09/12 14:43:00 Expected and Actual scan responses are the same
2023/09/12 14:43:00
--- CompIndexHighUnbounded2 ---
2023/09/12 14:43:00
--- Multi Scan 0 ---
2023/09/12 14:43:00 distinct = false
2023/09/12 14:43:01 Using n1ql client
2023/09/12 14:43:01 Using n1ql client
2023/09/12 14:43:01 len(scanResults) = 4138 MultiScanCount = 4138
2023/09/12 14:43:01 Expected and Actual scan responses are the same
2023/09/12 14:43:01
--- Multi Scan 1 ---
2023/09/12 14:43:01 distinct = false
2023/09/12 14:43:01 Using n1ql client
2023/09/12 14:43:01 Using n1ql client
2023/09/12 14:43:01 len(scanResults) = 2746 MultiScanCount = 2746
2023/09/12 14:43:01 Expected and Actual scan responses are the same
2023/09/12 14:43:01
--- Multi Scan 2 ---
2023/09/12 14:43:01 distinct = false
2023/09/12 14:43:02 Using n1ql client
2023/09/12 14:43:02 Using n1ql client
2023/09/12 14:43:02 len(scanResults) = 4691 MultiScanCount = 4691
2023/09/12 14:43:02 Expected and Actual scan responses are the same
2023/09/12 14:43:02
--- CompIndexHighUnbounded3 ---
2023/09/12 14:43:02
--- Multi Scan 0 ---
2023/09/12 14:43:02 distinct = false
2023/09/12 14:43:02 Using n1ql client
2023/09/12 14:43:02 Using n1ql client
2023/09/12 14:43:02 len(scanResults) = 1329 MultiScanCount = 1329
2023/09/12 14:43:02 Expected and Actual scan responses are the same
2023/09/12 14:43:02
--- CompIndexHighUnbounded4 ---
2023/09/12 14:43:02
--- Multi Scan 0 ---
2023/09/12 14:43:02 distinct = false
2023/09/12 14:43:03 Using n1ql client
2023/09/12 14:43:03 Using n1ql client
2023/09/12 14:43:03 len(scanResults) = 5349 MultiScanCount = 5349
2023/09/12 14:43:03 Expected and Actual scan responses are the same
2023/09/12 14:43:03
--- CompIndexHighUnbounded5 ---
2023/09/12 14:43:03
--- Multi Scan 0 ---
2023/09/12 14:43:03 distinct = false
2023/09/12 14:43:03 Using n1ql client
2023/09/12 14:43:03 Using n1ql client
2023/09/12 14:43:03 len(scanResults) = 8210 MultiScanCount = 8210
2023/09/12 14:43:04 Expected and Actual scan responses are the same
2023/09/12 14:43:04
--- SeekBoundaries ---
2023/09/12 14:43:04
--- Multi Scan 0 ---
2023/09/12 14:43:04 distinct = false
2023/09/12 14:43:04 Using n1ql client
2023/09/12 14:43:04 Using n1ql client
2023/09/12 14:43:04 len(scanResults) = 175 MultiScanCount = 175
2023/09/12 14:43:04 Expected and Actual scan responses are the same
2023/09/12 14:43:04
--- Multi Scan 1 ---
2023/09/12 14:43:04 distinct = false
2023/09/12 14:43:05 Using n1ql client
2023/09/12 14:43:05 Using n1ql client
2023/09/12 14:43:05 len(scanResults) = 1 MultiScanCount = 1
2023/09/12 14:43:05 Expected and Actual scan responses are the same
2023/09/12 14:43:05
--- Multi Scan 2 ---
2023/09/12 14:43:05 distinct = false
2023/09/12 14:43:05 Using n1ql client
2023/09/12 14:43:05 Using n1ql client
2023/09/12 14:43:05 len(scanResults) = 555 MultiScanCount = 555
2023/09/12 14:43:05 Expected and Actual scan responses are the same
2023/09/12 14:43:05
--- Multi Scan 3 ---
2023/09/12 14:43:05 distinct = false
2023/09/12 14:43:06 Using n1ql client
2023/09/12 14:43:06 Using n1ql client
2023/09/12 14:43:06 len(scanResults) = 872 MultiScanCount = 872
2023/09/12 14:43:06 Expected and Actual scan responses are the same
2023/09/12 14:43:06
--- Multi Scan 4 ---
2023/09/12 14:43:06 distinct = false
2023/09/12 14:43:06 Using n1ql client
2023/09/12 14:43:06 Using n1ql client
2023/09/12 14:43:06 len(scanResults) = 287 MultiScanCount = 287
2023/09/12 14:43:06 Expected and Actual scan responses are the same
2023/09/12 14:43:06
--- Multi Scan 5 ---
2023/09/12 14:43:06 distinct = false
2023/09/12 14:43:06 Using n1ql client
2023/09/12 14:43:06 Using n1ql client
2023/09/12 14:43:06 len(scanResults) = 5254 MultiScanCount = 5254
2023/09/12 14:43:06 Expected and Actual scan responses are the same
2023/09/12 14:43:06
--- Multi Scan 6 ---
2023/09/12 14:43:06 distinct = false
2023/09/12 14:43:07 Using n1ql client
2023/09/12 14:43:07 Using n1ql client
2023/09/12 14:43:07 len(scanResults) = 5566 MultiScanCount = 5566
2023/09/12 14:43:07 Expected and Actual scan responses are the same
2023/09/12 14:43:07
--- Multi Scan 7 ---
2023/09/12 14:43:07 distinct = false
2023/09/12 14:43:07 Using n1ql client
2023/09/12 14:43:07 Using n1ql client
2023/09/12 14:43:07 len(scanResults) = 8 MultiScanCount = 8
2023/09/12 14:43:07 Expected and Actual scan responses are the same
2023/09/12 14:43:07
--------- With DISTINCT True ---------
2023/09/12 14:43:07
--- ScanAllNoFilter ---
2023/09/12 14:43:07 distinct = true
2023/09/12 14:43:08 Using n1ql client
2023/09/12 14:43:08 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:43:08
--- ScanAllFilterNil ---
2023/09/12 14:43:08 distinct = true
2023/09/12 14:43:08 Using n1ql client
2023/09/12 14:43:08 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:43:08
--- ScanAll_AllFiltersNil ---
2023/09/12 14:43:08 distinct = true
2023/09/12 14:43:09 Using n1ql client
2023/09/12 14:43:09 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:43:09
--- SingleSeek ---
2023/09/12 14:43:09 distinct = true
2023/09/12 14:43:09 Using n1ql client
2023/09/12 14:43:09 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:43:09
--- MultipleSeek ---
2023/09/12 14:43:09 distinct = true
2023/09/12 14:43:09 Using n1ql client
2023/09/12 14:43:09 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 14:43:09
--- SimpleRange ---
2023/09/12 14:43:09 distinct = true
2023/09/12 14:43:10 Using n1ql client
2023/09/12 14:43:10 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/12 14:43:10
--- NonOverlappingRanges ---
2023/09/12 14:43:10 distinct = true
2023/09/12 14:43:10 Using n1ql client
2023/09/12 14:43:10 MultiScanCount = 428 ExpectedMultiScanCount = 428
2023/09/12 14:43:10
--- NonOverlappingFilters2 ---
2023/09/12 14:43:10 distinct = true
2023/09/12 14:43:11 Using n1ql client
2023/09/12 14:43:11 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:43:11
--- OverlappingRanges ---
2023/09/12 14:43:11 distinct = true
2023/09/12 14:43:11 Using n1ql client
2023/09/12 14:43:11 MultiScanCount = 575 ExpectedMultiScanCount = 575
2023/09/12 14:43:11
--- NonOverlappingFilters ---
2023/09/12 14:43:11 distinct = true
2023/09/12 14:43:11 Using n1ql client
2023/09/12 14:43:11 MultiScanCount = 186 ExpectedMultiScanCount = 186
2023/09/12 14:43:11
--- OverlappingFilters ---
2023/09/12 14:43:11 distinct = true
2023/09/12 14:43:12 Using n1ql client
2023/09/12 14:43:12 MultiScanCount = 543 ExpectedMultiScanCount = 543
2023/09/12 14:43:12
--- BoundaryFilters ---
2023/09/12 14:43:12 distinct = true
2023/09/12 14:43:12 Using n1ql client
2023/09/12 14:43:12 MultiScanCount = 172 ExpectedMultiScanCount = 172
2023/09/12 14:43:12
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:43:12 distinct = true
2023/09/12 14:43:13 Using n1ql client
2023/09/12 14:43:13 MultiScanCount = 135 ExpectedMultiScanCount = 135
2023/09/12 14:43:13
--- SeekAndFilters_Overlapping ---
2023/09/12 14:43:13 distinct = true
2023/09/12 14:43:13 Using n1ql client
2023/09/12 14:43:13 MultiScanCount = 134 ExpectedMultiScanCount = 134
2023/09/12 14:43:13
--- SimpleRangeLowUnbounded ---
2023/09/12 14:43:13 distinct = false
2023/09/12 14:43:13 Using n1ql client
2023/09/12 14:43:13 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/12 14:43:13
--- SimpleRangeHighUnbounded ---
2023/09/12 14:43:13 distinct = false
2023/09/12 14:43:14 Using n1ql client
2023/09/12 14:43:14 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/12 14:43:14
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:43:14 distinct = false
2023/09/12 14:43:14 Using n1ql client
2023/09/12 14:43:14 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 14:43:14
--- FiltersWithUnbounded ---
2023/09/12 14:43:14 distinct = false
2023/09/12 14:43:15 Using n1ql client
2023/09/12 14:43:15 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/12 14:43:15
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:43:15 distinct = false
2023/09/12 14:43:15 Using n1ql client
2023/09/12 14:43:15 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/12 14:43:15
--------- Simple Index with 1 field ---------
2023/09/12 14:43:15
--- SingleIndexSimpleRange ---
2023/09/12 14:43:15 distinct = true
2023/09/12 14:43:15 Using n1ql client
2023/09/12 14:43:15 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/12 14:43:15
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:43:15 distinct = true
2023/09/12 14:43:16 Using n1ql client
2023/09/12 14:43:16 MultiScanCount = 713 ExpectedMultiScanCount = 713
2023/09/12 14:43:16
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:43:16 distinct = true
2023/09/12 14:43:16 Using n1ql client
2023/09/12 14:43:16 MultiScanCount = 869 ExpectedMultiScanCount = 869
2023/09/12 14:43:16
--------- Composite Index with 3 fields ---------
2023/09/12 14:43:16
--- ScanAllNoFilter ---
2023/09/12 14:43:16 distinct = true
2023/09/12 14:43:17 Using n1ql client
2023/09/12 14:43:17 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:43:17
--- ScanAllFilterNil ---
2023/09/12 14:43:17 distinct = true
2023/09/12 14:43:17 Using n1ql client
2023/09/12 14:43:17 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:43:17
--- ScanAll_AllFiltersNil ---
2023/09/12 14:43:17 distinct = true
2023/09/12 14:43:18 Using n1ql client
2023/09/12 14:43:18 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 14:43:18
--- 3FieldsSingleSeek ---
2023/09/12 14:43:18 distinct = true
2023/09/12 14:43:18 Using n1ql client
2023/09/12 14:43:18 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 14:43:18
--- 3FieldsMultipleSeeks ---
2023/09/12 14:43:18 distinct = true
2023/09/12 14:43:18 Using n1ql client
2023/09/12 14:43:18 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/12 14:43:18
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:43:18 distinct = true
2023/09/12 14:43:19 Using n1ql client
2023/09/12 14:43:19 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanDescCount (30.66s)
=== RUN TestMultiScanDescOffset
2023/09/12 14:43:19 In SkipTestMultiScanDescOffset()
2023/09/12 14:43:19
--------- Composite Index with 2 fields ---------
2023/09/12 14:43:19
--- ScanAllNoFilter ---
2023/09/12 14:43:19 distinct = false
2023/09/12 14:43:19 Using n1ql client
2023/09/12 14:43:19
--- ScanAllFilterNil ---
2023/09/12 14:43:19 distinct = false
2023/09/12 14:43:20 Using n1ql client
2023/09/12 14:43:20
--- ScanAll_AllFiltersNil ---
2023/09/12 14:43:20 distinct = false
2023/09/12 14:43:20 Using n1ql client
2023/09/12 14:43:20
--- SingleSeek ---
2023/09/12 14:43:20 distinct = false
2023/09/12 14:43:20 Using n1ql client
2023/09/12 14:43:20
--- MultipleSeek ---
2023/09/12 14:43:20 distinct = false
2023/09/12 14:43:21 Using n1ql client
2023/09/12 14:43:21
--- SimpleRange ---
2023/09/12 14:43:21 distinct = false
2023/09/12 14:43:21 Using n1ql client
2023/09/12 14:43:21
--- NonOverlappingRanges ---
2023/09/12 14:43:21 distinct = false
2023/09/12 14:43:22 Using n1ql client
2023/09/12 14:43:22
--- OverlappingRanges ---
2023/09/12 14:43:22 distinct = false
2023/09/12 14:43:22 Using n1ql client
2023/09/12 14:43:22
--- NonOverlappingFilters ---
2023/09/12 14:43:22 distinct = false
2023/09/12 14:43:23 Using n1ql client
2023/09/12 14:43:23
--- OverlappingFilters ---
2023/09/12 14:43:23 distinct = false
2023/09/12 14:43:23 Using n1ql client
2023/09/12 14:43:23
--- BoundaryFilters ---
2023/09/12 14:43:23 distinct = false
2023/09/12 14:43:23 Using n1ql client
2023/09/12 14:43:23
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:43:23 distinct = false
2023/09/12 14:43:24 Using n1ql client
2023/09/12 14:43:24
--- SeekAndFilters_Overlapping ---
2023/09/12 14:43:24 distinct = false
2023/09/12 14:43:24 Using n1ql client
2023/09/12 14:43:24
--- SimpleRangeLowUnbounded ---
2023/09/12 14:43:24 distinct = false
2023/09/12 14:43:25 Using n1ql client
2023/09/12 14:43:25 Expected and Actual scan responses are the same
2023/09/12 14:43:25
--- SimpleRangeHighUnbounded ---
2023/09/12 14:43:25 distinct = false
2023/09/12 14:43:25 Using n1ql client
2023/09/12 14:43:25 Expected and Actual scan responses are the same
2023/09/12 14:43:25
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:43:25 distinct = false
2023/09/12 14:43:26 Using n1ql client
2023/09/12 14:43:26 Expected and Actual scan responses are the same
2023/09/12 14:43:26
--- FiltersWithUnbounded ---
2023/09/12 14:43:26 distinct = false
2023/09/12 14:43:26 Using n1ql client
2023/09/12 14:43:26 Expected and Actual scan responses are the same
2023/09/12 14:43:26
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:43:26 distinct = false
2023/09/12 14:43:26 Using n1ql client
2023/09/12 14:43:26 Expected and Actual scan responses are the same
2023/09/12 14:43:26
--------- Simple Index with 1 field ---------
2023/09/12 14:43:26
--- SingleIndexSimpleRange ---
2023/09/12 14:43:26 distinct = false
2023/09/12 14:43:27 Using n1ql client
2023/09/12 14:43:27
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:43:27 distinct = false
2023/09/12 14:43:27 Using n1ql client
2023/09/12 14:43:27
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:43:27 distinct = false
2023/09/12 14:43:28 Using n1ql client
2023/09/12 14:43:28
--------- Composite Index with 3 fields ---------
2023/09/12 14:43:28
--- ScanAllNoFilter ---
2023/09/12 14:43:28 distinct = false
2023/09/12 14:43:28 Using n1ql client
2023/09/12 14:43:28
--- ScanAllFilterNil ---
2023/09/12 14:43:28 distinct = false
2023/09/12 14:43:28 Using n1ql client
2023/09/12 14:43:28
--- ScanAll_AllFiltersNil ---
2023/09/12 14:43:28 distinct = false
2023/09/12 14:43:29 Using n1ql client
2023/09/12 14:43:29
--- 3FieldsSingleSeek ---
2023/09/12 14:43:29 distinct = false
2023/09/12 14:43:29 Using n1ql client
2023/09/12 14:43:29
--- 3FieldsMultipleSeeks ---
2023/09/12 14:43:29 distinct = false
2023/09/12 14:43:30 Using n1ql client
2023/09/12 14:43:30
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:43:30 distinct = false
2023/09/12 14:43:30 Using n1ql client
--- PASS: TestMultiScanDescOffset (11.38s)
=== RUN TestMultiScanDescDistinct
2023/09/12 14:43:30 In SkipTestMultiScanDescDistinct()
2023/09/12 14:43:30
--------- Composite Index with 2 fields ---------
2023/09/12 14:43:30
--- ScanAllNoFilter ---
2023/09/12 14:43:30 distinct = true
2023/09/12 14:43:31 Using n1ql client
2023/09/12 14:43:31 Expected and Actual scan responses are the same
2023/09/12 14:43:31
--- ScanAllFilterNil ---
2023/09/12 14:43:31 distinct = true
2023/09/12 14:43:31 Using n1ql client
2023/09/12 14:43:31 Expected and Actual scan responses are the same
2023/09/12 14:43:31
--- ScanAll_AllFiltersNil ---
2023/09/12 14:43:31 distinct = true
2023/09/12 14:43:32 Using n1ql client
2023/09/12 14:43:32 Expected and Actual scan responses are the same
2023/09/12 14:43:32
--- SingleSeek ---
2023/09/12 14:43:32 distinct = true
2023/09/12 14:43:32 Using n1ql client
2023/09/12 14:43:32 Expected and Actual scan responses are the same
2023/09/12 14:43:32
--- MultipleSeek ---
2023/09/12 14:43:32 distinct = true
2023/09/12 14:43:32 Using n1ql client
2023/09/12 14:43:32 Expected and Actual scan responses are the same
2023/09/12 14:43:32
--- SimpleRange ---
2023/09/12 14:43:32 distinct = true
2023/09/12 14:43:33 Using n1ql client
2023/09/12 14:43:33 Expected and Actual scan responses are the same
2023/09/12 14:43:33
--- NonOverlappingRanges ---
2023/09/12 14:43:33 distinct = true
2023/09/12 14:43:33 Using n1ql client
2023/09/12 14:43:33 Expected and Actual scan responses are the same
2023/09/12 14:43:33
--- OverlappingRanges ---
2023/09/12 14:43:33 distinct = true
2023/09/12 14:43:34 Using n1ql client
2023/09/12 14:43:34 Expected and Actual scan responses are the same
2023/09/12 14:43:34
--- NonOverlappingFilters ---
2023/09/12 14:43:34 distinct = true
2023/09/12 14:43:34 Using n1ql client
2023/09/12 14:43:34 Expected and Actual scan responses are the same
2023/09/12 14:43:34
--- OverlappingFilters ---
2023/09/12 14:43:34 distinct = true
2023/09/12 14:43:35 Using n1ql client
2023/09/12 14:43:35 Expected and Actual scan responses are the same
2023/09/12 14:43:35
--- BoundaryFilters ---
2023/09/12 14:43:35 distinct = true
2023/09/12 14:43:35 Using n1ql client
2023/09/12 14:43:35 Expected and Actual scan responses are the same
2023/09/12 14:43:35
--- SeekAndFilters_NonOverlapping ---
2023/09/12 14:43:35 distinct = true
2023/09/12 14:43:36 Using n1ql client
2023/09/12 14:43:36 Expected and Actual scan responses are the same
2023/09/12 14:43:36
--- SeekAndFilters_Overlapping ---
2023/09/12 14:43:36 distinct = true
2023/09/12 14:43:36 Using n1ql client
2023/09/12 14:43:36 Expected and Actual scan responses are the same
2023/09/12 14:43:36
--- SimpleRangeLowUnbounded ---
2023/09/12 14:43:36 distinct = false
2023/09/12 14:43:36 Using n1ql client
2023/09/12 14:43:36 Expected and Actual scan responses are the same
2023/09/12 14:43:36
--- SimpleRangeHighUnbounded ---
2023/09/12 14:43:36 distinct = false
2023/09/12 14:43:37 Using n1ql client
2023/09/12 14:43:37 Expected and Actual scan responses are the same
2023/09/12 14:43:37
--- SimpleRangeMultipleUnbounded ---
2023/09/12 14:43:37 distinct = false
2023/09/12 14:43:37 Using n1ql client
2023/09/12 14:43:37 Expected and Actual scan responses are the same
2023/09/12 14:43:37
--- FiltersWithUnbounded ---
2023/09/12 14:43:37 distinct = false
2023/09/12 14:43:38 Using n1ql client
2023/09/12 14:43:38 Expected and Actual scan responses are the same
2023/09/12 14:43:38
--- FiltersLowGreaterThanHigh ---
2023/09/12 14:43:38 distinct = false
2023/09/12 14:43:38 Using n1ql client
2023/09/12 14:43:38 Expected and Actual scan responses are the same
2023/09/12 14:43:38
--------- Simple Index with 1 field ---------
2023/09/12 14:43:38
--- SingleIndexSimpleRange ---
2023/09/12 14:43:38 distinct = true
2023/09/12 14:43:38 Using n1ql client
2023/09/12 14:43:38 Expected and Actual scan responses are the same
2023/09/12 14:43:38
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 14:43:38 distinct = true
2023/09/12 14:43:39 Using n1ql client
2023/09/12 14:43:39 Expected and Actual scan responses are the same
2023/09/12 14:43:39
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 14:43:39 distinct = true
2023/09/12 14:43:39 Using n1ql client
2023/09/12 14:43:39 Expected and Actual scan responses are the same
2023/09/12 14:43:39
--------- Composite Index with 3 fields ---------
2023/09/12 14:43:39
--- ScanAllNoFilter ---
2023/09/12 14:43:39 distinct = true
2023/09/12 14:43:40 Using n1ql client
2023/09/12 14:43:40 Expected and Actual scan responses are the same
2023/09/12 14:43:40
--- ScanAllFilterNil ---
2023/09/12 14:43:40 distinct = true
2023/09/12 14:43:40 Using n1ql client
2023/09/12 14:43:40 Expected and Actual scan responses are the same
2023/09/12 14:43:40
--- ScanAll_AllFiltersNil ---
2023/09/12 14:43:40 distinct = true
2023/09/12 14:43:41 Using n1ql client
2023/09/12 14:43:41 Expected and Actual scan responses are the same
2023/09/12 14:43:41
--- 3FieldsSingleSeek ---
2023/09/12 14:43:41 distinct = true
2023/09/12 14:43:41 Using n1ql client
2023/09/12 14:43:41 Expected and Actual scan responses are the same
2023/09/12 14:43:41
--- 3FieldsMultipleSeeks ---
2023/09/12 14:43:41 distinct = true
2023/09/12 14:43:42 Using n1ql client
2023/09/12 14:43:42 Expected and Actual scan responses are the same
2023/09/12 14:43:42
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 14:43:42 distinct = true
2023/09/12 14:43:42 Using n1ql client
2023/09/12 14:43:42 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescDistinct (11.78s)
=== RUN TestGroupAggrSetup
2023/09/12 14:43:42 In TestGroupAggrSetup()
2023/09/12 14:43:42 Emptying the default bucket
2023/09/12 14:43:45 Flush Enabled on bucket default, responseBody:
2023/09/12 14:44:23 Flushed the bucket default, Response body:
2023/09/12 14:44:23 Dropping the secondary index index_agg
2023/09/12 14:44:23 Populating the default bucket
2023/09/12 14:44:27 Created the secondary index index_agg. Waiting for it become active
2023/09/12 14:44:27 Index is 12218509026226075475 now active
--- PASS: TestGroupAggrSetup (50.98s)
=== RUN TestGroupAggrLeading
2023/09/12 14:44:33 In TestGroupAggrLeading()
2023/09/12 14:44:33 Total Scanresults = 7
2023/09/12 14:44:33 Expected and Actual scan responses are the same
2023/09/12 14:44:33 Total Scanresults = 3
2023/09/12 14:44:33 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLeading (0.02s)
=== RUN TestGroupAggrNonLeading
2023/09/12 14:44:33 In TestGroupAggrNonLeading()
2023/09/12 14:44:33 Total Scanresults = 4
2023/09/12 14:44:33 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNonLeading (0.01s)
=== RUN TestGroupAggrNoGroup
2023/09/12 14:44:33 In TestGroupAggrNoGroup()
2023/09/12 14:44:33 Total Scanresults = 1
2023/09/12 14:44:33 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroup (0.00s)
=== RUN TestGroupAggrMinMax
2023/09/12 14:44:33 In TestGroupAggrMinMax()
2023/09/12 14:44:33 Total Scanresults = 4
2023/09/12 14:44:33 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax (0.00s)
=== RUN TestGroupAggrMinMax2
2023/09/12 14:44:33 In TestGroupAggrMinMax()
2023/09/12 14:44:33 Total Scanresults = 1
2023/09/12 14:44:33 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax2 (0.00s)
=== RUN TestGroupAggrLeading_N1QLExprs
2023/09/12 14:44:33 In TestGroupAggrLeading_N1QLExprs()
2023/09/12 14:44:33 Total Scanresults = 17
2023/09/12 14:44:33 basicGroupAggrN1QLExprs1: Scan validation passed
2023/09/12 14:44:33 Total Scanresults = 9
2023/09/12 14:44:34 basicGroupAggrN1QLExprs2: Scan validation passed
--- PASS: TestGroupAggrLeading_N1QLExprs (0.47s)
=== RUN TestGroupAggrLimit
2023/09/12 14:44:34 In TestGroupAggrLimit()
2023/09/12 14:44:34 Total Scanresults = 3
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLimit (0.01s)
=== RUN TestGroupAggrOffset
2023/09/12 14:44:34 In TestGroupAggrOffset()
2023/09/12 14:44:34 Total Scanresults = 3
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrOffset (0.00s)
=== RUN TestGroupAggrCountN
2023/09/12 14:44:34 In TestGroupAggrCountN()
2023/09/12 14:44:34 Total Scanresults = 4
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 4
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrCountN (0.01s)
=== RUN TestGroupAggrNoGroupNoMatch
2023/09/12 14:44:34 In TestGroupAggrNoGroupNoMatch()
2023/09/12 14:44:34 Total Scanresults = 1
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroupNoMatch (0.00s)
=== RUN TestGroupAggrGroupNoMatch
2023/09/12 14:44:34 In TestGroupAggrGroupNoMatch()
2023/09/12 14:44:34 Total Scanresults = 0
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrGroupNoMatch (0.00s)
=== RUN TestGroupAggrMultDataTypes
2023/09/12 14:44:34 In TestGroupAggrMultDataTypes()
2023/09/12 14:44:34 Total Scanresults = 8
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMultDataTypes (0.00s)
=== RUN TestGroupAggrDistinct
2023/09/12 14:44:34 In TestGroupAggrDistinct()
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct (0.01s)
=== RUN TestGroupAggrDistinct2
2023/09/12 14:44:34 In TestGroupAggrDistinct2()
2023/09/12 14:44:34 Total Scanresults = 1
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 4
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 4
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct2 (0.01s)
=== RUN TestGroupAggrNull
2023/09/12 14:44:34 In TestGroupAggrNull()
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNull (0.00s)
=== RUN TestGroupAggrInt64
2023/09/12 14:44:34 In TestGroupAggrInt64()
2023/09/12 14:44:34 Updating the default bucket
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
2023/09/12 14:44:34 Total Scanresults = 2
2023/09/12 14:44:34 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrInt64 (0.21s)
=== RUN TestGroupAggr1
2023/09/12 14:44:34 In TestGroupAggr1()
2023/09/12 14:44:34 In DropAllSecondaryIndexes()
2023/09/12 14:44:34 Index found: index_company_name_age_desc
2023/09/12 14:44:34 Dropped index index_company_name_age_desc
2023/09/12 14:44:34 Index found: #primary
2023/09/12 14:44:34 Dropped index #primary
2023/09/12 14:44:34 Index found: #primary
2023/09/12 14:44:36 Dropped index #primary
2023/09/12 14:44:36 Index found: index_companyname_desc
2023/09/12 14:44:36 Dropped index index_companyname_desc
2023/09/12 14:44:36 Index found: index_agg
2023/09/12 14:44:37 Dropped index index_agg
2023/09/12 14:44:37 Index found: index_company_desc
2023/09/12 14:44:37 Dropped index index_company_desc
2023/09/12 14:45:15 Flushed the bucket default, Response body:
2023/09/12 14:45:26 Created the secondary index idx_aggrs. Waiting for it become active
2023/09/12 14:45:26 Index is 6371388713896333910 now active
2023/09/12 14:45:26 Total Scanresults = 633
2023/09/12 14:45:28 Total Scanresults = 743
--- PASS: TestGroupAggr1 (54.10s)
=== RUN TestGroupAggrArrayIndex
2023/09/12 14:45:28 In TestGroupAggrArrayIndex()
2023/09/12 14:45:33 Created the secondary index ga_arr1. Waiting for it become active
2023/09/12 14:45:33 Index is 11501026537151500193 now active
2023/09/12 14:45:39 Created the secondary index ga_arr2. Waiting for it become active
2023/09/12 14:45:39 Index is 7268404579467782516 now active
2023/09/12 14:45:39 Scenario 1
2023/09/12 14:45:39 Total Scanresults = 633
2023/09/12 14:45:39 Scenario 2
2023/09/12 14:45:39 Total Scanresults = 2824
2023/09/12 14:45:40 Scenario 3
2023/09/12 14:45:40 Total Scanresults = 1
2023/09/12 14:45:40 Scenario 4
2023/09/12 14:45:40 Total Scanresults = 992
2023/09/12 14:45:41 Scenario 5
2023/09/12 14:45:41 Total Scanresults = 2824
2023/09/12 14:45:41 Scenario 6
2023/09/12 14:45:41 Total Scanresults = 1
2023/09/12 14:45:42 Scenario 7
2023/09/12 14:45:42 Total Scanresults = 2929
2023/09/12 14:45:45 Scenario 8
2023/09/12 14:45:45 Total Scanresults = 1171
2023/09/12 14:45:46 Scenario 9
2023/09/12 14:45:46 Total Scanresults = 1
2023/09/12 14:45:46 Scenario 10
2023/09/12 14:45:46 Total Scanresults = 633
2023/09/12 14:45:46 Scenario 11
2023/09/12 14:45:46 Total Scanresults = 1171
2023/09/12 14:45:47 Scenario 12
2023/09/12 14:45:47 Total Scanresults = 1
2023/09/12 14:45:47 Scenario 13
2023/09/12 14:45:51 Total Scanresults = 1
2023/09/12 14:45:51 Count of scanResults is 1
2023/09/12 14:45:51 Value: [2 133]
--- PASS: TestGroupAggrArrayIndex (23.46s)
=== RUN TestGroupAggr_FirstValidAggrOnly
2023/09/12 14:45:51 In TestGroupAggr_FirstValidAggrOnly()
2023/09/12 14:45:51 In DropAllSecondaryIndexes()
2023/09/12 14:45:51 Index found: test_oneperprimarykey
2023/09/12 14:45:51 Dropped index test_oneperprimarykey
2023/09/12 14:45:51 Index found: idx_aggrs
2023/09/12 14:45:52 Dropped index idx_aggrs
2023/09/12 14:45:52 Index found: ga_arr2
2023/09/12 14:45:52 Dropped index ga_arr2
2023/09/12 14:45:52 Index found: #primary
2023/09/12 14:45:52 Dropped index #primary
2023/09/12 14:45:52 Index found: #primary
2023/09/12 14:45:52 Dropped index #primary
2023/09/12 14:45:52 Index found: ga_arr1
2023/09/12 14:45:52 Dropped index ga_arr1
2023/09/12 14:46:08 Created the secondary index idx_asc_3field. Waiting for it become active
2023/09/12 14:46:08 Index is 10627015457151352563 now active
2023/09/12 14:46:14 Created the secondary index idx_desc_3field. Waiting for it become active
2023/09/12 14:46:14 Index is 15357838297464725972 now active
2023/09/12 14:46:14 === MIN no group by ===
2023/09/12 14:46:14 Total Scanresults = 1
2023/09/12 14:46:14 Count of scanResults is 1
2023/09/12 14:46:14 Value: ["ACCEL"]
2023/09/12 14:46:14 === MIN no group by, no row match ===
2023/09/12 14:46:14 Total Scanresults = 1
2023/09/12 14:46:14 Count of scanResults is 1
2023/09/12 14:46:14 Value: [null]
2023/09/12 14:46:15 === MIN with group by ===
2023/09/12 14:46:15 Total Scanresults = 633
2023/09/12 14:46:15 === MIN with group by, no row match ===
2023/09/12 14:46:15 Total Scanresults = 0
2023/09/12 14:46:15 === One Aggr, no group by ===
2023/09/12 14:46:15 Total Scanresults = 1
2023/09/12 14:46:15 Count of scanResults is 1
2023/09/12 14:46:15 Value: ["FANFARE"]
2023/09/12 14:46:15 === One Aggr, no group by, no row match ===
2023/09/12 14:46:15 Total Scanresults = 1
2023/09/12 14:46:15 Count of scanResults is 1
2023/09/12 14:46:15 Value: [null]
2023/09/12 14:46:15 === Multiple Aggr, no group by ===
2023/09/12 14:46:15 Total Scanresults = 1
2023/09/12 14:46:15 Count of scanResults is 1
2023/09/12 14:46:15 Value: ["FANFARE" 15]
2023/09/12 14:46:15 === Multiple Aggr, no group by, no row match ===
2023/09/12 14:46:15 Total Scanresults = 1
2023/09/12 14:46:15 Count of scanResults is 1
2023/09/12 14:46:15 Value: [null null]
2023/09/12 14:46:16 === No Aggr, 1 group by ===
2023/09/12 14:46:16 Total Scanresults = 207
2023/09/12 14:46:16 === Aggr on non-leading key, previous equality filter, no group ===
2023/09/12 14:46:16 Total Scanresults = 1
2023/09/12 14:46:16 Count of scanResults is 1
2023/09/12 14:46:16 Value: [17]
2023/09/12 14:46:16 === Aggr on non-leading key, previous equality filters, no group ===
2023/09/12 14:46:16 Total Scanresults = 1
2023/09/12 14:46:16 Count of scanResults is 1
2023/09/12 14:46:16 Value: [null]
2023/09/12 14:46:16 === Aggr on non-leading key, previous non-equality filters, no group ===
2023/09/12 14:46:16 Total Scanresults = 1
2023/09/12 14:46:16 Count of scanResults is 1
2023/09/12 14:46:16 Value: ["Ahmed"]
2023/09/12 14:46:16 === MIN on desc, no group ===
2023/09/12 14:46:16 Total Scanresults = 1
2023/09/12 14:46:16 Count of scanResults is 1
2023/09/12 14:46:16 Value: ["FANFARE"]
2023/09/12 14:46:16 === MAX on asc, no group ===
2023/09/12 14:46:16 Total Scanresults = 1
2023/09/12 14:46:16 Count of scanResults is 1
2023/09/12 14:46:16 Value: ["OZEAN"]
2023/09/12 14:46:17 === MAX on desc, no group ===
2023/09/12 14:46:17 Total Scanresults = 1
2023/09/12 14:46:17 Count of scanResults is 1
2023/09/12 14:46:17 Value: ["OZEAN"]
2023/09/12 14:46:17 === COUNT(DISTINCT const_expr, no group ===
2023/09/12 14:46:17 Total Scanresults = 1
2023/09/12 14:46:17 Count of scanResults is 1
2023/09/12 14:46:17 Value: [1]
2023/09/12 14:46:17 === COUNT(DISTINCT const_expr, no group, no row match ===
2023/09/12 14:46:17 Total Scanresults = 1
2023/09/12 14:46:17 Count of scanResults is 1
2023/09/12 14:46:17 Value: [0]
2023/09/12 14:46:17 === COUNT(const_expr, no group ===
2023/09/12 14:46:17 Total Scanresults = 1
2023/09/12 14:46:17 Count of scanResults is 1
2023/09/12 14:46:17 Value: [321]
2023/09/12 14:46:21 Created the secondary index indexMinAggr. Waiting for it become active
2023/09/12 14:46:21 Index is 4149093255084319754 now active
2023/09/12 14:46:21 === Equality filter check: Equality for a, nil filter for b - inclusion 0, no filter for c ===
2023/09/12 14:46:21 Total Scanresults = 1
2023/09/12 14:46:21 Count of scanResults is 1
2023/09/12 14:46:21 Value: [5]
2023/09/12 14:46:22 === Equality filter check: Equality for a, nil filter for b - inclusion 3, no filter for c ===
2023/09/12 14:46:22 Total Scanresults = 1
2023/09/12 14:46:22 Count of scanResults is 1
2023/09/12 14:46:22 Value: [5]
2023/09/12 14:46:22 === Equality filter check: Equality for a, nil filter for b - inclusion 3, nil filter for c ===
2023/09/12 14:46:22 Total Scanresults = 1
2023/09/12 14:46:22 Count of scanResults is 1
2023/09/12 14:46:22 Value: [5]
--- PASS: TestGroupAggr_FirstValidAggrOnly (30.50s)
=== RUN TestGroupAggrPrimary
2023/09/12 14:46:22 In TestGroupAggrPrimary()
2023/09/12 14:46:22 Total Scanresults = 1
2023/09/12 14:46:22 Total Scanresults = 1
2023/09/12 14:46:22 Total Scanresults = 1
2023/09/12 14:46:22 Total Scanresults = 1002
2023/09/12 14:46:22 Total Scanresults = 1002
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 --- MB-28305 Scenario 1 ---
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 Count of scanResults is 1
2023/09/12 14:46:23 Value: [0]
2023/09/12 14:46:23 --- MB-28305 Scenario 2 ---
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 Count of scanResults is 1
2023/09/12 14:46:23 Value: [0]
2023/09/12 14:46:23 --- MB-28305 Scenario 3 ---
2023/09/12 14:46:23 Total Scanresults = 1
2023/09/12 14:46:23 Count of scanResults is 1
2023/09/12 14:46:23 Value: [0]
--- PASS: TestGroupAggrPrimary (1.51s)
=== RUN TestGroupAggrDocumentKey
2023/09/12 14:46:23 In TestGroupAggrDocumentKey()
2023/09/12 14:46:23 Dropping the secondary index documentkey_idx1
2023/09/12 14:46:23 Dropping the secondary index documentkey_idx2
2023/09/12 14:46:23 Populating the default bucket for TestGroupAggrDocumentKey single key index
2023/09/12 14:46:28 Created the secondary index documentkey_idx1. Waiting for it become active
2023/09/12 14:46:28 Index is 8984678300755173711 now active
2023/09/12 14:46:28 Using n1ql client
2023/09/12 14:46:29 Scanresult Row ["1"] :
2023/09/12 14:46:29 Scanresult Row ["2"] :
2023/09/12 14:46:29 Scanresult Row ["3"] :
2023/09/12 14:46:29 Expected and Actual scan responses are the same
2023/09/12 14:46:29 Populating the default bucket for TestGroupAggrDocumentKey composite key index
2023/09/12 14:46:34 Created the secondary index documentkey_idx2. Waiting for it become active
2023/09/12 14:46:34 Index is 8434786278133037216 now active
2023/09/12 14:46:34 Using n1ql client
2023/09/12 14:46:35 Scanresult Row ["1"] :
2023/09/12 14:46:35 Scanresult Row ["2"] :
2023/09/12 14:46:35 Scanresult Row ["3"] :
2023/09/12 14:46:35 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDocumentKey (11.82s)
=== RUN TestRebalanceSetupCluster
2023/09/12 14:46:35 set14_rebalance_test.go::TestRebalanceSetupCluster: entry: Current cluster configuration: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:46:35 set14_rebalance_test.go::TestRebalanceSetupCluster: 1. Setting up initial cluster configuration
2023/09/12 14:46:35 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 14:46:40 Rebalance progress: 3.450520833333334
2023/09/12 14:46:45 Rebalance progress: 8.463541666666666
2023/09/12 14:46:50 Rebalance progress: 14.19270833333333
2023/09/12 14:46:55 Rebalance progress: 19.27083333333334
2023/09/12 14:47:01 Rebalance progress: 24.93489583333334
2023/09/12 14:47:06 Rebalance progress: 28.58072916666666
2023/09/12 14:47:11 Rebalance progress: 33.203125
2023/09/12 14:47:15 Rebalance progress: 39.77864583333333
2023/09/12 14:47:20 Rebalance progress: 46.64713541666666
2023/09/12 14:47:25 Rebalance progress: 50
2023/09/12 14:47:30 Rebalance progress: 50
2023/09/12 14:47:35 Rebalance progress: 75
2023/09/12 14:47:40 Rebalance progress: 100
2023/09/12 14:47:40 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 14:47:41 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 14:47:42 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 14:47:59 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 14:48:14 Rebalance progress: 75
2023/09/12 14:48:19 Rebalance progress: 100
2023/09/12 14:48:19 set14_rebalance_test.go::TestRebalanceSetupCluster: 2. Changing indexer.settings.rebalance.redistribute_indexes to true
2023/09/12 14:48:20 Changing config key indexer.settings.rebalance.redistribute_indexes to value true
2023/09/12 14:48:20 set14_rebalance_test.go::TestRebalanceSetupCluster: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceSetupCluster (104.40s)
=== RUN TestCreateDocsBeforeRebalance
2023/09/12 14:48:20 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:48:20 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: 1. Creating 100 documents
2023/09/12 14:48:20 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: 100 documents created
2023/09/12 14:48:20 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateDocsBeforeRebalance (0.13s)
=== RUN TestCreateIndexesBeforeRebalance
2023/09/12 14:48:20 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:48:20 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 1. Creating 17 indexes: non-partitioned, 0-replica, non-deferred
2023/09/12 14:48:20 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN__id on `default`(_id)
2023/09/12 14:48:23 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN__id index is now active.
2023/09/12 14:48:23 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_docid on `default`(docid)
2023/09/12 14:48:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_docid index is now active.
2023/09/12 14:48:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_guid on `default`(guid)
2023/09/12 14:48:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_guid index is now active.
2023/09/12 14:48:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_isActive on `default`(isActive)
2023/09/12 14:48:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_isActive index is now active.
2023/09/12 14:48:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_balance on `default`(balance)
2023/09/12 14:48:47 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_balance index is now active.
2023/09/12 14:48:47 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_picture on `default`(picture)
2023/09/12 14:48:54 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_picture index is now active.
2023/09/12 14:48:54 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_age on `default`(age)
2023/09/12 14:49:00 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_age index is now active.
2023/09/12 14:49:00 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_eyeColor on `default`(eyeColor)
2023/09/12 14:49:06 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_eyeColor index is now active.
2023/09/12 14:49:06 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_name on `default`(name)
2023/09/12 14:49:12 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_name index is now active.
2023/09/12 14:49:12 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_gender on `default`(gender)
2023/09/12 14:49:18 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_gender index is now active.
2023/09/12 14:49:18 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_company on `default`(company)
2023/09/12 14:49:24 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_company index is now active.
2023/09/12 14:49:24 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_email on `default`(email)
2023/09/12 14:49:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_email index is now active.
2023/09/12 14:49:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_phone on `default`(phone)
2023/09/12 14:49:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_phone index is now active.
2023/09/12 14:49:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_registered on `default`(registered)
2023/09/12 14:49:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_registered index is now active.
2023/09/12 14:49:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_latitude on `default`(latitude)
2023/09/12 14:49:49 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_latitude index is now active.
2023/09/12 14:49:49 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_longitude on `default`(longitude)
2023/09/12 14:49:55 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_longitude index is now active.
2023/09/12 14:49:55 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_favoriteFruit on `default`(favoriteFruit)
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_favoriteFruit index is now active.
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 2. Creating 17 indexes: non-partitioned, 0-replica, DEFERRED
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED__id_docid on `default`(_id, docid) with {"defer_build":true}
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED__id_docid index is now deferred.
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_docid_guid on `default`(docid, guid) with {"defer_build":true}
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_docid_guid index is now deferred.
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_guid_isActive on `default`(guid, isActive) with {"defer_build":true}
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_guid_isActive index is now deferred.
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_isActive_balance on `default`(isActive, balance) with {"defer_build":true}
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_isActive_balance index is now deferred.
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_balance_picture on `default`(balance, picture) with {"defer_build":true}
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_balance_picture index is now deferred.
2023/09/12 14:50:01 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_picture_age on `default`(picture, age) with {"defer_build":true}
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_picture_age index is now deferred.
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_age_eyeColor on `default`(age, eyeColor) with {"defer_build":true}
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_age_eyeColor index is now deferred.
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_eyeColor_name on `default`(eyeColor, name) with {"defer_build":true}
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_eyeColor_name index is now deferred.
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_name_gender on `default`(name, gender) with {"defer_build":true}
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_name_gender index is now deferred.
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_gender_company on `default`(gender, company) with {"defer_build":true}
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_gender_company index is now deferred.
2023/09/12 14:50:02 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_company_email on `default`(company, email) with {"defer_build":true}
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_company_email index is now deferred.
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_email_phone on `default`(email, phone) with {"defer_build":true}
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_email_phone index is now deferred.
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_phone_registered on `default`(phone, registered) with {"defer_build":true}
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_phone_registered index is now deferred.
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_registered_latitude on `default`(registered, latitude) with {"defer_build":true}
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_registered_latitude index is now deferred.
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_latitude_longitude on `default`(latitude, longitude) with {"defer_build":true}
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_latitude_longitude index is now deferred.
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_longitude_favoriteFruit on `default`(longitude, favoriteFruit) with {"defer_build":true}
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_longitude_favoriteFruit index is now deferred.
2023/09/12 14:50:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_favoriteFruit__id on `default`(favoriteFruit, _id) with {"defer_build":true}
2023/09/12 14:50:04 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_favoriteFruit__id index is now deferred.
2023/09/12 14:50:04 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 3. Creating 3 indexes: 7-PARTITION, 0-replica, non-deferred
2023/09/12 14:50:04 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS__id_guid on `default`(_id, guid) partition by hash(Meta().id) with {"num_partition":7}
2023/09/12 14:50:08 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS__id_guid index is now active.
2023/09/12 14:50:08 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS_docid_isActive on `default`(docid, isActive) partition by hash(Meta().id) with {"num_partition":7}
2023/09/12 14:50:15 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS_docid_isActive index is now active.
2023/09/12 14:50:15 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS_guid_balance on `default`(guid, balance) partition by hash(Meta().id) with {"num_partition":7}
2023/09/12 14:50:21 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS_guid_balance index is now active.
2023/09/12 14:50:21 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateIndexesBeforeRebalance (121.61s)
=== RUN TestIndexNodeRebalanceIn
2023/09/12 14:50:21 TestIndexNodeRebalanceIn entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:50:21 TestIndexNodeRebalanceIn: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/12 14:50:21 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 14:50:33 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 14:50:33 TestIndexNodeRebalanceIn: 2. Adding index node 127.0.0.1:9003 to the cluster
2023/09/12 14:50:33 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/12 14:50:43 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/12 14:50:43 TestIndexNodeRebalanceIn: 3. Rebalancing
2023/09/12 14:50:49 Rebalance progress: 20
2023/09/12 14:50:54 Rebalance progress: 41.96428571428572
2023/09/12 14:50:58 Rebalance progress: 46.62528849048405
2023/09/12 14:51:04 Rebalance progress: 63.39285714285714
2023/09/12 14:51:08 Rebalance progress: 68.64212964511462
2023/09/12 14:51:13 Rebalance progress: 86.75
2023/09/12 14:51:18 Rebalance progress: 100
2023/09/12 14:51:18 TestIndexNodeRebalanceIn exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestIndexNodeRebalanceIn (59.14s)
=== RUN TestCreateReplicatedIndexesBeforeRebalance
2023/09/12 14:51:21 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:51:21 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: 1. Creating 5 indexes: non-partitioned, 2-REPLICA, non-deferred
2023/09/12 14:51:21 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS__id_isActive on `default`(_id, isActive) with {"num_replica":2}
2023/09/12 14:51:29 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS__id_isActive index is now active.
2023/09/12 14:51:29 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_docid_balance on `default`(docid, balance) with {"num_replica":2}
2023/09/12 14:51:39 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_docid_balance index is now active.
2023/09/12 14:51:39 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_guid_picture on `default`(guid, picture) with {"num_replica":2}
2023/09/12 14:51:51 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_guid_picture index is now active.
2023/09/12 14:51:51 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_isActive_age on `default`(isActive, age) with {"num_replica":2}
2023/09/12 14:52:04 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_isActive_age index is now active.
2023/09/12 14:52:04 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with {"num_replica":2}
2023/09/12 14:52:14 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_balance_eyeColor index is now active.
2023/09/12 14:52:14 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: 2. Creating 2 indexes: 5-PARTITION, 1-REPLICA, non-deferred
2023/09/12 14:52:14 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_5PARTITIONS_1REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "num_replica":1}
2023/09/12 14:52:28 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_5PARTITIONS_1REPLICAS__id_balance index is now active.
2023/09/12 14:52:28 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_5PARTITIONS_1REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "num_replica":1}
2023/09/12 14:52:39 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_5PARTITIONS_1REPLICAS_docid_picture index is now active.
2023/09/12 14:52:39 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateReplicatedIndexesBeforeRebalance (78.91s)
=== RUN TestIndexNodeRebalanceOut
2023/09/12 14:52:39 set14_rebalance_test.go::TestIndexNodeRebalanceOut: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:52:39 set14_rebalance_test.go::TestIndexNodeRebalanceOut: 1. Rebalancing index node 127.0.0.1:9001 out of the cluster
2023/09/12 14:52:39 Removing node(s): [127.0.0.1:9001] from the cluster
2023/09/12 14:52:46 Rebalance progress: 20
2023/09/12 14:52:50 Rebalance progress: 27.5
2023/09/12 14:52:55 Rebalance progress: 38.74999999999999
2023/09/12 14:53:00 Rebalance progress: 46.25
2023/09/12 14:53:05 Rebalance progress: 53.75000000000001
2023/09/12 14:53:10 Rebalance progress: 61.25000000000001
2023/09/12 14:53:15 Rebalance progress: 68.75
2023/09/12 14:53:21 Rebalance progress: 80
2023-09-12T14:53:25.061+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.065+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.069+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.070+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.108+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.110+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.217+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.217+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.237+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.247+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.256+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.261+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.306+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.313+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.338+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.351+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.373+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.378+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.401+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.427+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.437+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.437+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:1f99e5daac50316bf87e6d5bba95f3fa@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc0193ed3b0 0xc00b873940 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true bbefcd5162dedff03c6ca925893da41b [{default /poolsStreaming/default?uuid=bbefcd5162dedff03c6ca925893da41b /pools/default?uuid=bbefcd5162dedff03c6ca925893da41b}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.35264e+07 couch_docs_data_size:1.959513e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.8821544e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0462851072e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5703 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 3d75dff1c8fa8825c400cab195778324 inet 86775162 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.0962825e+07 index_disk_size:9.109504e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0418733056e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5697 7.6.0-1467-rel-EE-enterprise false [index] c29abf3a2e0a8ddce3bb6c047dcdb838 inet 104280896 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.2719801e+07 index_disk_size:1.8776064e+07 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.041154048e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5698 7.6.0-1467-rel-EE-enterprise false [index] 9c25d0570864cfbd348040975aed2860 inet 50135682 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=111508613&uuid=bbefcd5162dedff03c6ca925893da41b] /pools/default/nodeServices?v=69202768 /pools/default/serverGroups?v=63391191 [{default 4db40f29d5ef70257c7c6f00ee756671}] {0xc0193ed3b0 0xc00b873940 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true bbefcd5162dedff03c6ca925893da41b [{default /poolsStreaming/default?uuid=bbefcd5162dedff03c6ca925893da41b /pools/default?uuid=bbefcd5162dedff03c6ca925893da41b}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.35264e+07 couch_docs_data_size:1.959513e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.8821544e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0462851072e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5703 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 3d75dff1c8fa8825c400cab195778324 inet 86775162 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.0962825e+07 index_disk_size:9.109504e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0418733056e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5697 7.6.0-1467-rel-EE-enterprise false [index] c29abf3a2e0a8ddce3bb6c047dcdb838 inet 104280896 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.2719801e+07 index_disk_size:1.8776064e+07 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.041154048e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5698 7.6.0-1467-rel-EE-enterprise false [index] 9c25d0570864cfbd348040975aed2860 inet 50135682 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[indexAdmin:9112 indexHttp:9114 indexHttps:19114 indexScan:9113 indexStreamCatchup:9116 indexStreamInit:9115 indexStreamMaint:9117 mgmt:9002 mgmtSSL:19002] 127.0.0.1 false} {map[indexAdmin:9118 indexHttp:9120 indexHttps:19120 indexScan:9119 indexStreamCatchup:9122 indexStreamInit:9121 indexStreamMaint:9123 mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9002:19002 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9112:9112 9113:9113 9114:19114 9115:9115 9116:9116 9117:9117 9118:9118 9119:9119 9120:19120 9121:9121 9122:9122 9123:9123 9499:19499 9999:9999]}
2023-09-12T14:53:25.463+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T14:53:25.463+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:1f99e5daac50316bf87e6d5bba95f3fa@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc018a1bc20 0xc018a58400 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true bbefcd5162dedff03c6ca925893da41b [{default /poolsStreaming/default?uuid=bbefcd5162dedff03c6ca925893da41b /pools/default?uuid=bbefcd5162dedff03c6ca925893da41b}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.35264e+07 couch_docs_data_size:1.959513e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.8821544e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0462851072e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5703 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 3d75dff1c8fa8825c400cab195778324 inet 86775162 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.0962825e+07 index_disk_size:9.109504e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0418733056e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5697 7.6.0-1467-rel-EE-enterprise false [index] c29abf3a2e0a8ddce3bb6c047dcdb838 inet 104280896 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.2719801e+07 index_disk_size:1.8776064e+07 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.041154048e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5698 7.6.0-1467-rel-EE-enterprise false [index] 9c25d0570864cfbd348040975aed2860 inet 50135682 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=111508613&uuid=bbefcd5162dedff03c6ca925893da41b] /pools/default/nodeServices?v=69202768 /pools/default/serverGroups?v=63391191 [{default 4db40f29d5ef70257c7c6f00ee756671}] {0xc018a1bc20 0xc018a58400 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true bbefcd5162dedff03c6ca925893da41b [{default /poolsStreaming/default?uuid=bbefcd5162dedff03c6ca925893da41b /pools/default?uuid=bbefcd5162dedff03c6ca925893da41b}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.35264e+07 couch_docs_data_size:1.959513e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.8821544e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0462851072e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5703 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 3d75dff1c8fa8825c400cab195778324 inet 86775162 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.0962825e+07 index_disk_size:9.109504e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0418733056e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5697 7.6.0-1467-rel-EE-enterprise false [index] c29abf3a2e0a8ddce3bb6c047dcdb838 inet 104280896 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.2719801e+07 index_disk_size:1.8776064e+07 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.041154048e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5698 7.6.0-1467-rel-EE-enterprise false [index] 9c25d0570864cfbd348040975aed2860 inet 50135682 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[indexAdmin:9112 indexHttp:9114 indexHttps:19114 indexScan:9113 indexStreamCatchup:9116 indexStreamInit:9115 indexStreamMaint:9117 mgmt:9002 mgmtSSL:19002] 127.0.0.1 false} {map[indexAdmin:9118 indexHttp:9120 indexHttps:19120 indexScan:9119 indexStreamCatchup:9122 indexStreamInit:9121 indexStreamMaint:9123 mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9002:19002 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9112:9112 9113:9113 9114:19114 9115:9115 9116:9116 9117:9117 9118:9118 9119:9119 9120:19120 9121:9121 9122:9122 9123:9123 9499:19499 9999:9999]}
2023/09/12 14:53:25 Rebalance progress: 100
2023/09/12 14:53:25 set14_rebalance_test.go::TestIndexNodeRebalanceOut: exit: Current cluster configuration: map[127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestIndexNodeRebalanceOut (48.03s)
=== RUN TestFailoverAndRebalance
2023/09/12 14:53:27 set14_rebalance_test.go::TestFailoverAndRebalance: entry: Current cluster configuration: map[127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:53:27 set14_rebalance_test.go::TestFailoverAndRebalance: 1. Failing over index node 127.0.0.1:9002
2023/09/12 14:53:27 Failing over: [127.0.0.1:9002]
2023/09/12 14:53:40 set14_rebalance_test.go::TestFailoverAndRebalance: 2. Rebalancing
2023/09/12 14:53:45 Rebalance progress: 30
2023/09/12 14:53:50 Rebalance progress: 75
2023/09/12 14:53:55 Rebalance progress: 100
2023/09/12 14:53:55 set14_rebalance_test.go::TestFailoverAndRebalance: exit: Current cluster configuration: map[127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestFailoverAndRebalance (29.67s)
=== RUN TestSwapRebalance
2023/09/12 14:53:57 set14_rebalance_test.go::TestSwapRebalance: entry: Current cluster configuration: map[127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:53:57 set14_rebalance_test.go::TestSwapRebalance: 1. Adding index node 127.0.0.1:9001 to the cluster
2023/09/12 14:53:57 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 14:54:11 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 14:54:11 set14_rebalance_test.go::TestSwapRebalance: 2. Swap rebalancing index node 127.0.0.1:9003 out of the cluster
2023/09/12 14:54:11 Removing node(s): [127.0.0.1:9003] from the cluster
2023/09/12 14:54:17 Rebalance progress: 23.33333333333333
2023/09/12 14:54:22 Rebalance progress: 23.33333333333333
2023/09/12 14:54:27 Rebalance progress: 34.44444444444444
2023/09/12 14:54:32 Rebalance progress: 78.88888888888887
2023/09/12 14:54:38 Rebalance progress: 83.33333333333333
2023-09-12T14:54:42.142+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.143+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.153+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.164+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.191+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.201+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.229+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.250+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.303+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.304+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.377+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.379+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.388+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.389+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.397+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.398+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.407+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.408+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.417+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.417+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.418+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:1f99e5daac50316bf87e6d5bba95f3fa@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc01befaab0 0xc017c27de0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true bbefcd5162dedff03c6ca925893da41b [{default /poolsStreaming/default?uuid=bbefcd5162dedff03c6ca925893da41b /pools/default?uuid=bbefcd5162dedff03c6ca925893da41b}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.35264e+07 couch_docs_data_size:1.959513e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.6370984e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0891567104e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5779 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 3d75dff1c8fa8825c400cab195778324 inet 86775162 Group 1} {458758 active http://127.0.0.1:9501/ 127.0.0.1:9001 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:0 index_disk_size:0 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0937647104e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12002 distTCP:21400 distTLS:21450 httpsCAPI:19501 httpsMgmt:19001] healthy 5777 7.6.0-1467-rel-EE-enterprise false [index] 3af95a713a06f5b4d4d77cb399ba0709 inet 43970895 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=92568842&uuid=bbefcd5162dedff03c6ca925893da41b] /pools/default/nodeServices?v=132480064 /pools/default/serverGroups?v=10462945 [{default 4db40f29d5ef70257c7c6f00ee756671}] {0xc01befaab0 0xc017c27de0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true bbefcd5162dedff03c6ca925893da41b [{default /poolsStreaming/default?uuid=bbefcd5162dedff03c6ca925893da41b /pools/default?uuid=bbefcd5162dedff03c6ca925893da41b}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.35264e+07 couch_docs_data_size:1.959513e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.6370984e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0891567104e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5779 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 3d75dff1c8fa8825c400cab195778324 inet 86775162 Group 1} {458758 active http://127.0.0.1:9501/ 127.0.0.1:9001 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:0 index_disk_size:0 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0937647104e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12002 distTCP:21400 distTLS:21450 httpsCAPI:19501 httpsMgmt:19001] healthy 5777 7.6.0-1467-rel-EE-enterprise false [index] 3af95a713a06f5b4d4d77cb399ba0709 inet 43970895 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[indexAdmin:9106 indexHttp:9108 indexHttps:19108 indexScan:9107 indexStreamCatchup:9110 indexStreamInit:9109 indexStreamMaint:9111 mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9106:9106 9107:9107 9108:19108 9109:9109 9110:9110 9111:9111 9499:19499 9999:9999]}
2023-09-12T14:54:42.422+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.426+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T14:54:42.426+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:1f99e5daac50316bf87e6d5bba95f3fa@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc01befafc0 0xc017c27f40 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true bbefcd5162dedff03c6ca925893da41b [{default /poolsStreaming/default?uuid=bbefcd5162dedff03c6ca925893da41b /pools/default?uuid=bbefcd5162dedff03c6ca925893da41b}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.35264e+07 couch_docs_data_size:1.959513e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.6370984e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0891567104e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5779 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 3d75dff1c8fa8825c400cab195778324 inet 86775162 Group 1} {458758 active http://127.0.0.1:9501/ 127.0.0.1:9001 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:0 index_disk_size:0 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0937647104e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12002 distTCP:21400 distTLS:21450 httpsCAPI:19501 httpsMgmt:19001] healthy 5777 7.6.0-1467-rel-EE-enterprise false [index] 3af95a713a06f5b4d4d77cb399ba0709 inet 43970895 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=92568842&uuid=bbefcd5162dedff03c6ca925893da41b] /pools/default/nodeServices?v=132480064 /pools/default/serverGroups?v=10462945 [{default 4db40f29d5ef70257c7c6f00ee756671}] {0xc01befafc0 0xc017c27f40 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true bbefcd5162dedff03c6ca925893da41b [{default /poolsStreaming/default?uuid=bbefcd5162dedff03c6ca925893da41b /pools/default?uuid=bbefcd5162dedff03c6ca925893da41b}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.35264e+07 couch_docs_data_size:1.959513e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.6370984e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0891567104e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5779 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 3d75dff1c8fa8825c400cab195778324 inet 86775162 Group 1} {458758 active http://127.0.0.1:9501/ 127.0.0.1:9001 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:0 index_disk_size:0 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.0937647104e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12002 distTCP:21400 distTLS:21450 httpsCAPI:19501 httpsMgmt:19001] healthy 5777 7.6.0-1467-rel-EE-enterprise false [index] 3af95a713a06f5b4d4d77cb399ba0709 inet 43970895 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[indexAdmin:9106 indexHttp:9108 indexHttps:19108 indexScan:9107 indexStreamCatchup:9110 indexStreamInit:9109 indexStreamMaint:9111 mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9106:9106 9107:9107 9108:19108 9109:9109 9110:9110 9111:9111 9499:19499 9999:9999]}
2023/09/12 14:54:42 Rebalance progress: 100
2023/09/12 14:54:42 set14_rebalance_test.go::TestSwapRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestSwapRebalance (47.11s)
=== RUN TestRebalanceReplicaRepair
2023/09/12 14:54:44 TestRebalanceReplicaRepair entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:54:44 TestRebalanceReplicaRepair: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/12 14:54:44 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 14:54:57 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 14:54:57 TestRebalanceReplicaRepair: 2. Adding index node 127.0.0.1:9003 to the cluster
2023/09/12 14:54:57 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/12 14:55:09 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/12 14:55:09 TestRebalanceReplicaRepair: 3. Rebalancing
2023/09/12 14:55:14 Rebalance progress: 12.5
2023/09/12 14:55:19 Rebalance progress: 20
2023/09/12 14:55:24 Rebalance progress: 25
2023/09/12 14:55:29 Rebalance progress: 25
2023/09/12 14:55:34 Rebalance progress: 54.16666666666667
2023/09/12 14:55:39 Rebalance progress: 54.16666666666667
2023/09/12 14:55:44 Rebalance progress: 87.5
2023/09/12 14:55:49 Rebalance progress: 100
2023/09/12 14:55:49 TestRebalanceReplicaRepair exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceReplicaRepair (67.26s)
=== RUN TestFailureAndRebalanceDuringInitialIndexBuild
2023/09/12 14:55:51 set14_rebalance_test.go::TestFailureAndRebalanceDuringInitialIndexBuild: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:55:56 Created the secondary index index_0. Waiting for it become active
2023/09/12 14:55:56 Index is 7532307590014891915 now active
2023/09/12 14:56:02 Created the secondary index index_1. Waiting for it become active
2023/09/12 14:56:02 Index is 11455523694394948297 now active
2023/09/12 14:56:08 Created the secondary index index_2. Waiting for it become active
2023/09/12 14:56:08 Index is 11654501610780280578 now active
2023/09/12 14:56:15 Created the secondary index index_3. Waiting for it become active
2023/09/12 14:56:15 Index is 9092227672662921224 now active
2023/09/12 14:56:25 Created the secondary index index_4. Waiting for it become active
2023/09/12 14:56:25 Index is 14638689920772543563 now active
2023/09/12 14:56:31 Created the secondary index index_5. Waiting for it become active
2023/09/12 14:56:31 Index is 15502122251241360389 now active
2023/09/12 14:56:37 Created the secondary index index_6. Waiting for it become active
2023/09/12 14:56:37 Index is 6731788969136668371 now active
2023/09/12 14:56:43 Created the secondary index index_7. Waiting for it become active
2023/09/12 14:56:43 Index is 8175665954791996841 now active
2023/09/12 14:56:49 Created the secondary index index_8. Waiting for it become active
2023/09/12 14:56:49 Index is 2529593060180398360 now active
2023/09/12 14:56:55 Created the secondary index index_9. Waiting for it become active
2023/09/12 14:56:55 Index is 6774705252787293449 now active
2023/09/12 14:57:32 Failing over: [127.0.0.1:9002]
2023/09/12 14:57:33 Build the deferred index index_11. Waiting for the index to become active
2023/09/12 14:57:33 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:34 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:35 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:36 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:37 TestFailureAndRebalanceDuringInitialIndexBuild: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/12 14:57:37 Kicking off failover recovery, type: full
2023/09/12 14:57:37 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:38 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:39 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:40 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:41 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:42 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:43 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:44 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:44 Rebalance progress: 0
2023/09/12 14:57:45 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:46 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:47 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:48 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:49 Rebalance progress: 20
2023/09/12 14:57:49 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:50 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:51 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:52 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:53 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:54 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:55 Rebalance progress: 20
2023/09/12 14:57:55 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:56 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:57 Waiting for index 4009223410676715241 to go active ...
2023/09/12 14:57:58 Index is 4009223410676715241 now active
2023/09/12 14:57:59 Rebalance progress: 20
2023/09/12 14:58:04 Rebalance progress: 20
2023/09/12 14:58:09 Rebalance progress: 20
2023/09/12 14:58:14 Rebalance progress: 20
2023/09/12 14:58:19 Rebalance progress: 20
2023/09/12 14:58:24 Rebalance progress: 20
2023/09/12 14:58:29 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 14:58:29 set14_rebalance_test.go::TestFailureAndRebalanceDuringInitialIndexBuild: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestFailureAndRebalanceDuringInitialIndexBuild (157.87s)
=== RUN TestRedistributeWhenNodeIsAddedForFalse
2023/09/12 14:58:29 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 14:58:29 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 1. Setting up initial cluster configuration
2023/09/12 14:58:29 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 14:58:35 Rebalance progress: 87.5
2023/09/12 14:58:40 Rebalance progress: 87.5
2023-09-12T14:58:40.898+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T14:58:40.917+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T14:58:40.947+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T14:58:40.989+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T14:58:40.989+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T14:58:41.008+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T14:58:41.014+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023/09/12 14:58:45 Rebalance progress: 100
2023/09/12 14:58:45 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 14:59:09 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 14:59:24 Rebalance progress: 0
2023/09/12 14:59:29 Rebalance progress: 0
2023/09/12 14:59:34 Rebalance progress: 0
2023/09/12 14:59:39 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 14:59:39 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 15:00:09 Woke-up from sleep
2023/09/12 15:00:14 Rebalance progress: 75
2023/09/12 15:00:19 Rebalance progress: 100
2023/09/12 15:00:19 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 2. Changing indexer.settings.rebalance.redistribute_indexes to false
2023/09/12 15:00:20 Changing config key indexer.settings.rebalance.redistribute_indexes to value false
2023/09/12 15:00:20 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 3. Setup is completed
2023/09/12 15:00:20 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 15:00:20 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse 1. Creating 10 indexes: non-partitioned, 0-REPLICA, non-deferred
2023/09/12 15:00:20 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS__id_isActive on `default`(_id, isActive) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:00:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS__id_isActive index is now active.
2023/09/12 15:00:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_docid_balance on `default`(docid, balance) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:00:34 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_docid_balance index is now active.
2023/09/12 15:00:34 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_guid_picture on `default`(guid, picture) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:00:41 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_guid_picture index is now active.
2023/09/12 15:00:41 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_isActive_age on `default`(isActive, age) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:00:48 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_isActive_age index is now active.
2023/09/12 15:00:48 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:00:56 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_balance_eyeColor index is now active.
2023/09/12 15:00:56 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_picture_name on `default`(picture, name) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:01:03 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_picture_name index is now active.
2023/09/12 15:01:03 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_age_gender on `default`(age, gender) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:01:11 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_age_gender index is now active.
2023/09/12 15:01:11 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_eyeColor_company on `default`(eyeColor, company) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:01:18 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_eyeColor_company index is now active.
2023/09/12 15:01:18 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_name_email on `default`(name, email) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:01:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_name_email index is now active.
2023/09/12 15:01:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_gender_phone on `default`(gender, phone) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:01:34 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_gender_phone index is now active.
2023/09/12 15:01:34 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse 2. Creating 4 indexes: 5-PARTITION, 0-REPLICA, non-deferred
2023/09/12 15:01:34 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 15:01:41 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS__id_balance index is now active.
2023/09/12 15:01:41 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 15:01:49 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_docid_picture index is now active.
2023/09/12 15:01:49 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_guid_age on `default`(guid, age) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 15:01:57 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_guid_age index is now active.
2023/09/12 15:01:57 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor on `default`(isActive, eyeColor) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 15:02:04 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor index is now active.
2023/09/12 15:02:05 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/12 15:02:05 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Adding node 127.0.0.1:9002 with service index to the cluster
2023/09/12 15:02:05 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 15:02:17 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 15:02:22 Rebalance progress: 83.33333333333333
2023/09/12 15:02:27 Rebalance progress: 100
2023/09/12 15:02:27 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/12 15:02:27 for GetIndexLocalMetadata http://127.0.0.1:9114/getLocalIndexMetadata
--- PASS: TestRedistributeWhenNodeIsAddedForFalse (238.04s)
=== RUN TestRedistributeWhenNodeIsAddedForTrue
2023/09/12 15:02:27 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 15:02:27 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 1. Setting up initial cluster configuration
2023/09/12 15:02:27 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 15:02:33 Rebalance progress: 83.33333333333333
2023/09/12 15:02:38 Rebalance progress: 100
2023/09/12 15:02:38 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023-09-12T15:02:39.824+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.840+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.854+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.855+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.862+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.862+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.877+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.880+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.885+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.890+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.891+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.900+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.901+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.923+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:39.925+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:02:40.004+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023/09/12 15:02:41 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 15:02:42 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 15:03:02 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 15:03:18 Rebalance progress: 0
2023/09/12 15:03:23 Rebalance progress: 0
2023/09/12 15:03:28 Rebalance progress: 0
2023/09/12 15:03:33 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 15:03:33 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 15:04:03 Woke-up from sleep
2023/09/12 15:04:08 Rebalance progress: 75
2023/09/12 15:04:13 Rebalance progress: 100
2023/09/12 15:04:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 2. Changing indexer.settings.rebalance.redistribute_indexes to true
2023/09/12 15:04:13 Changing config key indexer.settings.rebalance.redistribute_indexes to value true
2023/09/12 15:04:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 3. Setup is completed
2023/09/12 15:04:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 15:04:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue 1. Creating 10 indexes: non-partitioned, 0-REPLICA, non-deferred
2023/09/12 15:04:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS__id_isActive on `default`(_id, isActive) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:04:19 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS__id_isActive index is now active.
2023/09/12 15:04:19 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_docid_balance on `default`(docid, balance) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:04:27 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_docid_balance index is now active.
2023/09/12 15:04:27 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_guid_picture on `default`(guid, picture) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:04:35 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_guid_picture index is now active.
2023/09/12 15:04:35 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_isActive_age on `default`(isActive, age) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:04:43 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_isActive_age index is now active.
2023/09/12 15:04:43 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:04:50 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_balance_eyeColor index is now active.
2023/09/12 15:04:50 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_picture_name on `default`(picture, name) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:04:58 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_picture_name index is now active.
2023/09/12 15:04:58 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_age_gender on `default`(age, gender) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:05:06 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_age_gender index is now active.
2023/09/12 15:05:06 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_eyeColor_company on `default`(eyeColor, company) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:05:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_eyeColor_company index is now active.
2023/09/12 15:05:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_name_email on `default`(name, email) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:05:21 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_name_email index is now active.
2023/09/12 15:05:21 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_gender_phone on `default`(gender, phone) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 15:05:29 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_gender_phone index is now active.
2023/09/12 15:05:29 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue 2. Creating 4 indexes: 5-PARTITION, 0-REPLICA, non-deferred
2023/09/12 15:05:29 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 15:05:36 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS__id_balance index is now active.
2023/09/12 15:05:36 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 15:05:45 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_docid_picture index is now active.
2023/09/12 15:05:45 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_guid_age on `default`(guid, age) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 15:05:53 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_guid_age index is now active.
2023/09/12 15:05:53 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor on `default`(isActive, eyeColor) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 15:06:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor index is now active.
2023/09/12 15:06:01 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/12 15:06:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Adding node 127.0.0.1:9002 with service index to the cluster
2023/09/12 15:06:01 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 15:06:14 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 15:06:20 Rebalance progress: 23.33333333333333
2023/09/12 15:06:25 Rebalance progress: 23.33333333333333
2023/09/12 15:06:30 Rebalance progress: 31.81565410816014
2023/09/12 15:06:35 Rebalance progress: 100
2023/09/12 15:06:35 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/12 15:06:35 for GetIndexLocalMetadata http://127.0.0.1:9114/getLocalIndexMetadata
--- PASS: TestRedistributeWhenNodeIsAddedForTrue (247.28s)
=== RUN TestRebalanceResetCluster
2023/09/12 15:06:35 set14_rebalance_test.go::TestRebalanceResetCluster: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 15:06:35 set14_rebalance_test.go::TestRebalanceResetCluster: 1. Restoring indexer.settings.rebalance.redistribute_indexes to false
2023/09/12 15:06:35 Changing config key indexer.settings.rebalance.redistribute_indexes to value false
2023/09/12 15:06:35 set14_rebalance_test.go::TestRebalanceResetCluster: 2. Resetting cluster to initial configuration
2023/09/12 15:06:35 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 15:06:40 Rebalance progress: 83.33333333333333
2023-09-12T15:06:45.548+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023/09/12 15:06:45 Rebalance progress: 100
2023/09/12 15:06:45 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023-09-12T15:06:45.585+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.585+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.611+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.614+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.615+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.620+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.622+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.625+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.627+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.629+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.631+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.636+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.637+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.651+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:06:45.657+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023/09/12 15:06:49 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 15:07:11 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 15:07:26 Rebalance progress: 0
2023/09/12 15:07:31 Rebalance progress: 0
2023/09/12 15:07:36 Rebalance progress: 0
2023/09/12 15:07:41 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 15:07:41 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 15:08:11 Woke-up from sleep
2023/09/12 15:08:16 Rebalance progress: 75
2023/09/12 15:08:21 Rebalance progress: 100
2023/09/12 15:08:21 set14_rebalance_test.go::TestRebalanceResetCluster: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceResetCluster (108.49s)
=== RUN TestAlterIndexIncrReplica
2023/09/12 15:08:23 In TestAlterIndexIncrReplica()
2023/09/12 15:08:23 This test creates an index with one replica and then increments replica count to 2
2023/09/12 15:08:23 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 15:08:29 Rebalance progress: 75
2023-09-12T15:08:31.829+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:08:31.833+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:08:31.844+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:08:32.012+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:08:32.354+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:08:33.434+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T15:08:33.448+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023/09/12 15:08:34 Rebalance progress: 100
2023/09/12 15:08:34 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 15:08:35 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 15:08:52 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 15:09:07 Rebalance progress: 0
2023/09/12 15:09:12 Rebalance progress: 0
2023/09/12 15:09:17 Rebalance progress: 0
2023/09/12 15:09:22 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 15:09:22 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 15:09:52 Woke-up from sleep
2023/09/12 15:09:57 Rebalance progress: 75
2023/09/12 15:10:02 Rebalance progress: 100
2023/09/12 15:10:03 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 15:10:15 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 15:10:20 Rebalance progress: 83.33333333333333
2023/09/12 15:10:25 Rebalance progress: 100
2023/09/12 15:10:25 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/12 15:10:37 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/12 15:10:43 Rebalance progress: 87.5
2023/09/12 15:10:48 Rebalance progress: 100
2023/09/12 15:10:48 In DropAllSecondaryIndexes()
2023/09/12 15:11:34 Flushed the bucket default, Response body:
2023/09/12 15:11:40 Created the secondary index idx_1. Waiting for it become active
2023/09/12 15:11:40 Index is 11959983185118687655 now active
2023/09/12 15:11:40 Executing alter index command: alter index `default`.idx_1 with {"action":"replica_count", "num_replica":2}
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:06 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12 15:12:07 Using n1ql client
2023/09/12