Building
Started building at 2023/09/12 17:35:26
Using pegged server, 1467 build
Calculating base
Updating mirror
Basing run on 7.6.0-1467 8820063a7b
Updating tree for run 12.09.2023-17.35
query is at fc4ec6b, changes since last good build: none
gometa is at 96e745a, changes since last good build: none
ns_server is at 57d74a0, changes since last good build: none
couchstore is at c392c9b, changes since last good build: none
forestdb is at 7af87ef, changes since last good build: none
kv_engine is at e36344c, changes since last good build: none
Switching indexing to unstable
indexing is at 8cc66e6, changes since last good build: none
Switching plasma to unstable
plasma is at 40f4da5, changes since last good build:
fatal: Invalid revision range 7431dcb1d1cb4337557ced397279a998bf143db0..HEAD
Switching nitro to unstable
nitro is at f6a9378, changes since last good build: none
Switching gometa to master
gometa is at 96e745a, changes since last good build: none
Switching testrunner to master
Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client'
Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI'
Submodule 'magma_loader/DocLoader' (https://github.com/couchbaselabs/DocLoader.git) registered for path 'magma_loader/DocLoader'
Cloning into '/opt/build/testrunner/java_sdk_client'...
Cloning into '/opt/build/testrunner/lib/capellaAPI'...
Cloning into '/opt/build/testrunner/magma_loader/DocLoader'...
Submodule path 'java_sdk_client': checked out 'de89b059ce28567dbac18afb032271a4eaa674ff'
Submodule path 'lib/capellaAPI': checked out 'b1bc0f0676302ea9888d033fa86fe0fd749e2445'
Submodule path 'magma_loader/DocLoader': checked out '0f32672eea77681939c9b26d43f60bd4b3478936'
testrunner is at 5aa9ede, changes since last good build:
5aa9ede18 Fixing cbstat validation in evictionkv::eph tests
Pulling in uncommitted change 191342 at refs/changes/42/191342/9
Total 8 (delta 5), reused 5 (delta 5)
[unstable ccc70162] MB-57427: disable array index tests
Author: Dhruvil Shah
Date: Mon May 22 10:24:11 2023 +0530
2 files changed, 7 insertions(+), 1 deletion(-)
Pulling in uncommitted change 193825 at refs/changes/25/193825/1
Total 6 (delta 5), reused 6 (delta 5)
[unstable 023dbc92] MB100: CIFail - Enable info level client logs after TestScheduleIndexBasic
Author: Sai Krishna Teja Kommaraju
Date: Fri Jul 14 00:58:44 2023 +0530
1 file changed, 3 insertions(+)
Pulling in uncommitted change 195279 at refs/changes/79/195279/2
Total 5 (delta 4), reused 5 (delta 4)
[unstable 3662b84b] MB-57825: Enable LSS flush buffer tuning
Author: Saptarshi Sen
Date: Fri Aug 11 10:53:36 2023 -0700
1 file changed, 6 insertions(+), 6 deletions(-)
Pulling in uncommitted change 196757 at refs/changes/57/196757/4
Total 5 (delta 4), reused 5 (delta 4)
[unstable b265522c] MB-58538 Handle failures during index recovery
Author: Varun Velamuri
Date: Wed Sep 6 14:38:00 2023 -0700
1 file changed, 22 insertions(+), 10 deletions(-)
Pulling in uncommitted change 196852 at refs/changes/52/196852/3
Total 10 (delta 4), reused 6 (delta 4)
[unstable f3f78f0b] MB-57930 - move plasma dependencies to separate file
Author: Dhruvil Shah
Date: Fri Sep 8 16:31:05 2023 +0530
6 files changed, 134 insertions(+), 37 deletions(-)
create mode 100644 secondary/indexer/pause_copier_community.go
create mode 100644 secondary/indexer/pause_copier_enterprise.go
Pulling in uncommitted change 196894 at refs/changes/94/196894/2
Total 7 (delta 5), reused 7 (delta 5)
[unstable 6b0a808a] MB-57930: Refactor Prometheus storage stats
Author: jineshparakh
Date: Sat Sep 9 18:43:17 2023 +0530
3 files changed, 173 insertions(+), 125 deletions(-)
create mode 100644 secondary/indexer/storage_stats_manager_community.go
create mode 100644 secondary/indexer/storage_stats_manager_enterprise.go
Pulling in uncommitted change 196915 at refs/changes/15/196915/3
Total 7 (delta 5), reused 7 (delta 5)
[unstable 4e47cf8c] MB-58588 - fix client TLS config for peer server
Author: Dhruvil Shah
Date: Mon Sep 11 14:35:19 2023 +0530
2 files changed, 36 insertions(+), 72 deletions(-)
Pulling in uncommitted change 196971 at refs/changes/71/196971/2
Total 6 (delta 1), reused 1 (delta 1)
[unstable ba16e272] MB-57932 CI fix flaky unit test
Author: hari kishore
Date: Mon Sep 11 14:54:26 2023 -0700
1 file changed, 7 insertions(+), 6 deletions(-)
Pulling in uncommitted change 196039 at refs/changes/39/196039/4
Total 18 (delta 7), reused 7 (delta 7)
[unstable ac28385] MB-58392: Add/update flush buffer unit tests
Author: Saptarshi Sen
Date: Thu Aug 24 15:55:02 2023 -0700
3 files changed, 173 insertions(+), 81 deletions(-)
Pulling in uncommitted change 196295 at refs/changes/95/196295/2
[unstable f5d6208] MB-58392: Fix a timer panic on zero LSSSampleInterval
Author: Saptarshi Sen
Date: Mon Aug 28 14:16:41 2023 -0700
1 file changed, 1 insertion(+), 1 deletion(-)
Pulling in uncommitted change 196296 at refs/changes/96/196296/2
[unstable 1717310] MB-57825: Do not exceed flush buffer limit on resumeIO for idleLSS
Author: Saptarshi Sen
Date: Mon Aug 28 16:12:34 2023 -0700
2 files changed, 108 insertions(+), 6 deletions(-)
Pulling in uncommitted change 196557 at refs/changes/57/196557/9
Total 11 (delta 9), reused 11 (delta 9)
[unstable dabc86f] MB-58423: Perform tenant quota adjustment asynchronously
Author: jliang00
Date: Fri Sep 1 09:30:02 2023 -0700
6 files changed, 321 insertions(+), 48 deletions(-)
Building community edition
Building cmakefiles and deps [CE]
Building main product [CE]
Build CE finished
BUILD_ENTERPRISE empty. Building enterprise edition
Building Enterprise Edition
Building cmakefiles and deps [EE]
Building main product [EE]
Build EE finished
Testing
Started testing at 2023/09/12 18:32:27
Testing mode: sanity,unit,functional,serverless,integration
Using storage type: memdb
Setting ulimit to 200000
Simple Test
Sep 12 18:34:08 suite_setUp (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 12 18:38:33 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 12 18:42:59 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 12 18:47:35 b" 'stop_on_failure': 'True'}"
Sep 12 18:47:35 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=50000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True,doc_ops=create;update;delete'
Sep 12 18:47:35 b"{'nodes_in': '3', 'replicas': '1', 'items': '50000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 1, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_18-32-50/test_1'}"
Sep 12 18:47:35 b'-->result: '
Sep 12 18:47:35 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0'
Sep 12 18:47:35 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,bucket_type=ephemeral,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Sep 12 18:47:35 b"{'nodes_in': '3', 'bucket_type': 'ephemeral', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 2, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_18-32-50/test_2'}"
Sep 12 18:47:35 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 18:47:35 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t memcapable.WarmUpMemcachedTest.do_warmup_100k,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True'
Sep 12 18:47:35 b"{'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 3, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_18-32-50/test_3'}"
Sep 12 18:47:35 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 18:47:35 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 18:47:35 b'failures so far...'
Sep 12 18:47:35 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.createdeleteview.CreateDeleteViewTests.test_view_ops,ddoc_ops=create,test_with_view=True,num_ddocs=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,num_views_per_ddoc=10,items=1000,skip_cleanup=False,get-logs-cluster-run=True'
Sep 12 18:47:35 b"{'ddoc_ops': 'create', 'test_with_view': 'True', 'num_ddocs': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'num_views_per_ddoc': '10', 'items': '1000', 'skip_cleanup': 'False', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 4, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_18-32-50/test_4'}"
Sep 12 18:48:45 b'http://127.0.0.1:9003/pools/default with status False: unknown pool'ok
Sep 12 18:58:22 test_employee_dataset_startkey_endkey_queries_rebalance_in (view.viewquerytests.ViewQueryTests) ... ok
Sep 12 18:59:10 test_simple_dataset_stale_queries_data_modification (view.viewquerytests.ViewQueryTests) ... ok
Sep 12 19:03:22 load_with_ops (xdcr.uniXDCR.unidirectional) ... ok
Sep 12 19:05:34 load_with_failover (xdcr.uniXDCR.unidirectional) ...
Sep 12 19:05:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 19:05:34 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 19:05:34 b'failures so far...'
Sep 12 19:05:34 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 19:05:34 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,num_nodes_to_add=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,docs-per-day=1,timeout=1200,get-logs-cluster-run=True'
Sep 12 19:05:34 b"{'num_nodes_to_add': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'docs-per-day': '1', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 5, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_18-32-50/test_5'}"
Sep 12 19:05:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 19:05:34 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 19:05:34 b'failures so far...'
Sep 12 19:05:34 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 19:05:34 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0'
Sep 12 19:05:34 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'
Sep 12 19:05:34 b"{'num-docs': '1000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 6, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_18-32-50/test_6'}"
Sep 12 19:05:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 19:05:34 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 19:05:34 b'failures so far...'
Sep 12 19:05:34 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 19:05:34 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 12 19:05:34 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_ops,replicas=1,items=10000,value_size=128,ctopology=chain,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,rdirection=unidirection,doc-ops=update-delete,get-logs-cluster-run=True'
Sep 12 19:05:34 b"{'replicas': '1', 'items': '10000', 'value_size': '128', 'ctopology': 'chain', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 7, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_18-32-50/test_7'}"
Sep 12 19:05:34 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 19:05:34 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 19:05:34 b'failures so far...'
Sep 12 19:05:34 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 19:05:34 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 12 19:05:34 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0'
Sep 12 19:05:34 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Sep 12 19:05:34 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-12_18-32-50/test_8'}"
Sep 12 19:07:40 b'http://127.0.0.1:9001/pools/default with status False: unknown pool'ok
Sep 12 19:10:31 suite_tearDown (xdcr.uniXDCR.unidirectional) ... ok
Sep 12 19:10:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 12 19:10:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 12 19:10:32 b'failures so far...'
Sep 12 19:10:32 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 12 19:10:32 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 12 19:10:32 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0'
Sep 12 19:10:32 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Sep 12 19:10:32 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Sep 12 19:10:32 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Sep 12 19:10:32 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' fail ')"
Sep 12 19:10:32 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' pass')"
Sep 12 19:10:32 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' pass')"
Sep 12 19:10:32 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' pass')"
Sep 12 19:10:32 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' pass')"
Sep 12 19:10:32 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' pass')"
Sep 12 19:10:32 Makefile:30: recipe for target 'simple-test' failed
Unit tests
=== RUN TestMerger
--- PASS: TestMerger (0.01s)
=== RUN TestInsert
--- PASS: TestInsert (0.00s)
=== RUN TestInsertPerf
16000000 items took 29.016760091s -> 551405.4618717632 items/s conflicts 22
--- PASS: TestInsertPerf (29.02s)
=== RUN TestGetPerf
16000000 items took 5.821643473s -> 2.748364800112863e+06 items/s
--- PASS: TestGetPerf (6.44s)
=== RUN TestGetRangeSplitItems
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3344,
"memory_used": 37351024,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749371,
"level1": 187782,
"level2": 47112,
"level3": 11818,
"level4": 2941,
"level5": 729,
"level6": 184,
"level7": 44,
"level8": 14,
"level9": 4,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Split range keys [55136 66250 123498 227461 387174 471694 544395]
No of items in each range [55136 11114 57248 103963 159713 84520 72701 455605]
--- PASS: TestGetRangeSplitItems (0.59s)
=== RUN TestBuilder
{
"node_count": 50000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3331,
"memory_used": 1866499440,
"node_allocs": 50000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 37506521,
"level1": 9372600,
"level2": 2339874,
"level3": 585439,
"level4": 146471,
"level5": 36968,
"level6": 9092,
"level7": 2266,
"level8": 578,
"level9": 138,
"level10": 39,
"level11": 12,
"level12": 2,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 8.228384762s to build 50000000 items, 6.0765265e+06 items/sec
Took 404.076439ms to iterate 50000000 items
--- PASS: TestBuilder (8.63s)
=== RUN TestNodeDCAS
--- PASS: TestNodeDCAS (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/memdb/skiplist 44.948s
=== RUN TestInsert
Set IO Concurrency: 716
--- PASS: TestInsert (0.01s)
=== RUN TestInsertPerf
20000000 items took 51.609619513s -> 387524.6550686579 items/s snapshots_created 210 live_snapshots 1
--- PASS: TestInsertPerf (64.28s)
=== RUN TestInsertDuplicates
--- PASS: TestInsertDuplicates (0.01s)
=== RUN TestGetPerf
16000000 items took 20.95919476s -> 763388.1064236077 items/s
--- PASS: TestGetPerf (22.74s)
=== RUN TestLoadStoreDisk
Inserting 1000000 items took 1.638060135s
{
"node_count": 1000686,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 12,
"next_pointers_per_node": 1.3333,
"memory_used": 57336592,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 750403,
"level1": 187786,
"level2": 46919,
"level3": 11678,
"level4": 2932,
"level5": 729,
"level6": 183,
"level7": 44,
"level8": 8,
"level9": 4,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
2023-09-12T19:13:14.485+05:30 [Info] MemDB::StoreToDisk: Unexpected amount of data being persisted dir [db.dump] count per shard [[13709 48213 13003 48292 58317 41669 100043 68933 35783 32832 33988 19466 159184 40411 42000 244157]] total count [1000000] snap count [999999] size per shard [[109672 385704 104024 386336 466536 333352 800344 551464 286264 262656 271904 155728 1273472 323288 336000 1953256]] total size [8000000] memoryInUse [57336592]
2023-09-12T19:13:14.537+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[13709 48213 13003 48292 58317 41669 100043 68933 35783 32832 33988 19466 159184 40411 42000 244157]] total count [1000000] snap count [999999] size per shard [[109672 385704 104024 386336 466536 333352 800344 551464 286264 262656 271904 155728 1273472 323288 336000 1953256]] total size [8000000] memoryInUse [57336592]
Storing to disk took 324.764679ms
Loading from disk took 317.098744ms
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3335,
"memory_used": 57336624,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749824,
"level1": 187722,
"level2": 46654,
"level3": 11978,
"level4": 2880,
"level5": 682,
"level6": 194,
"level7": 50,
"level8": 13,
"level9": 3,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestLoadStoreDisk (3.68s)
=== RUN TestConcurrentLoadCloseFragmentation
Done Inserting 2000000 items
frag = NaN%
2023-09-12T19:13:19.935+05:30 [Info] MemDB::StoreToDisk: Unexpected amount of data being persisted dir [db.dump] count per shard [[104614 101746 144063 288157 109610 144928 59473 48274 159244 57203 101351 216719 130025 58801 238345 37447]] total count [2000000] snap count [1999999] size per shard [[836912 813968 1152504 2305256 876880 1159424 475784 386192 1273952 457624 810808 1733752 1040200 470408 1906760 299576]] total size [16000000] memoryInUse [114677152]
2023-09-12T19:13:20.053+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[104614 101746 144063 288157 109610 144928 59473 48274 159244 57203 101351 216719 130025 58801 238345 37447]] total count [2000000] snap count [1999999] size per shard [[836912 813968 1152504 2305256 876880 1159424 475784 386192 1273952 457624 810808 1733752 1040200 470408 1906760 299576]] total size [16000000] memoryInUse [114677152]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentation (5.95s)
=== RUN TestConcurrentLoadCloseFragmentationSmall
Done Inserting 10 items
frag = NaN%
2023-09-12T19:13:22.020+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationSmall (0.06s)
=== RUN TestConcurrentLoadCloseFragmentationEmpty
Done Inserting 0 items
frag = NaN%
2023-09-12T19:13:22.081+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationEmpty (0.07s)
=== RUN TestConcurrentCloseSingleNode
A
--- PASS: TestConcurrentCloseSingleNode (0.00s)
=== RUN TestStoreDiskShutdown
Inserting 1000000 items took 1.505547307s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 13,
"next_pointers_per_node": 1.3343,
"memory_used": 57348640,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749708,
"level1": 187367,
"level2": 47074,
"level3": 11917,
"level4": 2971,
"level5": 720,
"level6": 177,
"level7": 51,
"level8": 14,
"level9": 1,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
Prepare returns error: MemDB instance has been shutdown
--- PASS: TestStoreDiskShutdown (2.25s)
=== RUN TestDelete
{
"node_count": 10,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.1000,
"memory_used": 556,
"node_allocs": 10,
"node_frees": 0,
"level_node_distribution":{
"level0": 9,
"level1": 1,
"level2": 0,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
{
"node_count": 10,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.2000,
"memory_used": 572,
"node_allocs": 20,
"node_frees": 10,
"level_node_distribution":{
"level0": 9,
"level1": 0,
"level2": 1,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestDelete (1.00s)
=== RUN TestGCPerf
final_node_count = 16000, average_live_node_count = 68174, wait_time_for_collection = 20ms
--- PASS: TestGCPerf (36.27s)
=== RUN TestMemoryInUse
ItemsCount: 5000, MemoryInUse: 295952, NodesCount: 5000
ItemsCount: 0, MemoryInUse: 64, NodesCount: 0
--- PASS: TestMemoryInUse (1.01s)
=== RUN TestFullScan
Inserting 1600000 items took 2.834731813s
{
"node_count": 1600000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 6,
"next_pointers_per_node": 1.3331,
"memory_used": 91855816,
"node_allocs": 1600980,
"node_frees": 0,
"level_node_distribution":{
"level0": 1200109,
"level1": 300003,
"level2": 74941,
"level3": 18795,
"level4": 4619,
"level5": 1141,
"level6": 292,
"level7": 66,
"level8": 23,
"level9": 10,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Full iteration of 1600000 items took 288.291484ms
--- PASS: TestFullScan (4.29s)
=== RUN TestVisitor
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3338,
"memory_used": 57341488,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749650,
"level1": 187565,
"level2": 47138,
"level3": 11816,
"level4": 2909,
"level5": 669,
"level6": 206,
"level7": 42,
"level8": 3,
"level9": 1,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 43.116709ms to iterate 1000000 items, 2.3192866e+07 items/s
shard - 0 count = 16728, range: 0-16727
shard - 1 count = 13914, range: 16728-30641
shard - 2 count = 47035, range: 30642-77676
shard - 3 count = 155151, range: 77677-232827
shard - 4 count = 33907, range: 232828-266734
shard - 5 count = 26238, range: 266735-292972
shard - 6 count = 36337, range: 292973-329309
shard - 7 count = 32446, range: 329310-361755
shard - 8 count = 40561, range: 361756-402316
shard - 9 count = 28327, range: 402317-430643
shard - 10 count = 50699, range: 430644-481342
shard - 11 count = 40675, range: 481343-522017
shard - 12 count = 42581, range: 522018-564598
shard - 13 count = 57912, range: 564599-622510
shard - 14 count = 35492, range: 622511-658002
shard - 15 count = 18202, range: 658003-676204
shard - 16 count = 51641, range: 676205-727845
shard - 17 count = 2726, range: 727846-730571
shard - 18 count = 18480, range: 730572-749051
shard - 19 count = 80664, range: 749052-829715
shard - 20 count = 12234, range: 829716-841949
shard - 21 count = 89051, range: 841950-931000
shard - 22 count = 26264, range: 931001-957264
shard - 23 count = 35220, range: 957265-992484
shard - 24 count = 7515, range: 992485-999999
shard - 25 count = 0, range: 0-0
shard - 26 count = 0, range: 0-0
shard - 27 count = 0, range: 0-0
shard - 28 count = 0, range: 0-0
shard - 29 count = 0, range: 0-0
shard - 30 count = 0, range: 0-0
shard - 31 count = 0, range: 0-0
--- PASS: TestVisitor (1.49s)
=== RUN TestVisitorError
--- PASS: TestVisitorError (0.55s)
=== RUN TestLoadDeltaStoreDisk
snap count = 1000000
2023-09-12T19:14:12.925+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 25636 239684 73638 64198 166451 118864 117437 165291]] total count [971199] snap count [1000000] size per shard [[0 0 0 0 0 0 0 0 205088 1917472 589104 513584 1331608 950912 939496 1322328]] total size [7769592] memoryInUse [116596208]
Storing to disk took 15.232655577s
Loading from disk took 1.32020838s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3328,
"memory_used": 57324016,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 750574,
"level1": 187129,
"level2": 46577,
"level3": 11756,
"level4": 2920,
"level5": 808,
"level6": 182,
"level7": 47,
"level8": 4,
"level9": 3,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Restored 28801
RestoredFailed 492127
--- PASS: TestLoadDeltaStoreDisk (18.38s)
=== RUN TestExecuteConcurrGCWorkers
--- PASS: TestExecuteConcurrGCWorkers (0.70s)
=== RUN TestCloseWithActiveIterators
--- PASS: TestCloseWithActiveIterators (24.87s)
=== RUN TestDiskCorruption
Inserting 100000 items took 122.970184ms
{
"node_count": 100000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 3,
"next_pointers_per_node": 1.3330,
"memory_used": 5732748,
"node_allocs": 99999,
"node_frees": 0,
"level_node_distribution":{
"level0": 74955,
"level1": 18837,
"level2": 4674,
"level3": 1160,
"level4": 270,
"level5": 78,
"level6": 19,
"level7": 5,
"level8": 2,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
2023-09-12T19:14:53.504+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[2510 20704 7659 2992 6345 4565 5355 5448 3289 6546 12982 8216 2979 10410 0 0]] total count [100000] snap count [100000] size per shard [[20080 165632 61272 23936 50760 36520 42840 43584 26312 52368 103856 65728 23832 83280 0 0]] total size [800000] memoryInUse [5732748]
Storing to disk took 115.412841ms
Loading from disk took 37.03066ms
--- PASS: TestDiskCorruption (0.75s)
=== RUN TestSnapshotStats
--- PASS: TestSnapshotStats (0.00s)
=== RUN TestInsertDeleteConcurrent
total items in snapshot: 7816086 items deleted: 2183914
{
"node_count": 7816086,
"soft_deletes": 0,
"read_conflicts": 5766,
"insert_conflicts": 169,
"next_pointers_per_node": 1.3333,
"memory_used": 448114120,
"node_allocs": 10000000,
"node_frees": 10000002,
"level_node_distribution":{
"level0": 5862404,
"level1": 1464997,
"level2": 367131,
"level3": 91001,
"level4": 22852,
"level5": 5729,
"level6": 1471,
"level7": 360,
"level8": 93,
"level9": 36,
"level10": 9,
"level11": 2,
"level12": 1,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
allocs: 20000002 frees: 20000002
--- PASS: TestInsertDeleteConcurrent (20.02s)
=== RUN TestNodeList
--- PASS: TestNodeList (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/memdb 208.665s
=== RUN TestInteger
--- PASS: TestInteger (0.00s)
=== RUN TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN TestFloat
--- PASS: TestFloat (0.00s)
=== RUN TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN TestReference
--- PASS: TestReference (0.00s)
=== RUN TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618]
PASS
TESTING [0]
PASS
TESTING [0.0]
PASS
TESTING [0.0000]
PASS
TESTING [0.0000000]
PASS
TESTING [-0]
PASS
TESTING [-0.0]
PASS
TESTING [-0.0000]
PASS
TESTING [-0.0000000]
PASS
TESTING [1]
PASS
TESTING [20]
PASS
TESTING [3456]
PASS
TESTING [7645000]
PASS
TESTING [9223372036854775807]
PASS
TESTING [9223372036854775806]
PASS
TESTING [9223372036854775808]
PASS
TESTING [92233720368547758071234000]
PASS
TESTING [92233720368547758071234987437653]
PASS
TESTING [12300000000000000000000000000000056]
PASS
TESTING [12300000000000000000000000000000000]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [210690]
PASS
TESTING [90000]
PASS
TESTING [123000000]
PASS
TESTING [3.60e2]
PASS
TESTING [36e2]
PASS
TESTING [1.9999999999e10]
PASS
TESTING [1.99999e10]
PASS
TESTING [1.99999e5]
PASS
TESTING [0.00000000000012e15]
PASS
TESTING [7.64507352e8]
PASS
TESTING [9.2233720368547758071234987437653e31]
PASS
TESTING [2650e-1]
PASS
TESTING [26500e-1]
PASS
TESTING [-1]
PASS
TESTING [-20]
PASS
TESTING [-3456]
PASS
TESTING [-7645000]
PASS
TESTING [-9223372036854775808]
PASS
TESTING [-9223372036854775807]
PASS
TESTING [-9223372036854775806]
PASS
TESTING [-9223372036854775809]
PASS
TESTING [-92233720368547758071234000]
PASS
TESTING [-92233720368547758071234987437653]
PASS
TESTING [-12300000000000000000000000000000056]
PASS
TESTING [-12300000000000000000000000000000000]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [-210690]
PASS
TESTING [-90000]
PASS
TESTING [-123000000]
PASS
TESTING [-3.60e2]
PASS
TESTING [-36e2]
PASS
TESTING [-1.9999999999e10]
PASS
TESTING [-1.99999e10]
PASS
TESTING [-1.99999e5]
PASS
TESTING [-0.00000000000012e15]
PASS
TESTING [-2650e-1]
PASS
TESTING [-26500e-1]
PASS
TESTING [0.03]
PASS
TESTING [198.60]
PASS
TESTING [2000045.178]
PASS
TESTING [1.7976931348623157e+308]
PASS
TESTING [0.000000000000000000890]
PASS
TESTING [257953786.9864236576]
PASS
TESTING [257953786.9864236576e8]
PASS
TESTING [36.912e3]
PASS
TESTING [2761.67e0]
PASS
TESTING [2761.67e00]
PASS
TESTING [2761.67e000]
PASS
TESTING [7676546.67e-3]
PASS
TESTING [-0.03]
PASS
TESTING [-198.60]
PASS
TESTING [-2000045.178]
PASS
TESTING [-1.7976931348623157e+308]
PASS
TESTING [-0.000000000000000000890]
PASS
TESTING [-257953786.9864236576]
PASS
TESTING [-257953786.9864236576e8]
PASS
TESTING [-36.912e3]
PASS
TESTING [-2761.67e0]
PASS
TESTING [-2761.67e00]
PASS
TESTING [-2761.67e000]
PASS
TESTING [-7676546.67e-3]
PASS
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/collatejson 0.037s
=== RUN TestForestDBIterator
2023-09-12T19:15:36.655+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 5615 us
2023-09-12T19:15:36.656+05:30 [INFO][FDB] Forestdb opened database file test
2023-09-12T19:15:36.659+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.01s)
=== RUN TestForestDBIteratorSeek
2023-09-12T19:15:36.660+05:30 [INFO][FDB] Forestdb opened database file test
2023-09-12T19:15:36.666+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.01s)
=== RUN TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN TestMemDBInsertionPerf
Maximum number of file descriptors = 200000
Set IO Concurrency: 7200
2023-09-12T19:15:37.770+05:30 DEBU REGU.impl.init.0.func1() at aggrecorder.go:57 [id 28] will report aggregate recorder stats every 5m0s
Initial build: 10000000 items took 55.097163628s -> 181497.54618072696 items/s
Incr build: 10000000 items took 2m58.575118768s -> 55998.8427782693 items/s
Main Index: {
"node_count": 18000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 4,
"next_pointers_per_node": 1.3334,
"memory_used": 1695935660,
"node_allocs": 18000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 13498231,
"level1": 3377193,
"level2": 842889,
"level3": 211183,
"level4": 52886,
"level5": 13208,
"level6": 3281,
"level7": 845,
"level8": 221,
"level9": 49,
"level10": 13,
"level11": 1,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (233.68s)
=== RUN TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN TestDequeueA
--- PASS: TestDequeueA (1.21s)
=== RUN TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.01s)
=== RUN TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.01s)
PASS
ok github.com/couchbase/indexing/secondary/indexer 257.799s
=== RUN TestConnPoolBasicSanity
2023-09-12T19:19:59.294+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T19:19:59.294+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T19:19:59.525+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:19:59.525+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:20:00.295+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN TestCloseActiveConnectionsUnsetFlag
2023-09-12T19:20:04.297+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T19:20:04.297+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T19:20:04.511+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:20:04.511+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:20:05.298+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestCloseActiveConnectionsUnsetFlag (9.22s)
=== RUN TestCloseActiveConnectionsSetFlag
2023-09-12T19:20:13.515+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T19:20:13.515+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T19:20:13.735+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:20:13.735+05:30 [Info] Closing active connection from 127.0.0.1:53376 to 127.0.0.1:15151
2023-09-12T19:20:13.735+05:30 [Info] Closing active connection from 127.0.0.1:53380 to 127.0.0.1:15151
2023-09-12T19:20:13.735+05:30 [Info] Closing active connection from 127.0.0.1:53382 to 127.0.0.1:15151
2023-09-12T19:20:13.736+05:30 [Info] Closing active connection from 127.0.0.1:53374 to 127.0.0.1:15151
2023-09-12T19:20:13.736+05:30 [Info] Closing active connection from 127.0.0.1:53378 to 127.0.0.1:15151
2023-09-12T19:20:13.736+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:20:14.516+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestCloseActiveConnectionsSetFlag (4.22s)
=== RUN TestMaintainActiveConnections
2023-09-12T19:20:17.738+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T19:20:17.738+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T19:20:18.114+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:20:18.114+05:30 [Info] Closing active connection from 127.0.0.1:53392 to 127.0.0.1:15151
2023-09-12T19:20:18.114+05:30 [Info] Closing active connection from 127.0.0.1:53396 to 127.0.0.1:15151
2023-09-12T19:20:18.114+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:20:18.738+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestMaintainActiveConnections (4.38s)
=== RUN TestConnectionPoolRenew
2023-09-12T19:20:22.115+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-12T19:20:22.116+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T19:20:22.336+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:53402"
2023-09-12T19:20:22.337+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:53404"
2023-09-12T19:20:22.338+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:53406"
2023-09-12T19:20:22.338+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:53408"
2023-09-12T19:20:22.339+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:53400"
2023-09-12T19:20:22.349+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:20:22.349+05:30 [Info] Closing active connection from 127.0.0.1:53410 to 127.0.0.1:15151
2023-09-12T19:20:22.349+05:30 [Info] Closing active connection from 127.0.0.1:53414 to 127.0.0.1:15151
2023-09-12T19:20:22.349+05:30 [Info] Closing active connection from 127.0.0.1:53418 to 127.0.0.1:15151
2023-09-12T19:20:22.350+05:30 [Info] Closing active connection from 127.0.0.1:53416 to 127.0.0.1:15151
2023-09-12T19:20:22.350+05:30 [Info] Closing active connection from 127.0.0.1:53412 to 127.0.0.1:15151
2023-09-12T19:20:22.350+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:20:23.116+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
2023-09-12T19:20:24.351+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:53412"
2023-09-12T19:20:24.351+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing connection "127.0.0.1:53420" -> "127.0.0.1:15151" as the pool is closed
--- PASS: TestConnectionPoolRenew (4.24s)
=== RUN TestConnRelease
2023-09-12T19:20:26.352+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-12T19:20:26.352+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2023-09-12T19:21:06.164+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:21:06.164+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:21:06.369+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.81s)
=== RUN TestLongevity
2023-09-12T19:21:10.166+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-12T19:21:10.166+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Releasing 2 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 0 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 4 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 2 conns.
Getting 3 conns.
Releasing 3 conns.
Getting 4 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 0 conns.
Getting 4 conns.
Releasing 4 conns.
Getting 1 conns.
Releasing 1 conns.
Getting 2 conns.
Releasing 4 conns.
Getting 1 conns.
Releasing 0 conns.
Getting 2 conns.
2023-09-12T19:21:49.049+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:21:49.050+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:21:49.188+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.89s)
=== RUN TestSustainedHighConns
2023-09-12T19:21:53.052+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-12T19:21:53.052+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Allocating 4 Connections
cp.curActConns = 0
Returning 0 Connections
Returning 4 Connections
cp.curActConns = 0
Allocating 10 Connections
cp.curActConns = 10
Returning 0 Connections
Allocating 19 Connections
Returning 0 Connections
cp.curActConns = 11
Returning 4 Connections
cp.curActConns = 21
Returning 1 Connections
cp.curActConns = 25
Allocating 7 Connections
cp.curActConns = 31
Returning 1 Connections
Allocating 24 Connections
Returning 2 Connections
cp.curActConns = 35
Returning 0 Connections
cp.curActConns = 46
cp.curActConns = 52
Returning 1 Connections
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 52
Allocating 9 Connections
cp.curActConns = 58
Returning 3 Connections
cp.curActConns = 56
Returning 1 Connections
Allocating 19 Connections
Returning 3 Connections
cp.curActConns = 69
Returning 1 Connections
cp.curActConns = 70
Allocating 7 Connections
cp.curActConns = 77
Returning 1 Connections
Allocating 18 Connections
cp.curActConns = 80
Returning 3 Connections
cp.curActConns = 91
Returning 0 Connections
Allocating 6 Connections
Returning 1 Connections
cp.curActConns = 90
Returning 0 Connections
cp.curActConns = 96
Allocating 16 Connections
Returning 2 Connections
cp.curActConns = 102
Returning 3 Connections
cp.curActConns = 110
Allocating 15 Connections
Returning 1 Connections
cp.curActConns = 113
cp.curActConns = 121
Returning 0 Connections
Allocating 14 Connections
Returning 4 Connections
cp.curActConns = 120
cp.curActConns = 131
Returning 3 Connections
Allocating 9 Connections
cp.curActConns = 135
Returning 3 Connections
cp.curActConns = 134
Returning 1 Connections
Allocating 18 Connections
Returning 3 Connections
cp.curActConns = 143
cp.curActConns = 148
Returning 4 Connections
Allocating 7 Connections
cp.curActConns = 151
Returning 0 Connections
Allocating 21 Connections
cp.curActConns = 157
Returning 1 Connections
Returning 3 Connections
cp.curActConns = 165
cp.curActConns = 168
Returning 0 Connections
Allocating 5 Connections
Returning 0 Connections
cp.curActConns = 173
Allocating 17 Connections
Returning 3 Connections
cp.curActConns = 176
cp.curActConns = 187
Returning 1 Connections
Allocating 20 Connections
Returning 2 Connections
cp.curActConns = 188
Returning 0 Connections
cp.curActConns = 201
cp.curActConns = 204
Returning 2 Connections
Allocating 0 Connections
Returning 1 Connections
cp.curActConns = 201
Allocating 3 Connections
Returning 1 Connections
cp.curActConns = 204
Allocating 2 Connections
cp.curActConns = 205
Returning 2 Connections
Allocating 0 Connections
Returning 3 Connections
cp.curActConns = 200
Allocating 0 Connections
cp.curActConns = 200
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 206
Returning 4 Connections
Allocating 0 Connections
Returning 3 Connections
cp.curActConns = 199
Allocating 16 Connections
Returning 1 Connections
cp.curActConns = 213
cp.curActConns = 214
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 214
Returning 1 Connections
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 216
Allocating 2 Connections
Returning 3 Connections
cp.curActConns = 211
Allocating 3 Connections
Returning 2 Connections
cp.curActConns = 214
Allocating 3 Connections
cp.curActConns = 215
Returning 0 Connections
Allocating 2 Connections
Returning 2 Connections
cp.curActConns = 216
Allocating 1 Connections
cp.curActConns = 216
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 217
Returning 0 Connections
Allocating 4 Connections
Returning 4 Connections
cp.curActConns = 220
Allocating 0 Connections
Returning 0 Connections
cp.curActConns = 217
Allocating 1 Connections
cp.curActConns = 218
Returning 2 Connections
Allocating 0 Connections
Returning 4 Connections
cp.curActConns = 212
Allocating 1 Connections
cp.curActConns = 213
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 214
Returning 3 Connections
Allocating 4 Connections
Returning 2 Connections
cp.curActConns = 213
Allocating 3 Connections
Returning 0 Connections
cp.curActConns = 216
Allocating 2 Connections
cp.curActConns = 218
Returning 4 Connections
Allocating 2 Connections
Returning 4 Connections
cp.curActConns = 212
Allocating 1 Connections
cp.curActConns = 213
Returning 1 Connections
Allocating 2 Connections
Returning 2 Connections
cp.curActConns = 214
Allocating 3 Connections
Returning 0 Connections
cp.curActConns = 215
Allocating 1 Connections
Returning 4 Connections
cp.curActConns = 212
Allocating 0 Connections
Returning 0 Connections
cp.curActConns = 212
Allocating 3 Connections
cp.curActConns = 215
Returning 4 Connections
Allocating 4 Connections
Returning 2 Connections
cp.curActConns = 213
Allocating 2 Connections
Returning 2 Connections
cp.curActConns = 213
Allocating 0 Connections
Returning 4 Connections
cp.curActConns = 209
Allocating 3 Connections
Returning 3 Connections
cp.curActConns = 212
Allocating 2 Connections
Returning 4 Connections
cp.curActConns = 207
Allocating 4 Connections
cp.curActConns = 211
Returning 4 Connections
Allocating 0 Connections
Returning 2 Connections
cp.curActConns = 205
Allocating 4 Connections
Returning 2 Connections
cp.curActConns = 207
Allocating 0 Connections
cp.curActConns = 207
Returning 0 Connections
Allocating 4 Connections
Returning 3 Connections
cp.curActConns = 208
Allocating 3 Connections
cp.curActConns = 211
Returning 4 Connections
Allocating 4 Connections
Returning 3 Connections
cp.curActConns = 208
Allocating 2 Connections
cp.curActConns = 210
Returning 1 Connections
Allocating 2 Connections
Returning 4 Connections
cp.curActConns = 210
Allocating 0 Connections
cp.curActConns = 207
Returning 1 Connections
Allocating 0 Connections
Returning 3 Connections
cp.curActConns = 203
Allocating 0 Connections
cp.curActConns = 203
Returning 4 Connections
Allocating 5 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 202
Returning 1 Connections
Allocating 1 Connections
Returning 0 Connections
cp.curActConns = 202
Allocating 3 Connections
cp.curActConns = 205
Returning 4 Connections
Allocating 0 Connections
Returning 2 Connections
cp.curActConns = 199
Allocating 2 Connections
cp.curActConns = 201
Returning 3 Connections
Allocating 8 Connections
Returning 4 Connections
cp.curActConns = 202
Allocating 4 Connections
cp.curActConns = 206
Returning 2 Connections
Allocating 4 Connections
Returning 4 Connections
cp.curActConns = 208
Retuning from startAllocatorRoutine
Retuning from startDeallocatorRoutine
2023-09-12T19:22:48.123+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:22:48.123+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:22:49.081+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.07s)
=== RUN TestLowWM
2023-09-12T19:22:52.125+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2023-09-12T19:22:52.125+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T19:23:52.143+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-09-12T19:24:52.160+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-09-12T19:24:57.644+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:24:57.644+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:24:58.162+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.52s)
=== RUN TestTotalConns
2023-09-12T19:25:01.646+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2023-09-12T19:25:01.646+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T19:25:15.893+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:25:15.893+05:30 [Info] Closing active connection from 127.0.0.1:54826 to 127.0.0.1:15151
2023-09-12T19:25:15.893+05:30 [Info] Closing active connection from 127.0.0.1:54988 to 127.0.0.1:15151
2023-09-12T19:25:15.893+05:30 [Info] Closing active connection from 127.0.0.1:54980 to 127.0.0.1:15151
2023-09-12T19:25:15.893+05:30 [Info] Closing active connection from 127.0.0.1:54810 to 127.0.0.1:15151
2023-09-12T19:25:15.893+05:30 [Info] Closing active connection from 127.0.0.1:54886 to 127.0.0.1:15151
2023-09-12T19:25:15.893+05:30 [Info] Closing active connection from 127.0.0.1:54928 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54952 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54854 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54868 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54876 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54920 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54986 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54848 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54896 to 127.0.0.1:15151
2023-09-12T19:25:15.894+05:30 [Info] Closing active connection from 127.0.0.1:54964 to 127.0.0.1:15151
2023-09-12T19:25:15.895+05:30 [Info] Closing active connection from 127.0.0.1:54962 to 127.0.0.1:15151
2023-09-12T19:25:15.895+05:30 [Info] Closing active connection from 127.0.0.1:54888 to 127.0.0.1:15151
2023-09-12T19:25:15.895+05:30 [Info] Closing active connection from 127.0.0.1:54894 to 127.0.0.1:15151
2023-09-12T19:25:15.895+05:30 [Info] Closing active connection from 127.0.0.1:54940 to 127.0.0.1:15151
2023-09-12T19:25:15.895+05:30 [Info] Closing active connection from 127.0.0.1:54958 to 127.0.0.1:15151
2023-09-12T19:25:15.895+05:30 [Info] Closing active connection from 127.0.0.1:54984 to 127.0.0.1:15151
2023-09-12T19:25:15.895+05:30 [Info] Closing active connection from 127.0.0.1:54880 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54918 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54966 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54836 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54856 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54828 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54898 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54916 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54976 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54820 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54830 to 127.0.0.1:15151
2023-09-12T19:25:15.896+05:30 [Info] Closing active connection from 127.0.0.1:54852 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54934 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54948 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54968 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54816 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54840 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54900 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54800 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54858 to 127.0.0.1:15151
2023-09-12T19:25:15.897+05:30 [Info] Closing active connection from 127.0.0.1:54906 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54944 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54796 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54822 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54838 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54902 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54812 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54814 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54860 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54882 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54884 to 127.0.0.1:15151
2023-09-12T19:25:15.898+05:30 [Info] Closing active connection from 127.0.0.1:54946 to 127.0.0.1:15151
2023-09-12T19:25:15.899+05:30 [Info] Closing active connection from 127.0.0.1:54972 to 127.0.0.1:15151
2023-09-12T19:25:15.899+05:30 [Info] Closing active connection from 127.0.0.1:54798 to 127.0.0.1:15151
2023-09-12T19:25:15.899+05:30 [Info] Closing active connection from 127.0.0.1:54910 to 127.0.0.1:15151
2023-09-12T19:25:15.899+05:30 [Info] Closing active connection from 127.0.0.1:54970 to 127.0.0.1:15151
2023-09-12T19:25:15.899+05:30 [Info] Closing active connection from 127.0.0.1:54872 to 127.0.0.1:15151
2023-09-12T19:25:15.899+05:30 [Info] Closing active connection from 127.0.0.1:54994 to 127.0.0.1:15151
2023-09-12T19:25:15.899+05:30 [Info] Closing active connection from 127.0.0.1:54990 to 127.0.0.1:15151
2023-09-12T19:25:15.899+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:25:16.653+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.25s)
=== RUN TestUpdateTickRate
2023-09-12T19:25:19.901+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2023-09-12T19:25:19.901+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-12T19:25:40.762+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-12T19:25:40.762+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-12T19:25:40.918+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.86s)
PASS
ok github.com/couchbase/indexing/secondary/queryport/client 345.521s
Starting server: attempt 1
Functional tests
2023/09/12 19:28:10 In TestMain()
2023/09/12 19:28:10 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2023/09/12 19:28:10 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2023/09/12 19:28:11 Initialising web UI on node: 127.0.0.1:9000
2023/09/12 19:28:12 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2023/09/12 19:28:13 Setting data quota of 1500M and Index quota of 1500M
2023/09/12 19:28:14 Adding node: https://127.0.0.1:19001 with role: kv,index to the cluster
2023/09/12 19:28:31 AddNode: Successfully added node: 127.0.0.1:9001 (role kv,index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 19:28:36 Rebalance progress: 0
2023/09/12 19:28:41 Rebalance progress: 0
2023/09/12 19:28:46 Rebalance progress: 75
2023/09/12 19:28:51 Rebalance progress: 100
2023/09/12 19:28:56 Created bucket default, responseBody:
2023/09/12 19:29:01 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 19:29:01 Successfully initialised cluster
2023/09/12 19:29:01 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 19:29:01 Changing config key queryport.client.settings.backfillLimit to value 0
2023/09/12 19:29:01 Changing config key queryport.client.log_level to value Warn
2023/09/12 19:29:01 Changing config key indexer.api.enableTestServer to value true
2023/09/12 19:29:02 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2023/09/12 19:29:02 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2023/09/12 19:29:02 Changing config key indexer.settings.log_level to value info
2023/09/12 19:29:02 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2023/09/12 19:29:02 Using memory_optimized for creating indexes
2023/09/12 19:29:02 Changing config key indexer.settings.storage_mode to value memory_optimized
2023/09/12 19:29:07 Data file exists. Skipping download
2023/09/12 19:29:07 Data file exists. Skipping download
2023/09/12 19:29:09 In DropAllSecondaryIndexes()
2023/09/12 19:29:09 Emptying the default bucket
2023/09/12 19:29:12 Flush Enabled on bucket default, responseBody:
2023/09/12 19:29:50 Flushed the bucket default, Response body:
2023/09/12 19:29:50 Create Index On the empty default Bucket()
2023/09/12 19:29:53 Created the secondary index index_eyeColor. Waiting for it become active
2023/09/12 19:29:53 Index is 17280797779108728115 now active
2023/09/12 19:29:53 Populating the default bucket
=== RUN TestScanAfterBucketPopulate
2023/09/12 19:30:02 In TestScanAfterBucketPopulate()
2023/09/12 19:30:02 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/09/12 19:30:02 Using n1ql client
2023-09-12T19:30:02.878+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2023/09/12 19:30:02 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.11s)
=== RUN TestRestartNilSnapshot
2023/09/12 19:30:02 In TestRestartNilSnapshot()
2023/09/12 19:30:07 Created the secondary index idx_age. Waiting for it become active
2023/09/12 19:30:07 Index is 12689385240702375204 now active
2023/09/12 19:30:07 Restarting indexer process ...
2023/09/12 19:30:07 []
2023-09-12T19:30:07.260+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-12T19:30:07.269+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/12 19:33:27 Using n1ql client
2023-09-12T19:33:27.218+05:30 [Error] transport error between 127.0.0.1:46034->127.0.0.1:9107: write tcp 127.0.0.1:46034->127.0.0.1:9107: write: broken pipe
2023-09-12T19:33:27.218+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -548017178939185542 request transport failed `write tcp 127.0.0.1:46034->127.0.0.1:9107: write: broken pipe`
2023-09-12T19:33:27.218+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T19:33:27.218+05:30 [Error] metadataClient:PickRandom: Replicas - [7112034236124178187], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 19:33:27 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.30s)
=== RUN TestThreeIndexCreates
2023/09/12 19:33:27 In TestThreeIndexCreates()
2023/09/12 19:33:31 Created the secondary index index_balance. Waiting for it become active
2023/09/12 19:33:31 Index is 17321145324961086419 now active
2023/09/12 19:33:31 Create docs mutations
2023/09/12 19:33:31 Using n1ql client
2023/09/12 19:33:31 Expected and Actual scan responses are the same
2023/09/12 19:33:38 Created the secondary index index_email. Waiting for it become active
2023/09/12 19:33:38 Index is 14503319325776518362 now active
2023/09/12 19:33:38 Create docs mutations
2023/09/12 19:33:38 Using n1ql client
2023/09/12 19:33:38 Expected and Actual scan responses are the same
2023/09/12 19:33:44 Created the secondary index index_pin. Waiting for it become active
2023/09/12 19:33:44 Index is 9386905361949813147 now active
2023/09/12 19:33:44 Delete docs mutations
2023/09/12 19:33:44 Using n1ql client
2023/09/12 19:33:44 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (17.55s)
=== RUN TestMultipleIndexCreatesDropsWithMutations
2023/09/12 19:33:44 In TestThreeIndexCreates()
2023/09/12 19:33:51 Created the secondary index index_state. Waiting for it become active
2023/09/12 19:33:51 Index is 327155618031125738 now active
2023/09/12 19:33:51 Create docs mutations
2023/09/12 19:33:51 Using n1ql client
2023/09/12 19:33:51 Expected and Actual scan responses are the same
2023/09/12 19:33:57 Created the secondary index index_registered. Waiting for it become active
2023/09/12 19:33:57 Index is 17099882036727064467 now active
2023/09/12 19:33:57 Create docs mutations
2023/09/12 19:33:57 Using n1ql client
2023/09/12 19:33:58 Expected and Actual scan responses are the same
2023/09/12 19:34:04 Created the secondary index index_gender. Waiting for it become active
2023/09/12 19:34:04 Index is 17239817507886922230 now active
2023/09/12 19:34:04 Create docs mutations
2023/09/12 19:34:04 Using n1ql client
2023/09/12 19:34:04 Expected and Actual scan responses are the same
2023/09/12 19:34:04 Dropping the secondary index index_registered
2023/09/12 19:34:04 Index dropped
2023/09/12 19:34:04 Create docs mutations
2023/09/12 19:34:04 Delete docs mutations
2023/09/12 19:34:05 Using n1ql client
2023/09/12 19:34:05 Expected and Actual scan responses are the same
2023/09/12 19:34:11 Created the secondary index index_longitude. Waiting for it become active
2023/09/12 19:34:11 Index is 13124702728715846422 now active
2023/09/12 19:34:11 Create docs mutations
2023/09/12 19:34:11 Using n1ql client
2023/09/12 19:34:11 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (26.91s)
=== RUN TestCreateDropScan
2023/09/12 19:34:11 In TestCreateDropScan()
2023/09/12 19:34:17 Created the secondary index index_cd. Waiting for it become active
2023/09/12 19:34:17 Index is 9486098465870560543 now active
2023/09/12 19:34:18 Using n1ql client
2023/09/12 19:34:18 Expected and Actual scan responses are the same
2023/09/12 19:34:18 Dropping the secondary index index_cd
2023/09/12 19:34:18 Index dropped
2023/09/12 19:34:18 Using n1ql client
2023/09/12 19:34:18 Scan failed as expected with error: Index Not Found - cause: GSI index index_cd not found.
--- PASS: TestCreateDropScan (6.42s)
=== RUN TestCreateDropCreate
2023/09/12 19:34:18 In TestCreateDropCreate()
2023/09/12 19:34:24 Created the secondary index index_cdc. Waiting for it become active
2023/09/12 19:34:24 Index is 9770925080129589747 now active
2023/09/12 19:34:24 Using n1ql client
2023/09/12 19:34:24 Expected and Actual scan responses are the same
2023/09/12 19:34:24 Dropping the secondary index index_cdc
2023/09/12 19:34:24 Index dropped
2023/09/12 19:34:24 Using n1ql client
2023/09/12 19:34:24 Scan 2 failed as expected with error: Index Not Found - cause: GSI index index_cdc not found.
2023/09/12 19:34:30 Created the secondary index index_cdc. Waiting for it become active
2023/09/12 19:34:30 Index is 9250767797334021201 now active
2023/09/12 19:34:30 Using n1ql client
2023/09/12 19:34:30 Expected and Actual scan responses are the same
2023/09/12 19:34:30 (Inclusion 1) Lengths of expected and actual scan results are 5072 and 5072. Num of docs in bucket = 10402
2023/09/12 19:34:30 Using n1ql client
2023/09/12 19:34:30 Expected and Actual scan responses are the same
2023/09/12 19:34:30 (Inclusion 3) Lengths of expected and actual scan results are 5072 and 5072. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (12.80s)
=== RUN TestCreate2Drop1Scan2
2023/09/12 19:34:30 In TestCreate2Drop1Scan2()
2023/09/12 19:34:37 Created the secondary index index_i1. Waiting for it become active
2023/09/12 19:34:37 Index is 17211558807246735507 now active
2023/09/12 19:34:43 Created the secondary index index_i2. Waiting for it become active
2023/09/12 19:34:43 Index is 16437270288776663417 now active
2023/09/12 19:34:43 Using n1ql client
2023/09/12 19:34:43 Expected and Actual scan responses are the same
2023/09/12 19:34:43 Using n1ql client
2023/09/12 19:34:43 Expected and Actual scan responses are the same
2023/09/12 19:34:43 Dropping the secondary index index_i1
2023/09/12 19:34:43 Index dropped
2023/09/12 19:34:43 Using n1ql client
2023/09/12 19:34:43 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (12.78s)
=== RUN TestIndexNameCaseSensitivity
2023/09/12 19:34:43 In TestIndexNameCaseSensitivity()
2023/09/12 19:34:49 Created the secondary index index_age. Waiting for it become active
2023/09/12 19:34:49 Index is 176083264390164701 now active
2023/09/12 19:34:49 Using n1ql client
2023/09/12 19:34:50 Expected and Actual scan responses are the same
2023/09/12 19:34:50 Using n1ql client
2023/09/12 19:34:50 Scan failed as expected with error: Index Not Found - cause: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (6.27s)
=== RUN TestCreateDuplicateIndex
2023/09/12 19:34:50 In TestCreateDuplicateIndex()
2023/09/12 19:34:56 Created the secondary index index_di1. Waiting for it become active
2023/09/12 19:34:56 Index is 3111841270272760259 now active
2023/09/12 19:34:56 Index found: index_di1
2023/09/12 19:34:56 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (6.26s)
=== RUN TestDropNonExistingIndex
2023/09/12 19:34:56 In TestDropNonExistingIndex()
2023/09/12 19:34:56 Dropping the secondary index 123456
2023/09/12 19:34:56 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.03s)
=== RUN TestCreateIndexNonExistentBucket
2023/09/12 19:34:56 In TestCreateIndexNonExistentBucket()
2023-09-12T19:34:56.800+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-09-12T19:35:07.803+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023/09/12 19:35:07 Index create failed as expected with error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- PASS: TestCreateIndexNonExistentBucket (11.51s)
=== RUN TestScanWithNoTimeout
2023/09/12 19:35:07 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/09/12 19:35:07 Changing config key indexer.settings.scan_timeout to value 0
2023/09/12 19:35:08 Using n1ql client
2023/09/12 19:35:08 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.46s)
=== RUN TestIndexingOnBinaryBucketMeta
2023/09/12 19:35:08 In TestIndexingOnBinaryBucketMeta()
2023/09/12 19:35:08 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2023/09/12 19:35:08 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2023/09/12 19:35:11 Modified parameters of bucket default, responseBody:
2023/09/12 19:35:11 Created bucket binaryBucket, responseBody:
2023/09/12 19:35:29 Created the secondary index index_binary_meta_id. Waiting for it become active
2023/09/12 19:35:29 Index is 2456272271244673278 now active
2023/09/12 19:35:34 items_count stat is 10 for index index_binary_meta_id
2023/09/12 19:35:34 Dropping the secondary index index_binary_meta_id
2023/09/12 19:35:34 Index dropped
2023/09/12 19:35:37 Created the secondary index index_binary_meta_cas. Waiting for it become active
2023/09/12 19:35:37 Index is 11864558060194779823 now active
2023/09/12 19:35:42 items_count stat is 10 for index index_binary_meta_cas
2023/09/12 19:35:42 Dropping the secondary index index_binary_meta_cas
2023/09/12 19:35:42 Index dropped
2023/09/12 19:35:45 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2023/09/12 19:35:45 Index is 9357231718868228333 now active
2023/09/12 19:35:50 items_count stat is 10 for index index_binary_meta_expiration
2023/09/12 19:35:50 Dropping the secondary index index_binary_meta_expiration
2023/09/12 19:35:51 Index dropped
2023/09/12 19:35:53 Deleted bucket binaryBucket, responseBody:
2023/09/12 19:35:56 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnBinaryBucketMeta (63.03s)
=== RUN TestRetainDeleteXATTRBinaryDocs
2023/09/12 19:36:11 In TestRetainDeleteXATTRBinaryDocs()
2023/09/12 19:36:11 1. Populate a bucket with binary docs having system XATTRS
2023/09/12 19:36:11 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2023/09/12 19:36:11 3. Delete the documents in the bucket
2023/09/12 19:36:11 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2023/09/12 19:36:14 Modified parameters of bucket default, responseBody:
2023/09/12 19:36:14 Created bucket binaryBucket, responseBody:
2023/09/12 19:36:32 Created the secondary index index_system_xattr. Waiting for it become active
2023/09/12 19:36:32 Index is 12487576733830065446 now active
2023/09/12 19:36:37 Deleted all the documents in the bucket: binaryBucket successfully
2023/09/12 19:36:40 Deleted bucket binaryBucket, responseBody:
2023/09/12 19:36:43 Modified parameters of bucket default, responseBody:
--- PASS: TestRetainDeleteXATTRBinaryDocs (47.60s)
=== RUN TestIndexingOnXATTRs
2023/09/12 19:36:58 In TestIndexingOnXATTRs()
2023/09/12 19:37:01 Modified parameters of bucket default, responseBody:
2023/09/12 19:37:02 Created bucket bucket_xattrs, responseBody:
2023/09/12 19:37:21 Created the secondary index index_sync_rev. Waiting for it become active
2023/09/12 19:37:21 Index is 8258024375579974565 now active
2023/09/12 19:37:28 Created the secondary index index_sync_channels. Waiting for it become active
2023/09/12 19:37:28 Index is 1486534283749206983 now active
2023/09/12 19:37:34 Created the secondary index index_sync_test. Waiting for it become active
2023/09/12 19:37:34 Index is 14352724569072920261 now active
2023/09/12 19:37:39 items_count stat is 100 for index index_sync_rev
2023/09/12 19:37:39 items_count stat is 100 for index index_sync_channels
2023/09/12 19:37:39 items_count stat is 100 for index index_sync_test
2023/09/12 19:37:39 Using n1ql client
2023-09-12T19:37:39.267+05:30 [Info] GSIC[default/bucket_xattrs-_default-_default-1694527659262932173] started ...
2023/09/12 19:37:39 Dropping the secondary index index_sync_rev
2023/09/12 19:37:39 Index dropped
2023/09/12 19:37:39 Using n1ql client
2023/09/12 19:37:39 Dropping the secondary index index_sync_channels
2023/09/12 19:37:39 Index dropped
2023/09/12 19:37:39 Using n1ql client
2023/09/12 19:37:39 Dropping the secondary index index_sync_test
2023/09/12 19:37:39 Index dropped
2023/09/12 19:37:40 Deleted bucket bucket_xattrs, responseBody:
2023/09/12 19:37:43 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnXATTRs (60.10s)
=== RUN TestSimpleIndex_FloatDataType
2023/09/12 19:37:58 In TestSimpleIndex_FloatDataType()
2023/09/12 19:37:58 Index found: index_age
2023/09/12 19:37:59 Using n1ql client
2023/09/12 19:37:59 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.02s)
=== RUN TestSimpleIndex_StringDataType
2023/09/12 19:37:59 In TestSimpleIndex_StringDataType()
2023/09/12 19:38:03 Created the secondary index index_company. Waiting for it become active
2023/09/12 19:38:03 Index is 14703745085694018365 now active
2023/09/12 19:38:03 Using n1ql client
2023/09/12 19:38:03 Expected and Actual scan responses are the same
2023/09/12 19:38:03 Using n1ql client
2023/09/12 19:38:03 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.70s)
=== RUN TestSimpleIndex_FieldValueCaseSensitivity
2023/09/12 19:38:03 In TestSimpleIndex_StringCaseSensitivity()
2023/09/12 19:38:03 Index found: index_company
2023/09/12 19:38:03 Using n1ql client
2023/09/12 19:38:03 Expected and Actual scan responses are the same
2023/09/12 19:38:03 Using n1ql client
2023/09/12 19:38:03 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.07s)
=== RUN TestSimpleIndex_BoolDataType
2023/09/12 19:38:03 In TestSimpleIndex_BoolDataType()
2023/09/12 19:38:10 Created the secondary index index_isActive. Waiting for it become active
2023/09/12 19:38:10 Index is 7163325738487065270 now active
2023/09/12 19:38:10 Using n1ql client
2023/09/12 19:38:10 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (6.66s)
=== RUN TestBasicLookup
2023/09/12 19:38:10 In TestBasicLookup()
2023/09/12 19:38:10 Index found: index_company
2023/09/12 19:38:10 Using n1ql client
2023/09/12 19:38:10 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.01s)
=== RUN TestIndexOnNonExistentField
2023/09/12 19:38:10 In TestIndexOnNonExistentField()
2023/09/12 19:38:17 Created the secondary index index_height. Waiting for it become active
2023/09/12 19:38:17 Index is 15738895327322999731 now active
2023/09/12 19:38:17 Using n1ql client
2023/09/12 19:38:17 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (6.66s)
=== RUN TestIndexPartiallyMissingField
2023/09/12 19:38:17 In TestIndexPartiallyMissingField()
2023/09/12 19:38:23 Created the secondary index index_nationality. Waiting for it become active
2023/09/12 19:38:23 Index is 14690421150473740551 now active
2023/09/12 19:38:23 Using n1ql client
2023/09/12 19:38:23 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (6.53s)
=== RUN TestScanNonMatchingDatatype
2023/09/12 19:38:23 In TestScanNonMatchingDatatype()
2023/09/12 19:38:23 Index found: index_age
2023/09/12 19:38:23 Using n1ql client
2023/09/12 19:38:23 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.01s)
=== RUN TestInclusionNeither
2023/09/12 19:38:23 In TestInclusionNeither()
2023/09/12 19:38:23 Index found: index_age
2023/09/12 19:38:23 Using n1ql client
2023/09/12 19:38:23 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.02s)
=== RUN TestInclusionLow
2023/09/12 19:38:23 In TestInclusionLow()
2023/09/12 19:38:23 Index found: index_age
2023/09/12 19:38:23 Using n1ql client
2023/09/12 19:38:23 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.03s)
=== RUN TestInclusionHigh
2023/09/12 19:38:23 In TestInclusionHigh()
2023/09/12 19:38:23 Index found: index_age
2023/09/12 19:38:23 Using n1ql client
2023/09/12 19:38:23 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.02s)
=== RUN TestInclusionBoth
2023/09/12 19:38:23 In TestInclusionBoth()
2023/09/12 19:38:23 Index found: index_age
2023/09/12 19:38:23 Using n1ql client
2023/09/12 19:38:23 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.02s)
=== RUN TestNestedIndex_String
2023/09/12 19:38:23 In TestNestedIndex_String()
2023/09/12 19:38:30 Created the secondary index index_streetname. Waiting for it become active
2023/09/12 19:38:30 Index is 14489391792343072037 now active
2023/09/12 19:38:30 Using n1ql client
2023/09/12 19:38:30 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (6.45s)
=== RUN TestNestedIndex_Float
2023/09/12 19:38:30 In TestNestedIndex_Float()
2023/09/12 19:38:36 Created the secondary index index_floor. Waiting for it become active
2023/09/12 19:38:36 Index is 15681418100184035042 now active
2023/09/12 19:38:36 Using n1ql client
2023/09/12 19:38:36 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (6.67s)
=== RUN TestNestedIndex_Bool
2023/09/12 19:38:36 In TestNestedIndex_Bool()
2023/09/12 19:38:43 Created the secondary index index_isresidential. Waiting for it become active
2023/09/12 19:38:43 Index is 15433120834530007131 now active
2023/09/12 19:38:43 Using n1ql client
2023/09/12 19:38:43 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (6.64s)
=== RUN TestLookupJsonObject
2023/09/12 19:38:43 In TestLookupJsonObject()
2023/09/12 19:38:50 Created the secondary index index_streetaddress. Waiting for it become active
2023/09/12 19:38:50 Index is 15603783888786357366 now active
2023/09/12 19:38:50 Using n1ql client
2023/09/12 19:38:50 Count of docScanResults is 1
2023/09/12 19:38:50 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/12 19:38:50 Count of scanResults is 1
2023/09/12 19:38:50 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/12 19:38:50 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.71s)
=== RUN TestLookupObjDifferentOrdering
2023/09/12 19:38:50 In TestLookupObjDifferentOrdering()
2023/09/12 19:38:50 Index found: index_streetaddress
2023/09/12 19:38:50 Using n1ql client
2023/09/12 19:38:50 Count of docScanResults is 1
2023/09/12 19:38:50 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/12 19:38:50 Count of scanResults is 1
2023/09/12 19:38:50 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/12 19:38:50 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.01s)
=== RUN TestRangeJsonObject
2023/09/12 19:38:50 In TestRangeJsonObject()
2023/09/12 19:38:50 Index found: index_streetaddress
2023/09/12 19:38:50 Using n1ql client
2023/09/12 19:38:50 Count of scanResults is 2
2023/09/12 19:38:50 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2023/09/12 19:38:50 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/12 19:38:50 Count of docScanResults is 2
2023/09/12 19:38:50 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/12 19:38:50 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2023/09/12 19:38:50 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.00s)
=== RUN TestLookupFloatDiffForms
2023/09/12 19:38:50 In TestLookupFloatDiffForms()
2023/09/12 19:38:56 Created the secondary index index_latitude. Waiting for it become active
2023/09/12 19:38:56 Index is 1632197243190802313 now active
2023/09/12 19:38:56 Scan 1
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 2
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 3
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 4
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 5
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 6
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (6.65s)
=== RUN TestRangeFloatInclVariations
2023/09/12 19:38:56 In TestRangeFloatInclVariations()
2023/09/12 19:38:56 Index found: index_latitude
2023/09/12 19:38:56 Scan 1
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 2
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 3
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 4
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 5
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
2023/09/12 19:38:56 Scan 6
2023/09/12 19:38:56 Using n1ql client
2023/09/12 19:38:56 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.03s)
=== RUN TestScanAll
2023/09/12 19:38:56 In TestScanAll()
2023/09/12 19:39:03 Created the secondary index index_name. Waiting for it become active
2023/09/12 19:39:03 Index is 3578935753602447625 now active
2023/09/12 19:39:03 Length of docScanResults = 10502
2023/09/12 19:39:03 Using n1ql client
2023/09/12 19:39:03 Length of scanResults = 10502
2023/09/12 19:39:03 Expected and Actual scan responses are the same
--- PASS: TestScanAll (6.72s)
=== RUN TestScanAllNestedField
2023/09/12 19:39:03 In TestScanAllNestedField()
2023/09/12 19:39:03 Index found: index_streetname
2023/09/12 19:39:03 Length of docScanResults = 2
2023/09/12 19:39:03 Using n1ql client
2023/09/12 19:39:03 Length of scanResults = 2
2023/09/12 19:39:03 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN TestBasicPrimaryIndex
2023/09/12 19:39:03 In TestBasicPrimaryIndex()
2023/09/12 19:39:10 Created the secondary index index_p1. Waiting for it become active
2023/09/12 19:39:10 Index is 14471126553810434335 now active
2023-09-12T19:39:10.646+05:30 [Error] transport error between 127.0.0.1:45712->127.0.0.1:9107: write tcp 127.0.0.1:45712->127.0.0.1:9107: write: broken pipe
2023-09-12T19:39:10.646+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:45712->127.0.0.1:9107: write: broken pipe`
2023-09-12T19:39:10.646+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T19:39:10.646+05:30 [Error] metadataClient:PickRandom: Replicas - [2068257012092290695], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 19:39:10 Expected and Actual scan responses are the same
2023/09/12 19:39:10 CountRange() expected and actual is: 1904 and 1904
2023/09/12 19:39:10 lookupkey for CountLookup() = Userf27b7bd7-00f9-4590-b445-38075750cefd
2023/09/12 19:39:10 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (7.11s)
=== RUN TestBasicNullDataType
2023/09/12 19:39:10 In TestBasicNullDataType()
2023/09/12 19:39:10 Index found: index_email
2023/09/12 19:39:10 Using n1ql client
2023/09/12 19:39:10 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.01s)
=== RUN TestBasicArrayDataType_ScanAll
2023/09/12 19:39:10 In TestBasicArrayDataType_ScanAll()
2023/09/12 19:39:17 Created the secondary index index_tags. Waiting for it become active
2023/09/12 19:39:17 Index is 4564614100803160164 now active
2023/09/12 19:39:17 Using n1ql client
2023/09/12 19:39:17 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (6.95s)
=== RUN TestBasicArrayDataType_Lookup
2023/09/12 19:39:17 In TestBasicArrayDataType_Lookup()
2023/09/12 19:39:19 Index found: index_tags
2023/09/12 19:39:19 Count of scanResults is 1
2023/09/12 19:39:19 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75 Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN TestArrayDataType_LookupMissingArrayValue
2023/09/12 19:39:19 In TestArrayDataType_LookupMissingArrayValue()
2023/09/12 19:39:19 Index found: index_tags
2023/09/12 19:39:19 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.00s)
=== RUN TestArrayDataType_LookupWrongOrder
2023/09/12 19:39:19 In TestArrayDataType_LookupWrongOrder()
2023/09/12 19:39:19 Index found: index_tags
2023/09/12 19:39:19 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN TestArrayDataType_LookupSubset
2023/09/12 19:39:19 In TestArrayDataType_LookupSubset()
2023/09/12 19:39:19 Index found: index_tags
2023/09/12 19:39:19 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN TestScanLimitParameter
2023/09/12 19:39:19 In TestScanLimitParameter()
2023/09/12 19:39:19 Index found: index_age
2023/09/12 19:39:19 Using n1ql client
2023/09/12 19:39:19 Using n1ql client
--- PASS: TestScanLimitParameter (0.01s)
=== RUN TestCountRange
2023/09/12 19:39:19 In TestRangeCount()
2023/09/12 19:39:19 Index found: index_age
2023/09/12 19:39:19 Count of expected and actual Range is: 2408 and 2408
2023/09/12 19:39:19 Count of expected and actual Range is: 10002 and 10002
2023/09/12 19:39:19 Count of expected and actual Range are: 0 and 0
2023/09/12 19:39:19 Count of expected and actual Range are: 483 and 483
2023/09/12 19:39:19 Testing CountRange() for key <= val
2023/09/12 19:39:19 Count of expected and actual CountRange for key <= 30 are: 5215 and 5215
2023/09/12 19:39:19 Testing CountRange() for key >= val
2023/09/12 19:39:19 Count of expected and actual CountRange for key >= 25 are: 7669 and 7669
2023/09/12 19:39:19 Testing CountRange() for null < key <= val
2023/09/12 19:39:19 Count of expected and actual CountRange for key > null && key <= 30 are: 5215 and 5215
2023/09/12 19:39:19 Testing CountRange() for val <= key < null
2023/09/12 19:39:19 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2023/09/12 19:39:19 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.05s)
=== RUN TestCountLookup
2023/09/12 19:39:19 In TestCountLookup()
2023/09/12 19:39:19 Index found: index_age
2023/09/12 19:39:19 Count of expected and actual Range are: 485 and 485
2023/09/12 19:39:19 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.01s)
=== RUN TestRangeStatistics
2023/09/12 19:39:19 In TestRangeCount()
2023/09/12 19:39:19 Index found: index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN TestIndexCreateWithWhere
2023/09/12 19:39:19 In TestIndexCreateWithWhere()
2023/09/12 19:39:24 Created the secondary index index_ageabove30. Waiting for it become active
2023/09/12 19:39:24 Index is 7535366846927396038 now active
2023/09/12 19:39:24 Using n1ql client
2023/09/12 19:39:24 Expected and Actual scan responses are the same
2023/09/12 19:39:24 Lengths of expected and actual scanReuslts are: 4304 and 4304
2023/09/12 19:39:30 Created the secondary index index_ageteens. Waiting for it become active
2023/09/12 19:39:30 Index is 16989549601814089059 now active
2023/09/12 19:39:30 Using n1ql client
2023/09/12 19:39:30 Expected and Actual scan responses are the same
2023/09/12 19:39:30 Lengths of expected and actual scanReuslts are: 0 and 0
2023/09/12 19:39:37 Created the secondary index index_age35to45. Waiting for it become active
2023/09/12 19:39:37 Index is 18434329972979152787 now active
2023/09/12 19:39:37 Using n1ql client
2023/09/12 19:39:37 Expected and Actual scan responses are the same
2023/09/12 19:39:37 Lengths of expected and actual scanReuslts are: 2891 and 2891
--- PASS: TestIndexCreateWithWhere (17.73s)
=== RUN TestDeferredIndexCreate
2023/09/12 19:39:37 In TestDeferredIndexCreate()
2023/09/12 19:39:37 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2023/09/12 19:39:39 Build the deferred index index_deferred. Waiting for the index to become active
2023/09/12 19:39:39 Waiting for index 1284158203087135147 to go active ...
2023/09/12 19:39:40 Waiting for index 1284158203087135147 to go active ...
2023/09/12 19:39:41 Waiting for index 1284158203087135147 to go active ...
2023/09/12 19:39:42 Waiting for index 1284158203087135147 to go active ...
2023/09/12 19:39:43 Waiting for index 1284158203087135147 to go active ...
2023/09/12 19:39:44 Index is 1284158203087135147 now active
2023/09/12 19:39:44 Using n1ql client
2023/09/12 19:39:44 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (7.13s)
=== RUN TestCompositeIndex_NumAndString
2023/09/12 19:39:44 In TestCompositeIndex()
2023/09/12 19:39:51 Created the secondary index index_composite1. Waiting for it become active
2023/09/12 19:39:51 Index is 464011668926900941 now active
2023/09/12 19:39:51 Using n1ql client
2023/09/12 19:39:52 Using n1ql client
2023/09/12 19:39:52 Using n1ql client
2023/09/12 19:39:52 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (7.58s)
=== RUN TestCompositeIndex_TwoNumberFields
2023/09/12 19:39:52 In TestCompositeIndex()
2023/09/12 19:39:57 Created the secondary index index_composite2. Waiting for it become active
2023/09/12 19:39:57 Index is 14351194260349313847 now active
2023/09/12 19:39:57 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (5.65s)
=== RUN TestNumbers_Int64_Float64
2023/09/12 19:39:57 In TestNumbers_Int64_Float64()
2023/09/12 19:40:04 Created the secondary index idx_numbertest. Waiting for it become active
2023/09/12 19:40:04 Index is 8934844070648857839 now active
2023/09/12 19:40:04
==== Int64 test #0
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Int64 test #1
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Int64 test #2
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Int64 test #3
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Int64 test #4
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Int64 test #5
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Int64 test #6
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Int64 test #7
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Int64 test #8
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Float64 test #0
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Float64 test #1
2023/09/12 19:40:04 Using n1ql client
2023/09/12 19:40:04 Expected and Actual scan responses are the same
2023/09/12 19:40:04
==== Float64 test #2
2023/09/12 19:40:05 Using n1ql client
2023/09/12 19:40:05 Expected and Actual scan responses are the same
2023/09/12 19:40:05
==== Float64 test #3
2023/09/12 19:40:05 Using n1ql client
2023/09/12 19:40:05 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (7.20s)
=== RUN TestRestartIndexer
2023/09/12 19:40:05 In TestRestartIndexer()
2023/09/12 19:40:05 []
2023-09-12T19:40:05.125+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-12T19:40:05.126+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/12 19:40:25 Using n1ql client
2023-09-12T19:40:25.114+05:30 [Error] transport error between 127.0.0.1:46586->127.0.0.1:9107: write tcp 127.0.0.1:46586->127.0.0.1:9107: write: broken pipe
2023-09-12T19:40:25.114+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 3340982173398771818 request transport failed `write tcp 127.0.0.1:46586->127.0.0.1:9107: write: broken pipe`
2023/09/12 19:40:25 Len of expected and actual scan results are : 10002 and 10002
2023/09/12 19:40:25 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.10s)
=== RUN TestCreateDocsMutation
2023/09/12 19:40:25 In TestCreateDocsMutation()
2023/09/12 19:40:25 Index found: index_age
2023/09/12 19:40:25 Using n1ql client
2023/09/12 19:40:25 Len of expected and actual scan results are : 10002 and 10002
2023/09/12 19:40:25 Expected and Actual scan responses are the same
2023/09/12 19:40:25 Using n1ql client
2023/09/12 19:40:25 Index Scan after mutations took 37.511713ms
2023/09/12 19:40:25 Len of expected and actual scan results are : 10102 and 10102
2023/09/12 19:40:25 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.31s)
=== RUN TestRestartProjector
2023/09/12 19:40:25 In TestRestartProjector()
2023/09/12 19:40:25 []
2023/09/12 19:40:45 Using n1ql client
2023/09/12 19:40:45 Len of expected and actual scan results are : 10102 and 10102
2023/09/12 19:40:45 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.08s)
=== RUN TestDeleteDocsMutation
2023/09/12 19:40:45 In TestDeleteDocsMutation()
2023/09/12 19:40:45 Index found: index_age
2023/09/12 19:40:45 Using n1ql client
2023/09/12 19:40:45 Len of expected and actual scan results are : 10102 and 10102
2023/09/12 19:40:45 Expected and Actual scan responses are the same
2023/09/12 19:40:45 Using n1ql client
2023/09/12 19:40:45 Index Scan after mutations took 36.299827ms
2023/09/12 19:40:45 Len of expected and actual scan results are : 9902 and 9902
2023/09/12 19:40:45 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (0.35s)
=== RUN TestUpdateDocsMutation
2023/09/12 19:40:45 In TestUpdateDocsMutation()
2023/09/12 19:40:45 Index found: index_age
2023/09/12 19:40:45 Using n1ql client
2023/09/12 19:40:45 Len of expected and actual scan results are : 9452 and 9452
2023/09/12 19:40:45 Expected and Actual scan responses are the same
2023/09/12 19:40:45 Num of keysFromMutDocs: 100
2023/09/12 19:40:45 Updating number of documents: 100
2023/09/12 19:40:46 Using n1ql client
2023/09/12 19:40:46 Index Scan after mutations took 105.745118ms
2023/09/12 19:40:46 Len of expected and actual scan results are : 9454 and 9454
2023/09/12 19:40:46 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.44s)
=== RUN TestLargeMutations
2023/09/12 19:40:46 In TestLargeMutations()
2023/09/12 19:40:46 In DropAllSecondaryIndexes()
2023/09/12 19:40:46 Index found: index_longitude
2023/09/12 19:40:46 Dropped index index_longitude
2023/09/12 19:40:46 Index found: index_pin
2023/09/12 19:40:46 Dropped index index_pin
2023/09/12 19:40:46 Index found: index_eyeColor
2023/09/12 19:40:46 Dropped index index_eyeColor
2023/09/12 19:40:46 Index found: index_tags
2023/09/12 19:40:46 Dropped index index_tags
2023/09/12 19:40:46 Index found: index_deferred
2023/09/12 19:40:46 Dropped index index_deferred
2023/09/12 19:40:46 Index found: index_gender
2023/09/12 19:40:46 Dropped index index_gender
2023/09/12 19:40:46 Index found: index_latitude
2023/09/12 19:40:46 Dropped index index_latitude
2023/09/12 19:40:46 Index found: index_composite2
2023/09/12 19:40:47 Dropped index index_composite2
2023/09/12 19:40:47 Index found: index_email
2023/09/12 19:40:47 Dropped index index_email
2023/09/12 19:40:47 Index found: index_height
2023/09/12 19:40:47 Dropped index index_height
2023/09/12 19:40:47 Index found: index_name
2023/09/12 19:40:47 Dropped index index_name
2023/09/12 19:40:47 Index found: index_ageteens
2023/09/12 19:40:47 Dropped index index_ageteens
2023/09/12 19:40:47 Index found: index_isresidential
2023/09/12 19:40:47 Dropped index index_isresidential
2023/09/12 19:40:47 Index found: index_isActive
2023/09/12 19:40:47 Dropped index index_isActive
2023/09/12 19:40:47 Index found: index_nationality
2023/09/12 19:40:47 Dropped index index_nationality
2023/09/12 19:40:47 Index found: index_p1
2023/09/12 19:40:47 Dropped index index_p1
2023/09/12 19:40:47 Index found: index_i2
2023/09/12 19:40:47 Dropped index index_i2
2023/09/12 19:40:47 Index found: index_company
2023/09/12 19:40:47 Dropped index index_company
2023/09/12 19:40:47 Index found: index_composite1
2023/09/12 19:40:47 Dropped index index_composite1
2023/09/12 19:40:47 Index found: index_streetaddress
2023/09/12 19:40:47 Dropped index index_streetaddress
2023/09/12 19:40:47 Index found: index_di1
2023/09/12 19:40:47 Dropped index index_di1
2023/09/12 19:40:47 Index found: idx_numbertest
2023/09/12 19:40:48 Dropped index idx_numbertest
2023/09/12 19:40:48 Index found: index_age35to45
2023/09/12 19:40:48 Dropped index index_age35to45
2023/09/12 19:40:48 Index found: index_streetname
2023/09/12 19:40:48 Dropped index index_streetname
2023/09/12 19:40:48 Index found: index_state
2023/09/12 19:40:48 Dropped index index_state
2023/09/12 19:40:48 Index found: index_cdc
2023/09/12 19:40:48 Dropped index index_cdc
2023/09/12 19:40:48 Index found: idx_age
2023/09/12 19:40:48 Dropped index idx_age
2023/09/12 19:40:48 Index found: index_balance
2023/09/12 19:40:48 Dropped index index_balance
2023/09/12 19:40:48 Index found: index_ageabove30
2023/09/12 19:40:48 Dropped index index_ageabove30
2023/09/12 19:40:48 Index found: index_floor
2023/09/12 19:40:48 Dropped index index_floor
2023/09/12 19:40:48 Index found: index_age
2023/09/12 19:40:48 Dropped index index_age
2023/09/12 19:41:07 Created the secondary index indexmut_1. Waiting for it become active
2023/09/12 19:41:07 Index is 1524412914354030255 now active
2023/09/12 19:41:07 Using n1ql client
2023/09/12 19:41:07 Expected and Actual scan responses are the same
2023/09/12 19:41:07 Len of expected and actual scan results are : 29902 and 29902
2023/09/12 19:41:07 ITERATION 0
2023/09/12 19:41:24 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:41:24 Index is 5881357208094159650 now active
2023/09/12 19:41:24 Using n1ql client
2023/09/12 19:41:24 Expected and Actual scan responses are the same
2023/09/12 19:41:24 Len of expected and actual scan results are : 39902 and 39902
2023/09/12 19:41:24 Using n1ql client
2023/09/12 19:41:25 Expected and Actual scan responses are the same
2023/09/12 19:41:25 Len of expected and actual scan results are : 39902 and 39902
2023/09/12 19:41:25 Dropping the secondary index indexmut_2
2023/09/12 19:41:25 Index dropped
2023/09/12 19:41:25 ITERATION 1
2023/09/12 19:41:41 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:41:41 Index is 14454515272217236073 now active
2023/09/12 19:41:41 Using n1ql client
2023/09/12 19:41:41 Expected and Actual scan responses are the same
2023/09/12 19:41:41 Len of expected and actual scan results are : 49902 and 49902
2023/09/12 19:41:41 Using n1ql client
2023/09/12 19:41:42 Expected and Actual scan responses are the same
2023/09/12 19:41:42 Len of expected and actual scan results are : 49902 and 49902
2023/09/12 19:41:42 Dropping the secondary index indexmut_2
2023/09/12 19:41:42 Index dropped
2023/09/12 19:41:42 ITERATION 2
2023/09/12 19:41:58 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:41:58 Index is 13136120759067186377 now active
2023/09/12 19:41:58 Using n1ql client
2023/09/12 19:41:59 Expected and Actual scan responses are the same
2023/09/12 19:41:59 Len of expected and actual scan results are : 59902 and 59902
2023/09/12 19:41:59 Using n1ql client
2023/09/12 19:41:59 Expected and Actual scan responses are the same
2023/09/12 19:41:59 Len of expected and actual scan results are : 59902 and 59902
2023/09/12 19:41:59 Dropping the secondary index indexmut_2
2023/09/12 19:41:59 Index dropped
2023/09/12 19:41:59 ITERATION 3
2023/09/12 19:42:17 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:42:17 Index is 2048577948337190889 now active
2023/09/12 19:42:17 Using n1ql client
2023/09/12 19:42:17 Expected and Actual scan responses are the same
2023/09/12 19:42:17 Len of expected and actual scan results are : 69902 and 69902
2023/09/12 19:42:17 Using n1ql client
2023/09/12 19:42:18 Expected and Actual scan responses are the same
2023/09/12 19:42:18 Len of expected and actual scan results are : 69902 and 69902
2023/09/12 19:42:18 Dropping the secondary index indexmut_2
2023/09/12 19:42:18 Index dropped
2023/09/12 19:42:18 ITERATION 4
2023/09/12 19:42:37 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:42:37 Index is 785361046221460672 now active
2023/09/12 19:42:37 Using n1ql client
2023/09/12 19:42:38 Expected and Actual scan responses are the same
2023/09/12 19:42:38 Len of expected and actual scan results are : 79902 and 79902
2023/09/12 19:42:38 Using n1ql client
2023/09/12 19:42:39 Expected and Actual scan responses are the same
2023/09/12 19:42:39 Len of expected and actual scan results are : 79902 and 79902
2023/09/12 19:42:39 Dropping the secondary index indexmut_2
2023/09/12 19:42:39 Index dropped
2023/09/12 19:42:39 ITERATION 5
2023/09/12 19:42:59 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:42:59 Index is 11553479052833716489 now active
2023/09/12 19:42:59 Using n1ql client
2023/09/12 19:42:59 Expected and Actual scan responses are the same
2023/09/12 19:42:59 Len of expected and actual scan results are : 89902 and 89902
2023/09/12 19:43:00 Using n1ql client
2023/09/12 19:43:00 Expected and Actual scan responses are the same
2023/09/12 19:43:00 Len of expected and actual scan results are : 89902 and 89902
2023/09/12 19:43:00 Dropping the secondary index indexmut_2
2023/09/12 19:43:00 Index dropped
2023/09/12 19:43:00 ITERATION 6
2023/09/12 19:43:19 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:43:19 Index is 8801635052273218876 now active
2023/09/12 19:43:19 Using n1ql client
2023/09/12 19:43:20 Expected and Actual scan responses are the same
2023/09/12 19:43:20 Len of expected and actual scan results are : 99902 and 99902
2023/09/12 19:43:20 Using n1ql client
2023/09/12 19:43:20 Expected and Actual scan responses are the same
2023/09/12 19:43:20 Len of expected and actual scan results are : 99902 and 99902
2023/09/12 19:43:20 Dropping the secondary index indexmut_2
2023/09/12 19:43:20 Index dropped
2023/09/12 19:43:20 ITERATION 7
2023/09/12 19:43:39 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:43:39 Index is 13948821721401991990 now active
2023/09/12 19:43:40 Using n1ql client
2023/09/12 19:43:40 Expected and Actual scan responses are the same
2023/09/12 19:43:40 Len of expected and actual scan results are : 109902 and 109902
2023/09/12 19:43:41 Using n1ql client
2023/09/12 19:43:41 Expected and Actual scan responses are the same
2023/09/12 19:43:41 Len of expected and actual scan results are : 109902 and 109902
2023/09/12 19:43:41 Dropping the secondary index indexmut_2
2023/09/12 19:43:41 Index dropped
2023/09/12 19:43:41 ITERATION 8
2023/09/12 19:44:02 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:44:02 Index is 8319316750164421575 now active
2023/09/12 19:44:02 Using n1ql client
2023/09/12 19:44:03 Expected and Actual scan responses are the same
2023/09/12 19:44:03 Len of expected and actual scan results are : 119902 and 119902
2023/09/12 19:44:03 Using n1ql client
2023/09/12 19:44:05 Expected and Actual scan responses are the same
2023/09/12 19:44:05 Len of expected and actual scan results are : 119902 and 119902
2023/09/12 19:44:05 Dropping the secondary index indexmut_2
2023/09/12 19:44:05 Index dropped
2023/09/12 19:44:05 ITERATION 9
2023/09/12 19:44:26 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:44:26 Index is 16635266632293098481 now active
2023/09/12 19:44:27 Using n1ql client
2023/09/12 19:44:28 Expected and Actual scan responses are the same
2023/09/12 19:44:28 Len of expected and actual scan results are : 129902 and 129902
2023/09/12 19:44:28 Using n1ql client
2023/09/12 19:44:29 Expected and Actual scan responses are the same
2023/09/12 19:44:29 Len of expected and actual scan results are : 129902 and 129902
2023/09/12 19:44:29 Dropping the secondary index indexmut_2
2023/09/12 19:44:29 Index dropped
2023/09/12 19:44:29 ITERATION 10
2023/09/12 19:44:49 Created the secondary index indexmut_2. Waiting for it become active
2023/09/12 19:44:49 Index is 689373541820979400 now active
2023/09/12 19:44:49 Using n1ql client
2023/09/12 19:44:50 Expected and Actual scan responses are the same
2023/09/12 19:44:50 Len of expected and actual scan results are : 139902 and 139902
2023/09/12 19:44:50 Using n1ql client
2023/09/12 19:44:51 Expected and Actual scan responses are the same
2023/09/12 19:44:51 Len of expected and actual scan results are : 139902 and 139902
2023/09/12 19:44:51 Dropping the secondary index indexmut_2
2023/09/12 19:44:51 Index dropped
--- PASS: TestLargeMutations (245.38s)
=== RUN TestPlanner
2023/09/12 19:44:51 In TestPlanner()
2023/09/12 19:44:51 -------------------------------------------
2023/09/12 19:44:51 initial placement - 20-50M, 10 index, 3 replica, 2x
2023-09-12T19:44:51.737+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:51.745+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:44:51.745+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:44:51.748+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:44:51.748+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:44:51.748+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-12T19:44:51.752+05:30 [Info] switched currmeta from 484 -> 486 force true
2023-09-12T19:44:51.759+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:44:51.759+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:44:51.760+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-12T19:44:51.763+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:44:51.763+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:44:51.768+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-12T19:44:51.811+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:51.811+05:30 [Info] Score: 0.03197283688148588
2023-09-12T19:44:51.811+05:30 [Info] Memory Quota: 66499692968 (61.9327G)
2023-09-12T19:44:51.811+05:30 [Info] CPU Quota: 12
2023-09-12T19:44:51.811+05:30 [Info] Indexer Memory Mean 39455494435 (36.7458G)
2023-09-12T19:44:51.811+05:30 [Info] Indexer Memory Deviation 2523008175 (2.34973G) (6.39%)
2023-09-12T19:44:51.811+05:30 [Info] Indexer Memory Utilization 0.5933
2023-09-12T19:44:51.811+05:30 [Info] Indexer CPU Mean 11.2790
2023-09-12T19:44:51.811+05:30 [Info] Indexer CPU Deviation 2.80 (24.80%)
2023-09-12T19:44:51.811+05:30 [Info] Indexer CPU Utilization 0.9399
2023-09-12T19:44:51.811+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:51.811+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:51.811+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:51.811+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:51.811+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:51.811+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:51.811+05:30 [Info] Indexer Data Size Mean 39455494435 (36.7458G)
2023-09-12T19:44:51.811+05:30 [Info] Indexer Data Size Deviation 2523008175 (2.34973G) (6.39%)
2023-09-12T19:44:51.811+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:51.811+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:51.811+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:51.811+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:51 -------------------------------------------
2023/09/12 19:44:51 initial placement - 20-50M, 30 index, 3 replica, 2x
2023-09-12T19:44:51.812+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:52.814+05:30 [Info] Score: 0.02964433371889561
2023-09-12T19:44:52.814+05:30 [Info] Memory Quota: 62213610762 (57.9409G)
2023-09-12T19:44:52.814+05:30 [Info] CPU Quota: 12
2023-09-12T19:44:52.814+05:30 [Info] Indexer Memory Mean 39139975750 (36.4519G)
2023-09-12T19:44:52.814+05:30 [Info] Indexer Memory Deviation 2320557005 (2.16119G) (5.93%)
2023-09-12T19:44:52.814+05:30 [Info] Indexer Memory Utilization 0.6291
2023-09-12T19:44:52.814+05:30 [Info] Indexer CPU Mean 10.6436
2023-09-12T19:44:52.814+05:30 [Info] Indexer CPU Deviation 3.11 (29.24%)
2023-09-12T19:44:52.814+05:30 [Info] Indexer CPU Utilization 0.8870
2023-09-12T19:44:52.814+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:52.814+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:52.814+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:52.814+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:52.814+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:52.814+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:52.814+05:30 [Info] Indexer Data Size Mean 39139975750 (36.4519G)
2023-09-12T19:44:52.814+05:30 [Info] Indexer Data Size Deviation 2320557005 (2.16119G) (5.93%)
2023-09-12T19:44:52.814+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:52.814+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:52.814+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:52.814+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:52 -------------------------------------------
2023/09/12 19:44:52 initial placement - 20-50M, 30 index, 3 replica, 4x
2023-09-12T19:44:52.814+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:53.143+05:30 [Info] Score: 0.02072111648579635
2023-09-12T19:44:53.143+05:30 [Info] Memory Quota: 120092305380 (111.845G)
2023-09-12T19:44:53.143+05:30 [Info] CPU Quota: 24
2023-09-12T19:44:53.143+05:30 [Info] Indexer Memory Mean 76237782845 (71.002G)
2023-09-12T19:44:53.143+05:30 [Info] Indexer Memory Deviation 3159463957 (2.94248G) (4.14%)
2023-09-12T19:44:53.143+05:30 [Info] Indexer Memory Utilization 0.6348
2023-09-12T19:44:53.143+05:30 [Info] Indexer CPU Mean 19.8674
2023-09-12T19:44:53.143+05:30 [Info] Indexer CPU Deviation 4.25 (21.40%)
2023-09-12T19:44:53.143+05:30 [Info] Indexer CPU Utilization 0.8278
2023-09-12T19:44:53.143+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:53.143+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:53.143+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:53.143+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:53.143+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:53.143+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:53.143+05:30 [Info] Indexer Data Size Mean 76237782845 (71.002G)
2023-09-12T19:44:53.143+05:30 [Info] Indexer Data Size Deviation 3159463957 (2.94248G) (4.14%)
2023-09-12T19:44:53.143+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:53.143+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:53.143+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:53.143+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:53 -------------------------------------------
2023/09/12 19:44:53 initial placement - 200-500M, 10 index, 3 replica, 2x
2023-09-12T19:44:53.144+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:53.227+05:30 [Info] Score: 0.011737692366365765
2023-09-12T19:44:53.227+05:30 [Info] Memory Quota: 464062856660 (432.192G)
2023-09-12T19:44:53.227+05:30 [Info] CPU Quota: 12
2023-09-12T19:44:53.227+05:30 [Info] Indexer Memory Mean 364644147772 (339.601G)
2023-09-12T19:44:53.227+05:30 [Info] Indexer Memory Deviation 8560161659 (7.97227G) (2.35%)
2023-09-12T19:44:53.227+05:30 [Info] Indexer Memory Utilization 0.7858
2023-09-12T19:44:53.227+05:30 [Info] Indexer CPU Mean 9.6636
2023-09-12T19:44:53.227+05:30 [Info] Indexer CPU Deviation 2.10 (21.76%)
2023-09-12T19:44:53.227+05:30 [Info] Indexer CPU Utilization 0.8053
2023-09-12T19:44:53.227+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:53.227+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:53.227+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:53.227+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:53.227+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:53.227+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:53.227+05:30 [Info] Indexer Data Size Mean 364644147772 (339.601G)
2023-09-12T19:44:53.227+05:30 [Info] Indexer Data Size Deviation 8560161659 (7.97227G) (2.35%)
2023-09-12T19:44:53.227+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:53.227+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:53.227+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:53.227+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:53 -------------------------------------------
2023/09/12 19:44:53 initial placement - 200-500M, 30 index, 3 replica, 2x
2023-09-12T19:44:53.228+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:54.181+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-12T19:44:54.186+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:44:54.186+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:44:54.187+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:44:54.187+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:44:54.189+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-12T19:44:54.189+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-12T19:44:54.305+05:30 [Info] Score: 0.025312395291045807
2023-09-12T19:44:54.305+05:30 [Info] Memory Quota: 495566978988 (461.533G)
2023-09-12T19:44:54.305+05:30 [Info] CPU Quota: 12
2023-09-12T19:44:54.305+05:30 [Info] Indexer Memory Mean 389376197645 (362.635G)
2023-09-12T19:44:54.305+05:30 [Info] Indexer Memory Deviation 19712088463 (18.3583G) (5.06%)
2023-09-12T19:44:54.305+05:30 [Info] Indexer Memory Utilization 0.7857
2023-09-12T19:44:54.305+05:30 [Info] Indexer CPU Mean 11.5849
2023-09-12T19:44:54.305+05:30 [Info] Indexer CPU Deviation 3.19 (27.56%)
2023-09-12T19:44:54.305+05:30 [Info] Indexer CPU Utilization 0.9654
2023-09-12T19:44:54.305+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:54.306+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:54.306+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:54.306+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:54.306+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:54.306+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:54.306+05:30 [Info] Indexer Data Size Mean 389376197645 (362.635G)
2023-09-12T19:44:54.306+05:30 [Info] Indexer Data Size Deviation 19712088463 (18.3583G) (5.06%)
2023-09-12T19:44:54.306+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:54.306+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:54.306+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:54.306+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:54 -------------------------------------------
2023/09/12 19:44:54 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2023-09-12T19:44:54.306+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:54.628+05:30 [Info] Score: 0.014352631311336274
2023-09-12T19:44:54.628+05:30 [Info] Memory Quota: 297108519261 (276.704G)
2023-09-12T19:44:54.628+05:30 [Info] CPU Quota: 16
2023-09-12T19:44:54.628+05:30 [Info] Indexer Memory Mean 231214824685 (215.336G)
2023-09-12T19:44:54.628+05:30 [Info] Indexer Memory Deviation 6637082264 (6.18126G) (2.87%)
2023-09-12T19:44:54.628+05:30 [Info] Indexer Memory Utilization 0.7782
2023-09-12T19:44:54.628+05:30 [Info] Indexer CPU Mean 10.2675
2023-09-12T19:44:54.628+05:30 [Info] Indexer CPU Deviation 6.60 (64.28%)
2023-09-12T19:44:54.628+05:30 [Info] Indexer CPU Utilization 0.6417
2023-09-12T19:44:54.628+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:54.628+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:54.628+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:54.628+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:54.628+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:54.628+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:54.629+05:30 [Info] Indexer Data Size Mean 231214824685 (215.336G)
2023-09-12T19:44:54.629+05:30 [Info] Indexer Data Size Deviation 6637082264 (6.18126G) (2.87%)
2023-09-12T19:44:54.629+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:54.629+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:54.629+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:54.629+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:54 -------------------------------------------
2023/09/12 19:44:54 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2023-09-12T19:44:54.629+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:55.019+05:30 [Info] Score: 0.007091360143081236
2023-09-12T19:44:55.019+05:30 [Info] Memory Quota: 378397349500 (352.41G)
2023-09-12T19:44:55.019+05:30 [Info] CPU Quota: 24
2023-09-12T19:44:55.019+05:30 [Info] Indexer Memory Mean 311893113528 (290.473G)
2023-09-12T19:44:55.019+05:30 [Info] Indexer Memory Deviation 4423492788 (4.1197G) (1.42%)
2023-09-12T19:44:55.019+05:30 [Info] Indexer Memory Utilization 0.8242
2023-09-12T19:44:55.019+05:30 [Info] Indexer CPU Mean 10.7932
2023-09-12T19:44:55.019+05:30 [Info] Indexer CPU Deviation 4.28 (39.62%)
2023-09-12T19:44:55.019+05:30 [Info] Indexer CPU Utilization 0.4497
2023-09-12T19:44:55.019+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.019+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.019+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.019+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.019+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.019+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.019+05:30 [Info] Indexer Data Size Mean 311893113528 (290.473G)
2023-09-12T19:44:55.019+05:30 [Info] Indexer Data Size Deviation 4423492788 (4.1197G) (1.42%)
2023-09-12T19:44:55.019+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.019+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.019+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.019+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 initial placement - 6 2M index, 1 replica, 2x
2023-09-12T19:44:55.031+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:55.046+05:30 [Info] Score: 0
2023-09-12T19:44:55.046+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2023-09-12T19:44:55.046+05:30 [Info] CPU Quota: 2
2023-09-12T19:44:55.046+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2023-09-12T19:44:55.046+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.046+05:30 [Info] Indexer Memory Utilization 0.4290
2023-09-12T19:44:55.046+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-12T19:44:55.046+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:44:55.046+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-12T19:44:55.046+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.046+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.046+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.046+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.046+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.046+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.046+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2023-09-12T19:44:55.046+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.046+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.046+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.046+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.046+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 initial placement - 5 20M primary index, 2 replica, 2x
2023-09-12T19:44:55.057+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:55.098+05:30 [Info] Score: 0
2023-09-12T19:44:55.098+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2023-09-12T19:44:55.098+05:30 [Info] CPU Quota: 2
2023-09-12T19:44:55.098+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2023-09-12T19:44:55.098+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.098+05:30 [Info] Indexer Memory Utilization 0.7659
2023-09-12T19:44:55.098+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-12T19:44:55.098+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:44:55.098+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-12T19:44:55.098+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.098+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.098+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.098+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.098+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.098+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.098+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2023-09-12T19:44:55.098+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.098+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.098+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.098+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.098+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 initial placement - 5 20M array index, 2 replica, 2x
2023-09-12T19:44:55.108+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:55.149+05:30 [Info] Score: 0
2023-09-12T19:44:55.149+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2023-09-12T19:44:55.149+05:30 [Info] CPU Quota: 2
2023-09-12T19:44:55.149+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2023-09-12T19:44:55.149+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.149+05:30 [Info] Indexer Memory Utilization 0.8063
2023-09-12T19:44:55.149+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-12T19:44:55.149+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:44:55.149+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-12T19:44:55.149+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.149+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.149+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.149+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.149+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.149+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.149+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2023-09-12T19:44:55.149+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.149+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.149+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.149+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.149+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 initial placement - 3 replica constraint, 2 index, 2x
2023-09-12T19:44:55.152+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:55.192+05:30 [Info] Score: 0
2023-09-12T19:44:55.192+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-12T19:44:55.192+05:30 [Info] CPU Quota: 2
2023-09-12T19:44:55.192+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-12T19:44:55.192+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.192+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-12T19:44:55.192+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:44:55.192+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:44:55.192+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:44:55.192+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.192+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.192+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.192+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.192+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.192+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.192+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-12T19:44:55.192+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.192+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.192+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.192+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.192+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2023-09-12T19:44:55.201+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.03639430456331184
2023-09-12T19:44:55.330+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:55.330+05:30 [Info] Score: 0.007189938568471697
2023-09-12T19:44:55.330+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2023-09-12T19:44:55.330+05:30 [Info] CPU Quota: 27
2023-09-12T19:44:55.330+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2023-09-12T19:44:55.330+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2023-09-12T19:44:55.330+05:30 [Info] Indexer Memory Utilization 0.5679
2023-09-12T19:44:55.330+05:30 [Info] Indexer CPU Mean 20.1734
2023-09-12T19:44:55.330+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2023-09-12T19:44:55.330+05:30 [Info] Indexer CPU Utilization 0.7472
2023-09-12T19:44:55.330+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.330+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.330+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.330+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.330+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.330+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.330+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2023-09-12T19:44:55.330+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2023-09-12T19:44:55.330+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.330+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.330+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.330+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2023-09-12T19:44:55.342+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0034595329989088514
2023-09-12T19:44:55.593+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:55.593+05:30 [Info] Score: 0.00043718596495524715
2023-09-12T19:44:55.593+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-12T19:44:55.593+05:30 [Info] CPU Quota: 20
2023-09-12T19:44:55.593+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2023-09-12T19:44:55.593+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2023-09-12T19:44:55.593+05:30 [Info] Indexer Memory Utilization 0.7321
2023-09-12T19:44:55.593+05:30 [Info] Indexer CPU Mean 14.2305
2023-09-12T19:44:55.593+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2023-09-12T19:44:55.593+05:30 [Info] Indexer CPU Utilization 0.7115
2023-09-12T19:44:55.593+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.593+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.593+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.593+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.593+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.593+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.593+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2023-09-12T19:44:55.593+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2023-09-12T19:44:55.593+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.593+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.593+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.593+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 incr placement - 3 server group, 3 replica, 1x
2023-09-12T19:44:55.596+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:55.609+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:55.609+05:30 [Info] Score: 0
2023-09-12T19:44:55.609+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-12T19:44:55.609+05:30 [Info] CPU Quota: 16
2023-09-12T19:44:55.609+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-12T19:44:55.609+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.610+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-12T19:44:55.610+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:44:55.610+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:44:55.610+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:44:55.610+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.610+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.610+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.610+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.610+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.610+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.610+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-12T19:44:55.610+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.610+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.610+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.610+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.610+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 incr placement - 2 server group, 3 replica, 1x
2023-09-12T19:44:55.612+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2023-09-12T19:44:55.612+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2023-09-12T19:44:55.612+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2023-09-12T19:44:55.612+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:44:55.625+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:55.625+05:30 [Info] Score: 0
2023-09-12T19:44:55.625+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-12T19:44:55.625+05:30 [Info] CPU Quota: 16
2023-09-12T19:44:55.625+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-12T19:44:55.625+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.625+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-12T19:44:55.625+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:44:55.625+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:44:55.625+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:44:55.625+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.625+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.625+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.625+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.625+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.625+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.625+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-12T19:44:55.625+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:44:55.625+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:55.625+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:55.625+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:55.625+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2023-09-12T19:44:55.628+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2700174356015024
2023-09-12T19:44:55.628+05:30 [Info] Planner::initial temperature: initial resource variation 0.2700174356015024 temp 0.02700174356015024
2023-09-12T19:44:55.816+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:55.816+05:30 [Info] Score: 0.19174669962517618
2023-09-12T19:44:55.816+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-09-12T19:44:55.816+05:30 [Info] CPU Quota: 30
2023-09-12T19:44:55.816+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-09-12T19:44:55.816+05:30 [Info] Indexer Memory Deviation 4615082684 (4.29813G) (5.19%)
2023-09-12T19:44:55.816+05:30 [Info] Indexer Memory Utilization 0.6367
2023-09-12T19:44:55.816+05:30 [Info] Indexer CPU Mean 24.0538
2023-09-12T19:44:55.816+05:30 [Info] Indexer CPU Deviation 3.21 (13.36%)
2023-09-12T19:44:55.816+05:30 [Info] Indexer CPU Utilization 0.8018
2023-09-12T19:44:55.816+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:55.816+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:55.816+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:55.816+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.816+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:55.816+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:55.816+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-09-12T19:44:55.816+05:30 [Info] Indexer Data Size Deviation 4615082684 (4.29813G) (5.19%)
2023-09-12T19:44:55.816+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2023-09-12T19:44:55.816+05:30 [Info] Index Data Moved (exclude new node) 374.694G (37.72%)
2023-09-12T19:44:55.816+05:30 [Info] No. Index (from non-deleted node) 90
2023-09-12T19:44:55.816+05:30 [Info] No. Index Moved (exclude new node) 29 (32.22%)
2023/09/12 19:44:55 -------------------------------------------
2023/09/12 19:44:55 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2023-09-12T19:44:55.818+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3692488345679043
2023-09-12T19:44:55.818+05:30 [Info] Planner::initial temperature: initial resource variation 0.3692488345679043 temp 0.03692488345679043
2023-09-12T19:44:56.020+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:56.020+05:30 [Info] Score: 0.215110288606148
2023-09-12T19:44:56.020+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-12T19:44:56.020+05:30 [Info] CPU Quota: 20
2023-09-12T19:44:56.020+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-09-12T19:44:56.020+05:30 [Info] Indexer Memory Deviation 28879893437 (26.8965G) (7.36%)
2023-09-12T19:44:56.020+05:30 [Info] Indexer Memory Utilization 0.7311
2023-09-12T19:44:56.020+05:30 [Info] Indexer CPU Mean 13.9305
2023-09-12T19:44:56.020+05:30 [Info] Indexer CPU Deviation 2.70 (19.36%)
2023-09-12T19:44:56.020+05:30 [Info] Indexer CPU Utilization 0.6965
2023-09-12T19:44:56.020+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:56.020+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:56.020+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:56.020+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:56.020+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:56.020+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:56.020+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-09-12T19:44:56.020+05:30 [Info] Indexer Data Size Deviation 28879893437 (26.8965G) (7.36%)
2023-09-12T19:44:56.020+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2023-09-12T19:44:56.020+05:30 [Info] Index Data Moved (exclude new node) 2.20349T (51.44%)
2023-09-12T19:44:56.020+05:30 [Info] No. Index (from non-deleted node) 90
2023-09-12T19:44:56.020+05:30 [Info] No. Index Moved (exclude new node) 23 (25.56%)
2023/09/12 19:44:56 -------------------------------------------
2023/09/12 19:44:56 rebalance - travel sample, 10% shuffle, 1x
2023-09-12T19:44:56.021+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.09326827300143914
2023-09-12T19:44:56.021+05:30 [Info] Planner::initial temperature: initial resource variation 0.09326827300143914 temp 0.009326827300143914
2023-09-12T19:44:56.035+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:56.035+05:30 [Info] Score: 0.023317068250359785
2023-09-12T19:44:56.035+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-12T19:44:56.035+05:30 [Info] CPU Quota: 8
2023-09-12T19:44:56.035+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-09-12T19:44:56.035+05:30 [Info] Indexer Memory Deviation 1632487 (1.55686M) (9.33%)
2023-09-12T19:44:56.035+05:30 [Info] Indexer Memory Utilization 0.0326
2023-09-12T19:44:56.035+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:44:56.035+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:44:56.035+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:44:56.035+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:56.035+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:56.035+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:56.036+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:56.036+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:56.036+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:56.036+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T19:44:56.036+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:44:56.036+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:56.036+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:56.036+05:30 [Info] No. Index (from non-deleted node) 10
2023-09-12T19:44:56.036+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:56 -------------------------------------------
2023/09/12 19:44:56 rebalance - 20-50M, 90 index, swap 2, 1x
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-09-12T19:44:56.037+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-09-12T19:44:56.038+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-09-12T19:44:56.038+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-09-12T19:44:56.038+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-09-12T19:44:56.038+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4095843409677649
2023-09-12T19:44:56.038+05:30 [Info] Planner::initial temperature: initial resource variation 0.4095843409677649 temp 0.04095843409677649
2023-09-12T19:44:56.364+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:56.364+05:30 [Info] Score: 0.0155241146000108
2023-09-12T19:44:56.364+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-09-12T19:44:56.364+05:30 [Info] CPU Quota: 30
2023-09-12T19:44:56.364+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-09-12T19:44:56.364+05:30 [Info] Indexer Memory Deviation 2759460076 (2.56995G) (3.10%)
2023-09-12T19:44:56.364+05:30 [Info] Indexer Memory Utilization 0.6367
2023-09-12T19:44:56.364+05:30 [Info] Indexer CPU Mean 24.0538
2023-09-12T19:44:56.364+05:30 [Info] Indexer CPU Deviation 0.58 (2.42%)
2023-09-12T19:44:56.364+05:30 [Info] Indexer CPU Utilization 0.8018
2023-09-12T19:44:56.364+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:56.364+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:56.364+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:56.364+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:56.364+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:56.364+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:56.364+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-09-12T19:44:56.364+05:30 [Info] Indexer Data Size Deviation 2759460076 (2.56995G) (3.10%)
2023-09-12T19:44:56.364+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:56.364+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:56.364+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:56.364+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:56 -------------------------------------------
2023/09/12 19:44:56 rebalance - mixed small/medium, 90 index, swap 2, 1x
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-09-12T19:44:56.366+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-09-12T19:44:56.366+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4082556623939647
2023-09-12T19:44:56.366+05:30 [Info] Planner::initial temperature: initial resource variation 0.4082556623939647 temp 0.040825566239396475
2023-09-12T19:44:56.919+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:44:56.919+05:30 [Info] Score: 0.0011709674182780777
2023-09-12T19:44:56.919+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-12T19:44:56.919+05:30 [Info] CPU Quota: 20
2023-09-12T19:44:56.919+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-09-12T19:44:56.919+05:30 [Info] Indexer Memory Deviation 919222543 (876.639M) (0.23%)
2023-09-12T19:44:56.919+05:30 [Info] Indexer Memory Utilization 0.7311
2023-09-12T19:44:56.919+05:30 [Info] Indexer CPU Mean 13.9305
2023-09-12T19:44:56.919+05:30 [Info] Indexer CPU Deviation 1.07 (7.70%)
2023-09-12T19:44:56.919+05:30 [Info] Indexer CPU Utilization 0.6965
2023-09-12T19:44:56.919+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:56.919+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:56.919+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:56.919+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:56.919+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:56.919+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:56.919+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-09-12T19:44:56.919+05:30 [Info] Indexer Data Size Deviation 919222543 (876.639M) (0.23%)
2023-09-12T19:44:56.919+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:56.919+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:56.920+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:56.920+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:56 -------------------------------------------
2023/09/12 19:44:56 rebalance - travel sample, swap 2, 1x
2023-09-12T19:44:56.920+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 192.168.1.8:9000
2023-09-12T19:44:56.920+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-12T19:44:56.920+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0086622738872069
2023-09-12T19:44:56.920+05:30 [Info] Planner::initial temperature: initial resource variation 1.0086622738872069 temp 0.1008662273887207
2023-09-12T19:44:57.052+05:30 [Info] Score: 0.00031929273712825843
2023-09-12T19:44:57.052+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-12T19:44:57.052+05:30 [Info] CPU Quota: 8
2023-09-12T19:44:57.052+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-09-12T19:44:57.052+05:30 [Info] Indexer Memory Deviation 22354 (21.8301K) (0.13%)
2023-09-12T19:44:57.052+05:30 [Info] Indexer Memory Utilization 0.0326
2023-09-12T19:44:57.052+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:44:57.052+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:44:57.052+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:44:57.052+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:44:57.052+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:44:57.052+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:44:57.052+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:57.052+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:44:57.052+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:44:57.052+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T19:44:57.052+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:44:57.052+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:44:57.052+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:44:57.052+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:44:57.052+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:44:57 -------------------------------------------
2023/09/12 19:44:57 rebalance - 8 identical index, add 4, 1x
2023-09-12T19:44:57.053+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-12T19:44:57.053+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-12T19:44:57.053+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-12T19:44:57.053+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-12T19:44:57.053+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1
2023-09-12T19:44:57.053+05:30 [Info] Planner::initial temperature: initial resource variation 1 temp 0.1
2023-09-12T19:45:00.701+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-12T19:45:00.710+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:45:00.711+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:45:00.711+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:45:00.712+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:45:00.712+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-12T19:45:00.717+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-12T19:45:01.660+05:30 [Info] Score: 0
2023-09-12T19:45:01.660+05:30 [Info] Memory Quota: 930294000 (887.197M)
2023-09-12T19:45:01.660+05:30 [Info] CPU Quota: 2
2023-09-12T19:45:01.660+05:30 [Info] Indexer Memory Mean 260000000 (247.955M)
2023-09-12T19:45:01.660+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:45:01.660+05:30 [Info] Indexer Memory Utilization 0.2795
2023-09-12T19:45:01.660+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:45:01.660+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:45:01.660+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:45:01.660+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:01.660+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:01.660+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:01.660+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:01.660+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:01.660+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:01.660+05:30 [Info] Indexer Data Size Mean 260000000 (247.955M)
2023-09-12T19:45:01.660+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:01.660+05:30 [Info] Total Index Data (from non-deleted node) 1.93715G
2023-09-12T19:45:01.660+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:01.660+05:30 [Info] No. Index (from non-deleted node) 8
2023-09-12T19:45:01.660+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:45:01 -------------------------------------------
2023/09/12 19:45:01 rebalance - 8 identical index, delete 2, 2x
2023-09-12T19:45:01.661+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:45:01.661+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023-09-12T19:45:01.684+05:30 [Info] connected with 1 indexers
2023-09-12T19:45:01.684+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-12T19:45:01.694+05:30 [Info] num concurrent scans {0}
2023-09-12T19:45:01.694+05:30 [Info] average scan response {1 ms}
2023-09-12T19:45:01.713+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:01.713+05:30 [Info] Score: 0
2023-09-12T19:45:01.713+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2023-09-12T19:45:01.713+05:30 [Info] CPU Quota: 4
2023-09-12T19:45:01.713+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2023-09-12T19:45:01.713+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:45:01.713+05:30 [Info] Indexer Memory Utilization 0.0098
2023-09-12T19:45:01.713+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:45:01.713+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:45:01.713+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:45:01.713+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:01.713+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:01.713+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:01.713+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:01.714+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:01.714+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:01.714+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2023-09-12T19:45:01.714+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:01.714+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:01.714+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:01.714+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:01.714+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:45:01 -------------------------------------------
2023/09/12 19:45:01 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2023-09-12T19:45:01.714+05:30 [Warn] There is more replica than available nodes. Will not move index replica (default,,,country) from ejected node 127.0.0.1:9002
2023-09-12T19:45:01.715+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-12T19:45:01.715+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-12T19:45:01.715+05:30 [Info] Score: 0
2023-09-12T19:45:01.715+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-12T19:45:01.715+05:30 [Info] CPU Quota: 16
2023-09-12T19:45:01.715+05:30 [Info] Indexer Memory Mean 0 (0)
2023-09-12T19:45:01.715+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:45:01.715+05:30 [Info] Indexer Memory Utilization 0.0000
2023-09-12T19:45:01.715+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:45:01.715+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:45:01.715+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:45:01.715+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:01.715+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:01.715+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:01.715+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:01.715+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:01.715+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:01.715+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T19:45:01.715+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:01.715+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:01.715+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:01.715+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:01.715+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:45:01 -------------------------------------------
2023/09/12 19:45:01 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2023-09-12T19:45:01.715+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-12T19:45:01.715+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-12T19:45:01.715+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9003
2023-09-12T19:45:01.716+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-12T19:45:01.716+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-12T19:45:01.716+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T19:45:01.716+05:30 [Info] Score: 0
2023-09-12T19:45:01.716+05:30 [Info] Memory Quota: 268435456 (256M)
2023-09-12T19:45:01.716+05:30 [Info] CPU Quota: 8
2023-09-12T19:45:01.716+05:30 [Info] Indexer Memory Mean 0 (0)
2023-09-12T19:45:01.716+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-12T19:45:01.716+05:30 [Info] Indexer Memory Utilization 0.0000
2023-09-12T19:45:01.716+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:45:01.716+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:45:01.716+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:45:01.716+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:01.716+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:01.716+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:01.716+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:01.716+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:01.716+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:01.716+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T19:45:01.716+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:01.716+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:01.716+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:01.716+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:01.716+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/12 19:45:01 -------------------------------------------
2023/09/12 19:45:01 Minimum memory test 1: min memory = 0
2023-09-12T19:45:01.717+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-12T19:45:01.718+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-12T19:45:01.721+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/12 19:45:01 -------------------------------------------
2023/09/12 19:45:01 Minimum memory test 2: min memory > quota
2023-09-12T19:45:01.722+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=9us
2023-09-12T19:45:01.722+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=9us
2023-09-12T19:45:01.722+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=7us
2023-09-12T19:45:01.722+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-12T19:45:01.722+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-12T19:45:02.370+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-12T19:45:02.917+05:30 [Info] connected with 1 indexers
2023-09-12T19:45:02.917+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-12T19:45:02.924+05:30 [Info] GSIC[default/default-_default-_default-1694527202875816220] logstats "default" {"gsi_scan_count":109,"gsi_scan_duration":9895853292,"gsi_throttle_duration":884026817,"gsi_prime_duration":566961956,"gsi_blocked_duration":972522462,"gsi_total_temp_files":0,"gsi_backfill_size":0}
2023-09-12T19:45:02.925+05:30 [Info] num concurrent scans {0}
2023-09-12T19:45:02.925+05:30 [Info] average scan response {439 ms}
2023/09/12 19:45:03 -------------------------------------------
2023/09/12 19:45:03 Minimum memory test 3: min memory < quota
2023-09-12T19:45:03.073+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-12T19:45:03.073+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-12T19:45:03.545+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Minimum memory test 4: replica repair with min memory > quota
2023-09-12T19:45:04.343+05:30 [Info] Rebuilding lost replica for (default,,,country,0,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.343+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=7us
2023-09-12T19:45:04.343+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-09-12T19:45:04.343+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-12T19:45:04.344+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-12T19:45:04.344+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-12T19:45:04.344+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T19:45:04.344+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:04.344+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=356us
2023-09-12T19:45:04.344+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-12T19:45:04.344+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-12T19:45:04.344+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T19:45:04.344+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:04.344+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=259us
2023-09-12T19:45:04.344+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster. Will not rebuild lost replica.
2023-09-12T19:45:04.344+05:30 [Warn]
MemoryQuota: 200
CpuQuota: 8
--- Violations for index (mem 130, cpu 0) at node 127.0.0.1:9003
Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2023-09-12T19:45:04.344+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-12T19:45:04.344+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0 is less than threshold: 0. No nodes have been added or deleted and there are no violations observed
2023-09-12T19:45:04.344+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Minimum memory test 5: replica repair with min memory < quota
2023-09-12T19:45:04.345+05:30 [Info] Rebuilding lost replica for (default,,,country,0,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.345+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-12T19:45:04.345+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-12T19:45:04.360+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Minimum memory test 6: rebalance with min memory > quota
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=8us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=9us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=7us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=6us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=6us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=8us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=6us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=6us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=11us
2023-09-12T19:45:04.360+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=7us
2023-09-12T19:45:04.361+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=6us
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Minimum memory test 7: rebalance-out with min memory > quota
2023-09-12T19:45:04.361+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=7us
2023-09-12T19:45:04.361+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-12T19:45:04.361+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-09-12T19:45:04.361+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-12T19:45:04.361+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=5us
2023-09-12T19:45:04.361+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=8us
2023-09-12T19:45:04.361+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T19:45:04.361+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-12T19:45:04.361+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-12T19:45:04.362+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Minimum memory test 8: plan with min memory > quota
2023-09-12T19:45:04.365+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-09-12T19:45:04.366+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T19:45:04.366+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=1ms
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=8us
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=7us
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=7us
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=6us
2023-09-12T19:45:04.366+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T19:45:04.366+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-09-12T19:45:04.366+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Minimum memory test 9: single node rebalance with min memory > quota
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-12T19:45:04.366+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=5us
2023-09-12T19:45:04.367+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=7us
2023-09-12T19:45:04.367+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=6us
2023-09-12T19:45:04.367+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=6us
2023-09-12T19:45:04.367+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=6us
2023-09-12T19:45:04.367+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=5us
2023-09-12T19:45:04.367+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=6us
2023-09-12T19:45:04.367+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=6us
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Minimum memory test 10: plan with partitioned index on empty cluster
2023-09-12T19:45:04.369+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.7071067811865476
2023-09-12T19:45:04.406+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 iterationTest :: Remove one node - failure
2023-09-12T19:45:04.408+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.30631126496359357
2023-09-12T19:45:04.487+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:04.487+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.487+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.488+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.488+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.488+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.15730556904676482).
2023-09-12T19:45:04.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=368us
2023-09-12T19:45:04.488+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.488+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.488+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.488+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.488+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1902603089911116).
2023-09-12T19:45:04.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=315us
2023-09-12T19:45:04.488+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.488+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.488+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.488+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.488+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1055691937471481).
2023-09-12T19:45:04.488+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=343us
2023-09-12T19:45:04.489+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.489+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.489+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.489+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.489+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1278690395937497).
2023-09-12T19:45:04.489+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=374us
2023-09-12T19:45:04.489+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.489+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.489+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.489+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.489+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.0736871705086794).
2023-09-12T19:45:04.489+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=469us
2023-09-12T19:45:04.490+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.490+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.490+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.490+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.490+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.14666011389180666).
2023-09-12T19:45:04.490+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=438us
2023-09-12T19:45:04.490+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T19:45:04.490+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.490+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.490+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.490+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.490+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.14666011389180666).
2023-09-12T19:45:04.490+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=442us
2023-09-12T19:45:04.490+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.491+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.491+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.491+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.491+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.16239234897109667).
2023-09-12T19:45:04.491+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=349us
2023-09-12T19:45:04.491+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.491+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.491+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.491+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.491+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1902603089911116).
2023-09-12T19:45:04.491+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=326us
2023-09-12T19:45:04.491+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.491+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.491+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.491+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.491+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13937917050431553).
2023-09-12T19:45:04.492+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=339us
2023-09-12T19:45:04.492+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.492+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.492+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.492+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.492+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12108602258995575).
2023-09-12T19:45:04.492+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=332us
2023-09-12T19:45:04.492+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012215456730705048
2023-09-12T19:45:04.492+05:30 [Info] Planner::initial temperature: initial resource variation 0.012215456730705048 temp 0.03377845432692949
2023-09-12T19:45:04.492+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.492+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-12T19:45:04.492+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.16712819366296622).
2023-09-12T19:45:04.492+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=342us
2023-09-12T19:45:04.492+05:30 [Error]
MemoryQuota: 5302940000000
CpuQuota: 6
--- Violations for index <10488701812023980943, bucket1, , > (mem 21.0786G, cpu 2.1085599999999998) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.63879T, free cpu -36.33204)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64998T, free cpu -31.247440000000005)
--- Violations for index <16537345286347435578, bucket1, , > (mem 16.8415G, cpu 4.559) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.63879T, free cpu -36.33204)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64998T, free cpu -31.247440000000005)
--- Violations for index <8983640087714896834, bucket1, , > (mem 21.5322G, cpu 5.45636) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.63879T, free cpu -36.33204)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64998T, free cpu -31.247440000000005)
--- Violations for index <7174710286832173770, bucket1, , > (mem 17.9655G, cpu 3.82688) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.63879T, free cpu -36.33204)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64998T, free cpu -31.247440000000005)
--- Violations for index <12975381992784862882, bucket1, , > (mem 14.55G, cpu 3.48984) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.63879T, free cpu -36.33204)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64998T, free cpu -31.247440000000005)
--- Violations for index <7584497576436276127, bucket1, , > (mem 13.7649G, cpu 3.4638799999999996) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.63879T, free cpu -36.33204)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64998T, free cpu -31.247440000000005)
--- Violations for index <16536751403023313151, bucket1, , > (mem 9.20792G, cpu 4.18304) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.63879T, free cpu -36.33204)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64998T, free cpu -31.247440000000005)
--- Violations for index <713159029872718454, bucket1, , > (mem 8.59327G, cpu 1.94752) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.63879T, free cpu -36.33204)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64998T, free cpu -31.247440000000005)
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 iterationTest :: Remove one node - success
2023-09-12T19:45:04.493+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.22620968258211538
2023-09-12T19:45:04.576+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:04.576+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01570208021109144
2023-09-12T19:45:04.576+05:30 [Info] Planner::initial temperature: initial resource variation 0.01570208021109144 temp 0.02342979197889086
2023-09-12T19:45:04.576+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-12T19:45:04.576+05:30 [Info] Planner::Finished planner run after 11 iterations.
2023-09-12T19:45:04.576+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.022995431284326216).
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 iterationTest :: Index rebuild - success
2023-09-12T19:45:04.579+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i18,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.579+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i22,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.579+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i0,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.579+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i5,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.579+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i10,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.579+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i13,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.579+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i15,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.579+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i8,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i11,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i24,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i26,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i28,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i4,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i23,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i27,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i6,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i12,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i14,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i20,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i19,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i21,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i25,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i29,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i7,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i9,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i16,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T19:45:04.580+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i17,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T19:45:04.581+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.58309518948453
2023-09-12T19:45:04.581+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0.58309518948453 is less than threshold: 0.8. No nodes have been added or deleted and there are no violations observed
2023-09-12T19:45:04.581+05:30 [Info] Planner::initial temperature: initial resource variation 0.58309518948453 temp 0.021690481051547007
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 iterationTest :: Index rebuild - initial placement - success
2023-09-12T19:45:04.582+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-09-12T19:45:04.582+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-12T19:45:04.582+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-12T19:45:04.582+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.582+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.582+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.582+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6236095644623236
2023-09-12T19:45:04.582+05:30 [Info] Planner::initial temperature: initial resource variation 0.6236095644623236 temp 0.03663904355376764
2023-09-12T19:45:04.582+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:04.582+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:04.582+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.6236095644623236).
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 iterationTest :: Index rebuild - initial placement - numReplica > numSG - success
2023-09-12T19:45:04.583+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-09-12T19:45:04.583+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-12T19:45:04.583+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-12T19:45:04.583+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.583+05:30 [Info] Rebuilding lost replica for (default,,,idx1,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T19:45:04.583+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.583+05:30 [Info] Rebuilding lost replica for (default,,,idx2,2,0) with initial placement on node: 127.0.0.1:9000
2023-09-12T19:45:04.583+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:04.583+05:30 [Info] Rebuilding lost replica for (default,,,idx3,2,0) with initial placement on node: 127.0.0.1:9000
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-09-12T19:45:04.583+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3333333333333333
2023-09-12T19:45:04.583+05:30 [Info] Planner::initial temperature: initial resource variation 0.3333333333333333 temp 0.06566666666666668
2023-09-12T19:45:04.583+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:04.583+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:04.583+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.3333333333333333).
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 scaling with excludeIn - 8 identical index, add 1, 1x
2023-09-12T19:45:04.584+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-09-12T19:45:04.584+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 swap with excludeIn - 8 identical index, add 1, 1x
2023-09-12T19:45:04.743+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-09-12T19:45:04.743+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023-09-12T19:45:04.743+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 replica repair with excludeIn - 3 replica, 4 zone, delete 1, 1x
2023-09-12T19:45:04.744+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-12T19:45:04.744+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-12T19:45:04.744+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 heterogenous rebalance - keep vertically scaled Node, swap 1, 1x
2023-09-12T19:45:04.745+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.1237823254333867
2023-09-12T19:45:04.745+05:30 [Info] Planner::initial temperature: initial resource variation 1.1237823254333867 temp 0.11237823254333867
2023-09-12T19:45:04.745+05:30 [Info] Planner::finalizing the solution as final solution is found.
--- PASS: TestPlanner (13.01s)
=== RUN TestGreedyPlanner
2023/09/12 19:45:04 In TestGreedyPlanner()
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Single Index Instance - 3 empty nodes - 1 SG
2023-09-12T19:45:04.748+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Single Index Instance - 2 empty nodes, 1 non-empty node - 1 SG
2023-09-12T19:45:04.750+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Single Index Instance - 1 empty node, 2 non-empty nodes - 1 SG
2023-09-12T19:45:04.752+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Single Index Instance - 3 non-empty nodes - 1 SG
2023-09-12T19:45:04.755+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 1 Replica - 3 empty nodes - 1 SG
2023-09-12T19:45:04.757+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 1 SG
2023-09-12T19:45:04.758+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 1 SG
2023-09-12T19:45:04.760+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 1 Replica - 3 non-empty nodes - 1 SG
2023-09-12T19:45:04.762+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 2 Replica - 3 empty nodes - 1 SG
2023-09-12T19:45:04.764+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 2 Replica - 3 non-empty nodes - 1 SG
2023-09-12T19:45:04.766+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 2 SG
2023-09-12T19:45:04.768+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 2 SG
2023-09-12T19:45:04.770+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Index With 1 Replica - 3 non-empty nodes - 2 SG
2023-09-12T19:45:04.772+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Equivalent Index Without any replica - 3 non-empty nodes - 1 SG
2023-09-12T19:45:04.774+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Skip least loaded node
2023-09-12T19:45:04.777+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Use least loaded node
2023-09-12T19:45:04.779+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place 60 index instaces on 3 empty nodes - 1 SG
2023-09-12T19:45:04.780+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T19:45:04.782+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T19:45:04.784+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T19:45:04.785+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T19:45:04.787+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T19:45:04.789+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-12T19:45:04.790+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-12T19:45:04.792+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-12T19:45:04.794+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-12T19:45:04.795+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-12T19:45:04.797+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-12T19:45:04.799+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-12T19:45:04.801+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-12T19:45:04.802+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-12T19:45:04.804+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-12T19:45:04.806+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-12T19:45:04.808+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-12T19:45:04.809+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-12T19:45:04.811+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-12T19:45:04.813+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-12T19:45:04.814+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-12T19:45:04.816+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-12T19:45:04.818+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-12T19:45:04.820+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-12T19:45:04.821+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-12T19:45:04.823+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-12T19:45:04.825+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-12T19:45:04.826+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-12T19:45:04.828+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-12T19:45:04.830+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-12T19:45:04.832+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-12T19:45:04.833+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-12T19:45:04.835+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-12T19:45:04.837+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-12T19:45:04.838+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-12T19:45:04.840+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-12T19:45:04.842+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-12T19:45:04.844+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-12T19:45:04.846+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-12T19:45:04.847+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-12T19:45:04.849+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-12T19:45:04.851+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-12T19:45:04.853+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-12T19:45:04.854+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-12T19:45:04.856+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-12T19:45:04.858+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-12T19:45:04.860+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-12T19:45:04.861+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-12T19:45:04.863+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-12T19:45:04.865+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-12T19:45:04.866+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-12T19:45:04.868+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-12T19:45:04.870+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-12T19:45:04.872+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-12T19:45:04.873+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-12T19:45:04.875+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-12T19:45:04.877+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-12T19:45:04.879+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-12T19:45:04.880+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-12T19:45:04.882+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-12T19:45:04.882+05:30 [Info] Actual variance of deferred index count across nodes is 0
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place 60 index instaces on 1 empty and 1 10 percent filled node - 1 SG
2023-09-12T19:45:04.884+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T19:45:04.886+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T19:45:04.888+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T19:45:04.890+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T19:45:04.892+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T19:45:04.894+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-12T19:45:04.895+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-12T19:45:04.897+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-12T19:45:04.899+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-12T19:45:04.900+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-12T19:45:04.902+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-12T19:45:04.904+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-12T19:45:04.906+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-12T19:45:04.907+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-12T19:45:04.909+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-12T19:45:04.910+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-12T19:45:04.912+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-12T19:45:04.914+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-12T19:45:04.915+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-12T19:45:04.917+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-12T19:45:04.919+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-12T19:45:04.921+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-12T19:45:04.922+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-12T19:45:04.924+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-12T19:45:04.926+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-12T19:45:04.928+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-12T19:45:04.929+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-12T19:45:04.931+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-12T19:45:04.933+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-12T19:45:04.934+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-12T19:45:04.936+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-12T19:45:04.938+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-12T19:45:04.939+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-12T19:45:04.941+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-12T19:45:04.943+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-12T19:45:04.945+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-12T19:45:04.946+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-12T19:45:04.948+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-12T19:45:04.950+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-12T19:45:04.952+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-12T19:45:04.953+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-12T19:45:04.955+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-12T19:45:04.957+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-12T19:45:04.959+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-12T19:45:04.960+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-12T19:45:04.962+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-12T19:45:04.964+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-12T19:45:04.965+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-12T19:45:04.967+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-12T19:45:04.969+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-12T19:45:04.971+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-12T19:45:04.972+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-12T19:45:04.974+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-12T19:45:04.976+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-12T19:45:04.978+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-12T19:45:04.979+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-12T19:45:04.981+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-12T19:45:04.983+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-12T19:45:04.985+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-12T19:45:04.987+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-12T19:45:04.987+05:30 [Info] Actual variance of deferred index count across nodes is 8
2023/09/12 19:45:04 -------------------------------------------
2023/09/12 19:45:04 Place 60 index instaces on 1 empty and 1 30 percent filled node - 1 SG
2023-09-12T19:45:04.989+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T19:45:04.991+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T19:45:04.992+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T19:45:04.994+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T19:45:04.996+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T19:45:04.998+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-12T19:45:04.999+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-12T19:45:05.001+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-12T19:45:05.003+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-12T19:45:05.004+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-12T19:45:05.006+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-12T19:45:05.008+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-12T19:45:05.010+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-12T19:45:05.011+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-12T19:45:05.013+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-12T19:45:05.015+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-12T19:45:05.016+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-12T19:45:05.018+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-12T19:45:05.020+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-12T19:45:05.021+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-12T19:45:05.023+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-12T19:45:05.025+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-12T19:45:05.027+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-12T19:45:05.028+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-12T19:45:05.030+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-12T19:45:05.032+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-12T19:45:05.033+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-12T19:45:05.035+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-12T19:45:05.037+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-12T19:45:05.038+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-12T19:45:05.040+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-12T19:45:05.042+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-12T19:45:05.043+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-12T19:45:05.045+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-12T19:45:05.047+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-12T19:45:05.049+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-12T19:45:05.051+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-12T19:45:05.052+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-12T19:45:05.054+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-12T19:45:05.056+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-12T19:45:05.058+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-12T19:45:05.060+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-12T19:45:05.062+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-12T19:45:05.064+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-12T19:45:05.066+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-12T19:45:05.068+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-12T19:45:05.070+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-12T19:45:05.072+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-12T19:45:05.074+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-12T19:45:05.076+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-12T19:45:05.078+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-12T19:45:05.080+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-12T19:45:05.082+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-12T19:45:05.084+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-12T19:45:05.086+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-12T19:45:05.088+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-12T19:45:05.090+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-12T19:45:05.092+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-12T19:45:05.094+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-12T19:45:05.096+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-12T19:45:05.096+05:30 [Info] Actual variance of deferred index count across nodes is 98
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place 5 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-09-12T19:45:05.098+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T19:45:05.100+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T19:45:05.101+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T19:45:05.103+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T19:45:05.105+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T19:45:05.105+05:30 [Info] Actual variance of deferred index count across nodes is 4.5
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place 60 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-09-12T19:45:05.106+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-12T19:45:05.108+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-12T19:45:05.110+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-12T19:45:05.112+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-12T19:45:05.113+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-12T19:45:05.115+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-12T19:45:05.117+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-12T19:45:05.119+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-12T19:45:05.120+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-12T19:45:05.122+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-12T19:45:05.124+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-12T19:45:05.126+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-12T19:45:05.128+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-12T19:45:05.130+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-12T19:45:05.131+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-12T19:45:05.133+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-12T19:45:05.135+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-12T19:45:05.137+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-12T19:45:05.138+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-12T19:45:05.140+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-12T19:45:05.142+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-12T19:45:05.144+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-12T19:45:05.145+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-12T19:45:05.147+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-12T19:45:05.149+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-12T19:45:05.151+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-12T19:45:05.152+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-12T19:45:05.154+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-12T19:45:05.156+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-12T19:45:05.158+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-12T19:45:05.159+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-12T19:45:05.161+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-12T19:45:05.163+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-12T19:45:05.165+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-12T19:45:05.166+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-12T19:45:05.168+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-12T19:45:05.170+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-12T19:45:05.171+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-12T19:45:05.173+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-12T19:45:05.175+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-12T19:45:05.177+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-12T19:45:05.179+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-12T19:45:05.181+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-12T19:45:05.183+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-12T19:45:05.185+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-12T19:45:05.187+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-12T19:45:05.189+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-12T19:45:05.190+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-12T19:45:05.192+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-12T19:45:05.194+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-12T19:45:05.196+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-12T19:45:05.198+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-12T19:45:05.200+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-12T19:45:05.201+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-12T19:45:05.203+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-12T19:45:05.205+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-12T19:45:05.207+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-12T19:45:05.209+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-12T19:45:05.210+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-12T19:45:05.212+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-12T19:45:05.212+05:30 [Info] Actual variance of deferred index count across nodes is 648
--- PASS: TestGreedyPlanner (0.47s)
=== RUN TestTenantAwarePlanner
2023/09/12 19:45:05 In TestTenantAwarePlanner()
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 1 empty node - 1 SG
2023-09-12T19:45:05.214+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-09-12T19:45:05.214+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.214+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 empty nodes - 2 SG
2023-09-12T19:45:05.216+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9003 127.0.0.1:9002]]
2023-09-12T19:45:05.216+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.216+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9002]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 1 node - 1 SG
2023-09-12T19:45:05.218+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.218+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-09-12T19:45:05.218+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-09-12T19:45:05.218+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 2 nodes - 1 SG
2023-09-12T19:45:05.220+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.220+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.220+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-09-12T19:45:05.220+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-09-12T19:45:05.220+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(a)
2023-09-12T19:45:05.222+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.222+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.222+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9004 127.0.0.1:9003]]
2023-09-12T19:45:05.222+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9002]
2023-09-12T19:45:05.222+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(b)
2023-09-12T19:45:05.225+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.225+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.225+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9002]]
2023-09-12T19:45:05.225+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.225+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(c)
2023-09-12T19:45:05.227+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.227+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.227+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.227+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.227+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-12T19:45:05.227+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.227+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Memory Above LWM
2023-09-12T19:45:05.229+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.229+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-12T19:45:05.229+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.229+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-12T19:45:05.229+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.229+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.229+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Units Above LWM
2023-09-12T19:45:05.231+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.231+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-12T19:45:05.232+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.232+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5000 Tenants 0
2023-09-12T19:45:05.232+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.232+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.232+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(a)
2023-09-12T19:45:05.234+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.234+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-12T19:45:05.234+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.234+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-12T19:45:05.234+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.234+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.234+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(b)
2023-09-12T19:45:05.236+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.236+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-12T19:45:05.236+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.236+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-12T19:45:05.236+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.236+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.236+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Units HWM
2023-09-12T19:45:05.238+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 8000 Tenants 0
2023-09-12T19:45:05.238+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.238+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.238+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 8000 Tenants 0
2023-09-12T19:45:05.238+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-12T19:45:05.238+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.238+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-09-12T19:45:05.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-12T19:45:05.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-09-12T19:45:05.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-12T19:45:05.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-09-12T19:45:05.240+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.240+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.240+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-09-12T19:45:05.242+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.243+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.243+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.243+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-12T19:45:05.243+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.243+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-12T19:45:05.243+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.243+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-09-12T19:45:05.245+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.245+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.245+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.245+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.245+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-12T19:45:05.245+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.245+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-09-12T19:45:05.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-12T19:45:05.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.247+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-12T19:45:05.247+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.247+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-09-12T19:45:05.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.249+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-12T19:45:05.249+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.249+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 2 empty nodes - 1 SG
2023-09-12T19:45:05.251+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-09-12T19:45:05.251+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.251+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9002]
2023-09-12T19:45:05.251+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9001]
2023-09-12T19:45:05.251+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Unable to find any valid SubCluster
2023/09/12 19:45:05 Expected error Planner not able to find any node for placement - Unable to find any valid SubCluster
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Memory HWM
2023-09-12T19:45:05.252+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-09-12T19:45:05.252+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.252+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.252+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-09-12T19:45:05.252+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-12T19:45:05.252+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.252+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2023/09/12 19:45:05 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Memory Above LWM
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 680000000 Units 1000 Tenants 0
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 680000000 Units 1000 Tenants 0
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-12T19:45:05.253+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.253+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-12T19:45:05.253+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2023/09/12 19:45:05 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 0 Units 4500 Tenants 0
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-12T19:45:05.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-09-12T19:45:05.254+05:30 [Error] Planner::validateSubClusterGrouping Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/09/12 19:45:05 Expected error Planner Constraint Violation. Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-09-12T19:45:05.254+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.254+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.254+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.254+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-12T19:45:05.254+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/12 19:45:05 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-09-12T19:45:05.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/12 19:45:05 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-09-12T19:45:05.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-12T19:45:05.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-12T19:45:05.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/12 19:45:05 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-09-12T19:45:05.256+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.256+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.256+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9004 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/12 19:45:05 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 3 SG, 1 empty, 1 Memory Above HWM
2023-09-12T19:45:05.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-09-12T19:45:05.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-09-12T19:45:05.257+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.257+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.257+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.257+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500
2023-09-12T19:45:05.257+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.257+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 3 SG, 1 empty, 1 Units Above HWM
2023-09-12T19:45:05.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 8000 Tenants 0
2023-09-12T19:45:05.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 400000000 Units 1000 Tenants 0
2023-09-12T19:45:05.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 8000 Tenants 0
2023-09-12T19:45:05.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 400000000 Units 1000 Tenants 0
2023-09-12T19:45:05.258+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.258+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.258+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.258+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000
2023-09-12T19:45:05.258+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.258+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 3 SG, 1 empty, Both Memory/Units Above HWM
2023-09-12T19:45:05.259+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.260+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.260+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.260+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.260+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.260+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.260+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.260+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.260+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T19:45:05.260+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.260+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.260+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 3 SG, Multiple tenants to move, single source, multiple destination
2023-09-12T19:45:05.261+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.261+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.261+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.261+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.261+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.261+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.261+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.261+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000
2023-09-12T19:45:05.261+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000
2023-09-12T19:45:05.261+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.261+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.261+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 3 SG, Multiple tenants to move, no nodes below LWM
2023-09-12T19:45:05.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-12T19:45:05.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-09-12T19:45:05.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 700000000 Units 3000 Tenants 0
2023-09-12T19:45:05.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-12T19:45:05.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-09-12T19:45:05.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 700000000 Units 3000 Tenants 0
2023-09-12T19:45:05.262+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.262+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.262+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.262+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-09-12T19:45:05.262+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-09-12T19:45:05.262+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-09-12T19:45:05.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000
2023-09-12T19:45:05.263+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-09-12T19:45:05.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.264+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-12T19:45:05.264+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T19:45:05.265+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-12T19:45:05.265+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-12T19:45:05.265+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.265+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.265+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.265+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.265+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.265+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.265+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.265+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.265+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 3 SG, Single Large Tenant, Nothing to move
2023-09-12T19:45:05.266+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-09-12T19:45:05.266+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 2000 Tenants 0
2023-09-12T19:45:05.266+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-09-12T19:45:05.266+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 2000 Tenants 0
2023-09-12T19:45:05.266+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.266+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.266+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.266+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000
2023-09-12T19:45:05.266+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.266+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(zero usage tenants)
2023-09-12T19:45:05.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.267+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.267+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.267+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.267+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.267+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.267+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.267+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.267+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.268+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.268+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.268+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.268+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.268+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 3 SG, 1 Partial Subcluster
2023-09-12T19:45:05.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.269+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-09-12T19:45:05.269+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.269+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-09-12T19:45:05.269+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003]]
2023-09-12T19:45:05.269+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.269+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.269+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.269+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-09-12T19:45:05.269+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-09-12T19:45:05.269+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9003]
2023-09-12T19:45:05.269+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.269+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.269+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Replica Repair - 4 SG, Missing Replicas for multiple tenants in SG
2023-09-12T19:45:05.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.270+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.270+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-12T19:45:05.270+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-09-12T19:45:05.270+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-12T19:45:05.270+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-12T19:45:05.270+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over
2023-09-12T19:45:05.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.271+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-09-12T19:45:05.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9004
2023-09-12T19:45:05.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-12T19:45:05.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9004
2023-09-12T19:45:05.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-12T19:45:05.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-12T19:45:05.271+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.271+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over, No replacement
2023-09-12T19:45:05.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.272+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.272+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9001] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.272+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Replica Repair - 4 SG, Missing Replicas, one replica missing with pendingDelete true
2023-09-12T19:45:05.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.273+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.273+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.273+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-12T19:45:05.273+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-09-12T19:45:05.273+05:30 [Info] Planner::findMissingReplicaForIndexerNode Skipping Replica Repair for 88883:81813:0. PendingDelete true
2023-09-12T19:45:05.273+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx2,1) on 127.0.0.1:9005
2023-09-12T19:45:05.273+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Replica Repair - 2 SG, Missing Replicas with Nodes over HWM
2023-09-12T19:45:05.274+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 7000 Tenants 0
2023-09-12T19:45:05.274+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.274+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 7000 Tenants 0
2023-09-12T19:45:05.274+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.274+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket9,,,idx2,1) on 127.0.0.1:9005
2023-09-12T19:45:05.274+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.274+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.274+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-09-12T19:45:05.274+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700
2023-09-12T19:45:05.274+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-09-12T19:45:05.274+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000
2023-09-12T19:45:05.275+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes
2023-09-12T19:45:05.276+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9004]
2023-09-12T19:45:05.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9004]
2023-09-12T19:45:05.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9001]
2023-09-12T19:45:05.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006 127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9008 127.0.0.1:9006 127.0.0.1:9007]
2023-09-12T19:45:05.276+05:30 [Info] Moving index 7777:7171:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T19:45:05.276+05:30 [Info] Moving index 8888:8181:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T19:45:05.276+05:30 [Info] Moving index 9999:9191:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T19:45:05.276+05:30 [Info] Moving index 101010:101101:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T19:45:05.276+05:30 [Info] Moving index 111111:112112:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T19:45:05.276+05:30 [Info] Moving index 121212:121121:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-12T19:45:05.276+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.276+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.276+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.276+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.276+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.276+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.276+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-09-12T19:45:05.276+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T19:45:05.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 1100000000 Units 8100 Tenants 0
2023-09-12T19:45:05.276+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008] [127.0.0.1:9003 127.0.0.1:9005] [127.0.0.1:9006] [127.0.0.1:9007]]
2023-09-12T19:45:05.276+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9006] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.276+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.276+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes(different SG)
2023-09-12T19:45:05.277+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004 127.0.0.1:9005]
2023-09-12T19:45:05.277+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004 127.0.0.1:9005]
2023-09-12T19:45:05.277+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-12T19:45:05.277+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.277+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.277+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.277+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.278+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.278+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.278+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.278+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.278+05:30 [Info] Moving index 7777:17171:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T19:45:05.278+05:30 [Info] Moving index 8888:18181:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T19:45:05.278+05:30 [Info] Moving index 9999:19191:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T19:45:05.278+05:30 [Info] Moving index 101010:1101101:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T19:45:05.278+05:30 [Info] Moving index 111111:1112112:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T19:45:05.278+05:30 [Info] Moving index 121212:1121121:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-12T19:45:05.278+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T19:45:05.278+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-09-12T19:45:05.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.278+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9003] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.278+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Swap Rebalance - 4 SG, Swap 1 SG with 2 new nodes
2023-09-12T19:45:05.279+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T19:45:05.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.279+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T19:45:05.279+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T19:45:05.279+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T19:45:05.279+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T19:45:05.279+05:30 [Info] Moving index 5555:5151:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T19:45:05.279+05:30 [Info] Moving index 6666:6161:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-12T19:45:05.279+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.279+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.279+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.279+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.279+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.279+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.279+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-09-12T19:45:05.279+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T19:45:05.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.279+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.279+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.279+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Swap Rebalance - 4 SG, Swap 1 node with 2 new nodes
2023-09-12T19:45:05.280+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-12T19:45:05.280+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-12T19:45:05.280+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-12T19:45:05.280+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008 127.0.0.1:9006]
2023-09-12T19:45:05.280+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.280+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.280+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.281+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.281+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.281+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.281+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-12T19:45:05.281+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T19:45:05.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.281+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.281+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003] [127.0.0.1:9008] [127.0.0.1:9007]]
2023-09-12T19:45:05.281+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.281+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9008] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.281+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.281+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Swap Rebalance - 4 SG, Swap 1 empty node with 2 new nodes
2023-09-12T19:45:05.282+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-12T19:45:05.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-09-12T19:45:05.282+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T19:45:05.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.282+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-09-12T19:45:05.282+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9006
2023-09-12T19:45:05.282+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9006
2023-09-12T19:45:05.282+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9006
2023-09-12T19:45:05.282+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9006
2023-09-12T19:45:05.282+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9006
2023-09-12T19:45:05.282+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket6,,,idx2,1) on 127.0.0.1:9006
2023-09-12T19:45:05.282+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.282+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Swap Rebalance - 1 SG, Swap 1 node - Failed swap rebalance
2023-09-12T19:45:05.283+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-12T19:45:05.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-12T19:45:05.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-12T19:45:05.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-12T19:45:05.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T19:45:05.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9008 as replacement node for deleted node 127.0.0.1:9004.
2023-09-12T19:45:05.283+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.283+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.283+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.283+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.283+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 600000000 Units 4000
2023-09-12T19:45:05.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 500000000 Units 4100 Tenants 0
2023-09-12T19:45:05.283+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008]]
2023-09-12T19:45:05.283+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Swap Rebalance - 1 SG, Swap 2 node - server group mismatch
2023-09-12T19:45:05.283+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-12T19:45:05.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-12T19:45:05.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9002 127.0.0.1:9001]
2023-09-12T19:45:05.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9004]
2023/09/12 19:45:05 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 subcluster, Enough Capacity
2023-09-12T19:45:05.285+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.286+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 600000000 Units 4500 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 600000000 Units 4500 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 600000000 Units 4100 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 600000000 Units 4100 Tenants 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity
2023-09-12T19:45:05.287+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-12T19:45:05.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T19:45:05.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.287+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.287+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 on any target
2023-09-12T19:45:05.287+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 on any target
2023-09-12T19:45:05.287+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 on any target
2023-09-12T19:45:05.287+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.287+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.287+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 19:45:05 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 node, Pair node not deleted(Failed swap rebalance of 1 node)
2023-09-12T19:45:05.289+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001]
2023-09-12T19:45:05.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001]
2023-09-12T19:45:05.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004]
2023-09-12T19:45:05.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9009 as replacement node for deleted node 127.0.0.1:9001.
2023-09-12T19:45:05.289+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-12T19:45:05.289+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-12T19:45:05.289+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-12T19:45:05.289+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-12T19:45:05.289+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 600000000 Units 4000
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 500000000 Units 4100 Tenants 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9004 127.0.0.1:9009] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9004 127.0.0.1:9009]]
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9009]
2023-09-12T19:45:05.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T19:45:05.290+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T19:45:05.290+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T19:45:05.290+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T19:45:05.290+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.290+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.290+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.290+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 node, Pair node already deleted
2023-09-12T19:45:05.291+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002]
2023-09-12T19:45:05.291+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002]
2023-09-12T19:45:05.291+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes []
2023-09-12T19:45:05.291+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.291+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-12T19:45:05.291+05:30 [Info] Planner::moveTenantsFromDeletedNodes Pair node not found for deleted node 127.0.0.1:9002.
2023-09-12T19:45:05.291+05:30 [Error] Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/09/12 19:45:05 Expected error Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 subcluster, empty nodes
2023-09-12T19:45:05.292+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9005 127.0.0.1:9007 127.0.0.1:9008]
2023-09-12T19:45:05.292+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-09-12T19:45:05.292+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-09-12T19:45:05.292+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-09-12T19:45:05.292+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-09-12T19:45:05.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-12T19:45:05.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 800000000 Units 7000 Tenants 0
2023-09-12T19:45:05.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-12T19:45:05.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.292+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.292+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9002] with len 1. Skipping replica repair attempt.
2023-09-12T19:45:05.292+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 subcluster, Deleted Nodes more than added nodes
2023-09-12T19:45:05.293+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.293+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.293+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T19:45:05.293+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-09-12T19:45:05.293+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 1
2023-09-12T19:45:05.293+05:30 [Error] Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/09/12 19:45:05 Expected error Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 node, Add 1 node in, server group mismatch
2023-09-12T19:45:05.294+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9006]
2023-09-12T19:45:05.294+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9006]
2023-09-12T19:45:05.294+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9003]
2023-09-12T19:45:05.294+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9007]
2023/09/12 19:45:05 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 node, Pair node exists
2023-09-12T19:45:05.294+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-12T19:45:05.294+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-12T19:45:05.294+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-12T19:45:05.294+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.294+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-12T19:45:05.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T19:45:05.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.294+05:30 [Info] Planner::moveTenantsFromDeletedNodes No replacement node found for deleted node 127.0.0.1:9004.
2023-09-12T19:45:05.294+05:30 [Error] Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/09/12 19:45:05 Expected error Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 subcluster, No nodes under LWM
2023-09-12T19:45:05.295+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-12T19:45:05.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-12T19:45:05.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-12T19:45:05.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.295+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-12T19:45:05.295+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 19:45:05 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity, Partial Subcluster
2023-09-12T19:45:05.296+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T19:45:05.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T19:45:05.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 100000000 UnitsUsage 500
2023-09-12T19:45:05.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 500
2023-09-12T19:45:05.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 200000000 Units 1000
2023-09-12T19:45:05.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 200000000 Units 1000
2023-09-12T19:45:05.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-12T19:45:05.296+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9006]
2023-09-12T19:45:05.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-12T19:45:05.296+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 19:45:05 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 2 SG, Move out 1 non-empty and 1 empty node
2023-09-12T19:45:05.297+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9007 127.0.0.1:9004]
2023-09-12T19:45:05.297+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-12T19:45:05.297+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-12T19:45:05.297+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-09-12T19:45:05.297+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9008]
2023-09-12T19:45:05.297+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.298+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.298+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.298+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.298+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.298+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.298+05:30 [Info] Moving index 171717:1171171:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.298+05:30 [Info] Moving index 141414:1141141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-12T19:45:05.298+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 0 Units 0
2023-09-12T19:45:05.298+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-12T19:45:05.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-12T19:45:05.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-12T19:45:05.298+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9008 127.0.0.1:9001]]
2023-09-12T19:45:05.298+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM
2023-09-12T19:45:05.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.299+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.299+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.299+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.299+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.299+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T19:45:05.299+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.299+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.299+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-12T19:45:05.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-12T19:45:05.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-12T19:45:05.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-12T19:45:05.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-12T19:45:05.299+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.299+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 2 Subclusters, 1 below LWM, 1 above HWM
2023-09-12T19:45:05.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.300+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.300+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.300+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.300+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.300+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T19:45:05.300+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.300+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.300+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-12T19:45:05.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-12T19:45:05.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 600000000 Units 4000 Tenants 0
2023-09-12T19:45:05.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-12T19:45:05.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 600000000 Units 4000 Tenants 0
2023-09-12T19:45:05.300+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.300+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 3 Subclusters, 1 empty, 1 Above HWM, 1 below LWM
2023-09-12T19:45:05.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-12T19:45:05.301+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.301+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.301+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.301+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.301+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T19:45:05.301+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.301+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.301+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.302+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.302+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.302+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.302+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.302+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.302+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.302+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-09-12T19:45:05.302+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-09-12T19:45:05.302+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-12T19:45:05.302+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 2 Subclusters, 1 above LWM/below HWM, 1 empty
2023-09-12T19:45:05.303+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-12T19:45:05.303+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-12T19:45:05.303+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.303+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 2 Subclusters, Both above LWM/below HWM
2023-09-12T19:45:05.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-12T19:45:05.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-09-12T19:45:05.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-12T19:45:05.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-09-12T19:45:05.304+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.304+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-12T19:45:05.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-12T19:45:05.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-09-12T19:45:05.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-12T19:45:05.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-09-12T19:45:05.304+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.304+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM (partial replica repair)
2023-09-12T19:45:05.305+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.305+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 550000000 Units 5500 Tenants 0
2023-09-12T19:45:05.305+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.305+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-09-12T19:45:05.305+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-09-12T19:45:05.305+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.305+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.305+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.305+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T19:45:05.305+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.305+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.305+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-12T19:45:05.305+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-12T19:45:05.305+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-12T19:45:05.305+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-12T19:45:05.305+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-12T19:45:05.305+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.305+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM(full replica repair)
2023-09-12T19:45:05.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-12T19:45:05.306+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.306+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx1,1) on 127.0.0.1:9001
2023-09-12T19:45:05.306+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9001
2023-09-12T19:45:05.306+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx1,1) on 127.0.0.1:9001
2023-09-12T19:45:05.306+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9001
2023-09-12T19:45:05.306+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9001
2023-09-12T19:45:05.306+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,1) on 127.0.0.1:9001
2023-09-12T19:45:05.306+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9004 127.0.0.1:9001]]
2023-09-12T19:45:05.306+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9001]
2023-09-12T19:45:05.306+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.306+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-12T19:45:05.306+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.306+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.306+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-12T19:45:05.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-12T19:45:05.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-12T19:45:05.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-12T19:45:05.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-12T19:45:05.306+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.306+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 ScaleIn- 2 Subclusters, Both below LWM, Positive Case
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.307+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.307+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.307+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.307+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.307+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.307+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.307+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-09-12T19:45:05.307+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2023-09-12T19:45:05.307+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-12T19:45:05.307+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.307+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9003 SG sg1 Memory 0 Units 0
2023-09-12T19:45:05.307+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9006 SG sg3 Memory 0 Units 0
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 ScaleIn- 2 Subclusters, One below LWM/ 1 Empty
2023-09-12T19:45:05.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-12T19:45:05.308+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.308+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. No ScaleIn.
2023-09-12T19:45:05.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-12T19:45:05.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-12T19:45:05.308+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.308+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.308+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.308+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.308+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.309+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-09-12T19:45:05.309+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.309+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.309+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.309+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.309+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.309+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.309+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-09-12T19:45:05.309+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.309+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.309+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-09-12T19:45:05.309+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.309+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-12T19:45:05.309+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. ScaleIn.
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.310+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.310+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-12T19:45:05.310+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-09-12T19:45:05.310+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.310+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.310+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-09-12T19:45:05.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-12T19:45:05.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-12T19:45:05.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-09-12T19:45:05.310+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-12T19:45:05.310+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-09-12T19:45:05.310+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-09-12T19:45:05.310+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Rebalance - 1 Subcluster, Below HWM (partial replica repair)
2023-09-12T19:45:05.311+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-09-12T19:45:05.311+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 350000000 Units 500 Tenants 0
2023-09-12T19:45:05.311+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.311+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-09-12T19:45:05.311+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-09-12T19:45:05.311+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-12T19:45:05.311+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-09-12T19:45:05.311+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 500000000 Units 800 Tenants 0
2023-09-12T19:45:05.311+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-12T19:45:05.311+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Resume - 1 tenant, Empty node in cluster.
2023-09-12T19:45:05.312+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-12T19:45:05.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.312+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.312+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.313+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-12T19:45:05.313+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-12T19:45:05.313+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Resume - 1 tenant, No empty node in cluster.
2023-09-12T19:45:05.314+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-12T19:45:05.314+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.314+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.314+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.314+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.314+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.314+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.314+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.314+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-12T19:45:05.314+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.314+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Resume - 1 tenant, No node below LWM in the cluster.
2023-09-12T19:45:05.316+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-12T19:45:05.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 5000 Tenants 0
2023-09-12T19:45:05.316+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 5000 Tenants 0
2023-09-12T19:45:05.316+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.316+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-12T19:45:05.317+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM []
2023/09/12 19:45:05 Expected error No SubCluster Below Low Usage Threshold
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Resume - 1 tenant, Not enough capacity in the cluster.
2023-09-12T19:45:05.317+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-12T19:45:05.318+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.318+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.318+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-12T19:45:05.318+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-12T19:45:05.318+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.318+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-12T19:45:05.318+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.318+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250
2023-09-12T19:45:05.318+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-09-12T19:45:05.318+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250 on any target
2023/09/12 19:45:05 Expected error Not Enough Capacity To Place Tenant
--- PASS: TestTenantAwarePlanner (0.11s)
=== RUN TestPlanDuringHeterogenousScaleup
2023/09/12 19:45:05 In TestPlanDuringHeterogenousScaleup()
=== RUN TestPlanDuringHeterogenousScaleup/GreedyPlanner
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T19:45:05.320+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T19:45:05.322+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T19:45:05.324+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-09-12T19:45:05.326+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-09-12T19:45:05.328+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T19:45:05.330+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-09-12T19:45:05.332+05:30 [Info] Using greedy index placement for index 987654
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-09-12T19:45:05.334+05:30 [Info] Using greedy index placement for index 987654
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T19:45:05.337+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.2180081556498616
2023-09-12T19:45:05.434+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:05.434+05:30 [Info] Score: 0.5118702120133598
2023-09-12T19:45:05.434+05:30 [Info] variation: 1.0237404240267196
2023-09-12T19:45:05.434+05:30 [Info] ElapsedTime: 97ms
2023-09-12T19:45:05.434+05:30 [Info] ConvergenceTime: 95ms
2023-09-12T19:45:05.434+05:30 [Info] Iteration: 6800
2023-09-12T19:45:05.434+05:30 [Info] Move: 3863
2023-09-12T19:45:05.434+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.434+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.434+05:30 [Info] Indexer Memory Mean 126888575449 (118.174G)
2023-09-12T19:45:05.434+05:30 [Info] Indexer Memory Deviation 80354383758 (74.8359G) (63.33%)
2023-09-12T19:45:05.434+05:30 [Info] Indexer Memory Utilization 2.3004
2023-09-12T19:45:05.434+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:05.434+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:05.434+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:05.434+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.434+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.434+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.434+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.434+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.434+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.434+05:30 [Info] Indexer Data Size Mean 18082106963 (16.8403G)
2023-09-12T19:45:05.434+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (141.42%)
2023-09-12T19:45:05.434+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.434+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.434+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.434+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.434+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.434+05:30 [Info] Number of indexes: 13
2023-09-12T19:45:05.434+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.434+05:30 [Info] Avg Index Size: 29281978949 (27.271G)
2023-09-12T19:45:05.434+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:05.434+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T19:45:05.434+05:30 [Info] Avg Index Cpu: 3.5385
2023-09-12T19:45:05.434+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:05.434+05:30 [Info] Num Estimation Run: 11
2023-09-12T19:45:05.435+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:05.435+05:30 [Info] CPU Quota 27
2023-09-12T19:45:05.435+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.435+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.435+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Total iteration: 6810
2023-09-12T19:45:05.435+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.435+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.435+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.435+05:30 [Info] RandomMove time: 0ns
2023-09-12T19:45:05.435+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T19:45:05.435+05:30 [Info] ExhaustMove time: 41ms
2023-09-12T19:45:05.435+05:30 [Info] ExhaustMove call: 6810
2023-09-12T19:45:05.435+05:30 [Info] ExhaustMove average time: 6us
2023-09-12T19:45:05.435+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.435+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.435+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.435+05:30 [Info]
2023-09-12T19:45:05.435+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:05.435+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T19:45:05.435+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.37390490588193165 allowDDLDuringScaleup:true
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info]
2023-09-12T19:45:05.435+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:05.435+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.435+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7501886306380632 allowDDLDuringScaleup:true
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:13113828142206585723, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info]
2023-09-12T19:45:05.435+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:05.435+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:0 (0), data:0 (0) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T19:45:05.435+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.07590646348000514 allowDDLDuringScaleup:true
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.435+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.435+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.435+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.435+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.436+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.436+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.436+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.436+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T19:45:05.438+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0155476961840748
2023-09-12T19:45:05.505+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:05.505+05:30 [Info] Score: 0.28937833136341934
2023-09-12T19:45:05.505+05:30 [Info] variation: 0.5787566627268387
2023-09-12T19:45:05.505+05:30 [Info] ElapsedTime: 66ms
2023-09-12T19:45:05.505+05:30 [Info] ConvergenceTime: 64ms
2023-09-12T19:45:05.505+05:30 [Info] Iteration: 4200
2023-09-12T19:45:05.505+05:30 [Info] Move: 2673
2023-09-12T19:45:05.505+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.505+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.505+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-12T19:45:05.505+05:30 [Info] Indexer Memory Deviation 65295744085 (60.8114G) (45.04%)
2023-09-12T19:45:05.505+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-12T19:45:05.505+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:05.505+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:05.505+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:05.505+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.505+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.505+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.505+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.505+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.505+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.505+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-12T19:45:05.505+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-12T19:45:05.505+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.505+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.505+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.505+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.505+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.505+05:30 [Info] Number of indexes: 14
2023-09-12T19:45:05.505+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.505+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-09-12T19:45:05.505+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:05.505+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T19:45:05.505+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-12T19:45:05.505+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:05.505+05:30 [Info] Num Estimation Run: 11
2023-09-12T19:45:05.505+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.505+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:05.505+05:30 [Info] CPU Quota 27
2023-09-12T19:45:05.505+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.505+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.505+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.505+05:30 [Info] Total iteration: 4210
2023-09-12T19:45:05.505+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.505+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.505+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.505+05:30 [Info] RandomMove time: 22ms
2023-09-12T19:45:05.506+05:30 [Info] RandomMove call: 4199 (empty index 0)
2023-09-12T19:45:05.506+05:30 [Info] RandomMove average time: 5us
2023-09-12T19:45:05.506+05:30 [Info] ExhaustMove time: 76us
2023-09-12T19:45:05.506+05:30 [Info] ExhaustMove call: 11
2023-09-12T19:45:05.506+05:30 [Info] ExhaustMove average time: 6us
2023-09-12T19:45:05.506+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.506+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.506+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.506+05:30 [Info]
2023-09-12T19:45:05.506+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:05.506+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T19:45:05.506+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32726796943638176 allowDDLDuringScaleup:true
2023-09-12T19:45:05.506+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.506+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.506+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.506+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.506+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.506+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.506+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.506+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.506+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.506+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.506+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.506+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.506+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.506+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.506+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.506+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.506+05:30 [Info]
2023-09-12T19:45:05.506+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:05.506+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.506+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-09-12T19:45:05.506+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.506+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.506+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.506+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.506+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.506+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.506+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.506+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.506+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.507+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.507+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.507+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.507+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.507+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.507+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.507+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.507+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.507+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:18136956766449057423, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.507+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.507+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.507+05:30 [Info]
2023-09-12T19:45:05.507+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:05.507+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.507+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-12T19:45:05.507+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.507+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.507+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.507+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.507+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.507+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.507+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.507+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.507+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.507+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.507+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.507+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.507+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.507+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.507+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.507+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.507+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.507+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:18136956766449057423, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.507+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.507+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T19:45:05.510+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.7080370846629772
2023-09-12T19:45:05.545+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:05.545+05:30 [Info] Score: 0.13929460298637122
2023-09-12T19:45:05.545+05:30 [Info] variation: 0.27858920597274245
2023-09-12T19:45:05.545+05:30 [Info] ElapsedTime: 35ms
2023-09-12T19:45:05.545+05:30 [Info] ConvergenceTime: 1ms
2023-09-12T19:45:05.545+05:30 [Info] Iteration: 2
2023-09-12T19:45:05.545+05:30 [Info] Move: 2
2023-09-12T19:45:05.545+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.545+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.545+05:30 [Info] Indexer Memory Mean 163052789375 (151.855G)
2023-09-12T19:45:05.545+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (55.72%)
2023-09-12T19:45:05.545+05:30 [Info] Indexer Memory Utilization 2.9561
2023-09-12T19:45:05.545+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:05.545+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:05.545+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:05.545+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.545+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.545+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.545+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.545+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.545+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.545+05:30 [Info] Indexer Data Size Mean 54246320889 (50.5208G)
2023-09-12T19:45:05.545+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:05.545+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.545+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.545+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.545+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.545+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.545+05:30 [Info] Number of indexes: 15
2023-09-12T19:45:05.545+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.545+05:30 [Info] Avg Index Size: 32610557875 (30.3709G)
2023-09-12T19:45:05.545+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:05.545+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T19:45:05.545+05:30 [Info] Avg Index Cpu: 3.0667
2023-09-12T19:45:05.545+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:05.545+05:30 [Info] Num Estimation Run: 11
2023-09-12T19:45:05.545+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.545+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:05.545+05:30 [Info] CPU Quota 27
2023-09-12T19:45:05.545+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.545+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.545+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.545+05:30 [Info] Total iteration: 6242
2023-09-12T19:45:05.545+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.545+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.545+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.545+05:30 [Info] RandomMove time: 9us
2023-09-12T19:45:05.545+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-09-12T19:45:05.545+05:30 [Info] RandomMove average time: 9us
2023-09-12T19:45:05.545+05:30 [Info] ExhaustMove time: 12us
2023-09-12T19:45:05.545+05:30 [Info] ExhaustMove call: 1
2023-09-12T19:45:05.545+05:30 [Info] ExhaustMove average time: 12us
2023-09-12T19:45:05.545+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.545+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.545+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.545+05:30 [Info]
2023-09-12T19:45:05.546+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:05.546+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.546+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5575132033129112 allowDDLDuringScaleup:true
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:4437796498939913500, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info]
2023-09-12T19:45:05.546+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:05.546+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.546+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3168776165275712 allowDDLDuringScaleup:true
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:4437796498939913500, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info]
2023-09-12T19:45:05.546+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:05.546+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.546+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3256091801595177 allowDDLDuringScaleup:true
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.546+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.546+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.546+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.546+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:4437796498939913500, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.547+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.547+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-09-12T19:45:05.548+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6856271841119315
2023-09-12T19:45:05.552+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T19:45:05.552+05:30 [Info] Score: 0.36056429186996203
2023-09-12T19:45:05.552+05:30 [Info] variation: 0.7211285837399241
2023-09-12T19:45:05.552+05:30 [Info] ElapsedTime: 3ms
2023-09-12T19:45:05.552+05:30 [Info] ConvergenceTime: 1ms
2023-09-12T19:45:05.552+05:30 [Info] Iteration: 1
2023-09-12T19:45:05.552+05:30 [Info] Move: 1
2023-09-12T19:45:05.552+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.552+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.552+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-12T19:45:05.552+05:30 [Info] Indexer Memory Deviation 106575253176 (99.2559G) (73.52%)
2023-09-12T19:45:05.552+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-12T19:45:05.552+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:05.552+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:05.552+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:05.552+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.552+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.552+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.552+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.552+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.552+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.552+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-12T19:45:05.552+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-12T19:45:05.552+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.552+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.552+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.552+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.552+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.552+05:30 [Info] Number of indexes: 14
2023-09-12T19:45:05.552+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.552+05:30 [Info] Avg Index Size: 23315671818 (21.7144G)
2023-09-12T19:45:05.552+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:05.552+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T19:45:05.552+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-12T19:45:05.553+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:05.553+05:30 [Info] Num Estimation Run: 230
2023-09-12T19:45:05.553+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:05.553+05:30 [Info] CPU Quota 27
2023-09-12T19:45:05.553+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.553+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.553+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Total iteration: 522
2023-09-12T19:45:05.553+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.553+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.553+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.553+05:30 [Info] RandomMove time: 7us
2023-09-12T19:45:05.553+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-09-12T19:45:05.553+05:30 [Info] RandomMove average time: 7us
2023-09-12T19:45:05.553+05:30 [Info] ExhaustMove time: 1ms
2023-09-12T19:45:05.553+05:30 [Info] ExhaustMove call: 220
2023-09-12T19:45:05.553+05:30 [Info] ExhaustMove average time: 5us
2023-09-12T19:45:05.553+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.553+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.553+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.553+05:30 [Info]
2023-09-12T19:45:05.553+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:05.553+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.553+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.7021056124497257 allowDDLDuringScaleup:true
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:4154652987479071560, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info]
2023-09-12T19:45:05.553+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:05.553+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:0 (0), data:0 (0) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T19:45:05.553+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.05661804908412874 allowDDLDuringScaleup:true
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info]
2023-09-12T19:45:05.553+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:05.553+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.553+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.553+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.553+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.553+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:4154652987479071560, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.553+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.554+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-09-12T19:45:05.556+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3952038770958589
2023-09-12T19:45:05.559+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T19:45:05.559+05:30 [Info] Score: 0.36056429186996203
2023-09-12T19:45:05.559+05:30 [Info] variation: 0.7211285837399241
2023-09-12T19:45:05.559+05:30 [Info] ElapsedTime: 3ms
2023-09-12T19:45:05.559+05:30 [Info] ConvergenceTime: 1ms
2023-09-12T19:45:05.559+05:30 [Info] Iteration: 1
2023-09-12T19:45:05.559+05:30 [Info] Move: 1
2023-09-12T19:45:05.559+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.559+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.559+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-12T19:45:05.559+05:30 [Info] Indexer Memory Deviation 106575253176 (99.2559G) (73.52%)
2023-09-12T19:45:05.559+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-12T19:45:05.559+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:05.560+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:05.560+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:05.560+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.560+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.560+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.560+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.560+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.560+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.560+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-12T19:45:05.560+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-12T19:45:05.560+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.560+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.560+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.560+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.560+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Number of indexes: 14
2023-09-12T19:45:05.560+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.560+05:30 [Info] Avg Index Size: 23315671818 (21.7144G)
2023-09-12T19:45:05.560+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:05.560+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T19:45:05.560+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-12T19:45:05.560+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:05.560+05:30 [Info] Num Estimation Run: 230
2023-09-12T19:45:05.560+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:05.560+05:30 [Info] CPU Quota 27
2023-09-12T19:45:05.560+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.560+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.560+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Total iteration: 524
2023-09-12T19:45:05.560+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.560+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.560+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.560+05:30 [Info] RandomMove time: 7us
2023-09-12T19:45:05.560+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-09-12T19:45:05.560+05:30 [Info] RandomMove average time: 7us
2023-09-12T19:45:05.560+05:30 [Info] ExhaustMove time: 1ms
2023-09-12T19:45:05.560+05:30 [Info] ExhaustMove call: 220
2023-09-12T19:45:05.560+05:30 [Info] ExhaustMove average time: 5us
2023-09-12T19:45:05.560+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.560+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.560+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.560+05:30 [Info]
2023-09-12T19:45:05.560+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:05.560+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.560+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7021056124497257 allowDDLDuringScaleup:true
2023-09-12T19:45:05.560+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.560+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.560+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.560+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.560+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.560+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.560+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.560+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.560+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.560+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.560+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.560+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.560+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:2444719218206222130, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.560+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.560+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.560+05:30 [Info]
2023-09-12T19:45:05.560+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:05.560+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:0 (0), data:0 (0) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-12T19:45:05.560+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.05661804908412874 allowDDLDuringScaleup:true
2023-09-12T19:45:05.560+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.560+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.560+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.561+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.561+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.561+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.561+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.561+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.561+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.561+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.561+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.561+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.561+05:30 [Info]
2023-09-12T19:45:05.561+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:05.561+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-12T19:45:05.561+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-12T19:45:05.561+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.561+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.561+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.561+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.561+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.561+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.561+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.561+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.561+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.561+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.561+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.561+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.561+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.561+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:2444719218206222130, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.561+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.561+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-12T19:45:05.563+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.1877979057133785
2023-09-12T19:45:05.563+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T19:45:05.563+05:30 [Info] Score: 0.4863052536963559
2023-09-12T19:45:05.563+05:30 [Info] variation: 0.9726105073927118
2023-09-12T19:45:05.563+05:30 [Info] ElapsedTime: 234us
2023-09-12T19:45:05.563+05:30 [Info] ConvergenceTime: 179us
2023-09-12T19:45:05.563+05:30 [Info] Iteration: 1
2023-09-12T19:45:05.563+05:30 [Info] Move: 1
2023-09-12T19:45:05.563+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.563+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.563+05:30 [Info] Indexer Memory Mean 14745215094 (13.7326G)
2023-09-12T19:45:05.563+05:30 [Info] Indexer Memory Deviation 7829819102 (7.29209G) (53.10%)
2023-09-12T19:45:05.563+05:30 [Info] Indexer Memory Utilization 1.6384
2023-09-12T19:45:05.563+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-12T19:45:05.563+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-12T19:45:05.563+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-12T19:45:05.563+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.564+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.564+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.564+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.564+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.564+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.564+05:30 [Info] Indexer Data Size Mean 2745215094 (2.55668G)
2023-09-12T19:45:05.564+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (141.42%)
2023-09-12T19:45:05.564+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.564+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.564+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.564+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.564+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.564+05:30 [Info] Number of indexes: 4
2023-09-12T19:45:05.564+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.564+05:30 [Info] Avg Index Size: 11058911320 (10.2994G)
2023-09-12T19:45:05.564+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-12T19:45:05.564+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-12T19:45:05.564+05:30 [Info] Avg Index Cpu: 0.7500
2023-09-12T19:45:05.564+05:30 [Info] Max Index Cpu: 1.0000
2023-09-12T19:45:05.564+05:30 [Info] Num Estimation Run: 7
2023-09-12T19:45:05.564+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.564+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-12T19:45:05.564+05:30 [Info] CPU Quota 8
2023-09-12T19:45:05.564+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.564+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.564+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.564+05:30 [Info] Total iteration: 8
2023-09-12T19:45:05.564+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.564+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.564+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.564+05:30 [Info] RandomMove time: 0ns
2023-09-12T19:45:05.564+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T19:45:05.564+05:30 [Info] ExhaustMove time: 51us
2023-09-12T19:45:05.564+05:30 [Info] ExhaustMove call: 8
2023-09-12T19:45:05.564+05:30 [Info] ExhaustMove average time: 6us
2023-09-12T19:45:05.564+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.564+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.564+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.564+05:30 [Info]
2023-09-12T19:45:05.564+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-12T19:45:05.564+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:05.564+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.3390930527717129 allowDDLDuringScaleup:true
2023-09-12T19:45:05.564+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.564+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.564+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.564+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.564+05:30 [Info]
2023-09-12T19:45:05.564+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-12T19:45:05.564+05:30 [Info] Indexer total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:0 (0), data:0 (0) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:05.564+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0813823326652111 allowDDLDuringScaleup:true
2023-09-12T19:45:05.564+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.564+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.564+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.564+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.564+05:30 [Info]
2023-09-12T19:45:05.564+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-12T19:45:05.564+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:05.564+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.779524614563076 allowDDLDuringScaleup:true
2023-09-12T19:45:05.564+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.564+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.564+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.564+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.564+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.564+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:3575613156166024602, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.564+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.564+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-09-12T19:45:05.566+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-12T19:45:05.566+05:30 [Warn] Definition 987654 Instance 2149196796916264333 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-09-12T19:45:05.566+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-12T19:45:05.566+05:30 [Warn] Definition 987654 Instance 2149196796916264333 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-09-12T19:45:05.566+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6702149941767832
2023-09-12T19:45:05.627+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:05.627+05:30 [Info] Score: 0.25290029571859646
2023-09-12T19:45:05.627+05:30 [Info] variation: 0.5058005914371929
2023-09-12T19:45:05.627+05:30 [Info] ElapsedTime: 60ms
2023-09-12T19:45:05.627+05:30 [Info] ConvergenceTime: 56ms
2023-09-12T19:45:05.627+05:30 [Info] Iteration: 3800
2023-09-12T19:45:05.627+05:30 [Info] Move: 2409
2023-09-12T19:45:05.627+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.627+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.627+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-09-12T19:45:05.627+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-09-12T19:45:05.627+05:30 [Info] Indexer Memory Utilization 1.9434
2023-09-12T19:45:05.627+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-12T19:45:05.627+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-12T19:45:05.627+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-12T19:45:05.627+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.627+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.627+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.627+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.627+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.627+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.627+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-09-12T19:45:05.627+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-09-12T19:45:05.627+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.627+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.627+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.627+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.627+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.627+05:30 [Info] Number of indexes: 5
2023-09-12T19:45:05.627+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.627+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-09-12T19:45:05.627+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-12T19:45:05.627+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-12T19:45:05.627+05:30 [Info] Avg Index Cpu: 0.6000
2023-09-12T19:45:05.627+05:30 [Info] Max Index Cpu: 1.0000
2023-09-12T19:45:05.627+05:30 [Info] Num Estimation Run: 7
2023-09-12T19:45:05.628+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.628+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-12T19:45:05.628+05:30 [Info] CPU Quota 8
2023-09-12T19:45:05.628+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.628+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.628+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.628+05:30 [Info] Total iteration: 3980
2023-09-12T19:45:05.628+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.628+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.628+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.628+05:30 [Info] RandomMove time: 19ms
2023-09-12T19:45:05.628+05:30 [Info] RandomMove call: 3799 (empty index 0)
2023-09-12T19:45:05.628+05:30 [Info] RandomMove average time: 5us
2023-09-12T19:45:05.628+05:30 [Info] ExhaustMove time: 6us
2023-09-12T19:45:05.628+05:30 [Info] ExhaustMove call: 1
2023-09-12T19:45:05.628+05:30 [Info] ExhaustMove average time: 6us
2023-09-12T19:45:05.628+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.628+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.628+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.628+05:30 [Info]
2023-09-12T19:45:05.628+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-12T19:45:05.628+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:05.628+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-09-12T19:45:05.628+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.628+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.628+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.628+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.628+05:30 [Info]
2023-09-12T19:45:05.628+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-12T19:45:05.628+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:05.628+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-09-12T19:45:05.628+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.628+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.628+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.628+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.628+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.628+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:2149196796916264333, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.628+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.628+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.628+05:30 [Info]
2023-09-12T19:45:05.628+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-12T19:45:05.628+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:05.628+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-09-12T19:45:05.628+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.628+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.628+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.628+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.628+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.628+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:2149196796916264333, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.628+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.628+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-09-12T19:45:05.631+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-12T19:45:05.631+05:30 [Warn] Definition 987654 Instance 10622606725595229209 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-09-12T19:45:05.631+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-12T19:45:05.631+05:30 [Warn] Definition 987654 Instance 10622606725595229209 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-09-12T19:45:05.631+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.002589402018371
2023-09-12T19:45:05.695+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:05.695+05:30 [Info] Score: 0.25290029571859646
2023-09-12T19:45:05.695+05:30 [Info] variation: 0.5058005914371929
2023-09-12T19:45:05.695+05:30 [Info] ElapsedTime: 63ms
2023-09-12T19:45:05.695+05:30 [Info] ConvergenceTime: 61ms
2023-09-12T19:45:05.695+05:30 [Info] Iteration: 3600
2023-09-12T19:45:05.695+05:30 [Info] Move: 2413
2023-09-12T19:45:05.695+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.695+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.695+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-09-12T19:45:05.695+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-09-12T19:45:05.695+05:30 [Info] Indexer Memory Utilization 1.9434
2023-09-12T19:45:05.695+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-12T19:45:05.695+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-12T19:45:05.695+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-12T19:45:05.695+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.695+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.695+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.695+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.695+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.695+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.695+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-09-12T19:45:05.695+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-09-12T19:45:05.695+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.695+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.695+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.695+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.695+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.695+05:30 [Info] Number of indexes: 5
2023-09-12T19:45:05.695+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.695+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-09-12T19:45:05.695+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-12T19:45:05.695+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-12T19:45:05.695+05:30 [Info] Avg Index Cpu: 0.6000
2023-09-12T19:45:05.695+05:30 [Info] Max Index Cpu: 1.0000
2023-09-12T19:45:05.695+05:30 [Info] Num Estimation Run: 7
2023-09-12T19:45:05.695+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.695+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-12T19:45:05.695+05:30 [Info] CPU Quota 8
2023-09-12T19:45:05.695+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.695+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.695+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.695+05:30 [Info] Total iteration: 3606
2023-09-12T19:45:05.695+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.695+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.695+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.695+05:30 [Info] RandomMove time: 20ms
2023-09-12T19:45:05.695+05:30 [Info] RandomMove call: 3599 (empty index 0)
2023-09-12T19:45:05.695+05:30 [Info] RandomMove average time: 5us
2023-09-12T19:45:05.695+05:30 [Info] ExhaustMove time: 75us
2023-09-12T19:45:05.695+05:30 [Info] ExhaustMove call: 7
2023-09-12T19:45:05.695+05:30 [Info] ExhaustMove average time: 10us
2023-09-12T19:45:05.696+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.696+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.696+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.696+05:30 [Info]
2023-09-12T19:45:05.696+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-12T19:45:05.696+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:05.696+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-09-12T19:45:05.696+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.696+05:30 [Info] Index name:nonEquiv 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.696+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.696+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.696+05:30 [Info]
2023-09-12T19:45:05.696+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-12T19:45:05.696+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:05.696+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-09-12T19:45:05.696+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.696+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.696+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.696+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.696+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.696+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:10622606725595229209, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.696+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.696+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.696+05:30 [Info]
2023-09-12T19:45:05.696+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-12T19:45:05.696+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:05.696+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-09-12T19:45:05.696+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.696+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.696+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.696+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.696+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.696+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:10622606725595229209, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.696+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.696+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T19:45:05.699+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2964535944160216
2023-09-12T19:45:05.720+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-12T19:45:05.731+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:45:05.731+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:45:05.733+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-12T19:45:05.737+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T19:45:05.738+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T19:45:05.739+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-12T19:45:05.842+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:05.842+05:30 [Info] Score: 0.1784816836053567
2023-09-12T19:45:05.842+05:30 [Info] variation: 0.3569633672107134
2023-09-12T19:45:05.842+05:30 [Info] ElapsedTime: 143ms
2023-09-12T19:45:05.842+05:30 [Info] ConvergenceTime: 137ms
2023-09-12T19:45:05.842+05:30 [Info] Iteration: 5500
2023-09-12T19:45:05.842+05:30 [Info] Move: 3760
2023-09-12T19:45:05.842+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.842+05:30 [Info] Using SAPlanner
2023-09-12T19:45:05.842+05:30 [Info] Indexer Memory Mean 154201322596 (143.611G)
2023-09-12T19:45:05.842+05:30 [Info] Indexer Memory Deviation 82829246465 (77.1407G) (53.72%)
2023-09-12T19:45:05.842+05:30 [Info] Indexer Memory Utilization 2.7956
2023-09-12T19:45:05.842+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:05.842+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:05.842+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:05.842+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:05.842+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:05.842+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:05.842+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.842+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:05.842+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:05.842+05:30 [Info] Indexer Data Size Mean 45394854109 (42.2773G)
2023-09-12T19:45:05.842+05:30 [Info] Indexer Data Size Deviation 8024752292 (7.47363G) (17.68%)
2023-09-12T19:45:05.842+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:05.842+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.842+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:05.842+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:05.842+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.842+05:30 [Info] Number of indexes: 20
2023-09-12T19:45:05.842+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:05.842+05:30 [Info] Avg Index Size: 23130198389 (21.5417G)
2023-09-12T19:45:05.842+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:05.842+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T19:45:05.842+05:30 [Info] Avg Index Cpu: 2.3000
2023-09-12T19:45:05.842+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:05.843+05:30 [Info] Num Estimation Run: 22
2023-09-12T19:45:05.843+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.843+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:05.843+05:30 [Info] CPU Quota 27
2023-09-12T19:45:05.843+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:05.843+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:05.843+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.843+05:30 [Info] Total iteration: 9024
2023-09-12T19:45:05.843+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:05.843+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:05.843+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:05.843+05:30 [Info] RandomMove time: 37ms
2023-09-12T19:45:05.843+05:30 [Info] RandomMove call: 5499 (empty index 0)
2023-09-12T19:45:05.843+05:30 [Info] RandomMove average time: 6us
2023-09-12T19:45:05.843+05:30 [Info] ExhaustMove time: 8us
2023-09-12T19:45:05.843+05:30 [Info] ExhaustMove call: 1
2023-09-12T19:45:05.843+05:30 [Info] ExhaustMove average time: 8us
2023-09-12T19:45:05.843+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:05.843+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:05.843+05:30 [Info] ----------------------------------------
2023-09-12T19:45:05.843+05:30 [Info]
2023-09-12T19:45:05.843+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:05.843+05:30 [Info] Indexer total memory:301827829691 (281.099G), mem:271267444887 (252.637G), overhead:30560384804 (28.4616G), min:34046140582 (31.7079G), data:34046140582 (31.7079G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:6
2023-09-12T19:45:05.843+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5018354321742201 allowDDLDuringScaleup:true
2023-09-12T19:45:05.843+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.843+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.843+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.843+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.843+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.843+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.843+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.843+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.843+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.843+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.843+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.843+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.843+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.843+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.843+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.843+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.843+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.843+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:13963091615009417521, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.843+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.843+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.843+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.843+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:13963091615009417521, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.843+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info]
2023-09-12T19:45:05.844+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:05.844+05:30 [Info] Indexer total memory:108440151874 (100.993G), mem:92108996936 (85.7832G), overhead:16331154938 (15.2096G), min:51069210873 (47.5619G), data:51069210873 (47.5619G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-12T19:45:05.844+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3444658974194678 allowDDLDuringScaleup:true
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:13963091615009417521, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:13963091615009417521, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:13963091615009417521, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info]
2023-09-12T19:45:05.844+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:05.844+05:30 [Info] Indexer total memory:122670760385 (114.246G), mem:99227525965 (92.4128G), overhead:23443234420 (21.8332G), min:51069210873 (47.5619G), data:51069210873 (47.5619G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-12T19:45:05.844+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.35369867040631203 allowDDLDuringScaleup:true
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:13963091615009417521, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:13963091615009417521, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.844+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.844+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:05.844+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:05.844+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:13963091615009417521, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:05.845+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:05.845+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:05 -------------------------------------------
2023/09/12 19:45:05 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T19:45:05.848+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.16298314584739637
2023-09-12T19:45:06.791+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:06.791+05:30 [Info] Score: 0.13739736706800032
2023-09-12T19:45:06.791+05:30 [Info] variation: 0.27479473413600064
2023-09-12T19:45:06.791+05:30 [Info] ElapsedTime: 942ms
2023-09-12T19:45:06.791+05:30 [Info] ConvergenceTime: 939ms
2023-09-12T19:45:06.791+05:30 [Info] Iteration: 7000
2023-09-12T19:45:06.791+05:30 [Info] Move: 4875
2023-09-12T19:45:06.791+05:30 [Info] ----------------------------------------
2023-09-12T19:45:06.791+05:30 [Info] Using SAPlanner
2023-09-12T19:45:06.791+05:30 [Info] Indexer Memory Mean 208747525973 (194.411G)
2023-09-12T19:45:06.791+05:30 [Info] Indexer Memory Deviation 77823744009 (72.479G) (37.28%)
2023-09-12T19:45:06.791+05:30 [Info] Indexer Memory Utilization 3.7845
2023-09-12T19:45:06.791+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:06.791+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:06.791+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:06.791+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:06.791+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:06.791+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:06.791+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:06.791+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:06.791+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:06.791+05:30 [Info] Indexer Data Size Mean 45221342736 (42.1157G)
2023-09-12T19:45:06.791+05:30 [Info] Indexer Data Size Deviation 7994079525 (7.44507G) (17.68%)
2023-09-12T19:45:06.791+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:06.791+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:06.791+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:06.791+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:06.791+05:30 [Info] ----------------------------------------
2023-09-12T19:45:06.791+05:30 [Info] Number of indexes: 20
2023-09-12T19:45:06.791+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:06.791+05:30 [Info] Avg Index Size: 31312128896 (29.1617G)
2023-09-12T19:45:06.791+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:06.791+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-12T19:45:06.791+05:30 [Info] Avg Index Cpu: 2.3000
2023-09-12T19:45:06.791+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:06.791+05:30 [Info] Num Estimation Run: 23
2023-09-12T19:45:06.791+05:30 [Info] ----------------------------------------
2023-09-12T19:45:06.791+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:06.791+05:30 [Info] CPU Quota 27
2023-09-12T19:45:06.791+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:06.791+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:06.791+05:30 [Info] ----------------------------------------
2023-09-12T19:45:06.791+05:30 [Info] Total iteration: 10946
2023-09-12T19:45:06.791+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:06.791+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:06.791+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:06.791+05:30 [Info] RandomMove time: 249ms
2023-09-12T19:45:06.791+05:30 [Info] RandomMove call: 6999 (empty index 0)
2023-09-12T19:45:06.791+05:30 [Info] RandomMove average time: 35us
2023-09-12T19:45:06.791+05:30 [Info] ExhaustMove time: 16us
2023-09-12T19:45:06.791+05:30 [Info] ExhaustMove call: 1
2023-09-12T19:45:06.791+05:30 [Info] ExhaustMove average time: 16us
2023-09-12T19:45:06.791+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:06.791+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:06.791+05:30 [Info] ----------------------------------------
2023-09-12T19:45:06.791+05:30 [Info]
2023-09-12T19:45:06.791+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:06.791+05:30 [Info] Indexer total memory:301697696161 (280.978G), mem:271137311357 (252.516G), overhead:30560384804 (28.4616G), min:33916007052 (31.5867G), data:33916007052 (31.5867G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:6
2023-09-12T19:45:06.792+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4097753531140166 allowDDLDuringScaleup:true
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:8559922532826252905, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:8559922532826252905, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info]
2023-09-12T19:45:06.792+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:06.792+05:30 [Info] Indexer total memory:337728715583 (314.534G), mem:256072940893 (238.487G), overhead:81655774690 (76.0479G), min:50874010578 (47.3801G), data:50874010578 (47.3801G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-12T19:45:06.792+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.470342252272453 allowDDLDuringScaleup:true
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.792+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.792+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.792+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:8559922532826252905, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.792+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:8559922532826252905, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:8559922532826252905, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info]
2023-09-12T19:45:06.793+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:06.793+05:30 [Info] Indexer total memory:122475560090 (114.064G), mem:99032325670 (92.231G), overhead:23443234420 (21.8332G), min:50874010578 (47.3801G), data:50874010578 (47.3801G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-12T19:45:06.793+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3198823946135304 allowDDLDuringScaleup:true
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:8559922532826252905, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:8559922532826252905, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:06.793+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:06.793+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:8559922532826252905, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:06.793+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:06.793+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:06 -------------------------------------------
2023/09/12 19:45:06 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T19:45:06.799+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.220964182131219
2023-09-12T19:45:07.089+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.089+05:30 [Info] Score: 0.16324776491504728
2023-09-12T19:45:07.089+05:30 [Info] variation: 0.32649552983009456
2023-09-12T19:45:07.089+05:30 [Info] ElapsedTime: 290ms
2023-09-12T19:45:07.089+05:30 [Info] ConvergenceTime: 288ms
2023-09-12T19:45:07.089+05:30 [Info] Iteration: 8400
2023-09-12T19:45:07.089+05:30 [Info] Move: 4533
2023-09-12T19:45:07.089+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.089+05:30 [Info] Using SAPlanner
2023-09-12T19:45:07.089+05:30 [Info] Indexer Memory Mean 157055841798 (146.27G)
2023-09-12T19:45:07.089+05:30 [Info] Indexer Memory Deviation 88674154216 (82.5842G) (56.46%)
2023-09-12T19:45:07.089+05:30 [Info] Indexer Memory Utilization 2.8474
2023-09-12T19:45:07.089+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:07.089+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:07.089+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:07.089+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:07.089+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:07.089+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:07.090+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.090+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:07.090+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.090+05:30 [Info] Indexer Data Size Mean 48249373312 (44.9357G)
2023-09-12T19:45:07.090+05:30 [Info] Indexer Data Size Deviation 4264682382 (3.97179G) (8.84%)
2023-09-12T19:45:07.090+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:07.090+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.090+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:07.090+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.090+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.090+05:30 [Info] Number of indexes: 28
2023-09-12T19:45:07.090+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:07.090+05:30 [Info] Avg Index Size: 16827411621 (15.6717G)
2023-09-12T19:45:07.090+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:07.090+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T19:45:07.090+05:30 [Info] Avg Index Cpu: 1.6429
2023-09-12T19:45:07.090+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:07.090+05:30 [Info] Num Estimation Run: 28
2023-09-12T19:45:07.090+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.090+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:07.090+05:30 [Info] CPU Quota 27
2023-09-12T19:45:07.090+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:07.090+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:07.090+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.090+05:30 [Info] Total iteration: 13482
2023-09-12T19:45:07.090+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:07.090+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:07.090+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:07.090+05:30 [Info] RandomMove time: 78ms
2023-09-12T19:45:07.090+05:30 [Info] RandomMove call: 8399 (empty index 0)
2023-09-12T19:45:07.090+05:30 [Info] RandomMove average time: 9us
2023-09-12T19:45:07.090+05:30 [Info] ExhaustMove time: 16us
2023-09-12T19:45:07.090+05:30 [Info] ExhaustMove call: 1
2023-09-12T19:45:07.090+05:30 [Info] ExhaustMove average time: 16us
2023-09-12T19:45:07.090+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:07.090+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:07.090+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.090+05:30 [Info]
2023-09-12T19:45:07.090+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:07.090+05:30 [Info] Indexer total memory:313015476589 (291.518G), mem:282455091785 (263.057G), overhead:30560384804 (28.4616G), min:45233787480 (42.1272G), data:45233787480 (42.1272G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-12T19:45:07.090+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5471874698199197 allowDDLDuringScaleup:true
2023-09-12T19:45:07.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.090+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.090+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.090+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.090+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.090+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.090+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.090+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.090+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.090+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.090+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.090+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.090+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.090+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.090+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info]
2023-09-12T19:45:07.091+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:07.091+05:30 [Info] Indexer total memory:111651485977 (103.984G), mem:95320331039 (88.774G), overhead:16331154938 (15.2096G), min:54280544976 (50.5527G), data:54280544976 (50.5527G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-09-12T19:45:07.091+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.346383999407285 allowDDLDuringScaleup:true
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.091+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.091+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.091+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.091+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info]
2023-09-12T19:45:07.092+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:07.092+05:30 [Info] Indexer total memory:116835336992 (108.811G), mem:93392102572 (86.9782G), overhead:23443234420 (21.8332G), min:45233787480 (42.1272G), data:45233787480 (42.1272G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-12T19:45:07.092+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3064285307727953 allowDDLDuringScaleup:true
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.092+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.092+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:7972164802132154062, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.092+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.092+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:07 -------------------------------------------
2023/09/12 19:45:07 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T19:45:07.095+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4667079270453719
2023-09-12T19:45:07.262+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.263+05:30 [Info] Score: 0.11475962811811741
2023-09-12T19:45:07.263+05:30 [Info] variation: 0.22951925623623481
2023-09-12T19:45:07.263+05:30 [Info] ElapsedTime: 167ms
2023-09-12T19:45:07.263+05:30 [Info] ConvergenceTime: 164ms
2023-09-12T19:45:07.263+05:30 [Info] Iteration: 6100
2023-09-12T19:45:07.263+05:30 [Info] Move: 4011
2023-09-12T19:45:07.263+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Using SAPlanner
2023-09-12T19:45:07.263+05:30 [Info] Indexer Memory Mean 211591134437 (197.06G)
2023-09-12T19:45:07.263+05:30 [Info] Indexer Memory Deviation 78426288854 (73.0402G) (37.07%)
2023-09-12T19:45:07.263+05:30 [Info] Indexer Memory Utilization 3.8361
2023-09-12T19:45:07.263+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:07.263+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:07.263+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:07.263+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:07.263+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:07.263+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:07.263+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.263+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:07.263+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.263+05:30 [Info] Indexer Data Size Mean 48064951200 (44.764G)
2023-09-12T19:45:07.263+05:30 [Info] Indexer Data Size Deviation 4248381616 (3.95661G) (8.84%)
2023-09-12T19:45:07.263+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:07.263+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.263+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:07.263+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.263+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Number of indexes: 28
2023-09-12T19:45:07.263+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:07.263+05:30 [Info] Avg Index Size: 22670478689 (21.1135G)
2023-09-12T19:45:07.263+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:07.263+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-12T19:45:07.263+05:30 [Info] Avg Index Cpu: 1.6429
2023-09-12T19:45:07.263+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:07.263+05:30 [Info] Num Estimation Run: 29
2023-09-12T19:45:07.263+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:07.263+05:30 [Info] CPU Quota 27
2023-09-12T19:45:07.263+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:07.263+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:07.263+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Total iteration: 10121
2023-09-12T19:45:07.263+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:07.263+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:07.263+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:07.263+05:30 [Info] RandomMove time: 46ms
2023-09-12T19:45:07.263+05:30 [Info] RandomMove call: 6099 (empty index 0)
2023-09-12T19:45:07.263+05:30 [Info] RandomMove average time: 7us
2023-09-12T19:45:07.263+05:30 [Info] ExhaustMove time: 10us
2023-09-12T19:45:07.263+05:30 [Info] ExhaustMove call: 1
2023-09-12T19:45:07.263+05:30 [Info] ExhaustMove average time: 10us
2023-09-12T19:45:07.263+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:07.263+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:07.263+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.263+05:30 [Info]
2023-09-12T19:45:07.263+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:07.263+05:30 [Info] Indexer total memory:312842580859 (291.357G), mem:282282196055 (262.896G), overhead:30560384804 (28.4616G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-12T19:45:07.263+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4543185477672772 allowDDLDuringScaleup:true
2023-09-12T19:45:07.263+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.263+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.263+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.263+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.263+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.263+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.263+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.263+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.263+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.263+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.263+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.263+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.263+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.263+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.263+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.263+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.263+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info]
2023-09-12T19:45:07.264+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:07.264+05:30 [Info] Indexer total memory:331915596755 (309.12G), mem:250259822065 (233.073G), overhead:81655774690 (76.0479G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-12T19:45:07.264+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.42405038546912194 allowDDLDuringScaleup:true
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info]
2023-09-12T19:45:07.264+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:07.264+05:30 [Info] Indexer total memory:125674619612 (117.044G), mem:102231385192 (95.2104G), overhead:23443234420 (21.8332G), min:54073070100 (50.3595G), data:54073070100 (50.3595G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-09-12T19:45:07.264+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32163106676360087 allowDDLDuringScaleup:true
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.264+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.264+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.264+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.264+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.265+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.265+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.265+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.265+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.265+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.265+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.265+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.265+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:225458201123229515, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.265+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.265+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:07 -------------------------------------------
2023/09/12 19:45:07 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T19:45:07.268+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.44938081443446765
2023-09-12T19:45:07.278+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-12T19:45:07.278+05:30 [Info] Score: 0.14057543510854384
2023-09-12T19:45:07.278+05:30 [Info] variation: 0.2811508702170877
2023-09-12T19:45:07.278+05:30 [Info] ElapsedTime: 10ms
2023-09-12T19:45:07.278+05:30 [Info] ConvergenceTime: 5ms
2023-09-12T19:45:07.278+05:30 [Info] Iteration: 6
2023-09-12T19:45:07.278+05:30 [Info] Move: 6
2023-09-12T19:45:07.278+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.278+05:30 [Info] Using SAPlanner
2023-09-12T19:45:07.278+05:30 [Info] Indexer Memory Mean 161567158190 (150.471G)
2023-09-12T19:45:07.278+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (56.23%)
2023-09-12T19:45:07.278+05:30 [Info] Indexer Memory Utilization 2.9292
2023-09-12T19:45:07.278+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:07.278+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:07.278+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:07.278+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:07.278+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:07.278+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:07.278+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.278+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:07.278+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.278+05:30 [Info] Indexer Data Size Mean 52760689704 (49.1372G)
2023-09-12T19:45:07.278+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:07.278+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:07.278+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.278+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:07.278+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.278+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.278+05:30 [Info] Number of indexes: 36
2023-09-12T19:45:07.278+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:07.278+05:30 [Info] Avg Index Size: 9067205707 (8.44449G)
2023-09-12T19:45:07.278+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:07.278+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-12T19:45:07.279+05:30 [Info] Avg Index Cpu: 1.2778
2023-09-12T19:45:07.279+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:07.279+05:30 [Info] Num Estimation Run: 230
2023-09-12T19:45:07.279+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:07.279+05:30 [Info] CPU Quota 27
2023-09-12T19:45:07.279+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:07.279+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:07.279+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Total iteration: 1110
2023-09-12T19:45:07.279+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:07.279+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:07.279+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:07.279+05:30 [Info] RandomMove time: 53us
2023-09-12T19:45:07.279+05:30 [Info] RandomMove call: 6 (empty index 0)
2023-09-12T19:45:07.279+05:30 [Info] RandomMove average time: 8us
2023-09-12T19:45:07.279+05:30 [Info] ExhaustMove time: 3ms
2023-09-12T19:45:07.279+05:30 [Info] ExhaustMove call: 200
2023-09-12T19:45:07.279+05:30 [Info] ExhaustMove average time: 19us
2023-09-12T19:45:07.279+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:07.279+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:07.279+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.279+05:30 [Info]
2023-09-12T19:45:07.279+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:07.279+05:30 [Info] Indexer total memory:320542378813 (298.528G), mem:289981994009 (270.067G), overhead:30560384804 (28.4616G), min:52760689704 (49.1372G), data:52760689704 (49.1372G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T19:45:07.279+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5589615578517387 allowDDLDuringScaleup:true
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.279+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.279+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.279+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.279+05:30 [Info]
2023-09-12T19:45:07.279+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:07.279+05:30 [Info] Indexer total memory:110131630705 (102.568G), mem:93800475767 (87.3585G), overhead:16331154938 (15.2096G), min:52760689704 (49.1372G), data:52760689704 (49.1372G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T19:45:07.279+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.3161132953224384 allowDDLDuringScaleup:true
2023-09-12T19:45:07.279+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info]
2023-09-12T19:45:07.280+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:07.280+05:30 [Info] Indexer total memory:124362239216 (115.821G), mem:100919004796 (93.9881G), overhead:23443234420 (21.8332G), min:52760689704 (49.1372G), data:52760689704 (49.1372G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T19:45:07.280+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32492514682582296 allowDDLDuringScaleup:true
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.280+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.280+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.280+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.280+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.281+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.281+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.281+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.281+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.281+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.281+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.281+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.281+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.281+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.281+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.281+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.281+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.281+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.281+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.281+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:316225112489405313, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.281+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.281+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:07 -------------------------------------------
2023/09/12 19:45:07 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T19:45:07.283+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.19299033857000408
2023-09-12T19:45:07.321+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.321+05:30 [Info] Score: 0.09796819540510597
2023-09-12T19:45:07.321+05:30 [Info] variation: 0.19593639081021194
2023-09-12T19:45:07.321+05:30 [Info] ElapsedTime: 38ms
2023-09-12T19:45:07.321+05:30 [Info] ConvergenceTime: 6ms
2023-09-12T19:45:07.321+05:30 [Info] Iteration: 7
2023-09-12T19:45:07.321+05:30 [Info] Move: 7
2023-09-12T19:45:07.321+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.321+05:30 [Info] Using SAPlanner
2023-09-12T19:45:07.321+05:30 [Info] Indexer Memory Mean 210829304949 (196.35G)
2023-09-12T19:45:07.321+05:30 [Info] Indexer Memory Deviation 82618266177 (76.9443G) (39.19%)
2023-09-12T19:45:07.321+05:30 [Info] Indexer Memory Utilization 3.8223
2023-09-12T19:45:07.321+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-12T19:45:07.321+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-12T19:45:07.321+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-12T19:45:07.321+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:07.321+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:07.322+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:07.322+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.322+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:07.322+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.322+05:30 [Info] Indexer Data Size Mean 47303121712 (44.0545G)
2023-09-12T19:45:07.322+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:07.322+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:07.322+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.322+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:07.322+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.322+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Number of indexes: 36
2023-09-12T19:45:07.322+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:07.322+05:30 [Info] Avg Index Size: 17569108745 (16.3625G)
2023-09-12T19:45:07.322+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-12T19:45:07.322+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-12T19:45:07.322+05:30 [Info] Avg Index Cpu: 1.2778
2023-09-12T19:45:07.322+05:30 [Info] Max Index Cpu: 5.0000
2023-09-12T19:45:07.322+05:30 [Info] Num Estimation Run: 33
2023-09-12T19:45:07.322+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:07.322+05:30 [Info] CPU Quota 27
2023-09-12T19:45:07.322+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:07.322+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:07.322+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Total iteration: 6758
2023-09-12T19:45:07.322+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:07.322+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:07.322+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:07.322+05:30 [Info] RandomMove time: 64us
2023-09-12T19:45:07.322+05:30 [Info] RandomMove call: 6 (empty index 0)
2023-09-12T19:45:07.322+05:30 [Info] RandomMove average time: 10us
2023-09-12T19:45:07.322+05:30 [Info] ExhaustMove time: 13us
2023-09-12T19:45:07.322+05:30 [Info] ExhaustMove call: 1
2023-09-12T19:45:07.322+05:30 [Info] ExhaustMove average time: 13us
2023-09-12T19:45:07.322+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:07.322+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:07.322+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.322+05:30 [Info]
2023-09-12T19:45:07.322+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-12T19:45:07.322+05:30 [Info] Indexer total memory:315084810821 (293.446G), mem:284524426017 (264.984G), overhead:30560384804 (28.4616G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T19:45:07.322+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4699097510048492 allowDDLDuringScaleup:true
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.322+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.322+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.322+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.322+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info]
2023-09-12T19:45:07.323+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-12T19:45:07.323+05:30 [Info] Indexer total memory:334157826717 (311.209G), mem:252502052027 (235.161G), overhead:81655774690 (76.0479G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T19:45:07.323+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43953221501885753 allowDDLDuringScaleup:true
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info]
2023-09-12T19:45:07.323+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-12T19:45:07.323+05:30 [Info] Indexer total memory:118904671224 (110.739G), mem:95461436804 (88.9054G), overhead:23443234420 (21.8332G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-12T19:45:07.323+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.29055803397629315 allowDDLDuringScaleup:true
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.323+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.323+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.323+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.323+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.324+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.324+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:6447413092643927764, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.324+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.324+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/CommandRepair
2023/09/12 19:45:07 -------------------------------------------
2023/09/12 19:45:07 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T19:45:07.325+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T19:45:07.325+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-12T19:45:07.325+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=8us
2023-09-12T19:45:07.325+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-09-12T19:45:07.325+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-12T19:45:07.325+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-09-12T19:45:07.325+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-09-12T19:45:07.325+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:07.325+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.325+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=209us
2023-09-12T19:45:07.325+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-09-12T19:45:07.325+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-09-12T19:45:07.325+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:07.325+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.325+05:30 [Info] Score: 0.22489777375378742
2023-09-12T19:45:07.325+05:30 [Info] variation: 0.8995910950151497
2023-09-12T19:45:07.325+05:30 [Info] ElapsedTime: 92us
2023-09-12T19:45:07.325+05:30 [Info] ConvergenceTime: 3us
2023-09-12T19:45:07.325+05:30 [Info] Iteration: 0
2023-09-12T19:45:07.325+05:30 [Info] Move: 0
2023-09-12T19:45:07.325+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.325+05:30 [Info] Using SAPlanner
2023-09-12T19:45:07.325+05:30 [Info] Indexer Memory Mean 122486397174 (114.074G)
2023-09-12T19:45:07.325+05:30 [Info] Indexer Memory Deviation 110187672158 (102.62G) (89.96%)
2023-09-12T19:45:07.325+05:30 [Info] Indexer Memory Utilization 2.2206
2023-09-12T19:45:07.325+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:45:07.325+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:45:07.326+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:45:07.326+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:07.326+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:07.326+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:07.326+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.326+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:07.326+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.326+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T19:45:07.326+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:07.326+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:07.326+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.326+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:07.326+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.326+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.326+05:30 [Info] Number of indexes: 4
2023-09-12T19:45:07.326+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:07.326+05:30 [Info] Avg Index Size: 91864797880 (85.5558G)
2023-09-12T19:45:07.326+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-12T19:45:07.326+05:30 [Info] Max Indexer Overhead: 46891539742 (43.6711G)
2023-09-12T19:45:07.326+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-12T19:45:07.326+05:30 [Info] Max Index Cpu: 0.0000
2023-09-12T19:45:07.326+05:30 [Info] Num Estimation Run: 0
2023-09-12T19:45:07.326+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.326+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:07.326+05:30 [Info] CPU Quota 27
2023-09-12T19:45:07.326+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:07.326+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:07.326+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.326+05:30 [Info] Total iteration: 0
2023-09-12T19:45:07.326+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:07.326+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:07.326+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:07.326+05:30 [Info] RandomMove time: 0ns
2023-09-12T19:45:07.326+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T19:45:07.326+05:30 [Info] ExhaustMove time: 0ns
2023-09-12T19:45:07.326+05:30 [Info] ExhaustMove call: 0
2023-09-12T19:45:07.326+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:07.326+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:07.326+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.326+05:30 [Info]
2023-09-12T19:45:07.326+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-12T19:45:07.326+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:07.326+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.45435427408637796 allowDDLDuringScaleup:true
2023-09-12T19:45:07.326+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.326+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.326+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.326+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.326+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.326+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:1537667514065895281, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.326+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.326+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.326+05:30 [Info]
2023-09-12T19:45:07.326+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-12T19:45:07.326+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:07.326+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.06701117350131312 allowDDLDuringScaleup:true
2023-09-12T19:45:07.326+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.326+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.326+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.326+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.326+05:30 [Info]
2023-09-12T19:45:07.326+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-12T19:45:07.326+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:07.326+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0786345524123089 allowDDLDuringScaleup:true
2023-09-12T19:45:07.326+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.326+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.326+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.326+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:07 -------------------------------------------
2023/09/12 19:45:07 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-12T19:45:07.326+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-12T19:45:07.327+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:07.327+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-12T19:45:07.327+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-09-12T19:45:07.327+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-12T19:45:07.327+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-09-12T19:45:07.327+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=7us
2023-09-12T19:45:07.327+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-09-12T19:45:07.327+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-09-12T19:45:07.327+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:07.327+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.327+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=129us
2023-09-12T19:45:07.327+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T19:45:07.327+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-09-12T19:45:07.327+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-09-12T19:45:07.327+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:07.327+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.327+05:30 [Info] Score: 0.019876174419669376
2023-09-12T19:45:07.327+05:30 [Info] variation: 0.0795046976786775
2023-09-12T19:45:07.327+05:30 [Info] ElapsedTime: 88us
2023-09-12T19:45:07.327+05:30 [Info] ConvergenceTime: 2us
2023-09-12T19:45:07.327+05:30 [Info] Iteration: 0
2023-09-12T19:45:07.327+05:30 [Info] Move: 0
2023-09-12T19:45:07.327+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.327+05:30 [Info] Using SAPlanner
2023-09-12T19:45:07.327+05:30 [Info] Indexer Memory Mean 266954004690 (248.62G)
2023-09-12T19:45:07.327+05:30 [Info] Indexer Memory Deviation 21224097436 (19.7665G) (7.95%)
2023-09-12T19:45:07.327+05:30 [Info] Indexer Memory Utilization 4.8398
2023-09-12T19:45:07.327+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:45:07.327+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:45:07.327+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:45:07.327+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:07.327+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:07.327+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:07.327+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.327+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:07.327+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.327+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T19:45:07.327+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:07.327+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:07.327+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.327+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:07.327+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.327+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.327+05:30 [Info] Number of indexes: 5
2023-09-12T19:45:07.327+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:07.327+05:30 [Info] Avg Index Size: 160172402814 (149.172G)
2023-09-12T19:45:07.327+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-12T19:45:07.327+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-09-12T19:45:07.327+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-12T19:45:07.327+05:30 [Info] Max Index Cpu: 0.0000
2023-09-12T19:45:07.327+05:30 [Info] Num Estimation Run: 0
2023-09-12T19:45:07.327+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.327+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:07.327+05:30 [Info] CPU Quota 27
2023-09-12T19:45:07.327+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:07.327+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:07.327+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.327+05:30 [Info] Total iteration: 0
2023-09-12T19:45:07.327+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:07.327+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:07.327+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:07.327+05:30 [Info] RandomMove time: 0ns
2023-09-12T19:45:07.327+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T19:45:07.327+05:30 [Info] ExhaustMove time: 0ns
2023-09-12T19:45:07.328+05:30 [Info] ExhaustMove call: 0
2023-09-12T19:45:07.328+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:07.328+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:07.328+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.328+05:30 [Info]
2023-09-12T19:45:07.328+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-12T19:45:07.328+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:07.328+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1777244769790758 allowDDLDuringScaleup:true
2023-09-12T19:45:07.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.328+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.328+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.328+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.328+05:30 [Info]
2023-09-12T19:45:07.328+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-12T19:45:07.328+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:07.328+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.20847118640616036 allowDDLDuringScaleup:true
2023-09-12T19:45:07.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.328+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.328+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.328+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:15817029093319930843, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.328+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.328+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.328+05:30 [Info]
2023-09-12T19:45:07.328+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-12T19:45:07.328+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:07.328+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2138043366147638 allowDDLDuringScaleup:true
2023-09-12T19:45:07.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.328+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.328+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.328+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.328+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:14578787216297184505, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.328+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.328+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:07 -------------------------------------------
2023/09/12 19:45:07 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T19:45:07.328+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-12T19:45:07.328+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=6us
2023-09-12T19:45:07.328+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-09-12T19:45:07.328+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-09-12T19:45:07.328+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-12T19:45:07.328+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-09-12T19:45:07.328+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-09-12T19:45:07.328+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:07.328+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.328+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=129us
2023-09-12T19:45:07.329+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-09-12T19:45:07.329+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-09-12T19:45:07.329+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:07.329+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.329+05:30 [Info] Score: 0.17469212089072378
2023-09-12T19:45:07.329+05:30 [Info] variation: 0.6987684835628951
2023-09-12T19:45:07.329+05:30 [Info] ElapsedTime: 72us
2023-09-12T19:45:07.329+05:30 [Info] ConvergenceTime: 2us
2023-09-12T19:45:07.329+05:30 [Info] Iteration: 0
2023-09-12T19:45:07.329+05:30 [Info] Move: 0
2023-09-12T19:45:07.329+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.329+05:30 [Info] Using SAPlanner
2023-09-12T19:45:07.329+05:30 [Info] Indexer Memory Mean 231925826675 (215.998G)
2023-09-12T19:45:07.329+05:30 [Info] Indexer Memory Deviation 162062458205 (150.932G) (69.88%)
2023-09-12T19:45:07.329+05:30 [Info] Indexer Memory Utilization 4.2047
2023-09-12T19:45:07.329+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:45:07.329+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:45:07.329+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:45:07.329+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:07.329+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:07.329+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:07.329+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.329+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:07.329+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.329+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T19:45:07.329+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:07.329+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:07.329+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.329+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:07.329+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.329+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.329+05:30 [Info] Number of indexes: 4
2023-09-12T19:45:07.329+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:07.329+05:30 [Info] Avg Index Size: 173944370006 (161.998G)
2023-09-12T19:45:07.329+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-12T19:45:07.329+05:30 [Info] Max Indexer Overhead: 49341212983 (45.9526G)
2023-09-12T19:45:07.329+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-12T19:45:07.329+05:30 [Info] Max Index Cpu: 0.0000
2023-09-12T19:45:07.329+05:30 [Info] Num Estimation Run: 0
2023-09-12T19:45:07.329+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.329+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:07.329+05:30 [Info] CPU Quota 27
2023-09-12T19:45:07.329+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:07.329+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:07.329+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.329+05:30 [Info] Total iteration: 0
2023-09-12T19:45:07.329+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:07.329+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:07.329+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:07.329+05:30 [Info] RandomMove time: 0ns
2023-09-12T19:45:07.329+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T19:45:07.329+05:30 [Info] ExhaustMove time: 0ns
2023-09-12T19:45:07.329+05:30 [Info] ExhaustMove call: 0
2023-09-12T19:45:07.329+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:07.329+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:07.329+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.329+05:30 [Info]
2023-09-12T19:45:07.329+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-12T19:45:07.329+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:07.329+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.38151873032984485 allowDDLDuringScaleup:true
2023-09-12T19:45:07.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.329+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.329+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.329+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.329+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:14182165901573594331, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.329+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.329+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.329+05:30 [Info]
2023-09-12T19:45:07.329+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-12T19:45:07.329+05:30 [Info] Indexer total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:07.329+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1769522034317959 allowDDLDuringScaleup:true
2023-09-12T19:45:07.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.329+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.329+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.329+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.329+05:30 [Info]
2023-09-12T19:45:07.329+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-12T19:45:07.329+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:07.329+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0415290662383593 allowDDLDuringScaleup:true
2023-09-12T19:45:07.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.329+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.329+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.329+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/12 19:45:07 -------------------------------------------
2023/09/12 19:45:07 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-12T19:45:07.330+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-12T19:45:07.330+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2,0) with initial placement on node: 127.0.0.1:9003
2023-09-12T19:45:07.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-12T19:45:07.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=4us
2023-09-12T19:45:07.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-12T19:45:07.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-09-12T19:45:07.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=5us
2023-09-12T19:45:07.330+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-09-12T19:45:07.330+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-09-12T19:45:07.330+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:07.330+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=129us
2023-09-12T19:45:07.330+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-12T19:45:07.330+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-09-12T19:45:07.330+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-09-12T19:45:07.330+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-12T19:45:07.330+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-12T19:45:07.330+05:30 [Info] Score: 0.06809310854298714
2023-09-12T19:45:07.330+05:30 [Info] variation: 0.27237243417194856
2023-09-12T19:45:07.330+05:30 [Info] ElapsedTime: 72us
2023-09-12T19:45:07.330+05:30 [Info] ConvergenceTime: 2us
2023-09-12T19:45:07.330+05:30 [Info] Iteration: 0
2023-09-12T19:45:07.330+05:30 [Info] Move: 0
2023-09-12T19:45:07.330+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.330+05:30 [Info] Using SAPlanner
2023-09-12T19:45:07.330+05:30 [Info] Indexer Memory Mean 321673719440 (299.582G)
2023-09-12T19:45:07.330+05:30 [Info] Indexer Memory Deviation 87615053973 (81.5979G) (27.24%)
2023-09-12T19:45:07.330+05:30 [Info] Indexer Memory Utilization 5.8318
2023-09-12T19:45:07.330+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-12T19:45:07.330+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-12T19:45:07.330+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-12T19:45:07.330+05:30 [Info] Indexer IO Mean 0.0000
2023-09-12T19:45:07.330+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-12T19:45:07.330+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-12T19:45:07.330+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.330+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-12T19:45:07.330+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-12T19:45:07.330+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-12T19:45:07.330+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-12T19:45:07.330+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-12T19:45:07.330+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.330+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-12T19:45:07.330+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-12T19:45:07.330+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.330+05:30 [Info] Number of indexes: 5
2023-09-12T19:45:07.330+05:30 [Info] Number of indexers: 3
2023-09-12T19:45:07.330+05:30 [Info] Avg Index Size: 193004231664 (179.749G)
2023-09-12T19:45:07.330+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-12T19:45:07.330+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-09-12T19:45:07.330+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-12T19:45:07.330+05:30 [Info] Max Index Cpu: 0.0000
2023-09-12T19:45:07.330+05:30 [Info] Num Estimation Run: 0
2023-09-12T19:45:07.330+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.330+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-12T19:45:07.330+05:30 [Info] CPU Quota 27
2023-09-12T19:45:07.330+05:30 [Info] Max Cpu Utilization -1
2023-09-12T19:45:07.331+05:30 [Info] Max Memory Utilization -1
2023-09-12T19:45:07.331+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.331+05:30 [Info] Total iteration: 0
2023-09-12T19:45:07.331+05:30 [Info] RandomSwap time: 0ns
2023-09-12T19:45:07.331+05:30 [Info] RandomSwap call: 0
2023-09-12T19:45:07.331+05:30 [Info] RandomSwap iteration: 0
2023-09-12T19:45:07.331+05:30 [Info] RandomMove time: 0ns
2023-09-12T19:45:07.331+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-12T19:45:07.331+05:30 [Info] ExhaustMove time: 0ns
2023-09-12T19:45:07.331+05:30 [Info] ExhaustMove call: 0
2023-09-12T19:45:07.331+05:30 [Info] ExhaustSwap time: 0ns
2023-09-12T19:45:07.331+05:30 [Info] ExhaustSwap call: 0
2023-09-12T19:45:07.331+05:30 [Info] ----------------------------------------
2023-09-12T19:45:07.331+05:30 [Info]
2023-09-12T19:45:07.331+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-12T19:45:07.331+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-12T19:45:07.331+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.14749187761902688 allowDDLDuringScaleup:true
2023-09-12T19:45:07.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.331+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.331+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.331+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.331+05:30 [Info]
2023-09-12T19:45:07.331+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-12T19:45:07.331+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:07.331+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.2750739074297335 allowDDLDuringScaleup:true
2023-09-12T19:45:07.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.331+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.331+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.331+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.331+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:17894597015481663132, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.331+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.331+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.331+05:30 [Info]
2023-09-12T19:45:07.331+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-12T19:45:07.331+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-12T19:45:07.331+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.17743421495123962 allowDDLDuringScaleup:true
2023-09-12T19:45:07.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.331+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.331+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.331+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-12T19:45:07.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-12T19:45:07.331+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:11839422373103720169, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-12T19:45:07.331+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-12T19:45:07.331+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
--- PASS: TestPlanDuringHeterogenousScaleup (2.01s)
--- PASS: TestPlanDuringHeterogenousScaleup/GreedyPlanner (0.02s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner (1.99s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests (0.36s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex (1.63s)
--- PASS: TestPlanDuringHeterogenousScaleup/CommandRepair (0.01s)
=== RUN TestRestfulAPI
2023/09/12 19:45:07 In TestRestfulAPI()
2023/09/12 19:45:07 In DropAllSecondaryIndexes()
2023/09/12 19:45:07 Index found: indexmut_1
2023/09/12 19:45:07 Dropped index indexmut_1
2023/09/12 19:45:07 Setting JSON docs in KV
2023/09/12 19:45:08 GET all indexes
2023/09/12 19:45:08 200 OK
2023/09/12 19:45:08 FOUND indexes: []
2023/09/12 19:45:08 DROP index: badindexid
2023/09/12 19:45:08 status: 400 Bad Request
2023/09/12 19:45:08 DROP index: 23544142
2023/09/12 19:45:08 status: 500 Internal Server Error
2023/09/12 19:45:08 TEST: malformed body
2023/09/12 19:45:08 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"
2023/09/12 19:45:08 TEST: missing field ``name``
2023/09/12 19:45:08 400 Bad Request "missing field name"
2023/09/12 19:45:08 TEST: empty field ``name``
2023/09/12 19:45:08 400 Bad Request "empty field name"
2023/09/12 19:45:08 TEST: missing field ``bucket``
2023/09/12 19:45:08 400 Bad Request "missing field bucket"
2023/09/12 19:45:08 TEST: empty field ``bucket``
2023/09/12 19:45:08 400 Bad Request "empty field bucket"
2023/09/12 19:45:08 TEST: missing field ``secExprs``
2023/09/12 19:45:08 400 Bad Request "missing field secExprs"
2023/09/12 19:45:08 TEST: empty field ``secExprs``
2023/09/12 19:45:08 400 Bad Request "empty field secExprs"
2023/09/12 19:45:08 TEST: incomplete field ``desc``
2023/09/12 19:45:08 400 Bad Request "incomplete desc information [true]"
2023/09/12 19:45:08 TEST: invalid field ``desc``
2023/09/12 19:45:08 400 Bad Request "incomplete desc information [1]"
2023/09/12 19:45:08
2023/09/12 19:45:08 CREATE INDEX: idx1
2023/09/12 19:45:17 status : 201 Created
2023/09/12 19:45:17 {"id": "11103589177366474347"}
2023/09/12 19:45:17 CREATE INDEX: idx2 (defer)
2023/09/12 19:45:18 status : 201 Created
2023/09/12 19:45:18 {"id": "7230412530401374050"}
2023/09/12 19:45:18 CREATE INDEX: idx3 (defer)
2023/09/12 19:45:18 status : 201 Created
2023/09/12 19:45:18 {"id": "1368563316019536930"}
2023/09/12 19:45:18 CREATE INDEX: idx4 (defer)
2023/09/12 19:45:18 status : 201 Created
2023/09/12 19:45:18 {"id": "7013617096977398716"}
2023/09/12 19:45:18 CREATE INDEX: idx5
2023/09/12 19:45:29 status : 201 Created
2023/09/12 19:45:29 {"id": "16310883538068446496"}
2023/09/12 19:45:29 BUILD single deferred index
2023/09/12 19:45:30 202 Accepted
2023/09/12 19:45:30 GET all indexes
2023/09/12 19:45:30 200 OK
2023/09/12 19:45:30 index idx1 in INDEX_STATE_ACTIVE
2023/09/12 19:45:30 GET all indexes
2023/09/12 19:45:30 200 OK
2023/09/12 19:45:30 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:31 GET all indexes
2023/09/12 19:45:31 200 OK
2023/09/12 19:45:31 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:32 GET all indexes
2023/09/12 19:45:32 200 OK
2023/09/12 19:45:32 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:33 GET all indexes
2023/09/12 19:45:33 200 OK
2023/09/12 19:45:33 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:34 GET all indexes
2023/09/12 19:45:34 200 OK
2023/09/12 19:45:34 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:35 GET all indexes
2023/09/12 19:45:35 200 OK
2023/09/12 19:45:35 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:36 GET all indexes
2023/09/12 19:45:36 200 OK
2023/09/12 19:45:36 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:37 GET all indexes
2023/09/12 19:45:37 200 OK
2023/09/12 19:45:37 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:38 GET all indexes
2023/09/12 19:45:38 200 OK
2023/09/12 19:45:38 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:39 GET all indexes
2023/09/12 19:45:39 200 OK
2023/09/12 19:45:39 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:40 GET all indexes
2023/09/12 19:45:40 200 OK
2023/09/12 19:45:40 index idx2 in INDEX_STATE_INITIAL
2023/09/12 19:45:41 GET all indexes
2023/09/12 19:45:41 200 OK
2023/09/12 19:45:41 index idx2 in INDEX_STATE_CATCHUP
2023/09/12 19:45:42 GET all indexes
2023/09/12 19:45:42 200 OK
2023/09/12 19:45:42 index idx2 in INDEX_STATE_ACTIVE
2023/09/12 19:45:42 BUILD many deferred index
2023/09/12 19:45:42 202 Accepted
2023/09/12 19:45:42 GET all indexes
2023/09/12 19:45:42 200 OK
2023/09/12 19:45:42 index idx1 in INDEX_STATE_ACTIVE
2023/09/12 19:45:42 GET all indexes
2023/09/12 19:45:42 200 OK
2023/09/12 19:45:42 index idx2 in INDEX_STATE_ACTIVE
2023/09/12 19:45:42 GET all indexes
2023/09/12 19:45:42 200 OK
2023/09/12 19:45:42 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:43 GET all indexes
2023/09/12 19:45:43 200 OK
2023/09/12 19:45:43 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:44 GET all indexes
2023/09/12 19:45:44 200 OK
2023/09/12 19:45:44 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:45 GET all indexes
2023/09/12 19:45:45 200 OK
2023/09/12 19:45:45 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:46 GET all indexes
2023/09/12 19:45:46 200 OK
2023/09/12 19:45:46 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:47 GET all indexes
2023/09/12 19:45:47 200 OK
2023/09/12 19:45:47 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:48 GET all indexes
2023/09/12 19:45:48 200 OK
2023/09/12 19:45:48 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:49 GET all indexes
2023/09/12 19:45:49 200 OK
2023/09/12 19:45:49 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:51 GET all indexes
2023/09/12 19:45:51 200 OK
2023/09/12 19:45:51 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:52 GET all indexes
2023/09/12 19:45:52 200 OK
2023/09/12 19:45:52 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:53 GET all indexes
2023/09/12 19:45:53 200 OK
2023/09/12 19:45:53 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:54 GET all indexes
2023/09/12 19:45:54 200 OK
2023/09/12 19:45:54 index idx3 in INDEX_STATE_INITIAL
2023/09/12 19:45:55 GET all indexes
2023/09/12 19:45:55 200 OK
2023/09/12 19:45:55 index idx3 in INDEX_STATE_CATCHUP
2023/09/12 19:45:56 GET all indexes
2023/09/12 19:45:56 200 OK
2023/09/12 19:45:56 index idx3 in INDEX_STATE_ACTIVE
2023/09/12 19:45:56 GET all indexes
2023/09/12 19:45:56 200 OK
2023/09/12 19:45:56 index idx4 in INDEX_STATE_ACTIVE
2023/09/12 19:45:56 GET all indexes
2023/09/12 19:45:56 200 OK
2023/09/12 19:45:56 index idx5 in INDEX_STATE_ACTIVE
2023/09/12 19:45:56 GET all indexes
2023/09/12 19:45:56 200 OK
2023/09/12 19:45:56 CREATED indexes: [11103589177366474347 7230412530401374050 1368563316019536930 7013617096977398716 16310883538068446496]
2023/09/12 19:45:56
2023/09/12 19:45:56 LOOKUP missing index
2023/09/12 19:45:56 status : 404 Not Found
2023/09/12 19:45:56 LOOKUP Pyongyang
2023/09/12 19:45:56 status : 200 OK
2023/09/12 19:45:56 number of entries 554
2023/09/12 19:45:56 Expected and Actual scan responses are the same
2023/09/12 19:45:56 LOOKUP with stale as false
2023/09/12 19:45:56 status : 200 OK
2023/09/12 19:45:56 number of entries 554
2023/09/12 19:45:56 Expected and Actual scan responses are the same
2023/09/12 19:45:56 LOOKUP with Rome
2023/09/12 19:45:56 status : 200 OK
2023/09/12 19:45:56 number of entries 540
2023/09/12 19:45:56 Expected and Actual scan responses are the same
2023/09/12 19:45:56 RANGE missing index
2023/09/12 19:45:56 Status : 404 Not Found
2023/09/12 19:45:56 RANGE cities - none
2023/09/12 19:45:56 Status : 200 OK
2023/09/12 19:46:01 number of entries 140902
2023/09/12 19:46:03 Expected and Actual scan responses are the same
2023/09/12 19:46:03 RANGE cities -low
2023/09/12 19:46:03 Status : 200 OK
2023/09/12 19:46:08 number of entries 140902
2023/09/12 19:46:09 Expected and Actual scan responses are the same
2023/09/12 19:46:09 RANGE cities -high
2023/09/12 19:46:09 Status : 200 OK
2023/09/12 19:46:14 number of entries 140902
2023/09/12 19:46:14 Expected and Actual scan responses are the same
2023/09/12 19:46:14 RANGE cities - both
2023/09/12 19:46:14 Status : 200 OK
2023/09/12 19:46:19 number of entries 140902
2023/09/12 19:46:20 Expected and Actual scan responses are the same
2023/09/12 19:46:20 RANGE missing cities
2023/09/12 19:46:20 Status : 200 OK
2023/09/12 19:46:20 number of entries 0
2023/09/12 19:46:20 Expected and Actual scan responses are the same
2023/09/12 19:46:20
2023/09/12 19:46:20 SCANALL missing index
2023/09/12 19:46:20 {"limit":1000000,"stale":"ok"}
2023/09/12 19:46:20 Status : 404 Not Found
2023/09/12 19:46:20 SCANALL stale ok
2023/09/12 19:46:20 {"limit":1000000,"stale":"ok"}
2023/09/12 19:46:20 Status : 200 OK
2023/09/12 19:46:25 number of entries 140902
2023/09/12 19:46:26 Expected and Actual scan responses are the same
2023/09/12 19:46:26 SCANALL stale false
2023/09/12 19:46:26 {"limit":1000000,"stale":"false"}
2023/09/12 19:46:26 Status : 200 OK
2023/09/12 19:46:31 number of entries 140902
2023/09/12 19:46:32 Expected and Actual scan responses are the same
2023/09/12 19:46:32
2023/09/12 19:46:32 COUNT missing index
2023/09/12 19:46:32 Status : 404 Not Found
2023/09/12 19:46:32 COUNT cities - none
2023/09/12 19:46:32 Status : 200 OK
2023/09/12 19:46:32 number of entries 140902
2023/09/12 19:46:32 COUNT cities -low
2023/09/12 19:46:32 Status : 200 OK
2023/09/12 19:46:32 number of entries 140902
2023/09/12 19:46:33 COUNT cities -high
2023/09/12 19:46:33 Status : 200 OK
2023/09/12 19:46:33 number of entries 140902
2023/09/12 19:46:33 COUNT cities - both
2023/09/12 19:46:33 Status : 200 OK
2023/09/12 19:46:33 number of entries 140902
2023/09/12 19:46:33 COUNT missing cities
2023/09/12 19:46:33 Status : 200 OK
2023/09/12 19:46:33 number of entries 0
2023/09/12 19:46:33
2023/09/12 19:46:35 STATS: Testing URLs with valid authentication
2023/09/12 19:46:35 STATS: Testing URLs with invalid authentication
2023/09/12 19:46:35 STATS: Testing invalid URLs
2023/09/12 19:46:35 STATS: Testing unsupported methods
2023/09/12 19:46:35
--- PASS: TestRestfulAPI (87.82s)
=== RUN TestStatIndexInstFilter
2023/09/12 19:46:35 CREATE INDEX: statIdx1
2023/09/12 19:46:45 status : 201 Created
2023/09/12 19:46:45 {"id": "13795671681308882605"}
2023/09/12 19:46:45 CREATE INDEX: statIdx2
2023/09/12 19:46:57 status : 201 Created
2023/09/12 19:46:57 {"id": "4075049557608478676"}
2023/09/12 19:46:57 Instance Id for statIdx2 is 1249380655698241931, common.IndexInstId
--- PASS: TestStatIndexInstFilter (22.05s)
=== RUN TestBucketDefaultDelete
2023-09-12T19:46:57.335+05:30 [Warn] Client:runObserveStreamingEndpoint streaming endpoint for /pools/default/bs/default returned err EOF
2023-09-12T19:46:57.335+05:30 [Warn] serviceChangeNotifier: Connection terminated for collection manifest notifier instance of http://%40query@127.0.0.1:9000-default, bucket: default, (EOF)
2023/09/12 19:46:59 Deleted bucket default, responseBody:
2023/09/12 19:47:14 Created bucket default, responseBody:
2023/09/12 19:47:30 Populating the default bucket
2023/09/12 19:47:38 Using n1ql client
2023-09-12T19:47:38.650+05:30 [Info] GSIC[default/default-_default-_default-1694528258648075509] started ...
2023/09/12 19:47:38 Scan failed as expected with error: Index Not Found - cause: GSI index index_isActive not found.
2023/09/12 19:47:38 Populating the default bucket after it was deleted
2023/09/12 19:47:47 Created the secondary index index_isActive. Waiting for it become active
2023/09/12 19:47:47 Index is 17918569684433166851 now active
2023/09/12 19:47:47 Using n1ql client
2023/09/12 19:47:47 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (50.57s)
=== RUN TestMixedDatatypesScanAll
2023/09/12 19:47:47 In TestMixedDatatypesScanAll()
2023/09/12 19:47:47 Before test begin: Length of kv docs is 10002
2023/09/12 19:47:47 In DropAllSecondaryIndexes()
2023/09/12 19:47:47 Index found: index_isActive
2023/09/12 19:47:47 Dropped index index_isActive
2023/09/12 19:47:48 Number of number fields is: 247
2023/09/12 19:47:48 Number of string fields is: 249
2023/09/12 19:47:48 Number of json fields is: 235
2023/09/12 19:47:48 Number of true bool fields is: 131
2023/09/12 19:47:48 Number of false bool fields is: 138
2023/09/12 19:47:48 After generate docs: Length of kv docs is 11002
2023/09/12 19:47:48 Setting mixed datatypes JSON docs in KV
2023/09/12 19:47:53 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 19:47:53 Index is 2619382697542778260 now active
2023/09/12 19:47:53 Using n1ql client
2023/09/12 19:47:53 Expected and Actual scan responses are the same
2023/09/12 19:47:53 Lengths of expected and actual scan results are: 1000 and 1000
2023/09/12 19:47:53 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (6.15s)
=== RUN TestMixedDatatypesRange_Float
2023/09/12 19:47:53 In TestMixedDatatypesRange_Float()
2023/09/12 19:47:53 In DropAllSecondaryIndexes()
2023/09/12 19:47:53 Index found: index_mixeddt
2023/09/12 19:47:54 Dropped index index_mixeddt
2023/09/12 19:47:54 Number of number fields is: 243
2023/09/12 19:47:54 Number of string fields is: 252
2023/09/12 19:47:54 Number of json fields is: 262
2023/09/12 19:47:54 Number of true bool fields is: 126
2023/09/12 19:47:54 Number of false bool fields is: 117
2023/09/12 19:47:54 Setting mixed datatypes JSON docs in KV
2023/09/12 19:47:59 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 19:47:59 Index is 3936964216802719729 now active
2023/09/12 19:47:59 Using n1ql client
2023/09/12 19:47:59 Expected and Actual scan responses are the same
2023/09/12 19:47:59 Lengths of expected and actual scan results are: 24 and 24
2023/09/12 19:47:59 Using n1ql client
2023/09/12 19:47:59 Expected and Actual scan responses are the same
2023/09/12 19:47:59 Lengths of expected and actual scan results are: 2 and 2
2023/09/12 19:47:59 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (5.35s)
=== RUN TestMixedDatatypesRange_String
2023/09/12 19:47:59 In TestMixedDatatypesRange_String()
2023/09/12 19:47:59 In DropAllSecondaryIndexes()
2023/09/12 19:47:59 Index found: index_mixeddt
2023/09/12 19:47:59 Dropped index index_mixeddt
2023/09/12 19:47:59 Number of number fields is: 253
2023/09/12 19:47:59 Number of string fields is: 256
2023/09/12 19:47:59 Number of json fields is: 249
2023/09/12 19:47:59 Number of true bool fields is: 132
2023/09/12 19:47:59 Number of false bool fields is: 110
2023/09/12 19:47:59 Setting mixed datatypes JSON docs in KV
2023/09/12 19:48:05 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 19:48:05 Index is 7848017541982326729 now active
2023/09/12 19:48:05 Using n1ql client
2023/09/12 19:48:05 Expected and Actual scan responses are the same
2023/09/12 19:48:05 Lengths of expected and actual scan results are: 208 and 208
2023/09/12 19:48:05 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (6.32s)
=== RUN TestMixedDatatypesRange_Json
2023/09/12 19:48:05 In TestMixedDatatypesRange_Json()
2023/09/12 19:48:05 In DropAllSecondaryIndexes()
2023/09/12 19:48:05 Index found: index_mixeddt
2023/09/12 19:48:05 Dropped index index_mixeddt
2023/09/12 19:48:05 Number of number fields is: 254
2023/09/12 19:48:05 Number of string fields is: 260
2023/09/12 19:48:05 Number of json fields is: 230
2023/09/12 19:48:05 Number of true bool fields is: 138
2023/09/12 19:48:05 Number of false bool fields is: 118
2023/09/12 19:48:05 Setting mixed datatypes JSON docs in KV
2023/09/12 19:48:11 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 19:48:11 Index is 3676159858153158655 now active
2023/09/12 19:48:11 Using n1ql client
2023/09/12 19:48:11 Expected and Actual scan responses are the same
2023/09/12 19:48:11 Lengths of expected and actual scan results are: 741 and 741
2023/09/12 19:48:11 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (5.69s)
=== RUN TestMixedDatatypesScan_Bool
2023/09/12 19:48:11 In TestMixedDatatypesScan_Bool()
2023/09/12 19:48:11 In DropAllSecondaryIndexes()
2023/09/12 19:48:11 Index found: index_mixeddt
2023/09/12 19:48:11 Dropped index index_mixeddt
2023/09/12 19:48:11 Number of number fields is: 227
2023/09/12 19:48:11 Number of string fields is: 261
2023/09/12 19:48:11 Number of json fields is: 244
2023/09/12 19:48:11 Number of true bool fields is: 132
2023/09/12 19:48:11 Number of false bool fields is: 136
2023/09/12 19:48:11 Setting mixed datatypes JSON docs in KV
2023/09/12 19:48:16 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/12 19:48:16 Index is 15380384806426895453 now active
2023/09/12 19:48:17 Using n1ql client
2023/09/12 19:48:17 Expected and Actual scan responses are the same
2023/09/12 19:48:17 Lengths of expected and actual scan results are: 528 and 528
2023/09/12 19:48:17 Using n1ql client
2023/09/12 19:48:17 Expected and Actual scan responses are the same
2023/09/12 19:48:17 Lengths of expected and actual scan results are: 481 and 481
2023/09/12 19:48:17 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (5.79s)
=== RUN TestLargeSecondaryKeyLength
2023/09/12 19:48:17 In TestLargeSecondaryKeyLength()
2023/09/12 19:48:17 In DropAllSecondaryIndexes()
2023/09/12 19:48:17 Index found: index_mixeddt
2023/09/12 19:48:17 Dropped index index_mixeddt
2023/09/12 19:48:17 Setting JSON docs in KV
2023/09/12 19:48:22 Created the secondary index index_LongSecField. Waiting for it become active
2023/09/12 19:48:22 Index is 14874904095473485662 now active
2023/09/12 19:48:22 Using n1ql client
2023/09/12 19:48:22 ScanAll: Lengths of expected and actual scan results are: 1000 and 1000
2023/09/12 19:48:22 Expected and Actual scan responses are the same
2023/09/12 19:48:22 Using n1ql client
2023/09/12 19:48:22 Range: Lengths of expected and actual scan results are: 820 and 820
2023/09/12 19:48:22 Expected and Actual scan responses are the same
2023/09/12 19:48:22 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (5.82s)
=== RUN TestLargePrimaryKeyLength
2023/09/12 19:48:22 In TestLargePrimaryKeyLength()
2023/09/12 19:48:22 In DropAllSecondaryIndexes()
2023/09/12 19:48:22 Index found: index_LongSecField
2023/09/12 19:48:22 Dropped index index_LongSecField
2023/09/12 19:48:23 Setting JSON docs in KV
2023/09/12 19:48:28 Created the secondary index index_LongPrimaryField. Waiting for it become active
2023/09/12 19:48:28 Index is 15538506757993202571 now active
2023/09/12 19:48:28 Using n1ql client
2023/09/12 19:48:30 Lengths of num of docs and scanResults are: 17002 and 17002
2023/09/12 19:48:30 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (7.18s)
=== RUN TestUpdateMutations_DeleteField
2023/09/12 19:48:30 In TestUpdateMutations_DeleteField()
2023/09/12 19:48:30 Setting JSON docs in KV
2023/09/12 19:48:36 Created the secondary index index_bal. Waiting for it become active
2023/09/12 19:48:36 Index is 2895610448564447946 now active
2023/09/12 19:48:36 Using n1ql client
2023/09/12 19:48:36 Expected and Actual scan responses are the same
2023/09/12 19:48:36 Using n1ql client
2023/09/12 19:48:36 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (6.74s)
=== RUN TestUpdateMutations_AddField
2023/09/12 19:48:36 In TestUpdateMutations_AddField()
2023/09/12 19:48:37 Setting JSON docs in KV
2023/09/12 19:48:43 Created the secondary index index_newField. Waiting for it become active
2023/09/12 19:48:43 Index is 17154983828688978042 now active
2023/09/12 19:48:43 Using n1ql client
2023/09/12 19:48:43 Count of scan results before add field mutations: 0
2023/09/12 19:48:43 Expected and Actual scan responses are the same
2023/09/12 19:48:43 Using n1ql client
2023/09/12 19:48:43 Count of scan results after add field mutations: 300
2023/09/12 19:48:43 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (7.19s)
=== RUN TestUpdateMutations_DataTypeChange
2023/09/12 19:48:43 In TestUpdateMutations_DataTypeChange()
2023/09/12 19:48:44 Setting JSON docs in KV
2023/09/12 19:48:51 Created the secondary index index_isUserActive. Waiting for it become active
2023/09/12 19:48:51 Index is 6909229707794006724 now active
2023/09/12 19:48:51 Using n1ql client
2023/09/12 19:48:52 Expected and Actual scan responses are the same
2023/09/12 19:48:52 Using n1ql client
2023/09/12 19:48:52 Expected and Actual scan responses are the same
2023/09/12 19:48:52 Using n1ql client
2023/09/12 19:48:52 Expected and Actual scan responses are the same
2023/09/12 19:48:52 Using n1ql client
2023/09/12 19:48:52 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (8.41s)
=== RUN TestMultipleBuckets
2023/09/12 19:48:52 In TestMultipleBuckets()
2023/09/12 19:48:52 In DropAllSecondaryIndexes()
2023/09/12 19:48:52 Index found: index_LongPrimaryField
2023/09/12 19:48:52 Dropped index index_LongPrimaryField
2023/09/12 19:48:52 Index found: index_newField
2023/09/12 19:48:52 Dropped index index_newField
2023/09/12 19:48:52 Index found: index_bal
2023/09/12 19:48:52 Dropped index index_bal
2023/09/12 19:48:52 Index found: index_isUserActive
2023/09/12 19:48:52 Dropped index index_isUserActive
2023/09/12 19:49:30 Flushed the bucket default, Response body:
2023/09/12 19:49:33 Modified parameters of bucket default, responseBody:
2023/09/12 19:49:33 Created bucket testbucket2, responseBody:
2023/09/12 19:49:33 Created bucket testbucket3, responseBody:
2023/09/12 19:49:33 Created bucket testbucket4, responseBody:
2023/09/12 19:49:48 Generating docs and Populating all the buckets
2023/09/12 19:49:52 Created the secondary index bucket1_age. Waiting for it become active
2023/09/12 19:49:52 Index is 14093220727017077463 now active
2023/09/12 19:49:58 Created the secondary index bucket2_city. Waiting for it become active
2023/09/12 19:49:58 Index is 4890369934641621567 now active
2023/09/12 19:50:04 Created the secondary index bucket3_gender. Waiting for it become active
2023/09/12 19:50:04 Index is 13219134939348065966 now active
2023/09/12 19:50:11 Created the secondary index bucket4_balance. Waiting for it become active
2023/09/12 19:50:11 Index is 10654842939145082241 now active
2023/09/12 19:50:14 Using n1ql client
2023/09/12 19:50:14 Expected and Actual scan responses are the same
2023/09/12 19:50:14 Using n1ql client
2023-09-12T19:50:14.941+05:30 [Info] GSIC[default/testbucket2-_default-_default-1694528414937839734] started ...
2023/09/12 19:50:14 Expected and Actual scan responses are the same
2023/09/12 19:50:14 Using n1ql client
2023-09-12T19:50:14.957+05:30 [Info] GSIC[default/testbucket3-_default-_default-1694528414952815152] started ...
2023/09/12 19:50:14 Expected and Actual scan responses are the same
2023/09/12 19:50:14 Using n1ql client
2023-09-12T19:50:14.969+05:30 [Info] GSIC[default/testbucket4-_default-_default-1694528414966925354] started ...
2023/09/12 19:50:14 Expected and Actual scan responses are the same
2023/09/12 19:50:17 Deleted bucket testbucket2, responseBody:
2023/09/12 19:50:19 Deleted bucket testbucket3, responseBody:
2023/09/12 19:50:21 Deleted bucket testbucket4, responseBody:
2023/09/12 19:50:24 Modified parameters of bucket default, responseBody:
--- PASS: TestMultipleBuckets (107.20s)
=== RUN TestBucketFlush
2023/09/12 19:50:39 In TestBucketFlush()
2023/09/12 19:50:39 In DropAllSecondaryIndexes()
2023/09/12 19:50:39 Index found: bucket1_age
2023/09/12 19:50:39 Dropped index bucket1_age
2023/09/12 19:51:17 Flushed the bucket default, Response body:
2023/09/12 19:51:21 Created the secondary index index_age. Waiting for it become active
2023/09/12 19:51:21 Index is 4284707081018771916 now active
2023/09/12 19:51:21 Using n1ql client
2023/09/12 19:51:21 Expected and Actual scan responses are the same
2023/09/12 19:51:28 Created the secondary index index_gender. Waiting for it become active
2023/09/12 19:51:28 Index is 1434641767147111815 now active
2023/09/12 19:51:28 Using n1ql client
2023/09/12 19:51:28 Expected and Actual scan responses are the same
2023/09/12 19:51:34 Created the secondary index index_city. Waiting for it become active
2023/09/12 19:51:34 Index is 5751643299900615362 now active
2023/09/12 19:51:34 Using n1ql client
2023/09/12 19:51:35 Expected and Actual scan responses are the same
2023/09/12 19:52:13 Flushed the bucket default, Response body:
2023/09/12 19:52:13 TestBucketFlush:: Flushed the bucket
2023/09/12 19:52:13 Using n1ql client
2023/09/12 19:52:13 Using n1ql client
2023/09/12 19:52:13 Using n1ql client
--- PASS: TestBucketFlush (93.88s)
=== RUN TestLargeDocumentSize
2023/09/12 19:52:13 In TestLargeDocumentSize()
2023/09/12 19:52:13 Data file exists. Skipping download
2023/09/12 19:52:13 Length of docs and largeDocs = 200 and 200
2023/09/12 19:52:17 Created the secondary index index_userscreenname. Waiting for it become active
2023/09/12 19:52:17 Index is 8545666238427088387 now active
2023/09/12 19:52:17 Using n1ql client
2023/09/12 19:52:17 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (4.37s)
=== RUN TestFieldsWithSpecialCharacters
2023/09/12 19:52:17 In TestFieldsWithSpecialCharacters()
2023/09/12 19:52:24 Created the secondary index index_specialchar. Waiting for it become active
2023/09/12 19:52:24 Index is 13637094226632494473 now active
2023/09/12 19:52:24 Looking up for value x1Š£1†€
2023/09/12 19:52:24 Using n1ql client
2023/09/12 19:52:25 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (7.41s)
=== RUN TestLargeKeyLookup
2023/09/12 19:52:25 In TestLargeKeyLookup()
2023/09/12 19:52:31 Created the secondary index index_largeKeyLookup. Waiting for it become active
2023/09/12 19:52:31 Index is 9893270275438422821 now active
2023/09/12 19:52:31 Looking up for a large key
2023/09/12 19:52:31 Using n1ql client
2023/09/12 19:52:31 Expected and Actual scan responses are the same
--- PASS: TestLargeKeyLookup (6.34s)
=== RUN TestIndexNameValidation
2023/09/12 19:52:31 In TestIndexNameValidation()
2023/09/12 19:52:31 Setting JSON docs in KV
2023/09/12 19:52:32 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected
2023/09/12 19:52:38 Created the secondary index #primary-Index_test. Waiting for it become active
2023/09/12 19:52:38 Index is 6044035604049219563 now active
2023/09/12 19:52:38 Using n1ql client
2023/09/12 19:52:38 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (6.48s)
=== RUN TestSameFieldNameAtDifferentLevels
2023/09/12 19:52:38 In TestSameFieldNameAtDifferentLevels()
2023/09/12 19:52:38 Setting JSON docs in KV
2023/09/12 19:52:44 Created the secondary index cityindex. Waiting for it become active
2023/09/12 19:52:44 Index is 9564807077263507981 now active
2023/09/12 19:52:44 Using n1ql client
2023/09/12 19:52:44 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (6.86s)
=== RUN TestSameIndexNameInTwoBuckets
2023/09/12 19:52:44 In TestSameIndexNameInTwoBuckets()
2023/09/12 19:52:44 In DropAllSecondaryIndexes()
2023/09/12 19:52:44 Index found: index_specialchar
2023/09/12 19:52:44 Dropped index index_specialchar
2023/09/12 19:52:44 Index found: index_gender
2023/09/12 19:52:45 Dropped index index_gender
2023/09/12 19:52:45 Index found: #primary-Index_test
2023/09/12 19:52:45 Dropped index #primary-Index_test
2023/09/12 19:52:45 Index found: index_largeKeyLookup
2023/09/12 19:52:45 Dropped index index_largeKeyLookup
2023/09/12 19:52:45 Index found: index_city
2023/09/12 19:52:45 Dropped index index_city
2023/09/12 19:52:45 Index found: index_userscreenname
2023/09/12 19:52:45 Dropped index index_userscreenname
2023/09/12 19:52:45 Index found: index_age
2023/09/12 19:52:45 Dropped index index_age
2023/09/12 19:52:45 Index found: cityindex
2023/09/12 19:52:45 Dropped index cityindex
2023/09/12 19:53:23 Flushed the bucket default, Response body:
2023/09/12 19:53:26 Modified parameters of bucket default, responseBody:
2023/09/12 19:53:26 Created bucket buck2, responseBody:
2023/09/12 19:53:41 Generating docs and Populating all the buckets
2023/09/12 19:53:45 Created the secondary index b_idx. Waiting for it become active
2023/09/12 19:53:45 Index is 16054898250810296376 now active
2023/09/12 19:53:51 Created the secondary index b_idx. Waiting for it become active
2023/09/12 19:53:51 Index is 6849200829638964607 now active
2023/09/12 19:53:54 Using n1ql client
2023/09/12 19:53:54 Expected and Actual scan responses are the same
2023/09/12 19:53:54 Using n1ql client
2023-09-12T19:53:54.748+05:30 [Info] GSIC[default/buck2-_default-_default-1694528634742240724] started ...
2023/09/12 19:53:54 Expected and Actual scan responses are the same
2023/09/12 19:53:57 Modified parameters of bucket default, responseBody:
2023/09/12 19:54:00 Deleted bucket buck2, responseBody:
--- PASS: TestSameIndexNameInTwoBuckets (90.19s)
=== RUN TestLargeKeysSplChars
2023/09/12 19:54:15 In TestLargeKeysSplChars()
2023/09/12 19:54:24 Created the secondary index idspl1. Waiting for it become active
2023/09/12 19:54:24 Index is 15694017249738250542 now active
2023/09/12 19:54:32 Created the secondary index idspl2. Waiting for it become active
2023/09/12 19:54:32 Index is 2886965336642745598 now active
2023/09/12 19:54:38 Created the secondary index idspl3. Waiting for it become active
2023/09/12 19:54:38 Index is 2547256873287014244 now active
2023/09/12 19:54:38 Using n1ql client
2023/09/12 19:54:38 Expected and Actual scan responses are the same
2023-09-12T19:54:38.842+05:30 [Error] transport error between 127.0.0.1:49472->127.0.0.1:9107: write tcp 127.0.0.1:49472->127.0.0.1:9107: write: broken pipe
2023-09-12T19:54:38.842+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:49472->127.0.0.1:9107: write: broken pipe`
2023-09-12T19:54:38.842+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T19:54:38.843+05:30 [Error] metadataClient:PickRandom: Replicas - [4068137035599842614], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 19:54:39 Expected and Actual scan responses are the same
2023/09/12 19:54:39 Using n1ql client
2023/09/12 19:54:39 Expected and Actual scan responses are the same
--- PASS: TestLargeKeysSplChars (24.13s)
=== RUN TestVeryLargeIndexKey
2023/09/12 19:54:39 In DropAllSecondaryIndexes()
2023/09/12 19:54:39 Index found: b_idx
2023/09/12 19:54:39 Dropped index b_idx
2023/09/12 19:54:39 Index found: idspl3
2023/09/12 19:54:39 Dropped index idspl3
2023/09/12 19:54:39 Index found: idspl2
2023/09/12 19:54:39 Dropped index idspl2
2023/09/12 19:54:39 Index found: idspl1
2023/09/12 19:54:39 Dropped index idspl1
2023/09/12 19:55:17 Flushed the bucket default, Response body:
2023/09/12 19:55:17 TestVeryLargeIndexKey:: Flushed the bucket
2023/09/12 19:55:18 clusterconfig.KVAddress = 127.0.0.1:9000
2023/09/12 19:55:22 Created the secondary index i1. Waiting for it become active
2023/09/12 19:55:22 Index is 4219399859741893507 now active
2023/09/12 19:55:22 Using n1ql client
2023/09/12 19:55:24 Expected and Actual scan responses are the same
2023/09/12 19:55:30 Created the secondary index i2. Waiting for it become active
2023/09/12 19:55:30 Index is 2277473667658018197 now active
2023/09/12 19:55:30 Using n1ql client
2023/09/12 19:55:30 Expected and Actual scan responses are the same
2023/09/12 19:55:30 In DropAllSecondaryIndexes()
2023/09/12 19:55:30 Index found: i1
2023/09/12 19:55:30 Dropped index i1
2023/09/12 19:55:30 Index found: i2
2023/09/12 19:55:30 Dropped index i2
2023/09/12 19:56:08 Flushed the bucket default, Response body:
--- PASS: TestVeryLargeIndexKey (89.54s)
=== RUN TestTempBufScanResult
2023/09/12 19:56:08 In DropAllSecondaryIndexes()
2023/09/12 19:56:46 Flushed the bucket default, Response body:
2023/09/12 19:56:46 TestTempBufScanResult:: Flushed the bucket
2023/09/12 19:56:49 Created the secondary index index_idxKey. Waiting for it become active
2023/09/12 19:56:49 Index is 11519486393557287260 now active
2023/09/12 19:56:49 Using n1ql client
2023/09/12 19:56:51 Expected and Actual scan responses are the same
2023/09/12 19:56:51 In DropAllSecondaryIndexes()
2023/09/12 19:56:51 Index found: index_idxKey
2023/09/12 19:56:51 Dropped index index_idxKey
2023/09/12 19:57:29 Flushed the bucket default, Response body:
--- PASS: TestTempBufScanResult (80.50s)
=== RUN TestBuildDeferredAnotherBuilding
2023/09/12 19:57:29 In TestBuildDeferredAnotherBuilding()
2023/09/12 19:57:29 In DropAllSecondaryIndexes()
2023/09/12 19:58:12 Setting JSON docs in KV
2023/09/12 20:00:07 Build the deferred index id_age1. Waiting for the index to become active
2023/09/12 20:00:07 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:08 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:09 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:10 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:11 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:12 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:13 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:14 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:15 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:16 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:17 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:18 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:19 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:20 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:21 Waiting for index 573209252832848229 to go active ...
2023/09/12 20:00:22 Index is 573209252832848229 now active
2023/09/12 20:00:22 Build command issued for the deferred indexes [9214495318651101841]
2023/09/12 20:00:24 Build index failed as expected: Build index failed. Encountered transient error. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2023/09/12 20:00:24 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:25 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:26 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:27 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:28 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:29 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:30 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:31 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:32 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:33 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:34 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:35 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:36 Waiting for index 9214495318651101841 to go active ...
2023/09/12 20:00:37 Index is 9214495318651101841 now active
2023/09/12 20:00:37 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:38 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:39 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:40 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:41 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:42 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:43 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:44 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:45 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:46 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:47 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:48 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:49 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:50 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:51 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:52 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:53 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:54 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:55 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:56 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:57 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:58 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:00:59 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:00 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:01 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:02 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:03 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:04 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:05 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:06 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:07 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:08 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:09 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:10 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:11 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:12 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:13 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:14 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:15 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:16 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:17 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:18 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:19 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:20 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:21 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:22 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:23 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:24 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:25 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:26 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:27 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:28 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:29 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:30 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:31 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:32 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:33 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:34 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:35 Waiting for index 3688129175410874182 to go active ...
2023/09/12 20:01:36 Index is 3688129175410874182 now active
2023/09/12 20:01:36 Using n1ql client
2023/09/12 20:01:37 Expected and Actual scan responses are the same
2023/09/12 20:01:37 Using n1ql client
2023/09/12 20:01:37 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (248.31s)
=== RUN TestMultipleBucketsDeferredBuild
2023/09/12 20:01:37 In TestMultipleBucketsDeferredBuild()
2023/09/12 20:01:37 In DropAllSecondaryIndexes()
2023/09/12 20:01:37 Index found: id_age
2023/09/12 20:01:37 Dropped index id_age
2023/09/12 20:01:37 Index found: id_age1
2023/09/12 20:01:37 Dropped index id_age1
2023/09/12 20:01:37 Index found: id_company
2023/09/12 20:01:38 Dropped index id_company
2023/09/12 20:02:15 Flushed the bucket default, Response body:
2023/09/12 20:02:18 Modified parameters of bucket default, responseBody:
2023/09/12 20:02:18 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2023/09/12 20:02:18 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/12 20:02:18 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 14:32:17 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0087cce80 31 [] false false map[] 0xc007bb2d00 }
2023/09/12 20:02:18 DeleteBucket failed for bucket defertest_buck2
2023/09/12 20:02:18 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2023/09/12 20:02:18 Created bucket defertest_buck2, responseBody:
2023/09/12 20:02:33 Setting JSON docs in KV
2023/09/12 20:03:46 Build command issued for the deferred indexes [18303125086956327861]
2023/09/12 20:03:47 Build command issued for the deferred indexes [10496277304986091588 11936890567365124323]
2023/09/12 20:03:47 Index state of 11936890567365124323 is INDEX_STATE_READY
2023/09/12 20:03:47 Waiting for index 18303125086956327861 to go active ...
2023/09/12 20:03:48 Waiting for index 18303125086956327861 to go active ...
2023/09/12 20:03:49 Waiting for index 18303125086956327861 to go active ...
2023/09/12 20:03:50 Waiting for index 18303125086956327861 to go active ...
2023/09/12 20:03:51 Waiting for index 18303125086956327861 to go active ...
2023/09/12 20:03:52 Waiting for index 18303125086956327861 to go active ...
2023/09/12 20:03:53 Waiting for index 18303125086956327861 to go active ...
2023/09/12 20:03:54 Waiting for index 18303125086956327861 to go active ...
2023/09/12 20:03:55 Index is 18303125086956327861 now active
2023/09/12 20:03:55 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:03:56 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:03:57 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:03:58 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:03:59 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:00 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:01 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:02 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:03 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:04 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:05 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:06 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:07 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:08 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:09 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:10 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:11 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:12 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:13 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:14 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:15 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:16 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:17 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:18 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:19 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:20 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:21 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:22 Waiting for index 10496277304986091588 to go active ...
2023/09/12 20:04:23 Index is 10496277304986091588 now active
2023/09/12 20:04:23 Using n1ql client
2023/09/12 20:04:23 Expected and Actual scan responses are the same
2023/09/12 20:04:23 Using n1ql client
2023/09/12 20:04:23 Expected and Actual scan responses are the same
2023/09/12 20:04:23 Using n1ql client
2023-09-12T20:04:23.747+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1694529263744900576] started ...
2023/09/12 20:04:23 Expected and Actual scan responses are the same
2023/09/12 20:04:26 Modified parameters of bucket default, responseBody:
2023/09/12 20:04:28 Deleted bucket defertest_buck2, responseBody:
--- PASS: TestMultipleBucketsDeferredBuild (176.29s)
=== RUN TestCreateDropCreateDeferredIndex
2023/09/12 20:04:33 In TestCreateDropCreateDeferredIndex()
2023/09/12 20:04:33 In DropAllSecondaryIndexes()
2023/09/12 20:04:33 Index found: buck1_id1
2023/09/12 20:04:33 Dropped index buck1_id1
2023/09/12 20:04:33 Index found: buck1_id2
2023/09/12 20:04:34 Dropped index buck1_id2
2023/09/12 20:04:36 Setting JSON docs in KV
2023/09/12 20:04:47 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:04:47 Index is 7317895381181550415 now active
2023/09/12 20:04:49 Dropping the secondary index id_age
2023/09/12 20:04:49 Index dropped
2023/09/12 20:04:52 Setting JSON docs in KV
2023/09/12 20:05:00 Using n1ql client
2023/09/12 20:05:00 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (27.08s)
=== RUN TestMultipleDeferredIndexes_BuildTogether
2023/09/12 20:05:00 In TestMultipleDeferredIndexes_BuildTogether()
2023/09/12 20:05:00 In DropAllSecondaryIndexes()
2023/09/12 20:05:00 Index found: id_company
2023/09/12 20:05:01 Dropped index id_company
2023/09/12 20:05:03 Setting JSON docs in KV
2023/09/12 20:05:16 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:05:16 Index is 3774567563334305694 now active
2023/09/12 20:05:18 Build command issued for the deferred indexes [id_age id_gender id_isActive], bucket: default, scope: _default, coll: _default
2023/09/12 20:05:18 Waiting for the index id_age to become active
2023/09/12 20:05:18 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:19 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:20 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:21 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:22 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:23 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:24 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:25 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:26 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:27 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:28 Waiting for index 16928407282055004829 to go active ...
2023/09/12 20:05:29 Index is 16928407282055004829 now active
2023/09/12 20:05:29 Waiting for the index id_gender to become active
2023/09/12 20:05:29 Index is 1343707035670067682 now active
2023/09/12 20:05:29 Waiting for the index id_isActive to become active
2023/09/12 20:05:29 Waiting for index 1717951988987956344 to go active ...
2023/09/12 20:05:30 Index is 1717951988987956344 now active
2023/09/12 20:05:30 Using n1ql client
2023/09/12 20:05:30 Expected and Actual scan responses are the same
2023/09/12 20:05:34 Setting JSON docs in KV
2023/09/12 20:05:43 Using n1ql client
2023/09/12 20:05:43 Expected and Actual scan responses are the same
2023/09/12 20:05:44 Using n1ql client
2023/09/12 20:05:44 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (43.33s)
=== RUN TestMultipleDeferredIndexes_BuildOneByOne
2023/09/12 20:05:44 In TestMultipleDeferredIndexes_BuildOneByOne()
2023/09/12 20:05:44 In DropAllSecondaryIndexes()
2023/09/12 20:05:44 Index found: id_isActive
2023/09/12 20:05:44 Dropped index id_isActive
2023/09/12 20:05:44 Index found: id_age
2023/09/12 20:05:44 Dropped index id_age
2023/09/12 20:05:44 Index found: id_gender
2023/09/12 20:05:44 Dropped index id_gender
2023/09/12 20:05:44 Index found: id_company
2023/09/12 20:05:44 Dropped index id_company
2023/09/12 20:05:47 Setting JSON docs in KV
2023/09/12 20:06:00 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:06:00 Index is 13458923549225492727 now active
2023/09/12 20:06:01 Build command issued for the deferred indexes [id_age], bucket: default, scope: _default, coll: _default
2023/09/12 20:06:01 Waiting for the index id_age to become active
2023/09/12 20:06:01 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:02 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:03 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:04 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:05 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:06 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:07 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:08 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:09 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:10 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:11 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:12 Waiting for index 10362064625214144436 to go active ...
2023/09/12 20:06:13 Index is 10362064625214144436 now active
2023/09/12 20:06:13 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 20:06:13 Waiting for the index id_gender to become active
2023/09/12 20:06:13 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:14 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:15 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:16 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:17 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:18 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:19 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:20 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:21 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:22 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:23 Waiting for index 8206422914587520210 to go active ...
2023/09/12 20:06:24 Index is 8206422914587520210 now active
2023/09/12 20:06:24 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/09/12 20:06:24 Waiting for the index id_isActive to become active
2023/09/12 20:06:24 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:25 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:26 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:27 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:28 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:29 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:30 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:31 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:32 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:33 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:34 Waiting for index 2563355696419653729 to go active ...
2023/09/12 20:06:35 Index is 2563355696419653729 now active
2023/09/12 20:06:35 Using n1ql client
2023/09/12 20:06:35 Expected and Actual scan responses are the same
2023/09/12 20:06:38 Setting JSON docs in KV
2023/09/12 20:06:46 Using n1ql client
2023/09/12 20:06:47 Expected and Actual scan responses are the same
2023/09/12 20:06:47 Using n1ql client
2023/09/12 20:06:47 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (63.18s)
=== RUN TestDropDeferredIndexWhileOthersBuilding
2023/09/12 20:06:47 In TestDropDeferredIndexWhileOthersBuilding()
2023/09/12 20:06:47 In DropAllSecondaryIndexes()
2023/09/12 20:06:47 Index found: id_gender
2023/09/12 20:06:47 Dropped index id_gender
2023/09/12 20:06:47 Index found: id_age
2023/09/12 20:06:47 Dropped index id_age
2023/09/12 20:06:47 Index found: id_isActive
2023/09/12 20:06:47 Dropped index id_isActive
2023/09/12 20:06:47 Index found: id_company
2023/09/12 20:06:47 Dropped index id_company
2023/09/12 20:06:50 Setting JSON docs in KV
2023/09/12 20:07:06 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:07:06 Index is 4141327982758687068 now active
2023/09/12 20:07:07 Build command issued for the deferred indexes [5213504413309425034 1240580357048257880]
2023/09/12 20:07:09 Dropping the secondary index id_isActive
2023/09/12 20:07:09 Index dropped
2023/09/12 20:07:09 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:10 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:11 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:12 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:13 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:14 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:15 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:16 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:17 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:18 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:19 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:20 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:21 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:22 Waiting for index 5213504413309425034 to go active ...
2023/09/12 20:07:23 Index is 5213504413309425034 now active
2023/09/12 20:07:23 Index is 1240580357048257880 now active
2023/09/12 20:07:25 Using n1ql client
2023/09/12 20:07:25 Expected and Actual scan responses are the same
2023/09/12 20:07:25 Using n1ql client
2023/09/12 20:07:25 Expected and Actual scan responses are the same
2023/09/12 20:07:27 Setting JSON docs in KV
2023/09/12 20:07:35 Using n1ql client
2023/09/12 20:07:36 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (48.73s)
=== RUN TestDropBuildingDeferredIndex
2023/09/12 20:07:36 In TestDropBuildingDeferredIndex()
2023/09/12 20:07:36 In DropAllSecondaryIndexes()
2023/09/12 20:07:36 Index found: id_age
2023/09/12 20:07:36 Dropped index id_age
2023/09/12 20:07:36 Index found: id_company
2023/09/12 20:07:36 Dropped index id_company
2023/09/12 20:07:36 Index found: id_gender
2023/09/12 20:07:36 Dropped index id_gender
2023/09/12 20:07:39 Setting JSON docs in KV
2023/09/12 20:07:44 Build command issued for the deferred indexes [5694138683840399644 3328506765027766757]
2023/09/12 20:07:45 Dropping the secondary index id_age
2023/09/12 20:07:45 Index dropped
2023/09/12 20:07:45 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:46 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:47 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:48 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:49 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:50 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:51 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:52 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:53 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:54 Waiting for index 5694138683840399644 to go active ...
2023/09/12 20:07:55 Index is 5694138683840399644 now active
2023/09/12 20:07:55 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 20:07:55 Waiting for the index id_gender to become active
2023/09/12 20:07:55 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:07:56 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:07:57 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:07:58 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:07:59 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:00 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:01 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:02 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:03 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:04 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:05 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:06 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:07 Waiting for index 9367389480709164935 to go active ...
2023/09/12 20:08:08 Index is 9367389480709164935 now active
2023/09/12 20:08:09 Using n1ql client
2023/09/12 20:08:10 Expected and Actual scan responses are the same
2023/09/12 20:08:10 Using n1ql client
2023/09/12 20:08:10 Expected and Actual scan responses are the same
2023/09/12 20:08:12 Setting JSON docs in KV
2023/09/12 20:08:21 Using n1ql client
2023/09/12 20:08:22 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (46.53s)
=== RUN TestDropMultipleBuildingDeferredIndexes
2023/09/12 20:08:22 In TestDropMultipleBuildingDeferredIndexes()
2023/09/12 20:08:22 In DropAllSecondaryIndexes()
2023/09/12 20:08:22 Index found: id_gender
2023/09/12 20:08:22 Dropped index id_gender
2023/09/12 20:08:22 Index found: id_company
2023/09/12 20:08:22 Dropped index id_company
2023/09/12 20:08:30 Setting JSON docs in KV
2023/09/12 20:09:00 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:09:00 Index is 16074130717938661066 now active
2023/09/12 20:09:01 Build command issued for the deferred indexes [15031296059639755966 14332320390826275706]
2023/09/12 20:09:02 Dropping the secondary index id_age
2023/09/12 20:09:02 Index dropped
2023/09/12 20:09:02 Dropping the secondary index id_gender
2023/09/12 20:09:15 Index dropped
2023/09/12 20:09:16 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/09/12 20:09:16 Waiting for the index id_isActive to become active
2023/09/12 20:09:16 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:17 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:18 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:19 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:20 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:21 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:22 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:23 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:24 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:25 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:26 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:27 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:28 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:29 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:30 Waiting for index 8512008719346936163 to go active ...
2023/09/12 20:09:31 Index is 8512008719346936163 now active
2023/09/12 20:09:41 Using n1ql client
2023/09/12 20:09:42 Expected and Actual scan responses are the same
2023/09/12 20:09:42 Number of docScanResults and scanResults = 180000 and 180000
2023/09/12 20:09:43 Using n1ql client
2023/09/12 20:09:44 Expected and Actual scan responses are the same
2023/09/12 20:09:44 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (81.46s)
=== RUN TestDropOneIndexSecondDeferBuilding
2023/09/12 20:09:44 In TestDropOneIndexSecondDeferBuilding()
2023/09/12 20:09:44 In DropAllSecondaryIndexes()
2023/09/12 20:09:44 Index found: id_company
2023/09/12 20:09:44 Dropped index id_company
2023/09/12 20:09:44 Index found: id_isActive
2023/09/12 20:09:44 Dropped index id_isActive
2023/09/12 20:09:46 Setting JSON docs in KV
2023/09/12 20:09:51 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/09/12 20:09:51 Waiting for the index id_company to become active
2023/09/12 20:09:51 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:09:52 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:09:53 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:09:54 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:09:55 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:09:56 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:09:57 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:09:58 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:09:59 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:00 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:01 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:02 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:03 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:04 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:05 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:06 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:07 Waiting for index 15947127400361696853 to go active ...
2023/09/12 20:10:08 Index is 15947127400361696853 now active
2023/09/12 20:10:08 Build command issued for the deferred indexes [16955961139227432866]
2023/09/12 20:10:09 Dropping the secondary index id_company
2023/09/12 20:10:09 Index dropped
2023/09/12 20:10:15 Setting JSON docs in KV
2023/09/12 20:10:31 Index is 16955961139227432866 now active
2023/09/12 20:10:31 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 20:10:31 Waiting for the index id_gender to become active
2023/09/12 20:10:31 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:32 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:33 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:34 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:35 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:36 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:37 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:38 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:39 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:40 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:41 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:42 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:43 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:44 Waiting for index 5738383231150760886 to go active ...
2023/09/12 20:10:45 Index is 5738383231150760886 now active
2023/09/12 20:10:45 Using n1ql client
2023/09/12 20:10:45 Expected and Actual scan responses are the same
2023/09/12 20:10:45 Using n1ql client
2023/09/12 20:10:47 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (63.32s)
=== RUN TestDropSecondIndexSecondDeferBuilding
2023/09/12 20:10:47 In TestDropSecondIndexSecondDeferBuilding()
2023/09/12 20:10:47 In DropAllSecondaryIndexes()
2023/09/12 20:10:47 Index found: id_gender
2023/09/12 20:10:47 Dropped index id_gender
2023/09/12 20:10:47 Index found: id_age
2023/09/12 20:10:47 Dropped index id_age
2023/09/12 20:10:49 Setting JSON docs in KV
2023/09/12 20:10:55 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/09/12 20:10:55 Waiting for the index id_company to become active
2023/09/12 20:10:55 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:10:56 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:10:57 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:10:58 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:10:59 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:00 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:01 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:02 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:03 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:04 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:05 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:06 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:07 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:08 Waiting for index 14272573736000818638 to go active ...
2023/09/12 20:11:09 Index is 14272573736000818638 now active
2023/09/12 20:11:09 Build command issued for the deferred indexes [6597713474739326154]
2023/09/12 20:11:10 Dropping the secondary index id_age
2023/09/12 20:11:10 Index dropped
2023/09/12 20:11:15 Setting JSON docs in KV
2023/09/12 20:11:24 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 20:11:24 Waiting for the index id_gender to become active
2023/09/12 20:11:24 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:25 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:26 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:27 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:28 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:29 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:30 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:31 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:32 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:33 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:34 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:35 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:36 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:37 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:38 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:39 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:40 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:41 Waiting for index 8906673454554785411 to go active ...
2023/09/12 20:11:42 Index is 8906673454554785411 now active
2023/09/12 20:11:42 Using n1ql client
2023/09/12 20:11:43 Expected and Actual scan responses are the same
2023/09/12 20:11:43 Using n1ql client
2023/09/12 20:11:45 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (58.06s)
=== RUN TestCreateAfterDropWhileIndexBuilding
2023/09/12 20:11:45 In TestCreateAfterDropWhileIndexBuilding()
2023/09/12 20:11:45 In DropAllSecondaryIndexes()
2023/09/12 20:11:45 Index found: id_company
2023/09/12 20:11:45 Dropped index id_company
2023/09/12 20:11:45 Index found: id_gender
2023/09/12 20:11:45 Dropped index id_gender
2023/09/12 20:12:07 Setting JSON docs in KV
2023/09/12 20:13:04 Build command issued for the deferred indexes [11259369138644494336]
2023/09/12 20:13:05 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:06 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:07 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:08 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:09 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:10 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:11 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:12 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:13 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:14 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:15 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:16 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:17 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:18 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:19 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:20 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:21 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:22 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:23 Waiting for index 11259369138644494336 to go active ...
2023/09/12 20:13:24 Index is 11259369138644494336 now active
2023/09/12 20:13:24 Build command issued for the deferred indexes [6948631668426089978]
2023/09/12 20:13:25 Dropping the secondary index id_company
2023/09/12 20:13:25 Index dropped
2023/09/12 20:13:25 Dropping the secondary index id_age
2023/09/12 20:13:27 Index dropped
2023/09/12 20:13:33 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/12 20:13:33 Waiting for the index id_gender to become active
2023/09/12 20:13:33 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:34 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:35 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:36 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:37 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:38 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:39 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:40 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:41 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:42 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:43 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:44 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:45 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:46 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:47 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:48 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:49 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:50 Waiting for index 1714654778231825949 to go active ...
2023/09/12 20:13:51 Index is 1714654778231825949 now active
2023/09/12 20:13:52 Index is 1714654778231825949 now active
2023/09/12 20:13:52 Using n1ql client
2023/09/12 20:13:54 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (129.01s)
=== RUN TestDropBuildingIndex1
2023/09/12 20:13:54 In TestDropBuildingIndex1()
2023/09/12 20:13:54 In DropAllSecondaryIndexes()
2023/09/12 20:13:54 Index found: id_gender
2023/09/12 20:13:54 Dropped index id_gender
2023/09/12 20:13:59 Setting JSON docs in KV
2023/09/12 20:14:28 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:14:28 Index is 9656932190036130799 now active
2023/09/12 20:14:51 Dropping the secondary index id_age
2023/09/12 20:14:51 Index dropped
2023/09/12 20:15:13 Created the secondary index id_age. Waiting for it become active
2023/09/12 20:15:13 Index is 465704348321408744 now active
2023/09/12 20:15:15 Setting JSON docs in KV
2023/09/12 20:15:24 Using n1ql client
2023/09/12 20:15:24 Expected and Actual scan responses are the same
2023/09/12 20:15:25 Using n1ql client
2023/09/12 20:15:25 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex1 (91.12s)
=== RUN TestDropBuildingIndex2
2023/09/12 20:15:25 In TestDropBuildingIndex2()
2023/09/12 20:15:25 In DropAllSecondaryIndexes()
2023/09/12 20:15:25 Index found: id_age
2023/09/12 20:15:25 Dropped index id_age
2023/09/12 20:15:25 Index found: id_company
2023/09/12 20:15:25 Dropped index id_company
2023/09/12 20:15:31 Setting JSON docs in KV
2023/09/12 20:16:03 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:16:03 Index is 10193030936432850646 now active
2023/09/12 20:16:28 Dropping the secondary index id_company
2023/09/12 20:16:28 Index dropped
2023/09/12 20:16:28 Index is 7670604338457108756 now active
2023/09/12 20:16:50 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:16:50 Index is 8885463394350508076 now active
2023/09/12 20:16:53 Setting JSON docs in KV
2023/09/12 20:17:01 Using n1ql client
2023/09/12 20:17:02 Expected and Actual scan responses are the same
2023/09/12 20:17:02 Using n1ql client
2023/09/12 20:17:03 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex2 (97.57s)
=== RUN TestDropIndexWithDataLoad
2023/09/12 20:17:03 In TestDropIndexWithDataLoad()
2023/09/12 20:17:03 In DropAllSecondaryIndexes()
2023/09/12 20:17:03 Index found: id_company
2023/09/12 20:17:03 Dropped index id_company
2023/09/12 20:17:03 Index found: id_age
2023/09/12 20:17:03 Dropped index id_age
2023/09/12 20:17:05 Setting JSON docs in KV
2023/09/12 20:17:32 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:17:32 Index is 14407945081364587374 now active
2023/09/12 20:17:56 Created the secondary index id_age. Waiting for it become active
2023/09/12 20:17:56 Index is 8230143521679308050 now active
2023/09/12 20:18:20 Created the secondary index id_gender. Waiting for it become active
2023/09/12 20:18:20 Index is 5649577157172468789 now active
2023/09/12 20:18:44 Created the secondary index id_isActive. Waiting for it become active
2023/09/12 20:18:44 Index is 7544533878548378030 now active
2023/09/12 20:18:51 Setting JSON docs in KV
2023/09/12 20:18:51 In DropIndexWhileKVLoad
2023/09/12 20:18:51 In LoadKVBucket
2023/09/12 20:18:51 Bucket name = default
2023/09/12 20:18:52 Dropping the secondary index id_company
2023/09/12 20:18:52 Index dropped
2023/09/12 20:19:19 Using n1ql client
2023/09/12 20:19:20 Expected and Actual scan responses are the same
2023/09/12 20:19:20 Number of docScanResults and scanResults = 96712 and 96712
2023/09/12 20:19:20 Using n1ql client
2023/09/12 20:19:24 Expected and Actual scan responses are the same
2023/09/12 20:19:24 Number of docScanResults and scanResults = 420000 and 420000
--- PASS: TestDropIndexWithDataLoad (140.72s)
=== RUN TestDropAllIndexesWithDataLoad
2023/09/12 20:19:24 In TestDropAllIndexesWithDataLoad()
2023/09/12 20:19:24 In DropAllSecondaryIndexes()
2023/09/12 20:19:24 Index found: id_isActive
2023/09/12 20:19:24 Dropped index id_isActive
2023/09/12 20:19:24 Index found: id_age
2023/09/12 20:19:24 Dropped index id_age
2023/09/12 20:19:24 Index found: id_gender
2023/09/12 20:19:24 Dropped index id_gender
2023/09/12 20:19:26 Setting JSON docs in KV
2023/09/12 20:20:01 Created the secondary index id_company. Waiting for it become active
2023/09/12 20:20:01 Index is 6337186301228797732 now active
2023/09/12 20:20:29 Created the secondary index id_age. Waiting for it become active
2023/09/12 20:20:29 Index is 197331797830475772 now active
2023/09/12 20:20:55 Created the secondary index id_gender. Waiting for it become active
2023/09/12 20:20:55 Index is 7791975902156061557 now active
2023/09/12 20:21:21 Created the secondary index id_isActive. Waiting for it become active
2023/09/12 20:21:21 Index is 5284507174468643221 now active
2023/09/12 20:21:28 Setting JSON docs in KV
2023/09/12 20:21:28 In LoadKVBucket
2023/09/12 20:21:28 Bucket name = default
2023/09/12 20:21:28 In DropIndexWhileKVLoad
2023/09/12 20:21:28 In DropIndexWhileKVLoad
2023/09/12 20:21:28 In DropIndexWhileKVLoad
2023/09/12 20:21:28 In DropIndexWhileKVLoad
2023/09/12 20:21:29 Dropping the secondary index id_isActive
2023/09/12 20:21:29 Dropping the secondary index id_gender
2023/09/12 20:21:29 Dropping the secondary index id_company
2023/09/12 20:21:29 Dropping the secondary index id_age
2023/09/12 20:21:29 Index dropped
2023/09/12 20:21:29 Index dropped
2023/09/12 20:21:29 Index dropped
2023/09/12 20:21:29 Index dropped
2023/09/12 20:21:47 Using n1ql client
2023/09/12 20:21:47 Scan failed as expected with error: Index Not Found - cause: GSI index id_company not found.
--- PASS: TestDropAllIndexesWithDataLoad (143.39s)
=== RUN TestCreateBucket_AnotherIndexBuilding
2023/09/12 20:21:47 In TestCreateBucket_AnotherIndexBuilding()
2023/09/12 20:21:47 In DropAllSecondaryIndexes()
2023/09/12 20:22:25 Flushed the bucket default, Response body:
2023/09/12 20:22:28 Modified parameters of bucket default, responseBody:
2023/09/12 20:22:28 http://127.0.0.1:9000/pools/default/buckets/multi_buck2
2023/09/12 20:22:28 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/12 20:22:28 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 14:52:27 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0025b7140 31 [] false false map[] 0xc00fec3300 }
2023/09/12 20:22:28 DeleteBucket failed for bucket multi_buck2
2023/09/12 20:22:28 Deleted bucket multi_buck2, responseBody: Requested resource not found.
2023/09/12 20:22:43 Setting JSON docs in KV
2023/09/12 20:24:42 Created bucket multi_buck2, responseBody:
2023/09/12 20:25:06 Index is 10456702774050588682 now active
2023/09/12 20:25:06 Index is 14063137806478993253 now active
2023/09/12 20:25:06 Using n1ql client
2023-09-12T20:25:06.085+05:30 [Info] GSIC[default/multi_buck2-_default-_default-1694530506082634205] started ...
2023/09/12 20:25:06 Expected and Actual scan responses are the same
2023/09/12 20:25:06 Number of docScanResults and scanResults = 10000 and 10000
2023/09/12 20:25:06 Using n1ql client
2023/09/12 20:25:11 Expected and Actual scan responses are the same
2023/09/12 20:25:11 Number of docScanResults and scanResults = 200000 and 200000
2023/09/12 20:25:14 Deleted bucket multi_buck2, responseBody:
2023/09/12 20:25:51 Flushed the bucket default, Response body:
--- PASS: TestCreateBucket_AnotherIndexBuilding (244.35s)
=== RUN TestDropBucket2Index_Bucket1IndexBuilding
2023/09/12 20:25:51 In TestDropBucket2Index_Bucket1IndexBuilding()
2023/09/12 20:25:51 In DropAllSecondaryIndexes()
2023/09/12 20:25:51 Index found: buck1_idx
2023/09/12 20:25:51 Dropped index buck1_idx
2023/09/12 20:26:30 Flushed the bucket default, Response body:
2023/09/12 20:26:33 Modified parameters of bucket default, responseBody:
2023/09/12 20:26:33 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3
2023/09/12 20:26:33 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/12 20:26:33 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 14:56:32 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc016363b00 31 [] false false map[] 0xc00ed7a400 }
2023/09/12 20:26:33 DeleteBucket failed for bucket multibucket_test3
2023/09/12 20:26:33 Deleted bucket multibucket_test3, responseBody: Requested resource not found.
2023/09/12 20:26:33 Created bucket multibucket_test3, responseBody:
2023/09/12 20:26:48 Setting JSON docs in KV
2023/09/12 20:27:48 Created the secondary index buck2_idx. Waiting for it become active
2023/09/12 20:27:48 Index is 15241403010336386257 now active
2023/09/12 20:28:01 Dropping the secondary index buck2_idx
2023/09/12 20:28:01 Index dropped
2023/09/12 20:28:01 Index is 6715473758748370526 now active
2023/09/12 20:28:01 Using n1ql client
2023/09/12 20:28:03 Expected and Actual scan responses are the same
2023/09/12 20:28:03 Number of docScanResults and scanResults = 100000 and 100000
2023/09/12 20:28:05 Deleted bucket multibucket_test3, responseBody:
2023/09/12 20:28:43 Flushed the bucket default, Response body:
--- PASS: TestDropBucket2Index_Bucket1IndexBuilding (171.88s)
=== RUN TestDeleteBucketWhileInitialIndexBuild
2023/09/12 20:28:43 In TestDeleteBucketWhileInitialIndexBuild()
2023/09/12 20:28:43 ============== DBG: Drop all indexes in all buckets
2023/09/12 20:28:43 In DropAllSecondaryIndexes()
2023/09/12 20:28:43 Index found: buck1_idx
2023/09/12 20:28:43 Dropped index buck1_idx
2023/09/12 20:28:43 ============== DBG: Delete bucket default
2023/09/12 20:28:45 Deleted bucket default, responseBody:
2023/09/12 20:28:45 ============== DBG: Create bucket default
2023/09/12 20:28:45 Created bucket default, responseBody:
2023/09/12 20:28:48 Flush Enabled on bucket default, responseBody:
2023/09/12 20:29:22 Flushed the bucket default, Response body:
2023/09/12 20:29:22 ============== DBG: Delete bucket testbucket2
2023/09/12 20:29:22 http://127.0.0.1:9000/pools/default/buckets/testbucket2
2023/09/12 20:29:22 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/12 20:29:22 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 14:59:21 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc015a3c400 31 [] false false map[] 0xc010088200 }
2023/09/12 20:29:22 DeleteBucket failed for bucket testbucket2
2023/09/12 20:29:22 Deleted bucket testbucket2, responseBody: Requested resource not found.
2023/09/12 20:29:22 ============== DBG: Create bucket testbucket2
2023/09/12 20:29:22 Created bucket testbucket2, responseBody:
2023/09/12 20:29:25 Flush Enabled on bucket testbucket2, responseBody:
2023/09/12 20:29:58 Flushed the bucket testbucket2, Response body:
2023/09/12 20:29:58 ============== DBG: Delete bucket testbucket3
2023/09/12 20:29:58 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2023/09/12 20:29:58 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/12 20:29:58 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 14:59:57 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0010bef80 31 [] false false map[] 0xc010088000 }
2023/09/12 20:29:58 DeleteBucket failed for bucket testbucket3
2023/09/12 20:29:58 Deleted bucket testbucket3, responseBody: Requested resource not found.
2023/09/12 20:29:58 ============== DBG: Create bucket testbucket3
2023/09/12 20:29:58 Created bucket testbucket3, responseBody:
2023/09/12 20:30:02 Flush Enabled on bucket testbucket3, responseBody:
2023/09/12 20:30:35 Flushed the bucket testbucket3, Response body:
2023/09/12 20:30:35 ============== DBG: Delete bucket testbucket4
2023/09/12 20:30:35 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/09/12 20:30:35 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/12 20:30:35 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 15:00:34 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0163ad5c0 31 [] false false map[] 0xc0004a2500 }
2023/09/12 20:30:35 DeleteBucket failed for bucket testbucket4
2023/09/12 20:30:35 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/09/12 20:30:35 ============== DBG: Create bucket testbucket4
2023/09/12 20:30:35 Created bucket testbucket4, responseBody:
2023/09/12 20:30:39 Flush Enabled on bucket testbucket4, responseBody:
2023/09/12 20:31:12 Flushed the bucket testbucket4, Response body:
2023/09/12 20:31:27 Generating docs and Populating all the buckets
2023/09/12 20:31:27 ============== DBG: Creating docs in bucket default
2023/09/12 20:31:28 ============== DBG: Creating index bucket1_age in bucket default
2023/09/12 20:31:32 Created the secondary index bucket1_age. Waiting for it become active
2023/09/12 20:31:32 Index is 15361321592318439437 now active
2023/09/12 20:31:32 ============== DBG: Creating index bucket1_gender in bucket default
2023/09/12 20:31:38 Created the secondary index bucket1_gender. Waiting for it become active
2023/09/12 20:31:38 Index is 6692539197079626995 now active
2023/09/12 20:31:39 ============== DBG: Creating docs in bucket testbucket2
2023/09/12 20:31:39 ============== DBG: Creating index bucket2_city in bucket testbucket2
2023/09/12 20:31:44 Created the secondary index bucket2_city. Waiting for it become active
2023/09/12 20:31:44 Index is 7610873839230217458 now active
2023/09/12 20:31:44 ============== DBG: Creating index bucket2_company in bucket testbucket2
2023/09/12 20:31:51 Created the secondary index bucket2_company. Waiting for it become active
2023/09/12 20:31:51 Index is 12842164595405807163 now active
2023/09/12 20:31:51 ============== DBG: Creating docs in bucket testbucket3
2023/09/12 20:31:52 ============== DBG: Creating index bucket3_gender in bucket testbucket3
2023/09/12 20:31:56 Created the secondary index bucket3_gender. Waiting for it become active
2023/09/12 20:31:56 Index is 5650039450019023311 now active
2023/09/12 20:31:56 ============== DBG: Creating index bucket3_address in bucket testbucket3
2023/09/12 20:32:03 Created the secondary index bucket3_address. Waiting for it become active
2023/09/12 20:32:03 Index is 10558675126174389564 now active
2023/09/12 20:32:03 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2023/09/12 20:32:03 Using n1ql client
2023-09-12T20:32:03.690+05:30 [Info] metadata provider version changed 1300 -> 1301
2023-09-12T20:32:03.691+05:30 [Info] switched currmeta from 1300 -> 1301 force false
2023-09-12T20:32:03.691+05:30 [Info] GSIC[default/default-_default-_default-1694530923686813783] started ...
2023/09/12 20:32:03 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2023/09/12 20:32:03 Expected and Actual scan responses are the same
2023/09/12 20:32:15 ============== DBG: Creating 50K docs in bucket testbucket4
2023/09/12 20:32:41 ============== DBG: Creating index bucket4_balance asynchronously in bucket testbucket4
2023/09/12 20:32:50 ============== DBG: Deleting bucket testbucket4
2023/09/12 20:32:53 Deleted bucket testbucket4, responseBody:
2023/09/12 20:32:53 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2023/09/12 20:32:53 Using n1ql client
2023/09/12 20:32:53 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2023/09/12 20:32:53 Expected and Actual scan responses are the same
2023/09/12 20:32:53 ============== DBG: Second bucket scan:: Scanning index bucket2_city in bucket testbucket2
2023/09/12 20:32:53 Using n1ql client
2023-09-12T20:32:53.070+05:30 [Info] GSIC[default/testbucket2-_default-_default-1694530973058121569] started ...
2023/09/12 20:32:53 ============== DBG: Second bucket scan:: Expected results = 392 Actual results = 392
2023/09/12 20:32:53 Expected and Actual scan responses are the same
2023/09/12 20:32:53 ============== DBG: Third bucket scan:: Scanning index bucket3_gender in bucket testbucket3
2023/09/12 20:32:53 Using n1ql client
2023-09-12T20:32:53.093+05:30 [Info] GSIC[default/testbucket3-_default-_default-1694530973087835008] started ...
2023/09/12 20:32:53 ============== DBG: Third bucket scan:: Expected results = 492 Actual results = 492
2023/09/12 20:32:53 Expected and Actual scan responses are the same
2023/09/12 20:32:53 ============== DBG: Deleting buckets testbucket2 testbucket3 testbucket4
2023/09/12 20:32:55 Deleted bucket testbucket2, responseBody:
2023/09/12 20:32:56 Deleted bucket testbucket3, responseBody:
2023/09/12 20:32:56 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/09/12 20:32:56 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/12 20:32:56 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Tue, 12 Sep 2023 15:02:55 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc002401c00 31 [] false false map[] 0xc002606800 }
2023/09/12 20:32:56 DeleteBucket failed for bucket testbucket4
2023/09/12 20:32:56 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/09/12 20:32:59 Modified parameters of bucket default, responseBody:
--- PASS: TestDeleteBucketWhileInitialIndexBuild (271.30s)
=== RUN TestWherClause_UpdateDocument
2023/09/12 20:33:14 In TestWherClause_UpdateDocument()
2023/09/12 20:33:14 In DropAllSecondaryIndexes()
2023/09/12 20:33:14 Index found: bucket1_gender
2023/09/12 20:33:14 Dropped index bucket1_gender
2023/09/12 20:33:14 Index found: bucket1_age
2023/09/12 20:33:15 Dropped index bucket1_age
2023/09/12 20:33:53 Flushed the bucket default, Response body:
2023/09/12 20:33:55 Setting JSON docs in KV
2023/09/12 20:34:03 Created the secondary index id_ageGreaterThan40. Waiting for it become active
2023/09/12 20:34:03 Index is 13653631364173168180 now active
2023/09/12 20:34:03 Using n1ql client
2023/09/12 20:34:03 Expected and Actual scan responses are the same
2023/09/12 20:34:03 Number of docScanResults and scanResults = 5981 and 5981
2023/09/12 20:34:09 Using n1ql client
2023/09/12 20:34:09 Expected and Actual scan responses are the same
2023/09/12 20:34:09 Number of docScanResults and scanResults = 1981 and 1981
--- PASS: TestWherClause_UpdateDocument (54.81s)
=== RUN TestDeferFalse
2023/09/12 20:34:09 In TestDeferFalse()
2023/09/12 20:34:12 Setting JSON docs in KV
2023/09/12 20:34:25 Created the secondary index index_deferfalse1. Waiting for it become active
2023/09/12 20:34:25 Index is 3754635678206830240 now active
2023/09/12 20:34:25 Using n1ql client
2023/09/12 20:34:25 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse (15.64s)
=== RUN TestDeferFalse_CloseClientConnection
2023/09/12 20:34:25 In TestDeferFalse_CloseClientConnection()
2023/09/12 20:34:25 In CloseClientThread
2023/09/12 20:34:25 In CreateIndexThread
2023/09/12 20:34:27 Create Index call failed as expected due to error : Terminate Request due to client termination
2023/09/12 20:34:27 Waiting for index 1902708969836059278 to go active ...
2023/09/12 20:34:28 Waiting for index 1902708969836059278 to go active ...
2023/09/12 20:34:29 Waiting for index 1902708969836059278 to go active ...
2023/09/12 20:34:30 Waiting for index 1902708969836059278 to go active ...
2023/09/12 20:34:31 Waiting for index 1902708969836059278 to go active ...
2023/09/12 20:34:32 Waiting for index 1902708969836059278 to go active ...
2023/09/12 20:34:33 Index is 1902708969836059278 now active
2023/09/12 20:34:33 Using n1ql client
2023/09/12 20:34:33 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse_CloseClientConnection (8.19s)
=== RUN TestOrphanIndexCleanup
2023/09/12 20:34:33 In DropAllSecondaryIndexes()
2023/09/12 20:34:33 Index found: index_deferfalse1
2023/09/12 20:34:33 Dropped index index_deferfalse1
2023/09/12 20:34:33 Index found: id_ageGreaterThan40
2023/09/12 20:34:33 Dropped index id_ageGreaterThan40
2023/09/12 20:34:33 Index found: index_deferfalse2
2023/09/12 20:34:33 Dropped index index_deferfalse2
2023/09/12 20:34:48 Created the secondary index idx1_age_regular. Waiting for it become active
2023/09/12 20:34:48 Index is 595350369517920394 now active
2023/09/12 20:34:55 Created the secondary index idx2_company_regular. Waiting for it become active
2023/09/12 20:34:55 Index is 2683133880547730825 now active
2023/09/12 20:35:05 Using n1ql client
2023/09/12 20:35:05 Query on idx1_age_regular is successful
2023/09/12 20:35:05 Using n1ql client
2023/09/12 20:35:05 Query on idx2_company_regular is successful
Restarting indexer process ...
2023/09/12 20:35:05 []
2023-09-12T20:35:05.781+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-12T20:35:05.782+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/12 20:35:25 Using n1ql client
2023-09-12T20:35:25.744+05:30 [Error] transport error between 127.0.0.1:50264->127.0.0.1:9107: write tcp 127.0.0.1:50264->127.0.0.1:9107: write: broken pipe
2023-09-12T20:35:25.744+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 3862962660981934842 request transport failed `write tcp 127.0.0.1:50264->127.0.0.1:9107: write: broken pipe`
2023-09-12T20:35:25.744+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T20:35:25.744+05:30 [Error] metadataClient:PickRandom: Replicas - [12108817877474450877], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 20:35:25 Query on idx1_age_regular is successful - after indexer restart.
2023/09/12 20:35:25 Using n1ql client
2023/09/12 20:35:25 Query on idx2_company_regular is successful - after indexer restart.
--- PASS: TestOrphanIndexCleanup (52.20s)
=== RUN TestOrphanPartitionCleanup
2023/09/12 20:35:30 Created the secondary index idx3_age_regular. Waiting for it become active
2023/09/12 20:35:30 Index is 7578860259635510833 now active
2023/09/12 20:35:40 Using n1ql client
2023/09/12 20:35:40 Query on idx3_age_regular is successful
Restarting indexer process ...
2023/09/12 20:35:40 []
2023-09-12T20:35:40.718+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-12T20:35:40.719+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/12 20:36:00 Using n1ql client
2023-09-12T20:36:00.692+05:30 [Error] transport error between 127.0.0.1:44688->127.0.0.1:9107: write tcp 127.0.0.1:44688->127.0.0.1:9107: write: broken pipe
2023-09-12T20:36:00.692+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -1704604357718243617 request transport failed `write tcp 127.0.0.1:44688->127.0.0.1:9107: write: broken pipe`
2023-09-12T20:36:00.692+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8. Partition with instances 0
2023-09-12T20:36:00.692+05:30 [Error] metadataClient:PickRandom: Replicas - [2249119405538932031], PrunedReplica - map[], FilteredReplica map[]
2023/09/12 20:36:00 Query on idx3_age_regular is successful - after indexer restart.
--- PASS: TestOrphanPartitionCleanup (34.94s)
=== RUN TestIndexerSettings
2023/09/12 20:36:00 In TestIndexerSettings()
2023/09/12 20:36:00 Changing config key indexer.settings.max_cpu_percent to value 300
2023/09/12 20:36:00 Changing config key indexer.settings.inmemory_snapshot.interval to value 300
2023/09/12 20:36:01 Changing config key indexer.settings.persisted_snapshot.interval to value 20000
2023/09/12 20:36:01 Changing config key indexer.settings.recovery.max_rollbacks to value 3
2023/09/12 20:36:01 Changing config key indexer.settings.log_level to value error
--- PASS: TestIndexerSettings (0.58s)
=== RUN TestRestoreDefaultSettings
2023/09/12 20:36:01 In TestIndexerSettings_RestoreDefault()
2023/09/12 20:36:01 Changing config key indexer.settings.max_cpu_percent to value 0
2023/09/12 20:36:01 Changing config key indexer.settings.inmemory_snapshot.interval to value 200
2023/09/12 20:36:01 Changing config key indexer.settings.persisted_snapshot.interval to value 5000
2023/09/12 20:36:01 Changing config key indexer.settings.recovery.max_rollbacks to value 5
2023/09/12 20:36:01 Changing config key indexer.settings.log_level to value info
--- PASS: TestRestoreDefaultSettings (0.55s)
=== RUN TestStat_ItemsCount
2023/09/12 20:36:01 In TestStat_ItemsCount()
2023/09/12 20:36:01 In DropAllSecondaryIndexes()
2023/09/12 20:36:01 Index found: idx3_age_regular
2023/09/12 20:36:01 Dropped index idx3_age_regular
2023/09/12 20:36:01 Index found: idx2_company_regular
2023/09/12 20:36:01 Dropped index idx2_company_regular
2023/09/12 20:36:01 Index found: idx1_age_regular
2023/09/12 20:36:02 Dropped index idx1_age_regular
2023/09/12 20:36:02 Emptying the default bucket
2023/09/12 20:36:05 Flush Enabled on bucket default, responseBody:
2023/09/12 20:36:43 Flushed the bucket default, Response body:
2023/09/12 20:36:43 Generating JSON docs
2023/09/12 20:36:43 Setting initial JSON docs in KV
2023/09/12 20:36:48 Creating a 2i
2023/09/12 20:36:51 Created the secondary index index_test1. Waiting for it become active
2023/09/12 20:36:51 Index is 7476276816708936070 now active
2023/09/12 20:36:56 items_count stat is 10000
--- PASS: TestStat_ItemsCount (54.44s)
=== RUN TestRangeArrayIndex_Distinct
2023/09/12 20:36:56 In TestRangeArrayIndex_Distinct()
2023/09/12 20:36:56 In DropAllSecondaryIndexes()
2023/09/12 20:36:56 Index found: index_test1
2023/09/12 20:36:56 Dropped index index_test1
2023/09/12 20:37:34 Flushed the bucket default, Response body:
2023/09/12 20:37:38 Created the secondary index arridx_friends. Waiting for it become active
2023/09/12 20:37:38 Index is 250587075228755415 now active
2023-09-12T20:37:38.231+05:30 [Error] transport error between 127.0.0.1:57428->127.0.0.1:9107: write tcp 127.0.0.1:57428->127.0.0.1:9107: write: broken pipe
2023-09-12T20:37:38.231+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:57428->127.0.0.1:9107: write: broken pipe`
2023-09-12T20:37:38.231+05:30 [Warn] scan failed: requestId queryport 127.0.0.1:9107 inst 15765868773296192934 partition [0]
2023-09-12T20:37:38.232+05:30 [Warn] Scan failed with error for index 250587075228755415. Trying scan again with replica, reqId: : write tcp 127.0.0.1:57428->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2023-09-12T20:37:38.232+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-12T20:37:38.233+05:30 [Error] metadataClient:PickRandom: Replicas - [15765868773296192934], PrunedReplica - map[], FilteredReplica map[]
2023-09-12T20:37:38.233+05:30 [Warn] Fail to find indexers to satisfy query request. Trying scan again for index 250587075228755415, reqId: : write tcp 127.0.0.1:57428->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2023/09/12 20:37:38 Expected and Actual scan responses are the same
2023/09/12 20:37:41 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Distinct (44.86s)
=== RUN TestUpdateArrayIndex_Distinct
2023/09/12 20:37:41 In TestUpdateArrayIndex_Distinct()
2023/09/12 20:37:41 In DropAllSecondaryIndexes()
2023/09/12 20:37:41 Index found: arridx_friends
2023/09/12 20:37:41 Dropped index arridx_friends
2023/09/12 20:38:19 Flushed the bucket default, Response body:
2023/09/12 20:38:23 Created the secondary index arridx_friends. Waiting for it become active
2023/09/12 20:38:23 Index is 10995225511825542587 now active
2023/09/12 20:38:23 Expected and Actual scan responses are the same
2023/09/12 20:38:26 Expected and Actual scan responses are the same
2023/09/12 20:38:26 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Distinct (45.37s)
=== RUN TestRangeArrayIndex_Duplicate
2023/09/12 20:38:26 In TestRangeArrayIndex_Duplicate()
2023/09/12 20:38:26 In DropAllSecondaryIndexes()
2023/09/12 20:38:26 Index found: arridx_friends
2023/09/12 20:38:26 Dropped index arridx_friends
2023/09/12 20:39:04 Flushed the bucket default, Response body:
2023/09/12 20:39:07 Created the secondary index arridx_friends. Waiting for it become active
2023/09/12 20:39:07 Index is 14881570474441413010 now active
2023/09/12 20:39:07 Expected and Actual scan responses are the same
2023/09/12 20:39:10 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Duplicate (44.03s)
=== RUN TestUpdateArrayIndex_Duplicate
2023/09/12 20:39:10 In TestUpdateArrayIndex_Duplicate()
2023/09/12 20:39:10 In DropAllSecondaryIndexes()
2023/09/12 20:39:10 Index found: arridx_friends
2023/09/12 20:39:10 Dropped index arridx_friends
2023/09/12 20:39:48 Flushed the bucket default, Response body:
2023/09/12 20:39:52 Created the secondary index arridx_friends. Waiting for it become active
2023/09/12 20:39:52 Index is 6770234646396115576 now active
2023/09/12 20:39:52 Expected and Actual scan responses are the same
2023/09/12 20:39:55 Expected and Actual scan responses are the same
2023/09/12 20:39:55 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Duplicate (45.32s)
=== RUN TestArrayIndexCornerCases
set09_arrayindex_test.go:193: Test disbaled
--- SKIP: TestArrayIndexCornerCases (0.00s)
=== RUN TestArraySizeIncreaseDecrease1
set09_arrayindex_test.go:249: Test disbaled
--- SKIP: TestArraySizeIncreaseDecrease1 (0.00s)
=== RUN TestArraySizeIncreaseDecrease2
set09_arrayindex_test.go:369: Test disbaled
--- SKIP: TestArraySizeIncreaseDecrease2 (0.00s)
=== RUN TestBufferedScan_BackfillDisabled
2023/09/12 20:39:55 In TestBufferedScan_BackfillDisabled()
2023/09/12 20:39:55 In DropAllSecondaryIndexes()
2023/09/12 20:39:55 Index found: arridx_friends
2023/09/12 20:39:56 Dropped index arridx_friends
2023/09/12 20:40:33 Flushed the bucket default, Response body:
2023/09/12 20:41:11 Changing config key queryport.client.settings.backfillLimit to value 0
2023/09/12 20:41:17 Created the secondary index addressidx. Waiting for it become active
2023/09/12 20:41:17 Index is 11594627386642728274 now active
2023-09-12T20:41:17.130+05:30 [Info] metadata provider version changed 1440 -> 1441
2023-09-12T20:41:17.130+05:30 [Info] switched currmeta from 1440 -> 1441 force false
2023-09-12T20:41:17.131+05:30 [Info] GSIC[default/default-_default-_default-1694531477099498924] started ...
2023-09-12T20:41:17.131+05:30 [Warn] MonitorIndexer: Indexer for default:_default:_default is already being monitored
2023/09/12 20:41:17 Non-backfill file found: /tmp/.ICE-unix
2023/09/12 20:41:17 Non-backfill file found: /tmp/.Test-unix
2023/09/12 20:41:17 Non-backfill file found: /tmp/.X11-unix
2023/09/12 20:41:17 Non-backfill file found: /tmp/.XIM-unix
2023/09/12 20:41:17 Non-backfill file found: /tmp/.font-unix
2023/09/12 20:41:17 Non-backfill file found: /tmp/445a92e9-0600-4469-a43c-7f357f7239f1.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/6c062469-ab70-435b-b047-e9033adc2187.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/8b8da0b4-6b9d-43a7-88b3-a996f952ddba.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/987286ff-63ef-45f7-83b8-deea3fa64016.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/d37a7e88-1532-4252-a1b6-367a64ee2026.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/e015912c-7ca5-4240-8baf-fb3e80dd922f.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/f5e1ec46-530f-4373-bcc2-85d49bafe62d.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/f_445a92e9-0600-4469-a43c-7f357f7239f1.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/f_6c062469-ab70-435b-b047-e9033adc2187.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/f_8b8da0b4-6b9d-43a7-88b3-a996f952ddba.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/f_987286ff-63ef-45f7-83b8-deea3fa64016.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/f_d37a7e88-1532-4252-a1b6-367a64ee2026.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/f_e015912c-7ca5-4240-8baf-fb3e80dd922f.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/f_f5e1ec46-530f-4373-bcc2-85d49bafe62d.sock
2023/09/12 20:41:17 Non-backfill file found: /tmp/fail.log
2023/09/12 20:41:17 Non-backfill file found: /tmp/go-build3439014738
2023/09/12 20:41:17 Non-backfill file found: /tmp/mdbslice
2023/09/12 20:41:17 Non-backfill file found: /tmp/systemd-private-2d645507dd4c4583a6c90296dc6dd5e7-apache2.service-LIJiJr
2023/09/12 20:41:17 Non-backfill file found: /tmp/systemd-private-2d645507dd4c4583a6c90296dc6dd5e7-systemd-timesyncd.service-itmBaV
2023-09-12T20:41:17.137+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T20:41:17.137+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T20:41:17.139+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023/09/12 20:41:17 limit=1,chsize=256; received 1 items; took 8.849505ms
2023-09-12T20:41:17.152+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-12T20:41:17.152+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-12T20:41:17.156+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023/09/12 20:41:19 limit=1000,chsize=256; received 1000 items; took 1.267013371s
2023-09-12T20:41:20.411+05:30 [Info] gsiKeyspace::Close Closing default:_default:_default
--- PASS: TestBufferedScan_BackfillDisabled (84.53s)
=== RUN TestBufferedScan_BackfillEnabled
2023/09/12 20:41:20 In TestBufferedScan_BackfillEnabled()
2023-09-12T20:41:20.512+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/12 20:41:20 Changing config key queryport.client.settings.backfillLimit to value 1
2023-09-12T20:41:20.529+05:30 [Info] GSIC[default/default-_default-_default-1694531480525069659] started ...
2023-09-12T20:41:20.533+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"warn","queryport.client.settings.backfillLimit":1,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023/09/12 20:41:20 limit=1,chsize=256; received 1 items; took 12.907668ms
2023/09/12 20:41:21 limit=1000,chsize=256; received 1000 items; took 10.643955ms
2023/09/12 20:41:33 limit=1000,chsize=256; received 1000 items; took 10.393090489s
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
2023/09/12 20:41:49 limit=1000,chsize=256; received 702 items; took 14.435462417s
2023/09/12 20:41:49 limit=1000,chsize=256; received 702 items; took 14.455918569s
2023/09/12 20:41:50 Changing config key queryport.client.settings.backfillLimit to value 0
--- PASS: TestBufferedScan_BackfillEnabled (30.11s)
=== RUN TestMultiScanSetup
2023/09/12 20:41:50 In TestMultiScanSetup()
2023/09/12 20:41:52 Emptying the default bucket
2023/09/12 20:41:55 Flush Enabled on bucket default, responseBody:
2023/09/12 20:42:32 Flushed the bucket default, Response body:
2023/09/12 20:42:32 Populating the default bucket
2023/09/12 20:42:46 Created the secondary index index_companyname. Waiting for it become active
2023/09/12 20:42:46 Index is 18176180542382136080 now active
2023/09/12 20:42:52 Created the secondary index index_company. Waiting for it become active
2023/09/12 20:42:52 Index is 14850540942201850470 now active
2023/09/12 20:42:58 Created the secondary index index_company_name_age. Waiting for it become active
2023/09/12 20:42:58 Index is 7348184685482971740 now active
2023/09/12 20:43:05 Created the secondary index index_primary. Waiting for it become active
2023/09/12 20:43:05 Index is 6337604818546112088 now active
2023/09/12 20:43:11 Created the secondary index index_company_name_age_address. Waiting for it become active
2023/09/12 20:43:11 Index is 5447979090900838873 now active
2023/09/12 20:43:18 Created the secondary index index_company_name_age_address_friends. Waiting for it become active
2023/09/12 20:43:18 Index is 17959101930807705636 now active
--- PASS: TestMultiScanSetup (87.66s)
=== RUN TestMultiScanCount
2023/09/12 20:43:18 In TestMultiScanCount()
2023/09/12 20:43:18
--------- Composite Index with 2 fields ---------
2023/09/12 20:43:18
--- ScanAllNoFilter ---
2023/09/12 20:43:18 distinct = false
2023/09/12 20:43:18 Using n1ql client
2023/09/12 20:43:18 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:43:18
--- ScanAllFilterNil ---
2023/09/12 20:43:18 distinct = false
2023/09/12 20:43:19 Using n1ql client
2023/09/12 20:43:19 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:43:19
--- ScanAll_AllFiltersNil ---
2023/09/12 20:43:19 distinct = false
2023/09/12 20:43:19 Using n1ql client
2023/09/12 20:43:19 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:43:19
--- SingleSeek ---
2023/09/12 20:43:19 distinct = false
2023/09/12 20:43:19 Using n1ql client
2023/09/12 20:43:19 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:43:19
--- MultipleSeek ---
2023/09/12 20:43:19 distinct = false
2023/09/12 20:43:20 Using n1ql client
2023/09/12 20:43:20 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 20:43:20
--- SimpleRange ---
2023/09/12 20:43:20 distinct = false
2023/09/12 20:43:20 Using n1ql client
2023/09/12 20:43:20 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/12 20:43:20
--- NonOverlappingRanges ---
2023/09/12 20:43:20 distinct = false
2023/09/12 20:43:21 Using n1ql client
2023/09/12 20:43:21 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2023/09/12 20:43:21
--- OverlappingRanges ---
2023/09/12 20:43:21 distinct = false
2023/09/12 20:43:21 Using n1ql client
2023/09/12 20:43:21 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2023/09/12 20:43:21
--- NonOverlappingFilters ---
2023/09/12 20:43:21 distinct = false
2023/09/12 20:43:21 Using n1ql client
2023/09/12 20:43:21 MultiScanCount = 337 ExpectedMultiScanCount = 337
2023/09/12 20:43:21
--- OverlappingFilters ---
2023/09/12 20:43:21 distinct = false
2023/09/12 20:43:22 Using n1ql client
2023/09/12 20:43:22 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2023/09/12 20:43:22
--- BoundaryFilters ---
2023/09/12 20:43:22 distinct = false
2023/09/12 20:43:22 Using n1ql client
2023/09/12 20:43:22 MultiScanCount = 499 ExpectedMultiScanCount = 499
2023/09/12 20:43:22
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:43:22 distinct = false
2023/09/12 20:43:23 Using n1ql client
2023/09/12 20:43:23 MultiScanCount = 256 ExpectedMultiScanCount = 256
2023/09/12 20:43:23
--- SeekAndFilters_Overlapping ---
2023/09/12 20:43:23 distinct = false
2023/09/12 20:43:23 Using n1ql client
2023/09/12 20:43:23 MultiScanCount = 255 ExpectedMultiScanCount = 255
2023/09/12 20:43:23
--- SimpleRangeLowUnbounded ---
2023/09/12 20:43:23 distinct = false
2023/09/12 20:43:23 Using n1ql client
2023/09/12 20:43:23 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/12 20:43:23
--- SimpleRangeHighUnbounded ---
2023/09/12 20:43:23 distinct = false
2023/09/12 20:43:24 Using n1ql client
2023/09/12 20:43:24 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/12 20:43:24
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:43:24 distinct = false
2023/09/12 20:43:24 Using n1ql client
2023/09/12 20:43:24 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:43:24
--- FiltersWithUnbounded ---
2023/09/12 20:43:24 distinct = false
2023/09/12 20:43:25 Using n1ql client
2023/09/12 20:43:25 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/12 20:43:25
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:43:25 distinct = false
2023/09/12 20:43:25 Using n1ql client
2023/09/12 20:43:25 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/12 20:43:25
--------- Simple Index with 1 field ---------
2023/09/12 20:43:25
--- SingleIndexSimpleRange ---
2023/09/12 20:43:25 distinct = false
2023/09/12 20:43:25 Using n1ql client
2023/09/12 20:43:25 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/12 20:43:25
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:43:25 distinct = false
2023/09/12 20:43:26 Using n1ql client
2023/09/12 20:43:26 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2023/09/12 20:43:26
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:43:26 distinct = false
2023/09/12 20:43:26 Using n1ql client
2023/09/12 20:43:26 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2023/09/12 20:43:26
--------- Composite Index with 3 fields ---------
2023/09/12 20:43:26
--- ScanAllNoFilter ---
2023/09/12 20:43:26 distinct = false
2023/09/12 20:43:27 Using n1ql client
2023/09/12 20:43:27 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:43:27
--- ScanAllFilterNil ---
2023/09/12 20:43:27 distinct = false
2023/09/12 20:43:27 Using n1ql client
2023/09/12 20:43:27 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:43:27
--- ScanAll_AllFiltersNil ---
2023/09/12 20:43:27 distinct = false
2023/09/12 20:43:27 Using n1ql client
2023/09/12 20:43:27 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:43:27
--- 3FieldsSingleSeek ---
2023/09/12 20:43:27 distinct = false
2023/09/12 20:43:28 Using n1ql client
2023/09/12 20:43:28 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:43:28
--- 3FieldsMultipleSeeks ---
2023/09/12 20:43:28 distinct = false
2023/09/12 20:43:28 Using n1ql client
2023/09/12 20:43:28 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/12 20:43:28
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:43:28 distinct = false
2023/09/12 20:43:29 Using n1ql client
2023/09/12 20:43:29 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 20:43:29
--------- New scenarios ---------
2023/09/12 20:43:29
--- CompIndexHighUnbounded1 ---
2023/09/12 20:43:29
--- Multi Scan 0 ---
2023/09/12 20:43:29 distinct = false
2023/09/12 20:43:29 Using n1ql client
2023/09/12 20:43:29 Using n1ql client
2023/09/12 20:43:29 len(scanResults) = 8 MultiScanCount = 8
2023/09/12 20:43:29 Expected and Actual scan responses are the same
2023/09/12 20:43:29
--- Multi Scan 1 ---
2023/09/12 20:43:29 distinct = false
2023/09/12 20:43:29 Using n1ql client
2023/09/12 20:43:29 Using n1ql client
2023/09/12 20:43:29 len(scanResults) = 0 MultiScanCount = 0
2023/09/12 20:43:29 Expected and Actual scan responses are the same
2023/09/12 20:43:29
--- Multi Scan 2 ---
2023/09/12 20:43:29 distinct = false
2023/09/12 20:43:30 Using n1ql client
2023/09/12 20:43:30 Using n1ql client
2023/09/12 20:43:30 len(scanResults) = 9 MultiScanCount = 9
2023/09/12 20:43:30 Expected and Actual scan responses are the same
2023/09/12 20:43:30
--- CompIndexHighUnbounded2 ---
2023/09/12 20:43:30
--- Multi Scan 0 ---
2023/09/12 20:43:30 distinct = false
2023/09/12 20:43:30 Using n1ql client
2023/09/12 20:43:30 Using n1ql client
2023/09/12 20:43:30 len(scanResults) = 4138 MultiScanCount = 4138
2023/09/12 20:43:30 Expected and Actual scan responses are the same
2023/09/12 20:43:30
--- Multi Scan 1 ---
2023/09/12 20:43:30 distinct = false
2023/09/12 20:43:31 Using n1ql client
2023/09/12 20:43:31 Using n1ql client
2023/09/12 20:43:31 len(scanResults) = 2746 MultiScanCount = 2746
2023/09/12 20:43:31 Expected and Actual scan responses are the same
2023/09/12 20:43:31
--- Multi Scan 2 ---
2023/09/12 20:43:31 distinct = false
2023/09/12 20:43:31 Using n1ql client
2023/09/12 20:43:31 Using n1ql client
2023/09/12 20:43:31 len(scanResults) = 4691 MultiScanCount = 4691
2023/09/12 20:43:31 Expected and Actual scan responses are the same
2023/09/12 20:43:31
--- CompIndexHighUnbounded3 ---
2023/09/12 20:43:31
--- Multi Scan 0 ---
2023/09/12 20:43:31 distinct = false
2023/09/12 20:43:32 Using n1ql client
2023/09/12 20:43:32 Using n1ql client
2023/09/12 20:43:32 len(scanResults) = 1329 MultiScanCount = 1329
2023/09/12 20:43:32 Expected and Actual scan responses are the same
2023/09/12 20:43:32
--- CompIndexHighUnbounded4 ---
2023/09/12 20:43:32
--- Multi Scan 0 ---
2023/09/12 20:43:32 distinct = false
2023/09/12 20:43:32 Using n1ql client
2023/09/12 20:43:32 Using n1ql client
2023/09/12 20:43:32 len(scanResults) = 5349 MultiScanCount = 5349
2023/09/12 20:43:32 Expected and Actual scan responses are the same
2023/09/12 20:43:32
--- CompIndexHighUnbounded5 ---
2023/09/12 20:43:32
--- Multi Scan 0 ---
2023/09/12 20:43:32 distinct = false
2023/09/12 20:43:33 Using n1ql client
2023/09/12 20:43:33 Using n1ql client
2023/09/12 20:43:33 len(scanResults) = 8210 MultiScanCount = 8210
2023/09/12 20:43:33 Expected and Actual scan responses are the same
2023/09/12 20:43:33
--- SeekBoundaries ---
2023/09/12 20:43:33
--- Multi Scan 0 ---
2023/09/12 20:43:33 distinct = false
2023/09/12 20:43:33 Using n1ql client
2023/09/12 20:43:33 Using n1ql client
2023/09/12 20:43:33 len(scanResults) = 175 MultiScanCount = 175
2023/09/12 20:43:33 Expected and Actual scan responses are the same
2023/09/12 20:43:33
--- Multi Scan 1 ---
2023/09/12 20:43:33 distinct = false
2023/09/12 20:43:33 Using n1ql client
2023/09/12 20:43:33 Using n1ql client
2023/09/12 20:43:33 len(scanResults) = 1 MultiScanCount = 1
2023/09/12 20:43:33 Expected and Actual scan responses are the same
2023/09/12 20:43:33
--- Multi Scan 2 ---
2023/09/12 20:43:33 distinct = false
2023/09/12 20:43:34 Using n1ql client
2023/09/12 20:43:34 Using n1ql client
2023/09/12 20:43:34 len(scanResults) = 555 MultiScanCount = 555
2023/09/12 20:43:34 Expected and Actual scan responses are the same
2023/09/12 20:43:34
--- Multi Scan 3 ---
2023/09/12 20:43:34 distinct = false
2023/09/12 20:43:34 Using n1ql client
2023/09/12 20:43:34 Using n1ql client
2023/09/12 20:43:34 len(scanResults) = 872 MultiScanCount = 872
2023/09/12 20:43:34 Expected and Actual scan responses are the same
2023/09/12 20:43:34
--- Multi Scan 4 ---
2023/09/12 20:43:34 distinct = false
2023/09/12 20:43:35 Using n1ql client
2023/09/12 20:43:35 Using n1ql client
2023/09/12 20:43:35 len(scanResults) = 287 MultiScanCount = 287
2023/09/12 20:43:35 Expected and Actual scan responses are the same
2023/09/12 20:43:35
--- Multi Scan 5 ---
2023/09/12 20:43:35 distinct = false
2023/09/12 20:43:35 Using n1ql client
2023/09/12 20:43:35 Using n1ql client
2023/09/12 20:43:35 len(scanResults) = 5254 MultiScanCount = 5254
2023/09/12 20:43:35 Expected and Actual scan responses are the same
2023/09/12 20:43:35
--- Multi Scan 6 ---
2023/09/12 20:43:35 distinct = false
2023/09/12 20:43:35 Using n1ql client
2023/09/12 20:43:36 Using n1ql client
2023/09/12 20:43:36 len(scanResults) = 5566 MultiScanCount = 5566
2023/09/12 20:43:36 Expected and Actual scan responses are the same
2023/09/12 20:43:36
--- Multi Scan 7 ---
2023/09/12 20:43:36 distinct = false
2023/09/12 20:43:36 Using n1ql client
2023/09/12 20:43:36 Using n1ql client
2023/09/12 20:43:36 len(scanResults) = 8 MultiScanCount = 8
2023/09/12 20:43:36 Expected and Actual scan responses are the same
2023/09/12 20:43:36
--------- With DISTINCT True ---------
2023/09/12 20:43:36
--- ScanAllNoFilter ---
2023/09/12 20:43:36 distinct = true
2023/09/12 20:43:36 Using n1ql client
2023/09/12 20:43:36 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:43:36
--- ScanAllFilterNil ---
2023/09/12 20:43:36 distinct = true
2023/09/12 20:43:37 Using n1ql client
2023/09/12 20:43:37 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:43:37
--- ScanAll_AllFiltersNil ---
2023/09/12 20:43:37 distinct = true
2023/09/12 20:43:37 Using n1ql client
2023/09/12 20:43:37 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:43:37
--- SingleSeek ---
2023/09/12 20:43:37 distinct = true
2023/09/12 20:43:38 Using n1ql client
2023/09/12 20:43:38 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:43:38
--- MultipleSeek ---
2023/09/12 20:43:38 distinct = true
2023/09/12 20:43:38 Using n1ql client
2023/09/12 20:43:38 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 20:43:38
--- SimpleRange ---
2023/09/12 20:43:38 distinct = true
2023/09/12 20:43:38 Using n1ql client
2023/09/12 20:43:38 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/12 20:43:38
--- NonOverlappingRanges ---
2023/09/12 20:43:38 distinct = true
2023/09/12 20:43:39 Using n1ql client
2023/09/12 20:43:39 MultiScanCount = 428 ExpectedMultiScanCount = 428
2023/09/12 20:43:39
--- OverlappingRanges ---
2023/09/12 20:43:39 distinct = true
2023/09/12 20:43:39 Using n1ql client
2023/09/12 20:43:39 MultiScanCount = 575 ExpectedMultiScanCount = 575
2023/09/12 20:43:39
--- NonOverlappingFilters ---
2023/09/12 20:43:39 distinct = true
2023/09/12 20:43:40 Using n1ql client
2023/09/12 20:43:40 MultiScanCount = 186 ExpectedMultiScanCount = 186
2023/09/12 20:43:40
--- NonOverlappingFilters2 ---
2023/09/12 20:43:40 distinct = true
2023/09/12 20:43:40 Using n1ql client
2023/09/12 20:43:40 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:43:40
--- OverlappingFilters ---
2023/09/12 20:43:40 distinct = true
2023/09/12 20:43:40 Using n1ql client
2023/09/12 20:43:40 MultiScanCount = 543 ExpectedMultiScanCount = 543
2023/09/12 20:43:40
--- BoundaryFilters ---
2023/09/12 20:43:40 distinct = true
2023/09/12 20:43:41 Using n1ql client
2023/09/12 20:43:41 MultiScanCount = 172 ExpectedMultiScanCount = 172
2023/09/12 20:43:41
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:43:41 distinct = true
2023/09/12 20:43:41 Using n1ql client
2023/09/12 20:43:41 MultiScanCount = 135 ExpectedMultiScanCount = 135
2023/09/12 20:43:41
--- SeekAndFilters_Overlapping ---
2023/09/12 20:43:41 distinct = true
2023/09/12 20:43:42 Using n1ql client
2023/09/12 20:43:42 MultiScanCount = 134 ExpectedMultiScanCount = 134
2023/09/12 20:43:42
--- SimpleRangeLowUnbounded ---
2023/09/12 20:43:42 distinct = false
2023/09/12 20:43:42 Using n1ql client
2023/09/12 20:43:42 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/12 20:43:42
--- SimpleRangeHighUnbounded ---
2023/09/12 20:43:42 distinct = false
2023/09/12 20:43:43 Using n1ql client
2023/09/12 20:43:43 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/12 20:43:43
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:43:43 distinct = false
2023/09/12 20:43:43 Using n1ql client
2023/09/12 20:43:43 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:43:43
--- FiltersWithUnbounded ---
2023/09/12 20:43:43 distinct = false
2023/09/12 20:43:44 Using n1ql client
2023/09/12 20:43:44 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/12 20:43:44
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:43:44 distinct = false
2023/09/12 20:43:44 Using n1ql client
2023/09/12 20:43:44 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/12 20:43:44
--------- Simple Index with 1 field ---------
2023/09/12 20:43:44
--- SingleIndexSimpleRange ---
2023/09/12 20:43:44 distinct = true
2023/09/12 20:43:45 Using n1ql client
2023/09/12 20:43:45 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/12 20:43:45
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:43:45 distinct = true
2023/09/12 20:43:45 Using n1ql client
2023/09/12 20:43:45 MultiScanCount = 713 ExpectedMultiScanCount = 713
2023/09/12 20:43:45
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:43:45 distinct = true
2023/09/12 20:43:45 Using n1ql client
2023/09/12 20:43:45 MultiScanCount = 869 ExpectedMultiScanCount = 869
2023/09/12 20:43:45
--------- Composite Index with 3 fields ---------
2023/09/12 20:43:45
--- ScanAllNoFilter ---
2023/09/12 20:43:45 distinct = true
2023/09/12 20:43:46 Using n1ql client
2023/09/12 20:43:46 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:43:46
--- ScanAllFilterNil ---
2023/09/12 20:43:46 distinct = true
2023/09/12 20:43:46 Using n1ql client
2023/09/12 20:43:46 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:43:46
--- ScanAll_AllFiltersNil ---
2023/09/12 20:43:46 distinct = true
2023/09/12 20:43:47 Using n1ql client
2023/09/12 20:43:47 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:43:47
--- 3FieldsSingleSeek ---
2023/09/12 20:43:47 distinct = true
2023/09/12 20:43:47 Using n1ql client
2023/09/12 20:43:47 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:43:47
--- 3FieldsMultipleSeeks ---
2023/09/12 20:43:47 distinct = true
2023/09/12 20:43:48 Using n1ql client
2023/09/12 20:43:48 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/12 20:43:48
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:43:48 distinct = true
2023/09/12 20:43:48 Using n1ql client
2023/09/12 20:43:48 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanCount (30.34s)
=== RUN TestMultiScanScenarios
2023/09/12 20:43:48 In TestMultiScanScenarios()
2023/09/12 20:43:48
--------- Composite Index with 2 fields ---------
2023/09/12 20:43:48
--- ScanAllNoFilter ---
2023/09/12 20:43:48 distinct = false
2023/09/12 20:43:48 Using n1ql client
2023/09/12 20:43:48 Expected and Actual scan responses are the same
2023/09/12 20:43:48
--- ScanAllFilterNil ---
2023/09/12 20:43:48 distinct = false
2023/09/12 20:43:49 Using n1ql client
2023/09/12 20:43:49 Expected and Actual scan responses are the same
2023/09/12 20:43:49
--- ScanAll_AllFiltersNil ---
2023/09/12 20:43:49 distinct = false
2023/09/12 20:43:49 Using n1ql client
2023/09/12 20:43:49 Expected and Actual scan responses are the same
2023/09/12 20:43:49
--- SingleSeek ---
2023/09/12 20:43:49 distinct = false
2023/09/12 20:43:50 Using n1ql client
2023/09/12 20:43:50 Expected and Actual scan responses are the same
2023/09/12 20:43:50
--- MultipleSeek ---
2023/09/12 20:43:50 distinct = false
2023/09/12 20:43:50 Using n1ql client
2023/09/12 20:43:50 Expected and Actual scan responses are the same
2023/09/12 20:43:50
--- SimpleRange ---
2023/09/12 20:43:50 distinct = false
2023/09/12 20:43:51 Using n1ql client
2023/09/12 20:43:51 Expected and Actual scan responses are the same
2023/09/12 20:43:51
--- NonOverlappingRanges ---
2023/09/12 20:43:51 distinct = false
2023/09/12 20:43:51 Using n1ql client
2023/09/12 20:43:51 Expected and Actual scan responses are the same
2023/09/12 20:43:51
--- OverlappingRanges ---
2023/09/12 20:43:51 distinct = false
2023/09/12 20:43:51 Using n1ql client
2023/09/12 20:43:51 Expected and Actual scan responses are the same
2023/09/12 20:43:51
--- NonOverlappingFilters ---
2023/09/12 20:43:51 distinct = false
2023/09/12 20:43:52 Using n1ql client
2023/09/12 20:43:52 Expected and Actual scan responses are the same
2023/09/12 20:43:52
--- OverlappingFilters ---
2023/09/12 20:43:52 distinct = false
2023/09/12 20:43:52 Using n1ql client
2023/09/12 20:43:52 Expected and Actual scan responses are the same
2023/09/12 20:43:52
--- BoundaryFilters ---
2023/09/12 20:43:52 distinct = false
2023/09/12 20:43:53 Using n1ql client
2023/09/12 20:43:53 Expected and Actual scan responses are the same
2023/09/12 20:43:53
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:43:53 distinct = false
2023/09/12 20:43:53 Using n1ql client
2023/09/12 20:43:53 Expected and Actual scan responses are the same
2023/09/12 20:43:53
--- SeekAndFilters_Overlapping ---
2023/09/12 20:43:53 distinct = false
2023/09/12 20:43:53 Using n1ql client
2023/09/12 20:43:53 Expected and Actual scan responses are the same
2023/09/12 20:43:53
--- SimpleRangeLowUnbounded ---
2023/09/12 20:43:53 distinct = false
2023/09/12 20:43:54 Using n1ql client
2023/09/12 20:43:54 Expected and Actual scan responses are the same
2023/09/12 20:43:54
--- SimpleRangeHighUnbounded ---
2023/09/12 20:43:54 distinct = false
2023/09/12 20:43:54 Using n1ql client
2023/09/12 20:43:54 Expected and Actual scan responses are the same
2023/09/12 20:43:54
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:43:54 distinct = false
2023/09/12 20:43:55 Using n1ql client
2023/09/12 20:43:55 Expected and Actual scan responses are the same
2023/09/12 20:43:55
--- FiltersWithUnbounded ---
2023/09/12 20:43:55 distinct = false
2023/09/12 20:43:55 Using n1ql client
2023/09/12 20:43:55 Expected and Actual scan responses are the same
2023/09/12 20:43:55
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:43:55 distinct = false
2023/09/12 20:43:56 Using n1ql client
2023/09/12 20:43:56 Expected and Actual scan responses are the same
2023/09/12 20:43:56
--------- Simple Index with 1 field ---------
2023/09/12 20:43:56
--- SingleIndexSimpleRange ---
2023/09/12 20:43:56 distinct = false
2023/09/12 20:43:56 Using n1ql client
2023/09/12 20:43:56 Expected and Actual scan responses are the same
2023/09/12 20:43:56
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:43:56 distinct = false
2023/09/12 20:43:56 Using n1ql client
2023/09/12 20:43:56 Expected and Actual scan responses are the same
2023/09/12 20:43:56
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:43:56 distinct = false
2023/09/12 20:43:57 Using n1ql client
2023/09/12 20:43:57 Expected and Actual scan responses are the same
2023/09/12 20:43:57
--------- Composite Index with 3 fields ---------
2023/09/12 20:43:57
--- ScanAllNoFilter ---
2023/09/12 20:43:57 distinct = false
2023/09/12 20:43:57 Using n1ql client
2023/09/12 20:43:57 Expected and Actual scan responses are the same
2023/09/12 20:43:57
--- ScanAllFilterNil ---
2023/09/12 20:43:57 distinct = false
2023/09/12 20:43:58 Using n1ql client
2023/09/12 20:43:58 Expected and Actual scan responses are the same
2023/09/12 20:43:58
--- ScanAll_AllFiltersNil ---
2023/09/12 20:43:58 distinct = false
2023/09/12 20:43:58 Using n1ql client
2023/09/12 20:43:58 Expected and Actual scan responses are the same
2023/09/12 20:43:58
--- 3FieldsSingleSeek ---
2023/09/12 20:43:58 distinct = false
2023/09/12 20:43:59 Using n1ql client
2023/09/12 20:43:59 Expected and Actual scan responses are the same
2023/09/12 20:43:59
--- 3FieldsMultipleSeeks ---
2023/09/12 20:43:59 distinct = false
2023/09/12 20:43:59 Using n1ql client
2023/09/12 20:43:59 Expected and Actual scan responses are the same
2023/09/12 20:43:59
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:43:59 distinct = false
2023/09/12 20:44:00 Using n1ql client
2023/09/12 20:44:00 Expected and Actual scan responses are the same
2023/09/12 20:44:00
--------- New scenarios ---------
2023/09/12 20:44:00
--- CompIndexHighUnbounded1 ---
2023/09/12 20:44:00
--- Multi Scan 0 ---
2023/09/12 20:44:00 distinct = false
2023/09/12 20:44:00 Using n1ql client
2023/09/12 20:44:00 Expected and Actual scan responses are the same
2023/09/12 20:44:00
--- Multi Scan 1 ---
2023/09/12 20:44:00 distinct = false
2023/09/12 20:44:00 Using n1ql client
2023/09/12 20:44:00 Expected and Actual scan responses are the same
2023/09/12 20:44:00
--- Multi Scan 2 ---
2023/09/12 20:44:00 distinct = false
2023/09/12 20:44:01 Using n1ql client
2023/09/12 20:44:01 Expected and Actual scan responses are the same
2023/09/12 20:44:01
--- CompIndexHighUnbounded2 ---
2023/09/12 20:44:01
--- Multi Scan 0 ---
2023/09/12 20:44:01 distinct = false
2023/09/12 20:44:01 Using n1ql client
2023/09/12 20:44:01 Expected and Actual scan responses are the same
2023/09/12 20:44:01
--- Multi Scan 1 ---
2023/09/12 20:44:01 distinct = false
2023/09/12 20:44:02 Using n1ql client
2023/09/12 20:44:02 Expected and Actual scan responses are the same
2023/09/12 20:44:02
--- Multi Scan 2 ---
2023/09/12 20:44:02 distinct = false
2023/09/12 20:44:02 Using n1ql client
2023/09/12 20:44:02 Expected and Actual scan responses are the same
2023/09/12 20:44:02
--- CompIndexHighUnbounded3 ---
2023/09/12 20:44:02
--- Multi Scan 0 ---
2023/09/12 20:44:02 distinct = false
2023/09/12 20:44:02 Using n1ql client
2023/09/12 20:44:02 Expected and Actual scan responses are the same
2023/09/12 20:44:02
--- CompIndexHighUnbounded4 ---
2023/09/12 20:44:02
--- Multi Scan 0 ---
2023/09/12 20:44:02 distinct = false
2023/09/12 20:44:03 Using n1ql client
2023/09/12 20:44:03 Expected and Actual scan responses are the same
2023/09/12 20:44:03
--- CompIndexHighUnbounded5 ---
2023/09/12 20:44:03
--- Multi Scan 0 ---
2023/09/12 20:44:03 distinct = false
2023/09/12 20:44:03 Using n1ql client
2023/09/12 20:44:03 Expected and Actual scan responses are the same
2023/09/12 20:44:03
--- SeekBoundaries ---
2023/09/12 20:44:03
--- Multi Scan 0 ---
2023/09/12 20:44:03 distinct = false
2023/09/12 20:44:04 Using n1ql client
2023/09/12 20:44:04 Expected and Actual scan responses are the same
2023/09/12 20:44:04
--- Multi Scan 1 ---
2023/09/12 20:44:04 distinct = false
2023/09/12 20:44:04 Using n1ql client
2023/09/12 20:44:04 Expected and Actual scan responses are the same
2023/09/12 20:44:04
--- Multi Scan 2 ---
2023/09/12 20:44:04 distinct = false
2023/09/12 20:44:05 Using n1ql client
2023/09/12 20:44:05 Expected and Actual scan responses are the same
2023/09/12 20:44:05
--- Multi Scan 3 ---
2023/09/12 20:44:05 distinct = false
2023/09/12 20:44:05 Using n1ql client
2023/09/12 20:44:05 Expected and Actual scan responses are the same
2023/09/12 20:44:05
--- Multi Scan 4 ---
2023/09/12 20:44:05 distinct = false
2023/09/12 20:44:05 Using n1ql client
2023/09/12 20:44:05 Expected and Actual scan responses are the same
2023/09/12 20:44:05
--- Multi Scan 5 ---
2023/09/12 20:44:05 distinct = false
2023/09/12 20:44:06 Using n1ql client
2023/09/12 20:44:06 Expected and Actual scan responses are the same
2023/09/12 20:44:06
--- Multi Scan 6 ---
2023/09/12 20:44:06 distinct = false
2023/09/12 20:44:06 Using n1ql client
2023/09/12 20:44:06 Expected and Actual scan responses are the same
2023/09/12 20:44:06
--- Multi Scan 7 ---
2023/09/12 20:44:06 distinct = false
2023/09/12 20:44:07 Using n1ql client
2023/09/12 20:44:07 Expected and Actual scan responses are the same
2023/09/12 20:44:07
--- PrefixSortVariations ---
2023/09/12 20:44:07
--- Multi Scan 0 ---
2023/09/12 20:44:07 distinct = false
2023/09/12 20:44:07 Using n1ql client
2023/09/12 20:44:07 Expected and Actual scan responses are the same
2023/09/12 20:44:07
--- Multi Scan 1 ---
2023/09/12 20:44:07 distinct = false
2023/09/12 20:44:07 Using n1ql client
2023/09/12 20:44:08 Expected and Actual scan responses are the same
--- PASS: TestMultiScanScenarios (19.52s)
=== RUN TestMultiScanOffset
2023/09/12 20:44:08 In TestMultiScanOffset()
2023/09/12 20:44:08
--------- Composite Index with 2 fields ---------
2023/09/12 20:44:08
--- ScanAllNoFilter ---
2023/09/12 20:44:08 distinct = false
2023/09/12 20:44:08 Using n1ql client
2023/09/12 20:44:08
--- ScanAllFilterNil ---
2023/09/12 20:44:08 distinct = false
2023/09/12 20:44:08 Using n1ql client
2023/09/12 20:44:08
--- ScanAll_AllFiltersNil ---
2023/09/12 20:44:08 distinct = false
2023/09/12 20:44:09 Using n1ql client
2023/09/12 20:44:09
--- SingleSeek ---
2023/09/12 20:44:09 distinct = false
2023/09/12 20:44:09 Using n1ql client
2023/09/12 20:44:09
--- MultipleSeek ---
2023/09/12 20:44:09 distinct = false
2023/09/12 20:44:10 Using n1ql client
2023/09/12 20:44:10
--- SimpleRange ---
2023/09/12 20:44:10 distinct = false
2023/09/12 20:44:10 Using n1ql client
2023/09/12 20:44:10
--- NonOverlappingRanges ---
2023/09/12 20:44:10 distinct = false
2023/09/12 20:44:10 Using n1ql client
2023/09/12 20:44:10
--- OverlappingRanges ---
2023/09/12 20:44:10 distinct = false
2023/09/12 20:44:11 Using n1ql client
2023/09/12 20:44:11
--- NonOverlappingFilters ---
2023/09/12 20:44:11 distinct = false
2023/09/12 20:44:11 Using n1ql client
2023/09/12 20:44:11
--- OverlappingFilters ---
2023/09/12 20:44:11 distinct = false
2023/09/12 20:44:12 Using n1ql client
2023/09/12 20:44:12
--- BoundaryFilters ---
2023/09/12 20:44:12 distinct = false
2023/09/12 20:44:12 Using n1ql client
2023/09/12 20:44:12
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:44:12 distinct = false
2023/09/12 20:44:12 Using n1ql client
2023/09/12 20:44:12
--- SeekAndFilters_Overlapping ---
2023/09/12 20:44:12 distinct = false
2023/09/12 20:44:13 Using n1ql client
2023/09/12 20:44:13
--- SimpleRangeLowUnbounded ---
2023/09/12 20:44:13 distinct = false
2023/09/12 20:44:13 Using n1ql client
2023/09/12 20:44:13 Expected and Actual scan responses are the same
2023/09/12 20:44:13
--- SimpleRangeHighUnbounded ---
2023/09/12 20:44:13 distinct = false
2023/09/12 20:44:14 Using n1ql client
2023/09/12 20:44:14 Expected and Actual scan responses are the same
2023/09/12 20:44:14
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:44:14 distinct = false
2023/09/12 20:44:14 Using n1ql client
2023/09/12 20:44:14 Expected and Actual scan responses are the same
2023/09/12 20:44:14
--- FiltersWithUnbounded ---
2023/09/12 20:44:14 distinct = false
2023/09/12 20:44:15 Using n1ql client
2023/09/12 20:44:15 Expected and Actual scan responses are the same
2023/09/12 20:44:15
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:44:15 distinct = false
2023/09/12 20:44:15 Using n1ql client
2023/09/12 20:44:15 Expected and Actual scan responses are the same
2023/09/12 20:44:15
--------- Simple Index with 1 field ---------
2023/09/12 20:44:15
--- SingleIndexSimpleRange ---
2023/09/12 20:44:15 distinct = false
2023/09/12 20:44:15 Using n1ql client
2023/09/12 20:44:15
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:44:15 distinct = false
2023/09/12 20:44:16 Using n1ql client
2023/09/12 20:44:16
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:44:16 distinct = false
2023/09/12 20:44:16 Using n1ql client
2023/09/12 20:44:16
--------- Composite Index with 3 fields ---------
2023/09/12 20:44:16
--- ScanAllNoFilter ---
2023/09/12 20:44:16 distinct = false
2023/09/12 20:44:16 Using n1ql client
2023/09/12 20:44:16
--- ScanAllFilterNil ---
2023/09/12 20:44:16 distinct = false
2023/09/12 20:44:17 Using n1ql client
2023/09/12 20:44:17
--- ScanAll_AllFiltersNil ---
2023/09/12 20:44:17 distinct = false
2023/09/12 20:44:17 Using n1ql client
2023/09/12 20:44:17
--- 3FieldsSingleSeek ---
2023/09/12 20:44:17 distinct = false
2023/09/12 20:44:18 Using n1ql client
2023/09/12 20:44:18
--- 3FieldsMultipleSeeks ---
2023/09/12 20:44:18 distinct = false
2023/09/12 20:44:18 Using n1ql client
2023/09/12 20:44:18
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:44:18 distinct = false
2023/09/12 20:44:19 Using n1ql client
--- PASS: TestMultiScanOffset (11.18s)
=== RUN TestMultiScanPrimaryIndex
2023/09/12 20:44:19 In TestMultiScanPrimaryIndex()
2023/09/12 20:44:19
--- PrimaryRange ---
2023/09/12 20:44:19 Using n1ql client
2023/09/12 20:44:19 Expected and Actual scan responses are the same
2023/09/12 20:44:19
--- PrimaryScanAllNoFilter ---
2023/09/12 20:44:19 Using n1ql client
2023/09/12 20:44:19 Expected and Actual scan responses are the same
--- PASS: TestMultiScanPrimaryIndex (0.07s)
=== RUN TestMultiScanDistinct
2023/09/12 20:44:19 In TestScansDistinct()
2023/09/12 20:44:19
--------- Composite Index with 2 fields ---------
2023/09/12 20:44:19
--- ScanAllNoFilter ---
2023/09/12 20:44:19 distinct = true
2023/09/12 20:44:19 Using n1ql client
2023/09/12 20:44:19 Expected and Actual scan responses are the same
2023/09/12 20:44:19
--- ScanAllFilterNil ---
2023/09/12 20:44:19 distinct = true
2023/09/12 20:44:20 Using n1ql client
2023/09/12 20:44:20 Expected and Actual scan responses are the same
2023/09/12 20:44:20
--- ScanAll_AllFiltersNil ---
2023/09/12 20:44:20 distinct = true
2023/09/12 20:44:20 Using n1ql client
2023/09/12 20:44:20 Expected and Actual scan responses are the same
2023/09/12 20:44:20
--- SingleSeek ---
2023/09/12 20:44:20 distinct = true
2023/09/12 20:44:21 Using n1ql client
2023/09/12 20:44:21 Expected and Actual scan responses are the same
2023/09/12 20:44:21
--- MultipleSeek ---
2023/09/12 20:44:21 distinct = true
2023/09/12 20:44:21 Using n1ql client
2023/09/12 20:44:21 Expected and Actual scan responses are the same
2023/09/12 20:44:21
--- SimpleRange ---
2023/09/12 20:44:21 distinct = true
2023/09/12 20:44:21 Using n1ql client
2023/09/12 20:44:21 Expected and Actual scan responses are the same
2023/09/12 20:44:21
--- NonOverlappingRanges ---
2023/09/12 20:44:21 distinct = true
2023/09/12 20:44:22 Using n1ql client
2023/09/12 20:44:22 Expected and Actual scan responses are the same
2023/09/12 20:44:22
--- OverlappingRanges ---
2023/09/12 20:44:22 distinct = true
2023/09/12 20:44:22 Using n1ql client
2023/09/12 20:44:22 Expected and Actual scan responses are the same
2023/09/12 20:44:22
--- NonOverlappingFilters ---
2023/09/12 20:44:22 distinct = true
2023/09/12 20:44:23 Using n1ql client
2023/09/12 20:44:23 Expected and Actual scan responses are the same
2023/09/12 20:44:23
--- OverlappingFilters ---
2023/09/12 20:44:23 distinct = true
2023/09/12 20:44:23 Using n1ql client
2023/09/12 20:44:23 Expected and Actual scan responses are the same
2023/09/12 20:44:23
--- BoundaryFilters ---
2023/09/12 20:44:23 distinct = true
2023/09/12 20:44:23 Using n1ql client
2023/09/12 20:44:23 Expected and Actual scan responses are the same
2023/09/12 20:44:23
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:44:23 distinct = true
2023/09/12 20:44:24 Using n1ql client
2023/09/12 20:44:24 Expected and Actual scan responses are the same
2023/09/12 20:44:24
--- SeekAndFilters_Overlapping ---
2023/09/12 20:44:24 distinct = true
2023/09/12 20:44:24 Using n1ql client
2023/09/12 20:44:24 Expected and Actual scan responses are the same
2023/09/12 20:44:24
--- SimpleRangeLowUnbounded ---
2023/09/12 20:44:24 distinct = false
2023/09/12 20:44:25 Using n1ql client
2023/09/12 20:44:25 Expected and Actual scan responses are the same
2023/09/12 20:44:25
--- SimpleRangeHighUnbounded ---
2023/09/12 20:44:25 distinct = false
2023/09/12 20:44:25 Using n1ql client
2023/09/12 20:44:25 Expected and Actual scan responses are the same
2023/09/12 20:44:25
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:44:25 distinct = false
2023/09/12 20:44:25 Using n1ql client
2023/09/12 20:44:26 Expected and Actual scan responses are the same
2023/09/12 20:44:26
--- FiltersWithUnbounded ---
2023/09/12 20:44:26 distinct = false
2023/09/12 20:44:26 Using n1ql client
2023/09/12 20:44:26 Expected and Actual scan responses are the same
2023/09/12 20:44:26
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:44:26 distinct = false
2023/09/12 20:44:26 Using n1ql client
2023/09/12 20:44:26 Expected and Actual scan responses are the same
2023/09/12 20:44:26
--------- Simple Index with 1 field ---------
2023/09/12 20:44:26
--- SingleIndexSimpleRange ---
2023/09/12 20:44:26 distinct = true
2023/09/12 20:44:27 Using n1ql client
2023/09/12 20:44:27 Expected and Actual scan responses are the same
2023/09/12 20:44:27
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:44:27 distinct = true
2023/09/12 20:44:27 Using n1ql client
2023/09/12 20:44:27 Expected and Actual scan responses are the same
2023/09/12 20:44:27
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:44:27 distinct = true
2023/09/12 20:44:27 Using n1ql client
2023/09/12 20:44:28 Expected and Actual scan responses are the same
2023/09/12 20:44:28
--------- Composite Index with 3 fields ---------
2023/09/12 20:44:28
--- ScanAllNoFilter ---
2023/09/12 20:44:28 distinct = true
2023/09/12 20:44:28 Using n1ql client
2023/09/12 20:44:28 Expected and Actual scan responses are the same
2023/09/12 20:44:28
--- ScanAllFilterNil ---
2023/09/12 20:44:28 distinct = true
2023/09/12 20:44:29 Using n1ql client
2023/09/12 20:44:29 Expected and Actual scan responses are the same
2023/09/12 20:44:29
--- ScanAll_AllFiltersNil ---
2023/09/12 20:44:29 distinct = true
2023/09/12 20:44:29 Using n1ql client
2023/09/12 20:44:29 Expected and Actual scan responses are the same
2023/09/12 20:44:29
--- 3FieldsSingleSeek ---
2023/09/12 20:44:29 distinct = true
2023/09/12 20:44:30 Using n1ql client
2023/09/12 20:44:30 Expected and Actual scan responses are the same
2023/09/12 20:44:30
--- 3FieldsMultipleSeeks ---
2023/09/12 20:44:30 distinct = true
2023/09/12 20:44:30 Using n1ql client
2023/09/12 20:44:30 Expected and Actual scan responses are the same
2023/09/12 20:44:30
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:44:30 distinct = true
2023/09/12 20:44:30 Using n1ql client
2023/09/12 20:44:30 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDistinct (11.65s)
=== RUN TestMultiScanProjection
2023/09/12 20:44:30 In TestMultiScanProjection()
2023/09/12 20:44:30
--------- Composite Index with 2 fields ---------
2023/09/12 20:44:30
--- ScanAllNoFilter ---
2023/09/12 20:44:30 distinct = true
2023/09/12 20:44:31 Using n1ql client
2023/09/12 20:44:31 Expected and Actual scan responses are the same
2023/09/12 20:44:31
--- ScanAllFilterNil ---
2023/09/12 20:44:31 distinct = true
2023/09/12 20:44:31 Using n1ql client
2023/09/12 20:44:31 Expected and Actual scan responses are the same
2023/09/12 20:44:31
--- ScanAll_AllFiltersNil ---
2023/09/12 20:44:31 distinct = true
2023/09/12 20:44:32 Using n1ql client
2023/09/12 20:44:32 Expected and Actual scan responses are the same
2023/09/12 20:44:32
--- SingleSeek ---
2023/09/12 20:44:32 distinct = true
2023/09/12 20:44:32 Using n1ql client
2023/09/12 20:44:32 Expected and Actual scan responses are the same
2023/09/12 20:44:32
--- MultipleSeek ---
2023/09/12 20:44:32 distinct = true
2023/09/12 20:44:33 Using n1ql client
2023/09/12 20:44:33 Expected and Actual scan responses are the same
2023/09/12 20:44:33
--- SimpleRange ---
2023/09/12 20:44:33 distinct = true
2023/09/12 20:44:33 Using n1ql client
2023/09/12 20:44:33 Expected and Actual scan responses are the same
2023/09/12 20:44:33
--- NonOverlappingRanges ---
2023/09/12 20:44:33 distinct = true
2023/09/12 20:44:33 Using n1ql client
2023/09/12 20:44:33 Expected and Actual scan responses are the same
2023/09/12 20:44:33
--- OverlappingRanges ---
2023/09/12 20:44:33 distinct = true
2023/09/12 20:44:34 Using n1ql client
2023/09/12 20:44:34 Expected and Actual scan responses are the same
2023/09/12 20:44:34
--- NonOverlappingFilters ---
2023/09/12 20:44:34 distinct = true
2023/09/12 20:44:34 Using n1ql client
2023/09/12 20:44:34 Expected and Actual scan responses are the same
2023/09/12 20:44:34
--- OverlappingFilters ---
2023/09/12 20:44:34 distinct = true
2023/09/12 20:44:35 Using n1ql client
2023/09/12 20:44:35 Expected and Actual scan responses are the same
2023/09/12 20:44:35
--- BoundaryFilters ---
2023/09/12 20:44:35 distinct = true
2023/09/12 20:44:35 Using n1ql client
2023/09/12 20:44:35 Expected and Actual scan responses are the same
2023/09/12 20:44:35
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:44:35 distinct = true
2023/09/12 20:44:35 Using n1ql client
2023/09/12 20:44:35 Expected and Actual scan responses are the same
2023/09/12 20:44:35
--- SeekAndFilters_Overlapping ---
2023/09/12 20:44:35 distinct = true
2023/09/12 20:44:36 Using n1ql client
2023/09/12 20:44:36 Expected and Actual scan responses are the same
2023/09/12 20:44:36
--- SimpleRangeLowUnbounded ---
2023/09/12 20:44:36 distinct = false
2023/09/12 20:44:36 Using n1ql client
2023/09/12 20:44:36 Expected and Actual scan responses are the same
2023/09/12 20:44:36
--- SimpleRangeHighUnbounded ---
2023/09/12 20:44:36 distinct = false
2023/09/12 20:44:37 Using n1ql client
2023/09/12 20:44:37 Expected and Actual scan responses are the same
2023/09/12 20:44:37
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:44:37 distinct = false
2023/09/12 20:44:37 Using n1ql client
2023/09/12 20:44:37 Expected and Actual scan responses are the same
2023/09/12 20:44:37
--- FiltersWithUnbounded ---
2023/09/12 20:44:37 distinct = false
2023/09/12 20:44:38 Using n1ql client
2023/09/12 20:44:38 Expected and Actual scan responses are the same
2023/09/12 20:44:38
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:44:38 distinct = false
2023/09/12 20:44:38 Using n1ql client
2023/09/12 20:44:38 Expected and Actual scan responses are the same
2023/09/12 20:44:38
--------- Simple Index with 1 field ---------
2023/09/12 20:44:38
--- SingleIndexSimpleRange ---
2023/09/12 20:44:38 distinct = true
2023/09/12 20:44:38 Using n1ql client
2023/09/12 20:44:38 Expected and Actual scan responses are the same
2023/09/12 20:44:38
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:44:38 distinct = true
2023/09/12 20:44:39 Using n1ql client
2023/09/12 20:44:39 Expected and Actual scan responses are the same
2023/09/12 20:44:39
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:44:39 distinct = true
2023/09/12 20:44:39 Using n1ql client
2023/09/12 20:44:39 Expected and Actual scan responses are the same
2023/09/12 20:44:39
--------- Composite Index with 3 fields ---------
2023/09/12 20:44:39
--- ScanAllNoFilter ---
2023/09/12 20:44:39 distinct = true
2023/09/12 20:44:40 Using n1ql client
2023/09/12 20:44:40 Expected and Actual scan responses are the same
2023/09/12 20:44:40
--- ScanAllFilterNil ---
2023/09/12 20:44:40 distinct = true
2023/09/12 20:44:40 Using n1ql client
2023/09/12 20:44:40 Expected and Actual scan responses are the same
2023/09/12 20:44:40
--- ScanAll_AllFiltersNil ---
2023/09/12 20:44:40 distinct = true
2023/09/12 20:44:41 Using n1ql client
2023/09/12 20:44:41 Expected and Actual scan responses are the same
2023/09/12 20:44:41
--- 3FieldsSingleSeek ---
2023/09/12 20:44:41 distinct = true
2023/09/12 20:44:41 Using n1ql client
2023/09/12 20:44:41 Expected and Actual scan responses are the same
2023/09/12 20:44:41
--- 3FieldsMultipleSeeks ---
2023/09/12 20:44:41 distinct = true
2023/09/12 20:44:42 Using n1ql client
2023/09/12 20:44:42 Expected and Actual scan responses are the same
2023/09/12 20:44:42
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:44:42 distinct = true
2023/09/12 20:44:42 Using n1ql client
2023/09/12 20:44:42 Expected and Actual scan responses are the same
2023/09/12 20:44:42 indexes are: index_company, index_companyname, index_company_name_age, index_company_name_age_address, index_company_name_age_address_friends
2023/09/12 20:44:42 fields are: [company], [company name], [company name age], [company name age address], [company name age address friends]
2023/09/12 20:44:42
--- SingleIndexProjectFirst ---
2023/09/12 20:44:42 distinct = true
2023/09/12 20:44:42 Using n1ql client
2023/09/12 20:44:43 Expected and Actual scan responses are the same
2023/09/12 20:44:43
--- 2FieldIndexProjectSecond ---
2023/09/12 20:44:43 distinct = true
2023/09/12 20:44:43 Using n1ql client
2023/09/12 20:44:43 Expected and Actual scan responses are the same
2023/09/12 20:44:43
--- 3FieldIndexProjectThird ---
2023/09/12 20:44:43 distinct = true
2023/09/12 20:44:44 Using n1ql client
2023/09/12 20:44:44 Expected and Actual scan responses are the same
2023/09/12 20:44:44
--- 4FieldIndexProjectFourth ---
2023/09/12 20:44:44 distinct = true
2023/09/12 20:44:45 Using n1ql client
2023/09/12 20:44:46 Expected and Actual scan responses are the same
2023/09/12 20:44:46
--- 5FieldIndexProjectFifth ---
2023/09/12 20:44:46 distinct = true
2023/09/12 20:44:49 Using n1ql client
2023/09/12 20:44:49 Expected and Actual scan responses are the same
2023/09/12 20:44:49
--- 2FieldIndexProjectTwo ---
2023/09/12 20:44:49 distinct = true
2023/09/12 20:44:49 Using n1ql client
2023/09/12 20:44:49 Expected and Actual scan responses are the same
2023/09/12 20:44:49
--- 3FieldIndexProjectTwo ---
2023/09/12 20:44:49 distinct = true
2023/09/12 20:44:50 Using n1ql client
2023/09/12 20:44:50 Expected and Actual scan responses are the same
2023/09/12 20:44:50
--- 3FieldIndexProjectTwo ---
2023/09/12 20:44:50 distinct = true
2023/09/12 20:44:50 Using n1ql client
2023/09/12 20:44:50 Expected and Actual scan responses are the same
2023/09/12 20:44:50
--- 3FieldIndexProjectTwo ---
2023/09/12 20:44:50 distinct = true
2023/09/12 20:44:51 Using n1ql client
2023/09/12 20:44:51 Expected and Actual scan responses are the same
2023/09/12 20:44:51
--- 4FieldIndexProjectTwo ---
2023/09/12 20:44:51 distinct = true
2023/09/12 20:44:52 Using n1ql client
2023/09/12 20:44:52 Expected and Actual scan responses are the same
2023/09/12 20:44:52
--- 4FieldIndexProjectTwo ---
2023/09/12 20:44:52 distinct = true
2023/09/12 20:44:54 Using n1ql client
2023/09/12 20:44:54 Expected and Actual scan responses are the same
2023/09/12 20:44:54
--- 4FieldIndexProjectTwo ---
2023/09/12 20:44:54 distinct = true
2023/09/12 20:44:55 Using n1ql client
2023/09/12 20:44:55 Expected and Actual scan responses are the same
2023/09/12 20:44:55
--- 4FieldIndexProjectTwo ---
2023/09/12 20:44:55 distinct = true
2023/09/12 20:44:57 Using n1ql client
2023/09/12 20:44:57 Expected and Actual scan responses are the same
2023/09/12 20:44:57
--- 4FieldIndexProjectTwo ---
2023/09/12 20:44:57 distinct = true
2023/09/12 20:44:59 Using n1ql client
2023/09/12 20:44:59 Expected and Actual scan responses are the same
2023/09/12 20:44:59
--- 5FieldIndexProjectTwo ---
2023/09/12 20:44:59 distinct = true
2023/09/12 20:45:02 Using n1ql client
2023/09/12 20:45:02 Expected and Actual scan responses are the same
2023/09/12 20:45:02
--- 5FieldIndexProjectTwo ---
2023/09/12 20:45:02 distinct = true
2023/09/12 20:45:05 Using n1ql client
2023/09/12 20:45:05 Expected and Actual scan responses are the same
2023/09/12 20:45:05
--- 5FieldIndexProjectTwo ---
2023/09/12 20:45:05 distinct = true
2023/09/12 20:45:09 Using n1ql client
2023/09/12 20:45:09 Expected and Actual scan responses are the same
2023/09/12 20:45:09
--- 5FieldIndexProjectTwo ---
2023/09/12 20:45:09 distinct = true
2023/09/12 20:45:12 Using n1ql client
2023/09/12 20:45:12 Expected and Actual scan responses are the same
2023/09/12 20:45:12
--- 5FieldIndexProjectThree ---
2023/09/12 20:45:12 distinct = true
2023/09/12 20:45:15 Using n1ql client
2023/09/12 20:45:15 Expected and Actual scan responses are the same
2023/09/12 20:45:15
--- 5FieldIndexProjectFour ---
2023/09/12 20:45:15 distinct = true
2023/09/12 20:45:19 Using n1ql client
2023/09/12 20:45:19 Expected and Actual scan responses are the same
2023/09/12 20:45:19
--- 5FieldIndexProjectAll ---
2023/09/12 20:45:19 distinct = true
2023/09/12 20:45:22 Using n1ql client
2023/09/12 20:45:22 Expected and Actual scan responses are the same
2023/09/12 20:45:22
--- 5FieldIndexProjectAlternate ---
2023/09/12 20:45:22 distinct = true
2023/09/12 20:45:26 Using n1ql client
2023/09/12 20:45:26 Expected and Actual scan responses are the same
2023/09/12 20:45:26
--- 5FieldIndexProjectEmptyEntryKeys ---
2023/09/12 20:45:26 distinct = true
2023/09/12 20:45:29 Using n1ql client
2023/09/12 20:45:29 Expected and Actual scan responses are the same
--- PASS: TestMultiScanProjection (58.43s)
=== RUN TestMultiScanRestAPI
2023/09/12 20:45:29 In TestMultiScanRestAPI()
2023/09/12 20:45:29 In DropAllSecondaryIndexes()
2023/09/12 20:45:29 Index found: index_primary
2023/09/12 20:45:29 Dropped index index_primary
2023/09/12 20:45:29 Index found: index_company
2023/09/12 20:45:29 Dropped index index_company
2023/09/12 20:45:29 Index found: index_company_name_age_address
2023/09/12 20:45:29 Dropped index index_company_name_age_address
2023/09/12 20:45:29 Index found: index_companyname
2023/09/12 20:45:29 Dropped index index_companyname
2023/09/12 20:45:29 Index found: index_company_name_age_address_friends
2023/09/12 20:45:29 Dropped index index_company_name_age_address_friends
2023/09/12 20:45:29 Index found: addressidx
2023/09/12 20:45:29 Dropped index addressidx
2023/09/12 20:45:29 Index found: index_company_name_age
2023/09/12 20:45:29 Dropped index index_company_name_age
2023/09/12 20:45:33 Created the secondary index index_companyname. Waiting for it become active
2023/09/12 20:45:33 Index is 8567817467038849160 now active
2023/09/12 20:45:33 GET all indexes
2023/09/12 20:45:33 200 OK
2023/09/12 20:45:33 getscans status : 200 OK
2023/09/12 20:45:33 number of entries 337
2023/09/12 20:45:33 Status : 200 OK
2023/09/12 20:45:33 Result from multiscancount API = 0
--- PASS: TestMultiScanRestAPI (4.16s)
=== RUN TestMultiScanPrimaryIndexVariations
2023/09/12 20:45:33 In TestMultiScanPrimaryIndexVariations()
2023/09/12 20:45:40 Created the secondary index index_pi. Waiting for it become active
2023/09/12 20:45:40 Index is 7369881061040768027 now active
2023/09/12 20:45:40
--- No Overlap ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40
--- Proper Overlap ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40
--- Low Boundary Overlap ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40
--- Complex Overlaps ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40
--- Multiple Equal Overlaps ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40
--- Boundary and Subset Overlaps ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40
--- Point Overlaps ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40
--- Boundary and Point Overlaps ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40
--- Primary index range null ---
2023/09/12 20:45:40 Using n1ql client
2023/09/12 20:45:40 Expected and Actual scan responses are the same
2023/09/12 20:45:40 Dropping the secondary index index_pi
2023/09/12 20:45:40 Index dropped
--- PASS: TestMultiScanPrimaryIndexVariations (7.05s)
=== RUN TestMultiScanDescSetup
2023/09/12 20:45:40 In TestMultiScanDescSetup()
2023/09/12 20:45:40 In DropAllSecondaryIndexes()
2023/09/12 20:45:40 Index found: index_companyname
2023/09/12 20:45:40 Dropped index index_companyname
2023/09/12 20:45:47 Created the secondary index index_companyname_desc. Waiting for it become active
2023/09/12 20:45:47 Index is 7028640962790872879 now active
2023/09/12 20:45:54 Created the secondary index index_company_desc. Waiting for it become active
2023/09/12 20:45:54 Index is 18179106470889999073 now active
2023/09/12 20:46:00 Created the secondary index index_company_name_age_desc. Waiting for it become active
2023/09/12 20:46:00 Index is 878324421872240587 now active
--- PASS: TestMultiScanDescSetup (20.10s)
=== RUN TestMultiScanDescScenarios
2023/09/12 20:46:00 In TestMultiScanDescScenarios()
2023/09/12 20:46:00
--------- Composite Index with 2 fields ---------
2023/09/12 20:46:00
--- ScanAllNoFilter ---
2023/09/12 20:46:00 distinct = false
2023/09/12 20:46:01 Using n1ql client
2023/09/12 20:46:01 Expected and Actual scan responses are the same
2023/09/12 20:46:01
--- ScanAllFilterNil ---
2023/09/12 20:46:01 distinct = false
2023/09/12 20:46:01 Using n1ql client
2023/09/12 20:46:01 Expected and Actual scan responses are the same
2023/09/12 20:46:01
--- ScanAll_AllFiltersNil ---
2023/09/12 20:46:01 distinct = false
2023/09/12 20:46:02 Using n1ql client
2023/09/12 20:46:02 Expected and Actual scan responses are the same
2023/09/12 20:46:02
--- SingleSeek ---
2023/09/12 20:46:02 distinct = false
2023/09/12 20:46:02 Using n1ql client
2023/09/12 20:46:02 Expected and Actual scan responses are the same
2023/09/12 20:46:02
--- MultipleSeek ---
2023/09/12 20:46:02 distinct = false
2023/09/12 20:46:02 Using n1ql client
2023/09/12 20:46:02 Expected and Actual scan responses are the same
2023/09/12 20:46:02
--- SimpleRange ---
2023/09/12 20:46:02 distinct = false
2023/09/12 20:46:03 Using n1ql client
2023/09/12 20:46:03 Expected and Actual scan responses are the same
2023/09/12 20:46:03
--- NonOverlappingRanges ---
2023/09/12 20:46:03 distinct = false
2023/09/12 20:46:03 Using n1ql client
2023/09/12 20:46:03 Expected and Actual scan responses are the same
2023/09/12 20:46:03
--- OverlappingRanges ---
2023/09/12 20:46:03 distinct = false
2023/09/12 20:46:04 Using n1ql client
2023/09/12 20:46:04 Expected and Actual scan responses are the same
2023/09/12 20:46:04
--- NonOverlappingFilters ---
2023/09/12 20:46:04 distinct = false
2023/09/12 20:46:04 Using n1ql client
2023/09/12 20:46:04 Expected and Actual scan responses are the same
2023/09/12 20:46:04
--- OverlappingFilters ---
2023/09/12 20:46:04 distinct = false
2023/09/12 20:46:05 Using n1ql client
2023/09/12 20:46:05 Expected and Actual scan responses are the same
2023/09/12 20:46:05
--- BoundaryFilters ---
2023/09/12 20:46:05 distinct = false
2023/09/12 20:46:05 Using n1ql client
2023/09/12 20:46:05 Expected and Actual scan responses are the same
2023/09/12 20:46:05
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:46:05 distinct = false
2023/09/12 20:46:06 Using n1ql client
2023/09/12 20:46:06 Expected and Actual scan responses are the same
2023/09/12 20:46:06
--- SeekAndFilters_Overlapping ---
2023/09/12 20:46:06 distinct = false
2023/09/12 20:46:06 Using n1ql client
2023/09/12 20:46:06 Expected and Actual scan responses are the same
2023/09/12 20:46:06
--- SimpleRangeLowUnbounded ---
2023/09/12 20:46:06 distinct = false
2023/09/12 20:46:06 Using n1ql client
2023/09/12 20:46:06 Expected and Actual scan responses are the same
2023/09/12 20:46:06
--- SimpleRangeHighUnbounded ---
2023/09/12 20:46:06 distinct = false
2023/09/12 20:46:07 Using n1ql client
2023/09/12 20:46:07 Expected and Actual scan responses are the same
2023/09/12 20:46:07
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:46:07 distinct = false
2023/09/12 20:46:07 Using n1ql client
2023/09/12 20:46:07 Expected and Actual scan responses are the same
2023/09/12 20:46:07
--- FiltersWithUnbounded ---
2023/09/12 20:46:07 distinct = false
2023/09/12 20:46:08 Using n1ql client
2023/09/12 20:46:08 Expected and Actual scan responses are the same
2023/09/12 20:46:08
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:46:08 distinct = false
2023/09/12 20:46:08 Using n1ql client
2023/09/12 20:46:08 Expected and Actual scan responses are the same
2023/09/12 20:46:08
--------- Simple Index with 1 field ---------
2023/09/12 20:46:08
--- SingleIndexSimpleRange ---
2023/09/12 20:46:08 distinct = false
2023/09/12 20:46:08 Using n1ql client
2023/09/12 20:46:08 Expected and Actual scan responses are the same
2023/09/12 20:46:08
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:46:08 distinct = false
2023/09/12 20:46:09 Using n1ql client
2023/09/12 20:46:09 Expected and Actual scan responses are the same
2023/09/12 20:46:09
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:46:09 distinct = false
2023/09/12 20:46:09 Using n1ql client
2023/09/12 20:46:09 Expected and Actual scan responses are the same
2023/09/12 20:46:09
--------- Composite Index with 3 fields ---------
2023/09/12 20:46:09
--- ScanAllNoFilter ---
2023/09/12 20:46:09 distinct = false
2023/09/12 20:46:10 Using n1ql client
2023/09/12 20:46:10 Expected and Actual scan responses are the same
2023/09/12 20:46:10
--- ScanAllFilterNil ---
2023/09/12 20:46:10 distinct = false
2023/09/12 20:46:10 Using n1ql client
2023/09/12 20:46:10 Expected and Actual scan responses are the same
2023/09/12 20:46:10
--- ScanAll_AllFiltersNil ---
2023/09/12 20:46:10 distinct = false
2023/09/12 20:46:11 Using n1ql client
2023/09/12 20:46:11 Expected and Actual scan responses are the same
2023/09/12 20:46:11
--- 3FieldsSingleSeek ---
2023/09/12 20:46:11 distinct = false
2023/09/12 20:46:11 Using n1ql client
2023/09/12 20:46:11 Expected and Actual scan responses are the same
2023/09/12 20:46:11
--- 3FieldsMultipleSeeks ---
2023/09/12 20:46:11 distinct = false
2023/09/12 20:46:12 Using n1ql client
2023/09/12 20:46:12 Expected and Actual scan responses are the same
2023/09/12 20:46:12
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:46:12 distinct = false
2023/09/12 20:46:12 Using n1ql client
2023/09/12 20:46:12 Expected and Actual scan responses are the same
2023/09/12 20:46:12
--------- New scenarios ---------
2023/09/12 20:46:12
--- CompIndexHighUnbounded1 ---
2023/09/12 20:46:12
--- Multi Scan 0 ---
2023/09/12 20:46:12 distinct = false
2023/09/12 20:46:12 Using n1ql client
2023/09/12 20:46:12 Expected and Actual scan responses are the same
2023/09/12 20:46:12
--- Multi Scan 1 ---
2023/09/12 20:46:12 distinct = false
2023/09/12 20:46:13 Using n1ql client
2023/09/12 20:46:13 Expected and Actual scan responses are the same
2023/09/12 20:46:13
--- Multi Scan 2 ---
2023/09/12 20:46:13 distinct = false
2023/09/12 20:46:13 Using n1ql client
2023/09/12 20:46:13 Expected and Actual scan responses are the same
2023/09/12 20:46:13
--- CompIndexHighUnbounded2 ---
2023/09/12 20:46:13
--- Multi Scan 0 ---
2023/09/12 20:46:13 distinct = false
2023/09/12 20:46:14 Using n1ql client
2023/09/12 20:46:14 Expected and Actual scan responses are the same
2023/09/12 20:46:14
--- Multi Scan 1 ---
2023/09/12 20:46:14 distinct = false
2023/09/12 20:46:14 Using n1ql client
2023/09/12 20:46:14 Expected and Actual scan responses are the same
2023/09/12 20:46:14
--- Multi Scan 2 ---
2023/09/12 20:46:14 distinct = false
2023/09/12 20:46:14 Using n1ql client
2023/09/12 20:46:15 Expected and Actual scan responses are the same
2023/09/12 20:46:15
--- CompIndexHighUnbounded3 ---
2023/09/12 20:46:15
--- Multi Scan 0 ---
2023/09/12 20:46:15 distinct = false
2023/09/12 20:46:15 Using n1ql client
2023/09/12 20:46:15 Expected and Actual scan responses are the same
2023/09/12 20:46:15
--- CompIndexHighUnbounded4 ---
2023/09/12 20:46:15
--- Multi Scan 0 ---
2023/09/12 20:46:15 distinct = false
2023/09/12 20:46:15 Using n1ql client
2023/09/12 20:46:15 Expected and Actual scan responses are the same
2023/09/12 20:46:15
--- CompIndexHighUnbounded5 ---
2023/09/12 20:46:15
--- Multi Scan 0 ---
2023/09/12 20:46:15 distinct = false
2023/09/12 20:46:16 Using n1ql client
2023/09/12 20:46:16 Expected and Actual scan responses are the same
2023/09/12 20:46:16
--- SeekBoundaries ---
2023/09/12 20:46:16
--- Multi Scan 0 ---
2023/09/12 20:46:16 distinct = false
2023/09/12 20:46:16 Using n1ql client
2023/09/12 20:46:16 Expected and Actual scan responses are the same
2023/09/12 20:46:16
--- Multi Scan 1 ---
2023/09/12 20:46:16 distinct = false
2023/09/12 20:46:17 Using n1ql client
2023/09/12 20:46:17 Expected and Actual scan responses are the same
2023/09/12 20:46:17
--- Multi Scan 2 ---
2023/09/12 20:46:17 distinct = false
2023/09/12 20:46:17 Using n1ql client
2023/09/12 20:46:17 Expected and Actual scan responses are the same
2023/09/12 20:46:17
--- Multi Scan 3 ---
2023/09/12 20:46:17 distinct = false
2023/09/12 20:46:17 Using n1ql client
2023/09/12 20:46:17 Expected and Actual scan responses are the same
2023/09/12 20:46:17
--- Multi Scan 4 ---
2023/09/12 20:46:17 distinct = false
2023/09/12 20:46:18 Using n1ql client
2023/09/12 20:46:18 Expected and Actual scan responses are the same
2023/09/12 20:46:18
--- Multi Scan 5 ---
2023/09/12 20:46:18 distinct = false
2023/09/12 20:46:18 Using n1ql client
2023/09/12 20:46:18 Expected and Actual scan responses are the same
2023/09/12 20:46:18
--- Multi Scan 6 ---
2023/09/12 20:46:18 distinct = false
2023/09/12 20:46:19 Using n1ql client
2023/09/12 20:46:19 Expected and Actual scan responses are the same
2023/09/12 20:46:19
--- Multi Scan 7 ---
2023/09/12 20:46:19 distinct = false
2023/09/12 20:46:19 Using n1ql client
2023/09/12 20:46:19 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescScenarios (18.93s)
=== RUN TestMultiScanDescCount
2023/09/12 20:46:19 In TestMultiScanDescCount()
2023/09/12 20:46:19
--------- Composite Index with 2 fields ---------
2023/09/12 20:46:19
--- ScanAllNoFilter ---
2023/09/12 20:46:19 distinct = false
2023/09/12 20:46:20 Using n1ql client
2023/09/12 20:46:20 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:46:20
--- ScanAllFilterNil ---
2023/09/12 20:46:20 distinct = false
2023/09/12 20:46:20 Using n1ql client
2023/09/12 20:46:20 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:46:20
--- ScanAll_AllFiltersNil ---
2023/09/12 20:46:20 distinct = false
2023/09/12 20:46:20 Using n1ql client
2023/09/12 20:46:20 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:46:20
--- SingleSeek ---
2023/09/12 20:46:20 distinct = false
2023/09/12 20:46:21 Using n1ql client
2023/09/12 20:46:21 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:46:21
--- MultipleSeek ---
2023/09/12 20:46:21 distinct = false
2023/09/12 20:46:21 Using n1ql client
2023/09/12 20:46:21 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 20:46:21
--- SimpleRange ---
2023/09/12 20:46:21 distinct = false
2023/09/12 20:46:21 Using n1ql client
2023/09/12 20:46:21 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/12 20:46:21
--- NonOverlappingRanges ---
2023/09/12 20:46:21 distinct = false
2023/09/12 20:46:22 Using n1ql client
2023/09/12 20:46:22 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2023/09/12 20:46:22
--- OverlappingRanges ---
2023/09/12 20:46:22 distinct = false
2023/09/12 20:46:22 Using n1ql client
2023/09/12 20:46:22 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2023/09/12 20:46:22
--- NonOverlappingFilters ---
2023/09/12 20:46:22 distinct = false
2023/09/12 20:46:23 Using n1ql client
2023/09/12 20:46:23 MultiScanCount = 337 ExpectedMultiScanCount = 337
2023/09/12 20:46:23
--- OverlappingFilters ---
2023/09/12 20:46:23 distinct = false
2023/09/12 20:46:23 Using n1ql client
2023/09/12 20:46:23 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2023/09/12 20:46:23
--- BoundaryFilters ---
2023/09/12 20:46:23 distinct = false
2023/09/12 20:46:24 Using n1ql client
2023/09/12 20:46:24 MultiScanCount = 499 ExpectedMultiScanCount = 499
2023/09/12 20:46:24
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:46:24 distinct = false
2023/09/12 20:46:24 Using n1ql client
2023/09/12 20:46:24 MultiScanCount = 256 ExpectedMultiScanCount = 256
2023/09/12 20:46:24
--- SeekAndFilters_Overlapping ---
2023/09/12 20:46:24 distinct = false
2023/09/12 20:46:24 Using n1ql client
2023/09/12 20:46:24 MultiScanCount = 255 ExpectedMultiScanCount = 255
2023/09/12 20:46:24
--- SimpleRangeLowUnbounded ---
2023/09/12 20:46:24 distinct = false
2023/09/12 20:46:25 Using n1ql client
2023/09/12 20:46:25 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/12 20:46:25
--- SimpleRangeHighUnbounded ---
2023/09/12 20:46:25 distinct = false
2023/09/12 20:46:25 Using n1ql client
2023/09/12 20:46:25 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/12 20:46:25
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:46:25 distinct = false
2023/09/12 20:46:26 Using n1ql client
2023/09/12 20:46:26 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:46:26
--- FiltersWithUnbounded ---
2023/09/12 20:46:26 distinct = false
2023/09/12 20:46:26 Using n1ql client
2023/09/12 20:46:26 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/12 20:46:26
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:46:26 distinct = false
2023/09/12 20:46:26 Using n1ql client
2023/09/12 20:46:26 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/12 20:46:26
--------- Simple Index with 1 field ---------
2023/09/12 20:46:26
--- SingleIndexSimpleRange ---
2023/09/12 20:46:26 distinct = false
2023/09/12 20:46:27 Using n1ql client
2023/09/12 20:46:27 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/12 20:46:27
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:46:27 distinct = false
2023/09/12 20:46:27 Using n1ql client
2023/09/12 20:46:27 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2023/09/12 20:46:27
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:46:27 distinct = false
2023/09/12 20:46:27 Using n1ql client
2023/09/12 20:46:27 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2023/09/12 20:46:27
--------- Composite Index with 3 fields ---------
2023/09/12 20:46:27
--- ScanAllNoFilter ---
2023/09/12 20:46:27 distinct = false
2023/09/12 20:46:28 Using n1ql client
2023/09/12 20:46:28 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:46:28
--- ScanAllFilterNil ---
2023/09/12 20:46:28 distinct = false
2023/09/12 20:46:28 Using n1ql client
2023/09/12 20:46:28 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:46:28
--- ScanAll_AllFiltersNil ---
2023/09/12 20:46:28 distinct = false
2023/09/12 20:46:29 Using n1ql client
2023/09/12 20:46:29 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:46:29
--- 3FieldsSingleSeek ---
2023/09/12 20:46:29 distinct = false
2023/09/12 20:46:29 Using n1ql client
2023/09/12 20:46:29 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:46:29
--- 3FieldsMultipleSeeks ---
2023/09/12 20:46:29 distinct = false
2023/09/12 20:46:30 Using n1ql client
2023/09/12 20:46:30 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/12 20:46:30
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:46:30 distinct = false
2023/09/12 20:46:30 Using n1ql client
2023/09/12 20:46:30 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 20:46:30
--------- New scenarios ---------
2023/09/12 20:46:30
--- CompIndexHighUnbounded1 ---
2023/09/12 20:46:30
--- Multi Scan 0 ---
2023/09/12 20:46:30 distinct = false
2023/09/12 20:46:30 Using n1ql client
2023/09/12 20:46:30 Using n1ql client
2023/09/12 20:46:30 len(scanResults) = 8 MultiScanCount = 8
2023/09/12 20:46:30 Expected and Actual scan responses are the same
2023/09/12 20:46:30
--- Multi Scan 1 ---
2023/09/12 20:46:30 distinct = false
2023/09/12 20:46:31 Using n1ql client
2023/09/12 20:46:31 Using n1ql client
2023/09/12 20:46:31 len(scanResults) = 0 MultiScanCount = 0
2023/09/12 20:46:31 Expected and Actual scan responses are the same
2023/09/12 20:46:31
--- Multi Scan 2 ---
2023/09/12 20:46:31 distinct = false
2023/09/12 20:46:31 Using n1ql client
2023/09/12 20:46:31 Using n1ql client
2023/09/12 20:46:31 len(scanResults) = 9 MultiScanCount = 9
2023/09/12 20:46:31 Expected and Actual scan responses are the same
2023/09/12 20:46:31
--- CompIndexHighUnbounded2 ---
2023/09/12 20:46:31
--- Multi Scan 0 ---
2023/09/12 20:46:31 distinct = false
2023/09/12 20:46:32 Using n1ql client
2023/09/12 20:46:32 Using n1ql client
2023/09/12 20:46:32 len(scanResults) = 4138 MultiScanCount = 4138
2023/09/12 20:46:32 Expected and Actual scan responses are the same
2023/09/12 20:46:32
--- Multi Scan 1 ---
2023/09/12 20:46:32 distinct = false
2023/09/12 20:46:32 Using n1ql client
2023/09/12 20:46:32 Using n1ql client
2023/09/12 20:46:32 len(scanResults) = 2746 MultiScanCount = 2746
2023/09/12 20:46:32 Expected and Actual scan responses are the same
2023/09/12 20:46:32
--- Multi Scan 2 ---
2023/09/12 20:46:32 distinct = false
2023/09/12 20:46:32 Using n1ql client
2023/09/12 20:46:32 Using n1ql client
2023/09/12 20:46:33 len(scanResults) = 4691 MultiScanCount = 4691
2023/09/12 20:46:33 Expected and Actual scan responses are the same
2023/09/12 20:46:33
--- CompIndexHighUnbounded3 ---
2023/09/12 20:46:33
--- Multi Scan 0 ---
2023/09/12 20:46:33 distinct = false
2023/09/12 20:46:33 Using n1ql client
2023/09/12 20:46:33 Using n1ql client
2023/09/12 20:46:33 len(scanResults) = 1329 MultiScanCount = 1329
2023/09/12 20:46:33 Expected and Actual scan responses are the same
2023/09/12 20:46:33
--- CompIndexHighUnbounded4 ---
2023/09/12 20:46:33
--- Multi Scan 0 ---
2023/09/12 20:46:33 distinct = false
2023/09/12 20:46:33 Using n1ql client
2023/09/12 20:46:33 Using n1ql client
2023/09/12 20:46:33 len(scanResults) = 5349 MultiScanCount = 5349
2023/09/12 20:46:33 Expected and Actual scan responses are the same
2023/09/12 20:46:33
--- CompIndexHighUnbounded5 ---
2023/09/12 20:46:33
--- Multi Scan 0 ---
2023/09/12 20:46:33 distinct = false
2023/09/12 20:46:34 Using n1ql client
2023/09/12 20:46:34 Using n1ql client
2023/09/12 20:46:34 len(scanResults) = 8210 MultiScanCount = 8210
2023/09/12 20:46:34 Expected and Actual scan responses are the same
2023/09/12 20:46:34
--- SeekBoundaries ---
2023/09/12 20:46:34
--- Multi Scan 0 ---
2023/09/12 20:46:34 distinct = false
2023/09/12 20:46:34 Using n1ql client
2023/09/12 20:46:34 Using n1ql client
2023/09/12 20:46:34 len(scanResults) = 175 MultiScanCount = 175
2023/09/12 20:46:34 Expected and Actual scan responses are the same
2023/09/12 20:46:34
--- Multi Scan 1 ---
2023/09/12 20:46:34 distinct = false
2023/09/12 20:46:35 Using n1ql client
2023/09/12 20:46:35 Using n1ql client
2023/09/12 20:46:35 len(scanResults) = 1 MultiScanCount = 1
2023/09/12 20:46:35 Expected and Actual scan responses are the same
2023/09/12 20:46:35
--- Multi Scan 2 ---
2023/09/12 20:46:35 distinct = false
2023/09/12 20:46:35 Using n1ql client
2023/09/12 20:46:35 Using n1ql client
2023/09/12 20:46:35 len(scanResults) = 555 MultiScanCount = 555
2023/09/12 20:46:35 Expected and Actual scan responses are the same
2023/09/12 20:46:35
--- Multi Scan 3 ---
2023/09/12 20:46:35 distinct = false
2023/09/12 20:46:35 Using n1ql client
2023/09/12 20:46:35 Using n1ql client
2023/09/12 20:46:36 len(scanResults) = 872 MultiScanCount = 872
2023/09/12 20:46:36 Expected and Actual scan responses are the same
2023/09/12 20:46:36
--- Multi Scan 4 ---
2023/09/12 20:46:36 distinct = false
2023/09/12 20:46:36 Using n1ql client
2023/09/12 20:46:36 Using n1ql client
2023/09/12 20:46:36 len(scanResults) = 287 MultiScanCount = 287
2023/09/12 20:46:36 Expected and Actual scan responses are the same
2023/09/12 20:46:36
--- Multi Scan 5 ---
2023/09/12 20:46:36 distinct = false
2023/09/12 20:46:36 Using n1ql client
2023/09/12 20:46:36 Using n1ql client
2023/09/12 20:46:36 len(scanResults) = 5254 MultiScanCount = 5254
2023/09/12 20:46:36 Expected and Actual scan responses are the same
2023/09/12 20:46:36
--- Multi Scan 6 ---
2023/09/12 20:46:36 distinct = false
2023/09/12 20:46:37 Using n1ql client
2023/09/12 20:46:37 Using n1ql client
2023/09/12 20:46:37 len(scanResults) = 5566 MultiScanCount = 5566
2023/09/12 20:46:37 Expected and Actual scan responses are the same
2023/09/12 20:46:37
--- Multi Scan 7 ---
2023/09/12 20:46:37 distinct = false
2023/09/12 20:46:37 Using n1ql client
2023/09/12 20:46:37 Using n1ql client
2023/09/12 20:46:37 len(scanResults) = 8 MultiScanCount = 8
2023/09/12 20:46:37 Expected and Actual scan responses are the same
2023/09/12 20:46:37
--------- With DISTINCT True ---------
2023/09/12 20:46:37
--- ScanAllNoFilter ---
2023/09/12 20:46:37 distinct = true
2023/09/12 20:46:38 Using n1ql client
2023/09/12 20:46:38 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:46:38
--- ScanAllFilterNil ---
2023/09/12 20:46:38 distinct = true
2023/09/12 20:46:38 Using n1ql client
2023/09/12 20:46:38 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:46:38
--- ScanAll_AllFiltersNil ---
2023/09/12 20:46:38 distinct = true
2023/09/12 20:46:38 Using n1ql client
2023/09/12 20:46:38 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:46:38
--- SingleSeek ---
2023/09/12 20:46:38 distinct = true
2023/09/12 20:46:39 Using n1ql client
2023/09/12 20:46:39 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:46:39
--- MultipleSeek ---
2023/09/12 20:46:39 distinct = true
2023/09/12 20:46:39 Using n1ql client
2023/09/12 20:46:39 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/12 20:46:39
--- SimpleRange ---
2023/09/12 20:46:39 distinct = true
2023/09/12 20:46:40 Using n1ql client
2023/09/12 20:46:40 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/12 20:46:40
--- NonOverlappingRanges ---
2023/09/12 20:46:40 distinct = true
2023/09/12 20:46:40 Using n1ql client
2023/09/12 20:46:40 MultiScanCount = 428 ExpectedMultiScanCount = 428
2023/09/12 20:46:40
--- NonOverlappingFilters2 ---
2023/09/12 20:46:40 distinct = true
2023/09/12 20:46:40 Using n1ql client
2023/09/12 20:46:40 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:46:40
--- OverlappingRanges ---
2023/09/12 20:46:40 distinct = true
2023/09/12 20:46:41 Using n1ql client
2023/09/12 20:46:41 MultiScanCount = 575 ExpectedMultiScanCount = 575
2023/09/12 20:46:41
--- NonOverlappingFilters ---
2023/09/12 20:46:41 distinct = true
2023/09/12 20:46:41 Using n1ql client
2023/09/12 20:46:41 MultiScanCount = 186 ExpectedMultiScanCount = 186
2023/09/12 20:46:41
--- OverlappingFilters ---
2023/09/12 20:46:41 distinct = true
2023/09/12 20:46:42 Using n1ql client
2023/09/12 20:46:42 MultiScanCount = 543 ExpectedMultiScanCount = 543
2023/09/12 20:46:42
--- BoundaryFilters ---
2023/09/12 20:46:42 distinct = true
2023/09/12 20:46:42 Using n1ql client
2023/09/12 20:46:42 MultiScanCount = 172 ExpectedMultiScanCount = 172
2023/09/12 20:46:42
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:46:42 distinct = true
2023/09/12 20:46:43 Using n1ql client
2023/09/12 20:46:43 MultiScanCount = 135 ExpectedMultiScanCount = 135
2023/09/12 20:46:43
--- SeekAndFilters_Overlapping ---
2023/09/12 20:46:43 distinct = true
2023/09/12 20:46:43 Using n1ql client
2023/09/12 20:46:43 MultiScanCount = 134 ExpectedMultiScanCount = 134
2023/09/12 20:46:43
--- SimpleRangeLowUnbounded ---
2023/09/12 20:46:43 distinct = false
2023/09/12 20:46:44 Using n1ql client
2023/09/12 20:46:44 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/12 20:46:44
--- SimpleRangeHighUnbounded ---
2023/09/12 20:46:44 distinct = false
2023/09/12 20:46:44 Using n1ql client
2023/09/12 20:46:44 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/12 20:46:44
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:46:44 distinct = false
2023/09/12 20:46:45 Using n1ql client
2023/09/12 20:46:45 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/12 20:46:45
--- FiltersWithUnbounded ---
2023/09/12 20:46:45 distinct = false
2023/09/12 20:46:45 Using n1ql client
2023/09/12 20:46:45 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/12 20:46:45
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:46:45 distinct = false
2023/09/12 20:46:46 Using n1ql client
2023/09/12 20:46:46 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/12 20:46:46
--------- Simple Index with 1 field ---------
2023/09/12 20:46:46
--- SingleIndexSimpleRange ---
2023/09/12 20:46:46 distinct = true
2023/09/12 20:46:46 Using n1ql client
2023/09/12 20:46:46 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/12 20:46:46
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:46:46 distinct = true
2023/09/12 20:46:46 Using n1ql client
2023/09/12 20:46:46 MultiScanCount = 713 ExpectedMultiScanCount = 713
2023/09/12 20:46:46
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:46:46 distinct = true
2023/09/12 20:46:47 Using n1ql client
2023/09/12 20:46:47 MultiScanCount = 869 ExpectedMultiScanCount = 869
2023/09/12 20:46:47
--------- Composite Index with 3 fields ---------
2023/09/12 20:46:47
--- ScanAllNoFilter ---
2023/09/12 20:46:47 distinct = true
2023/09/12 20:46:47 Using n1ql client
2023/09/12 20:46:47 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:46:47
--- ScanAllFilterNil ---
2023/09/12 20:46:47 distinct = true
2023/09/12 20:46:48 Using n1ql client
2023/09/12 20:46:48 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:46:48
--- ScanAll_AllFiltersNil ---
2023/09/12 20:46:48 distinct = true
2023/09/12 20:46:48 Using n1ql client
2023/09/12 20:46:48 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/12 20:46:48
--- 3FieldsSingleSeek ---
2023/09/12 20:46:48 distinct = true
2023/09/12 20:46:48 Using n1ql client
2023/09/12 20:46:48 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/12 20:46:48
--- 3FieldsMultipleSeeks ---
2023/09/12 20:46:48 distinct = true
2023/09/12 20:46:49 Using n1ql client
2023/09/12 20:46:49 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/12 20:46:49
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:46:49 distinct = true
2023/09/12 20:46:49 Using n1ql client
2023/09/12 20:46:49 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanDescCount (30.15s)
=== RUN TestMultiScanDescOffset
2023/09/12 20:46:49 In SkipTestMultiScanDescOffset()
2023/09/12 20:46:49
--------- Composite Index with 2 fields ---------
2023/09/12 20:46:49
--- ScanAllNoFilter ---
2023/09/12 20:46:49 distinct = false
2023/09/12 20:46:50 Using n1ql client
2023/09/12 20:46:50
--- ScanAllFilterNil ---
2023/09/12 20:46:50 distinct = false
2023/09/12 20:46:50 Using n1ql client
2023/09/12 20:46:50
--- ScanAll_AllFiltersNil ---
2023/09/12 20:46:50 distinct = false
2023/09/12 20:46:51 Using n1ql client
2023/09/12 20:46:51
--- SingleSeek ---
2023/09/12 20:46:51 distinct = false
2023/09/12 20:46:51 Using n1ql client
2023/09/12 20:46:51
--- MultipleSeek ---
2023/09/12 20:46:51 distinct = false
2023/09/12 20:46:51 Using n1ql client
2023/09/12 20:46:51
--- SimpleRange ---
2023/09/12 20:46:51 distinct = false
2023/09/12 20:46:52 Using n1ql client
2023/09/12 20:46:52
--- NonOverlappingRanges ---
2023/09/12 20:46:52 distinct = false
2023/09/12 20:46:52 Using n1ql client
2023/09/12 20:46:52
--- OverlappingRanges ---
2023/09/12 20:46:52 distinct = false
2023/09/12 20:46:53 Using n1ql client
2023/09/12 20:46:53
--- NonOverlappingFilters ---
2023/09/12 20:46:53 distinct = false
2023/09/12 20:46:53 Using n1ql client
2023/09/12 20:46:53
--- OverlappingFilters ---
2023/09/12 20:46:53 distinct = false
2023/09/12 20:46:53 Using n1ql client
2023/09/12 20:46:53
--- BoundaryFilters ---
2023/09/12 20:46:53 distinct = false
2023/09/12 20:46:54 Using n1ql client
2023/09/12 20:46:54
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:46:54 distinct = false
2023/09/12 20:46:54 Using n1ql client
2023/09/12 20:46:54
--- SeekAndFilters_Overlapping ---
2023/09/12 20:46:54 distinct = false
2023/09/12 20:46:55 Using n1ql client
2023/09/12 20:46:55
--- SimpleRangeLowUnbounded ---
2023/09/12 20:46:55 distinct = false
2023/09/12 20:46:55 Using n1ql client
2023/09/12 20:46:55 Expected and Actual scan responses are the same
2023/09/12 20:46:55
--- SimpleRangeHighUnbounded ---
2023/09/12 20:46:55 distinct = false
2023/09/12 20:46:55 Using n1ql client
2023/09/12 20:46:55 Expected and Actual scan responses are the same
2023/09/12 20:46:55
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:46:55 distinct = false
2023/09/12 20:46:56 Using n1ql client
2023/09/12 20:46:56 Expected and Actual scan responses are the same
2023/09/12 20:46:56
--- FiltersWithUnbounded ---
2023/09/12 20:46:56 distinct = false
2023/09/12 20:46:56 Using n1ql client
2023/09/12 20:46:56 Expected and Actual scan responses are the same
2023/09/12 20:46:56
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:46:56 distinct = false
2023/09/12 20:46:57 Using n1ql client
2023/09/12 20:46:57 Expected and Actual scan responses are the same
2023/09/12 20:46:57
--------- Simple Index with 1 field ---------
2023/09/12 20:46:57
--- SingleIndexSimpleRange ---
2023/09/12 20:46:57 distinct = false
2023/09/12 20:46:57 Using n1ql client
2023/09/12 20:46:57
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:46:57 distinct = false
2023/09/12 20:46:57 Using n1ql client
2023/09/12 20:46:57
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:46:57 distinct = false
2023/09/12 20:46:58 Using n1ql client
2023/09/12 20:46:58
--------- Composite Index with 3 fields ---------
2023/09/12 20:46:58
--- ScanAllNoFilter ---
2023/09/12 20:46:58 distinct = false
2023/09/12 20:46:58 Using n1ql client
2023/09/12 20:46:58
--- ScanAllFilterNil ---
2023/09/12 20:46:58 distinct = false
2023/09/12 20:46:59 Using n1ql client
2023/09/12 20:46:59
--- ScanAll_AllFiltersNil ---
2023/09/12 20:46:59 distinct = false
2023/09/12 20:46:59 Using n1ql client
2023/09/12 20:46:59
--- 3FieldsSingleSeek ---
2023/09/12 20:46:59 distinct = false
2023/09/12 20:47:00 Using n1ql client
2023/09/12 20:47:00
--- 3FieldsMultipleSeeks ---
2023/09/12 20:47:00 distinct = false
2023/09/12 20:47:00 Using n1ql client
2023/09/12 20:47:00
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:47:00 distinct = false
2023/09/12 20:47:01 Using n1ql client
--- PASS: TestMultiScanDescOffset (11.28s)
=== RUN TestMultiScanDescDistinct
2023/09/12 20:47:01 In SkipTestMultiScanDescDistinct()
2023/09/12 20:47:01
--------- Composite Index with 2 fields ---------
2023/09/12 20:47:01
--- ScanAllNoFilter ---
2023/09/12 20:47:01 distinct = true
2023/09/12 20:47:01 Using n1ql client
2023/09/12 20:47:01 Expected and Actual scan responses are the same
2023/09/12 20:47:01
--- ScanAllFilterNil ---
2023/09/12 20:47:01 distinct = true
2023/09/12 20:47:01 Using n1ql client
2023/09/12 20:47:02 Expected and Actual scan responses are the same
2023/09/12 20:47:02
--- ScanAll_AllFiltersNil ---
2023/09/12 20:47:02 distinct = true
2023/09/12 20:47:02 Using n1ql client
2023/09/12 20:47:02 Expected and Actual scan responses are the same
2023/09/12 20:47:02
--- SingleSeek ---
2023/09/12 20:47:02 distinct = true
2023/09/12 20:47:02 Using n1ql client
2023/09/12 20:47:02 Expected and Actual scan responses are the same
2023/09/12 20:47:02
--- MultipleSeek ---
2023/09/12 20:47:02 distinct = true
2023/09/12 20:47:03 Using n1ql client
2023/09/12 20:47:03 Expected and Actual scan responses are the same
2023/09/12 20:47:03
--- SimpleRange ---
2023/09/12 20:47:03 distinct = true
2023/09/12 20:47:03 Using n1ql client
2023/09/12 20:47:03 Expected and Actual scan responses are the same
2023/09/12 20:47:03
--- NonOverlappingRanges ---
2023/09/12 20:47:03 distinct = true
2023/09/12 20:47:04 Using n1ql client
2023/09/12 20:47:04 Expected and Actual scan responses are the same
2023/09/12 20:47:04
--- OverlappingRanges ---
2023/09/12 20:47:04 distinct = true
2023/09/12 20:47:04 Using n1ql client
2023/09/12 20:47:04 Expected and Actual scan responses are the same
2023/09/12 20:47:04
--- NonOverlappingFilters ---
2023/09/12 20:47:04 distinct = true
2023/09/12 20:47:05 Using n1ql client
2023/09/12 20:47:05 Expected and Actual scan responses are the same
2023/09/12 20:47:05
--- OverlappingFilters ---
2023/09/12 20:47:05 distinct = true
2023/09/12 20:47:05 Using n1ql client
2023/09/12 20:47:05 Expected and Actual scan responses are the same
2023/09/12 20:47:05
--- BoundaryFilters ---
2023/09/12 20:47:05 distinct = true
2023/09/12 20:47:05 Using n1ql client
2023/09/12 20:47:05 Expected and Actual scan responses are the same
2023/09/12 20:47:05
--- SeekAndFilters_NonOverlapping ---
2023/09/12 20:47:05 distinct = true
2023/09/12 20:47:06 Using n1ql client
2023/09/12 20:47:06 Expected and Actual scan responses are the same
2023/09/12 20:47:06
--- SeekAndFilters_Overlapping ---
2023/09/12 20:47:06 distinct = true
2023/09/12 20:47:06 Using n1ql client
2023/09/12 20:47:06 Expected and Actual scan responses are the same
2023/09/12 20:47:06
--- SimpleRangeLowUnbounded ---
2023/09/12 20:47:06 distinct = false
2023/09/12 20:47:07 Using n1ql client
2023/09/12 20:47:07 Expected and Actual scan responses are the same
2023/09/12 20:47:07
--- SimpleRangeHighUnbounded ---
2023/09/12 20:47:07 distinct = false
2023/09/12 20:47:07 Using n1ql client
2023/09/12 20:47:07 Expected and Actual scan responses are the same
2023/09/12 20:47:07
--- SimpleRangeMultipleUnbounded ---
2023/09/12 20:47:07 distinct = false
2023/09/12 20:47:07 Using n1ql client
2023/09/12 20:47:08 Expected and Actual scan responses are the same
2023/09/12 20:47:08
--- FiltersWithUnbounded ---
2023/09/12 20:47:08 distinct = false
2023/09/12 20:47:08 Using n1ql client
2023/09/12 20:47:08 Expected and Actual scan responses are the same
2023/09/12 20:47:08
--- FiltersLowGreaterThanHigh ---
2023/09/12 20:47:08 distinct = false
2023/09/12 20:47:08 Using n1ql client
2023/09/12 20:47:08 Expected and Actual scan responses are the same
2023/09/12 20:47:08
--------- Simple Index with 1 field ---------
2023/09/12 20:47:08
--- SingleIndexSimpleRange ---
2023/09/12 20:47:08 distinct = true
2023/09/12 20:47:09 Using n1ql client
2023/09/12 20:47:09 Expected and Actual scan responses are the same
2023/09/12 20:47:09
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/12 20:47:09 distinct = true
2023/09/12 20:47:09 Using n1ql client
2023/09/12 20:47:09 Expected and Actual scan responses are the same
2023/09/12 20:47:09
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/12 20:47:09 distinct = true
2023/09/12 20:47:09 Using n1ql client
2023/09/12 20:47:09 Expected and Actual scan responses are the same
2023/09/12 20:47:09
--------- Composite Index with 3 fields ---------
2023/09/12 20:47:09
--- ScanAllNoFilter ---
2023/09/12 20:47:09 distinct = true
2023/09/12 20:47:10 Using n1ql client
2023/09/12 20:47:10 Expected and Actual scan responses are the same
2023/09/12 20:47:10
--- ScanAllFilterNil ---
2023/09/12 20:47:10 distinct = true
2023/09/12 20:47:10 Using n1ql client
2023/09/12 20:47:11 Expected and Actual scan responses are the same
2023/09/12 20:47:11
--- ScanAll_AllFiltersNil ---
2023/09/12 20:47:11 distinct = true
2023/09/12 20:47:11 Using n1ql client
2023/09/12 20:47:11 Expected and Actual scan responses are the same
2023/09/12 20:47:11
--- 3FieldsSingleSeek ---
2023/09/12 20:47:11 distinct = true
2023/09/12 20:47:11 Using n1ql client
2023/09/12 20:47:11 Expected and Actual scan responses are the same
2023/09/12 20:47:11
--- 3FieldsMultipleSeeks ---
2023/09/12 20:47:11 distinct = true
2023/09/12 20:47:12 Using n1ql client
2023/09/12 20:47:12 Expected and Actual scan responses are the same
2023/09/12 20:47:12
--- 3FieldsMultipleSeeks_Identical ---
2023/09/12 20:47:12 distinct = true
2023/09/12 20:47:12 Using n1ql client
2023/09/12 20:47:12 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescDistinct (11.90s)
=== RUN TestGroupAggrSetup
2023/09/12 20:47:12 In TestGroupAggrSetup()
2023/09/12 20:47:12 Emptying the default bucket
2023/09/12 20:47:16 Flush Enabled on bucket default, responseBody:
2023/09/12 20:47:53 Flushed the bucket default, Response body:
2023/09/12 20:47:53 Dropping the secondary index index_agg
2023/09/12 20:47:53 Populating the default bucket
2023/09/12 20:47:57 Created the secondary index index_agg. Waiting for it become active
2023/09/12 20:47:57 Index is 15491983295777932387 now active
--- PASS: TestGroupAggrSetup (50.76s)
=== RUN TestGroupAggrLeading
2023/09/12 20:48:03 In TestGroupAggrLeading()
2023/09/12 20:48:03 Total Scanresults = 7
2023/09/12 20:48:03 Expected and Actual scan responses are the same
2023/09/12 20:48:03 Total Scanresults = 3
2023/09/12 20:48:03 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLeading (0.02s)
=== RUN TestGroupAggrNonLeading
2023/09/12 20:48:03 In TestGroupAggrNonLeading()
2023/09/12 20:48:03 Total Scanresults = 4
2023/09/12 20:48:03 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNonLeading (0.03s)
=== RUN TestGroupAggrNoGroup
2023/09/12 20:48:03 In TestGroupAggrNoGroup()
2023/09/12 20:48:03 Total Scanresults = 1
2023/09/12 20:48:03 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroup (0.00s)
=== RUN TestGroupAggrMinMax
2023/09/12 20:48:03 In TestGroupAggrMinMax()
2023/09/12 20:48:03 Total Scanresults = 4
2023/09/12 20:48:03 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax (0.00s)
=== RUN TestGroupAggrMinMax2
2023/09/12 20:48:03 In TestGroupAggrMinMax()
2023/09/12 20:48:03 Total Scanresults = 1
2023/09/12 20:48:03 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax2 (0.00s)
=== RUN TestGroupAggrLeading_N1QLExprs
2023/09/12 20:48:03 In TestGroupAggrLeading_N1QLExprs()
2023/09/12 20:48:03 Total Scanresults = 17
2023/09/12 20:48:04 basicGroupAggrN1QLExprs1: Scan validation passed
2023/09/12 20:48:04 Total Scanresults = 9
2023/09/12 20:48:04 basicGroupAggrN1QLExprs2: Scan validation passed
--- PASS: TestGroupAggrLeading_N1QLExprs (0.53s)
=== RUN TestGroupAggrLimit
2023/09/12 20:48:04 In TestGroupAggrLimit()
2023/09/12 20:48:04 Total Scanresults = 3
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLimit (0.01s)
=== RUN TestGroupAggrOffset
2023/09/12 20:48:04 In TestGroupAggrOffset()
2023/09/12 20:48:04 Total Scanresults = 3
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrOffset (0.00s)
=== RUN TestGroupAggrCountN
2023/09/12 20:48:04 In TestGroupAggrCountN()
2023/09/12 20:48:04 Total Scanresults = 4
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 4
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrCountN (0.00s)
=== RUN TestGroupAggrNoGroupNoMatch
2023/09/12 20:48:04 In TestGroupAggrNoGroupNoMatch()
2023/09/12 20:48:04 Total Scanresults = 1
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroupNoMatch (0.00s)
=== RUN TestGroupAggrGroupNoMatch
2023/09/12 20:48:04 In TestGroupAggrGroupNoMatch()
2023/09/12 20:48:04 Total Scanresults = 0
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrGroupNoMatch (0.00s)
=== RUN TestGroupAggrMultDataTypes
2023/09/12 20:48:04 In TestGroupAggrMultDataTypes()
2023/09/12 20:48:04 Total Scanresults = 8
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMultDataTypes (0.00s)
=== RUN TestGroupAggrDistinct
2023/09/12 20:48:04 In TestGroupAggrDistinct()
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct (0.00s)
=== RUN TestGroupAggrDistinct2
2023/09/12 20:48:04 In TestGroupAggrDistinct2()
2023/09/12 20:48:04 Total Scanresults = 1
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 4
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 4
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct2 (0.01s)
=== RUN TestGroupAggrNull
2023/09/12 20:48:04 In TestGroupAggrNull()
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNull (0.00s)
=== RUN TestGroupAggrInt64
2023/09/12 20:48:04 In TestGroupAggrInt64()
2023/09/12 20:48:04 Updating the default bucket
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
2023/09/12 20:48:04 Total Scanresults = 2
2023/09/12 20:48:04 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrInt64 (0.20s)
=== RUN TestGroupAggr1
2023/09/12 20:48:04 In TestGroupAggr1()
2023/09/12 20:48:04 In DropAllSecondaryIndexes()
2023/09/12 20:48:04 Index found: index_company_desc
2023/09/12 20:48:04 Dropped index index_company_desc
2023/09/12 20:48:04 Index found: index_company_name_age_desc
2023/09/12 20:48:04 Dropped index index_company_name_age_desc
2023/09/12 20:48:04 Index found: #primary
2023/09/12 20:48:04 Dropped index #primary
2023/09/12 20:48:04 Index found: index_companyname_desc
2023/09/12 20:48:04 Dropped index index_companyname_desc
2023/09/12 20:48:04 Index found: index_agg
2023/09/12 20:48:04 Dropped index index_agg
2023/09/12 20:48:04 Index found: #primary
2023/09/12 20:48:04 Dropped index #primary
2023/09/12 20:48:43 Flushed the bucket default, Response body:
2023/09/12 20:48:54 Created the secondary index idx_aggrs. Waiting for it become active
2023/09/12 20:48:54 Index is 4758172023035241372 now active
2023/09/12 20:48:54 Total Scanresults = 633
2023/09/12 20:48:56 Total Scanresults = 743
--- PASS: TestGroupAggr1 (51.79s)
=== RUN TestGroupAggrArrayIndex
2023/09/12 20:48:56 In TestGroupAggrArrayIndex()
2023/09/12 20:49:01 Created the secondary index ga_arr1. Waiting for it become active
2023/09/12 20:49:01 Index is 600923015910209947 now active
2023/09/12 20:49:07 Created the secondary index ga_arr2. Waiting for it become active
2023/09/12 20:49:07 Index is 18368439307378851657 now active
2023/09/12 20:49:07 Scenario 1
2023/09/12 20:49:07 Total Scanresults = 633
2023/09/12 20:49:07 Scenario 2
2023/09/12 20:49:07 Total Scanresults = 2824
2023/09/12 20:49:08 Scenario 3
2023/09/12 20:49:08 Total Scanresults = 1
2023/09/12 20:49:08 Scenario 4
2023/09/12 20:49:08 Total Scanresults = 992
2023/09/12 20:49:09 Scenario 5
2023/09/12 20:49:09 Total Scanresults = 2824
2023/09/12 20:49:10 Scenario 6
2023/09/12 20:49:10 Total Scanresults = 1
2023/09/12 20:49:10 Scenario 7
2023/09/12 20:49:10 Total Scanresults = 2929
2023/09/12 20:49:13 Scenario 8
2023/09/12 20:49:13 Total Scanresults = 1171
2023/09/12 20:49:14 Scenario 9
2023/09/12 20:49:14 Total Scanresults = 1
2023/09/12 20:49:14 Scenario 10
2023/09/12 20:49:14 Total Scanresults = 633
2023/09/12 20:49:14 Scenario 11
2023/09/12 20:49:14 Total Scanresults = 1171
2023/09/12 20:49:15 Scenario 12
2023/09/12 20:49:15 Total Scanresults = 1
2023/09/12 20:49:15 Scenario 13
2023/09/12 20:49:19 Total Scanresults = 1
2023/09/12 20:49:19 Count of scanResults is 1
2023/09/12 20:49:19 Value: [2 133]
--- PASS: TestGroupAggrArrayIndex (23.52s)
=== RUN TestGroupAggr_FirstValidAggrOnly
2023/09/12 20:49:19 In TestGroupAggr_FirstValidAggrOnly()
2023/09/12 20:49:19 In DropAllSecondaryIndexes()
2023/09/12 20:49:19 Index found: ga_arr1
2023/09/12 20:49:19 Dropped index ga_arr1
2023/09/12 20:49:19 Index found: #primary
2023/09/12 20:49:19 Dropped index #primary
2023/09/12 20:49:19 Index found: #primary
2023/09/12 20:49:20 Dropped index #primary
2023/09/12 20:49:20 Index found: idx_aggrs
2023/09/12 20:49:20 Dropped index idx_aggrs
2023/09/12 20:49:20 Index found: ga_arr2
2023/09/12 20:49:20 Dropped index ga_arr2
2023/09/12 20:49:20 Index found: test_oneperprimarykey
2023/09/12 20:49:20 Dropped index test_oneperprimarykey
2023/09/12 20:49:35 Created the secondary index idx_asc_3field. Waiting for it become active
2023/09/12 20:49:35 Index is 11901623353376864090 now active
2023/09/12 20:49:41 Created the secondary index idx_desc_3field. Waiting for it become active
2023/09/12 20:49:41 Index is 8584185558628125910 now active
2023/09/12 20:49:41 === MIN no group by ===
2023/09/12 20:49:41 Total Scanresults = 1
2023/09/12 20:49:41 Count of scanResults is 1
2023/09/12 20:49:41 Value: ["ACCEL"]
2023/09/12 20:49:41 === MIN no group by, no row match ===
2023/09/12 20:49:41 Total Scanresults = 1
2023/09/12 20:49:41 Count of scanResults is 1
2023/09/12 20:49:41 Value: [null]
2023/09/12 20:49:41 === MIN with group by ===
2023/09/12 20:49:41 Total Scanresults = 633
2023/09/12 20:49:41 === MIN with group by, no row match ===
2023/09/12 20:49:41 Total Scanresults = 0
2023/09/12 20:49:41 === One Aggr, no group by ===
2023/09/12 20:49:41 Total Scanresults = 1
2023/09/12 20:49:41 Count of scanResults is 1
2023/09/12 20:49:41 Value: ["FANFARE"]
2023/09/12 20:49:42 === One Aggr, no group by, no row match ===
2023/09/12 20:49:42 Total Scanresults = 1
2023/09/12 20:49:42 Count of scanResults is 1
2023/09/12 20:49:42 Value: [null]
2023/09/12 20:49:42 === Multiple Aggr, no group by ===
2023/09/12 20:49:42 Total Scanresults = 1
2023/09/12 20:49:42 Count of scanResults is 1
2023/09/12 20:49:42 Value: ["FANFARE" 15]
2023/09/12 20:49:42 === Multiple Aggr, no group by, no row match ===
2023/09/12 20:49:42 Total Scanresults = 1
2023/09/12 20:49:42 Count of scanResults is 1
2023/09/12 20:49:42 Value: [null null]
2023/09/12 20:49:42 === No Aggr, 1 group by ===
2023/09/12 20:49:42 Total Scanresults = 207
2023/09/12 20:49:42 === Aggr on non-leading key, previous equality filter, no group ===
2023/09/12 20:49:42 Total Scanresults = 1
2023/09/12 20:49:42 Count of scanResults is 1
2023/09/12 20:49:42 Value: [17]
2023/09/12 20:49:42 === Aggr on non-leading key, previous equality filters, no group ===
2023/09/12 20:49:42 Total Scanresults = 1
2023/09/12 20:49:42 Count of scanResults is 1
2023/09/12 20:49:42 Value: [null]
2023/09/12 20:49:43 === Aggr on non-leading key, previous non-equality filters, no group ===
2023/09/12 20:49:43 Total Scanresults = 1
2023/09/12 20:49:43 Count of scanResults is 1
2023/09/12 20:49:43 Value: ["Ahmed"]
2023/09/12 20:49:43 === MIN on desc, no group ===
2023/09/12 20:49:43 Total Scanresults = 1
2023/09/12 20:49:43 Count of scanResults is 1
2023/09/12 20:49:43 Value: ["FANFARE"]
2023/09/12 20:49:43 === MAX on asc, no group ===
2023/09/12 20:49:43 Total Scanresults = 1
2023/09/12 20:49:43 Count of scanResults is 1
2023/09/12 20:49:43 Value: ["OZEAN"]
2023/09/12 20:49:44 === MAX on desc, no group ===
2023/09/12 20:49:44 Total Scanresults = 1
2023/09/12 20:49:44 Count of scanResults is 1
2023/09/12 20:49:44 Value: ["OZEAN"]
2023/09/12 20:49:44 === COUNT(DISTINCT const_expr, no group ===
2023/09/12 20:49:44 Total Scanresults = 1
2023/09/12 20:49:44 Count of scanResults is 1
2023/09/12 20:49:44 Value: [1]
2023/09/12 20:49:44 === COUNT(DISTINCT const_expr, no group, no row match ===
2023/09/12 20:49:44 Total Scanresults = 1
2023/09/12 20:49:44 Count of scanResults is 1
2023/09/12 20:49:44 Value: [0]
2023/09/12 20:49:45 === COUNT(const_expr, no group ===
2023/09/12 20:49:45 Total Scanresults = 1
2023/09/12 20:49:45 Count of scanResults is 1
2023/09/12 20:49:45 Value: [321]
2023/09/12 20:49:49 Created the secondary index indexMinAggr. Waiting for it become active
2023/09/12 20:49:49 Index is 4009437753505995799 now active
2023/09/12 20:49:49 === Equality filter check: Equality for a, nil filter for b - inclusion 0, no filter for c ===
2023/09/12 20:49:49 Total Scanresults = 1
2023/09/12 20:49:49 Count of scanResults is 1
2023/09/12 20:49:49 Value: [5]
2023/09/12 20:49:49 === Equality filter check: Equality for a, nil filter for b - inclusion 3, no filter for c ===
2023/09/12 20:49:49 Total Scanresults = 1
2023/09/12 20:49:49 Count of scanResults is 1
2023/09/12 20:49:49 Value: [5]
2023/09/12 20:49:49 === Equality filter check: Equality for a, nil filter for b - inclusion 3, nil filter for c ===
2023/09/12 20:49:49 Total Scanresults = 1
2023/09/12 20:49:49 Count of scanResults is 1
2023/09/12 20:49:49 Value: [5]
--- PASS: TestGroupAggr_FirstValidAggrOnly (29.94s)
=== RUN TestGroupAggrPrimary
2023/09/12 20:49:49 In TestGroupAggrPrimary()
2023/09/12 20:49:49 Total Scanresults = 1
2023/09/12 20:49:49 Total Scanresults = 1
2023/09/12 20:49:49 Total Scanresults = 1
2023/09/12 20:49:49 Total Scanresults = 1002
2023/09/12 20:49:50 Total Scanresults = 1002
2023/09/12 20:49:50 Total Scanresults = 1
2023/09/12 20:49:50 Total Scanresults = 1
2023/09/12 20:49:50 Total Scanresults = 1
2023/09/12 20:49:50 Total Scanresults = 1
2023/09/12 20:49:51 Total Scanresults = 1
2023/09/12 20:49:51 Total Scanresults = 1
2023/09/12 20:49:51 --- MB-28305 Scenario 1 ---
2023/09/12 20:49:51 Total Scanresults = 1
2023/09/12 20:49:51 Count of scanResults is 1
2023/09/12 20:49:51 Value: [0]
2023/09/12 20:49:51 --- MB-28305 Scenario 2 ---
2023/09/12 20:49:51 Total Scanresults = 1
2023/09/12 20:49:51 Count of scanResults is 1
2023/09/12 20:49:51 Value: [0]
2023/09/12 20:49:51 --- MB-28305 Scenario 3 ---
2023/09/12 20:49:51 Total Scanresults = 1
2023/09/12 20:49:51 Count of scanResults is 1
2023/09/12 20:49:51 Value: [0]
--- PASS: TestGroupAggrPrimary (1.53s)
=== RUN TestGroupAggrDocumentKey
2023/09/12 20:49:51 In TestGroupAggrDocumentKey()
2023/09/12 20:49:51 Dropping the secondary index documentkey_idx1
2023/09/12 20:49:51 Dropping the secondary index documentkey_idx2
2023/09/12 20:49:51 Populating the default bucket for TestGroupAggrDocumentKey single key index
2023/09/12 20:49:55 Created the secondary index documentkey_idx1. Waiting for it become active
2023/09/12 20:49:55 Index is 9635684515197780502 now active
2023/09/12 20:49:55 Using n1ql client
2023/09/12 20:49:56 Scanresult Row ["1"] :
2023/09/12 20:49:56 Scanresult Row ["2"] :
2023/09/12 20:49:56 Scanresult Row ["3"] :
2023/09/12 20:49:56 Expected and Actual scan responses are the same
2023/09/12 20:49:56 Populating the default bucket for TestGroupAggrDocumentKey composite key index
2023/09/12 20:50:01 Created the secondary index documentkey_idx2. Waiting for it become active
2023/09/12 20:50:01 Index is 7574074819740352205 now active
2023/09/12 20:50:01 Using n1ql client
2023/09/12 20:50:02 Scanresult Row ["1"] :
2023/09/12 20:50:02 Scanresult Row ["2"] :
2023/09/12 20:50:02 Scanresult Row ["3"] :
2023/09/12 20:50:02 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDocumentKey (11.38s)
=== RUN TestRebalanceSetupCluster
2023/09/12 20:50:02 set14_rebalance_test.go::TestRebalanceSetupCluster: entry: Current cluster configuration: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:50:02 set14_rebalance_test.go::TestRebalanceSetupCluster: 1. Setting up initial cluster configuration
2023/09/12 20:50:02 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 20:50:07 Rebalance progress: 2.669270833333334
2023/09/12 20:50:12 Rebalance progress: 8.333333333333334
2023/09/12 20:50:17 Rebalance progress: 13.99739583333333
2023/09/12 20:50:22 Rebalance progress: 19.53125
2023/09/12 20:50:27 Rebalance progress: 25.26041666666666
2023/09/12 20:50:32 Rebalance progress: 30.98958333333334
2023/09/12 20:50:37 Rebalance progress: 37.01171875
2023/09/12 20:50:43 Rebalance progress: 43.09895833333333
2023/09/12 20:50:48 Rebalance progress: 45.5078125
2023/09/12 20:50:52 Rebalance progress: 50
2023/09/12 20:50:57 Rebalance progress: 50
2023/09/12 20:51:02 Rebalance progress: 75
2023/09/12 20:51:07 Rebalance progress: 100
2023/09/12 20:51:07 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 20:51:08 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 20:51:09 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 20:51:27 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 20:51:42 Rebalance progress: 75
2023/09/12 20:51:47 Rebalance progress: 100
2023/09/12 20:51:47 set14_rebalance_test.go::TestRebalanceSetupCluster: 2. Changing indexer.settings.rebalance.redistribute_indexes to true
2023/09/12 20:51:48 Changing config key indexer.settings.rebalance.redistribute_indexes to value true
2023/09/12 20:51:48 set14_rebalance_test.go::TestRebalanceSetupCluster: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceSetupCluster (105.49s)
=== RUN TestCreateDocsBeforeRebalance
2023/09/12 20:51:48 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:51:48 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: 1. Creating 100 documents
2023/09/12 20:51:48 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: 100 documents created
2023/09/12 20:51:48 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateDocsBeforeRebalance (0.13s)
=== RUN TestCreateIndexesBeforeRebalance
2023/09/12 20:51:48 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:51:48 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 1. Creating 17 indexes: non-partitioned, 0-replica, non-deferred
2023/09/12 20:51:48 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN__id on `default`(_id)
2023/09/12 20:51:51 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN__id index is now active.
2023/09/12 20:51:51 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_docid on `default`(docid)
2023/09/12 20:51:57 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_docid index is now active.
2023/09/12 20:51:57 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_guid on `default`(guid)
2023/09/12 20:52:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_guid index is now active.
2023/09/12 20:52:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_isActive on `default`(isActive)
2023/09/12 20:52:09 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_isActive index is now active.
2023/09/12 20:52:09 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_balance on `default`(balance)
2023/09/12 20:52:15 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_balance index is now active.
2023/09/12 20:52:15 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_picture on `default`(picture)
2023/09/12 20:52:21 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_picture index is now active.
2023/09/12 20:52:21 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_age on `default`(age)
2023/09/12 20:52:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_age index is now active.
2023/09/12 20:52:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_eyeColor on `default`(eyeColor)
2023/09/12 20:52:33 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_eyeColor index is now active.
2023/09/12 20:52:33 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_name on `default`(name)
2023/09/12 20:52:39 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_name index is now active.
2023/09/12 20:52:39 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_gender on `default`(gender)
2023/09/12 20:52:45 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_gender index is now active.
2023/09/12 20:52:45 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_company on `default`(company)
2023/09/12 20:52:51 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_company index is now active.
2023/09/12 20:52:51 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_email on `default`(email)
2023/09/12 20:52:57 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_email index is now active.
2023/09/12 20:52:57 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_phone on `default`(phone)
2023/09/12 20:53:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_phone index is now active.
2023/09/12 20:53:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_registered on `default`(registered)
2023/09/12 20:53:09 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_registered index is now active.
2023/09/12 20:53:09 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_latitude on `default`(latitude)
2023/09/12 20:53:15 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_latitude index is now active.
2023/09/12 20:53:15 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_longitude on `default`(longitude)
2023/09/12 20:53:21 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_longitude index is now active.
2023/09/12 20:53:21 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_favoriteFruit on `default`(favoriteFruit)
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_favoriteFruit index is now active.
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 2. Creating 17 indexes: non-partitioned, 0-replica, DEFERRED
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED__id_docid on `default`(_id, docid) with {"defer_build":true}
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED__id_docid index is now deferred.
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_docid_guid on `default`(docid, guid) with {"defer_build":true}
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_docid_guid index is now deferred.
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_guid_isActive on `default`(guid, isActive) with {"defer_build":true}
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_guid_isActive index is now deferred.
2023/09/12 20:53:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_isActive_balance on `default`(isActive, balance) with {"defer_build":true}
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_isActive_balance index is now deferred.
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_balance_picture on `default`(balance, picture) with {"defer_build":true}
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_balance_picture index is now deferred.
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_picture_age on `default`(picture, age) with {"defer_build":true}
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_picture_age index is now deferred.
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_age_eyeColor on `default`(age, eyeColor) with {"defer_build":true}
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_age_eyeColor index is now deferred.
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_eyeColor_name on `default`(eyeColor, name) with {"defer_build":true}
2023/09/12 20:53:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_eyeColor_name index is now deferred.
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_name_gender on `default`(name, gender) with {"defer_build":true}
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_name_gender index is now deferred.
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_gender_company on `default`(gender, company) with {"defer_build":true}
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_gender_company index is now deferred.
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_company_email on `default`(company, email) with {"defer_build":true}
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_company_email index is now deferred.
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_email_phone on `default`(email, phone) with {"defer_build":true}
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_email_phone index is now deferred.
2023/09/12 20:53:29 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_phone_registered on `default`(phone, registered) with {"defer_build":true}
2023/09/12 20:53:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_phone_registered index is now deferred.
2023/09/12 20:53:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_registered_latitude on `default`(registered, latitude) with {"defer_build":true}
2023/09/12 20:53:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_registered_latitude index is now deferred.
2023/09/12 20:53:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_latitude_longitude on `default`(latitude, longitude) with {"defer_build":true}
2023/09/12 20:53:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_latitude_longitude index is now deferred.
2023/09/12 20:53:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_longitude_favoriteFruit on `default`(longitude, favoriteFruit) with {"defer_build":true}
2023/09/12 20:53:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_longitude_favoriteFruit index is now deferred.
2023/09/12 20:53:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_favoriteFruit__id on `default`(favoriteFruit, _id) with {"defer_build":true}
2023/09/12 20:53:31 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_favoriteFruit__id index is now deferred.
2023/09/12 20:53:31 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 3. Creating 3 indexes: 7-PARTITION, 0-replica, non-deferred
2023/09/12 20:53:31 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS__id_guid on `default`(_id, guid) partition by hash(Meta().id) with {"num_partition":7}
2023/09/12 20:53:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS__id_guid index is now active.
2023/09/12 20:53:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS_docid_isActive on `default`(docid, isActive) partition by hash(Meta().id) with {"num_partition":7}
2023/09/12 20:53:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS_docid_isActive index is now active.
2023/09/12 20:53:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS_guid_balance on `default`(guid, balance) partition by hash(Meta().id) with {"num_partition":7}
2023/09/12 20:53:47 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS_guid_balance index is now active.
2023/09/12 20:53:47 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateIndexesBeforeRebalance (119.47s)
=== RUN TestIndexNodeRebalanceIn
2023/09/12 20:53:47 TestIndexNodeRebalanceIn entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:53:47 TestIndexNodeRebalanceIn: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/12 20:53:47 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 20:53:59 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 20:53:59 TestIndexNodeRebalanceIn: 2. Adding index node 127.0.0.1:9003 to the cluster
2023/09/12 20:53:59 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/12 20:54:09 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/12 20:54:09 TestIndexNodeRebalanceIn: 3. Rebalancing
2023/09/12 20:54:15 Rebalance progress: 20
2023/09/12 20:54:20 Rebalance progress: 43.53448275862069
2023/09/12 20:54:25 Rebalance progress: 59.22248282321029
2023/09/12 20:54:30 Rebalance progress: 64.51842417587741
2023/09/12 20:54:35 Rebalance progress: 87.5
2023/09/12 20:54:40 Rebalance progress: 87.5
2023/09/12 20:54:45 Rebalance progress: 100
2023/09/12 20:54:45 TestIndexNodeRebalanceIn exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestIndexNodeRebalanceIn (59.68s)
=== RUN TestCreateReplicatedIndexesBeforeRebalance
2023/09/12 20:54:47 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:54:47 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: 1. Creating 5 indexes: non-partitioned, 2-REPLICA, non-deferred
2023/09/12 20:54:47 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS__id_isActive on `default`(_id, isActive) with {"num_replica":2}
2023/09/12 20:54:55 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS__id_isActive index is now active.
2023/09/12 20:54:55 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_docid_balance on `default`(docid, balance) with {"num_replica":2}
2023/09/12 20:55:05 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_docid_balance index is now active.
2023/09/12 20:55:05 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_guid_picture on `default`(guid, picture) with {"num_replica":2}
2023/09/12 20:55:17 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_guid_picture index is now active.
2023/09/12 20:55:17 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_isActive_age on `default`(isActive, age) with {"num_replica":2}
2023/09/12 20:55:30 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_isActive_age index is now active.
2023/09/12 20:55:30 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with {"num_replica":2}
2023/09/12 20:55:40 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_balance_eyeColor index is now active.
2023/09/12 20:55:40 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: 2. Creating 2 indexes: 5-PARTITION, 1-REPLICA, non-deferred
2023/09/12 20:55:40 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_5PARTITIONS_1REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "num_replica":1}
2023/09/12 20:55:54 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_5PARTITIONS_1REPLICAS__id_balance index is now active.
2023/09/12 20:55:54 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_5PARTITIONS_1REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "num_replica":1}
2023/09/12 20:56:06 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_5PARTITIONS_1REPLICAS_docid_picture index is now active.
2023/09/12 20:56:06 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateReplicatedIndexesBeforeRebalance (78.89s)
=== RUN TestIndexNodeRebalanceOut
2023/09/12 20:56:06 set14_rebalance_test.go::TestIndexNodeRebalanceOut: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:56:06 set14_rebalance_test.go::TestIndexNodeRebalanceOut: 1. Rebalancing index node 127.0.0.1:9001 out of the cluster
2023/09/12 20:56:06 Removing node(s): [127.0.0.1:9001] from the cluster
2023/09/12 20:56:12 Rebalance progress: 20
2023/09/12 20:56:16 Rebalance progress: 30.35714285714286
2023/09/12 20:56:21 Rebalance progress: 41.07142857142857
2023/09/12 20:56:26 Rebalance progress: 48.21428571428572
2023/09/12 20:56:31 Rebalance progress: 55.35714285714286
2023/09/12 20:56:36 Rebalance progress: 62.5
2023/09/12 20:56:41 Rebalance progress: 69.64285714285714
2023/09/12 20:56:47 Rebalance progress: 76.78571428571428
2023/09/12 20:56:52 Rebalance progress: 100
2023-09-12T20:56:52.150+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.150+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.155+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.165+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.222+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.224+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.250+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.259+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.267+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.279+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.285+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.295+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.305+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.316+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.335+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.343+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.349+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.355+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.358+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.377+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.384+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.384+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:6ff4ddf27feed34cf31e528aae0ad611@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc017f2ae10 0xc017ce26c0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3358464e+07 couch_docs_data_size:1.960018e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.9990856e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1330650112e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5418 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.134715e+06 index_disk_size:3.232642e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1311239168e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5414 7.6.0-1467-rel-EE-enterprise false [index] 3431c6c177e8aad35658724d13b916bf inet 111289816 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.158457e+06 index_disk_size:2.472461e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1324112896e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5413 7.6.0-1467-rel-EE-enterprise false [index] 36e908e6ed909f2b22f7f52ff4c5a723 inet 6419272 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=55160233&uuid=24ebaa2fe1a9f5d23cb1dd6205439390] /pools/default/nodeServices?v=69202768 /pools/default/serverGroups?v=63391191 [{default 328f64a1c82e43110b8b87ef89b3ce04}] {0xc017f2ae10 0xc017ce26c0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3358464e+07 couch_docs_data_size:1.960018e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.9990856e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1330650112e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5418 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.134715e+06 index_disk_size:3.232642e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1311239168e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5414 7.6.0-1467-rel-EE-enterprise false [index] 3431c6c177e8aad35658724d13b916bf inet 111289816 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.158457e+06 index_disk_size:2.472461e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1324112896e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5413 7.6.0-1467-rel-EE-enterprise false [index] 36e908e6ed909f2b22f7f52ff4c5a723 inet 6419272 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[indexAdmin:9112 indexHttp:9114 indexHttps:19114 indexScan:9113 indexStreamCatchup:9116 indexStreamInit:9115 indexStreamMaint:9117 mgmt:9002 mgmtSSL:19002] 127.0.0.1 false} {map[indexAdmin:9118 indexHttp:9120 indexHttps:19120 indexScan:9119 indexStreamCatchup:9122 indexStreamInit:9121 indexStreamMaint:9123 mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9002:19002 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9112:9112 9113:9113 9114:19114 9115:9115 9116:9116 9117:9117 9118:9118 9119:9119 9120:19120 9121:9121 9122:9122 9123:9123 9499:19499 9999:9999]}
2023-09-12T20:56:52.385+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-12T20:56:52.385+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:6ff4ddf27feed34cf31e528aae0ad611@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc017f2a510 0xc017ce24e0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3358464e+07 couch_docs_data_size:1.960018e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.9990856e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1330650112e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5418 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.134715e+06 index_disk_size:3.232642e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1311239168e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5414 7.6.0-1467-rel-EE-enterprise false [index] 3431c6c177e8aad35658724d13b916bf inet 111289816 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.158457e+06 index_disk_size:2.472461e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1324112896e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5413 7.6.0-1467-rel-EE-enterprise false [index] 36e908e6ed909f2b22f7f52ff4c5a723 inet 6419272 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=55160233&uuid=24ebaa2fe1a9f5d23cb1dd6205439390] /pools/default/nodeServices?v=69202768 /pools/default/serverGroups?v=63391191 [{default 328f64a1c82e43110b8b87ef89b3ce04}] {0xc017f2a510 0xc017ce24e0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3358464e+07 couch_docs_data_size:1.960018e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.9990856e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1330650112e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5418 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.134715e+06 index_disk_size:3.232642e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1311239168e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5414 7.6.0-1467-rel-EE-enterprise false [index] 3431c6c177e8aad35658724d13b916bf inet 111289816 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:1.158457e+06 index_disk_size:2.472461e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1324112896e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5413 7.6.0-1467-rel-EE-enterprise false [index] 36e908e6ed909f2b22f7f52ff4c5a723 inet 6419272 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[indexAdmin:9112 indexHttp:9114 indexHttps:19114 indexScan:9113 indexStreamCatchup:9116 indexStreamInit:9115 indexStreamMaint:9117 mgmt:9002 mgmtSSL:19002] 127.0.0.1 false} {map[indexAdmin:9118 indexHttp:9120 indexHttps:19120 indexScan:9119 indexStreamCatchup:9122 indexStreamInit:9121 indexStreamMaint:9123 mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9002:19002 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9112:9112 9113:9113 9114:19114 9115:9115 9116:9116 9117:9117 9118:9118 9119:9119 9120:19120 9121:9121 9122:9122 9123:9123 9499:19499 9999:9999]}
2023/09/12 20:56:52 set14_rebalance_test.go::TestIndexNodeRebalanceOut: exit: Current cluster configuration: map[127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestIndexNodeRebalanceOut (48.10s)
=== RUN TestFailoverAndRebalance
2023/09/12 20:56:54 set14_rebalance_test.go::TestFailoverAndRebalance: entry: Current cluster configuration: map[127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:56:54 set14_rebalance_test.go::TestFailoverAndRebalance: 1. Failing over index node 127.0.0.1:9002
2023/09/12 20:56:54 Failing over: [127.0.0.1:9002]
2023/09/12 20:57:07 set14_rebalance_test.go::TestFailoverAndRebalance: 2. Rebalancing
2023/09/12 20:57:12 Rebalance progress: 30
2023/09/12 20:57:17 Rebalance progress: 100
2023/09/12 20:57:17 set14_rebalance_test.go::TestFailoverAndRebalance: exit: Current cluster configuration: map[127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestFailoverAndRebalance (25.40s)
=== RUN TestSwapRebalance
2023/09/12 20:57:19 set14_rebalance_test.go::TestSwapRebalance: entry: Current cluster configuration: map[127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:57:19 set14_rebalance_test.go::TestSwapRebalance: 1. Adding index node 127.0.0.1:9001 to the cluster
2023/09/12 20:57:19 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 20:57:33 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 20:57:33 set14_rebalance_test.go::TestSwapRebalance: 2. Swap rebalancing index node 127.0.0.1:9003 out of the cluster
2023/09/12 20:57:33 Removing node(s): [127.0.0.1:9003] from the cluster
2023/09/12 20:57:40 Rebalance progress: 23.33333333333333
2023/09/12 20:57:45 Rebalance progress: 38.09523809523809
2023/09/12 20:57:49 Rebalance progress: 52.70884480127503
2023-09-12T20:57:54.362+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.384+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.405+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.421+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.424+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.445+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.452+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.454+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.460+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.470+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.479+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.500+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.509+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.551+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-12T20:57:54.553+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023/09/12 20:57:54 Rebalance progress: 100
2023/09/12 20:57:55 set14_rebalance_test.go::TestSwapRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestSwapRebalance (37.24s)
=== RUN TestRebalanceReplicaRepair
2023/09/12 20:57:57 TestRebalanceReplicaRepair entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:57:57 TestRebalanceReplicaRepair: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/12 20:57:57 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 20:58:10 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 20:58:10 TestRebalanceReplicaRepair: 2. Adding index node 127.0.0.1:9003 to the cluster
2023/09/12 20:58:10 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/12 20:58:21 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/12 20:58:21 TestRebalanceReplicaRepair: 3. Rebalancing
2023/09/12 20:58:26 Rebalance progress: 20
2023/09/12 20:58:31 Rebalance progress: 26.5625
2023/09/12 20:58:36 Rebalance progress: 32.86003541569852
2023/09/12 20:58:41 Rebalance progress: 57.03125
2023/09/12 20:58:46 Rebalance progress: 61.11403419646988
2023/09/12 20:58:51 Rebalance progress: 86.75
2023/09/12 20:58:56 Rebalance progress: 100
2023/09/12 20:58:57 TestRebalanceReplicaRepair exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceReplicaRepair (61.96s)
=== RUN TestFailureAndRebalanceDuringInitialIndexBuild
2023/09/12 20:58:59 set14_rebalance_test.go::TestFailureAndRebalanceDuringInitialIndexBuild: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 20:59:03 Created the secondary index index_0. Waiting for it become active
2023/09/12 20:59:03 Index is 11109707579708180541 now active
2023/09/12 20:59:09 Created the secondary index index_1. Waiting for it become active
2023/09/12 20:59:09 Index is 17795344971248331145 now active
2023/09/12 20:59:15 Created the secondary index index_2. Waiting for it become active
2023/09/12 20:59:15 Index is 17710867176254898918 now active
2023/09/12 20:59:21 Created the secondary index index_3. Waiting for it become active
2023/09/12 20:59:21 Index is 14344783009656257111 now active
2023/09/12 20:59:29 Created the secondary index index_4. Waiting for it become active
2023/09/12 20:59:29 Index is 3921080710950033861 now active
2023/09/12 20:59:38 Created the secondary index index_5. Waiting for it become active
2023/09/12 20:59:38 Index is 14225528509319231648 now active
2023/09/12 20:59:46 Created the secondary index index_6. Waiting for it become active
2023/09/12 20:59:46 Index is 16178626697273526614 now active
2023/09/12 20:59:52 Created the secondary index index_7. Waiting for it become active
2023/09/12 20:59:52 Index is 3888738388725494225 now active
2023/09/12 20:59:58 Created the secondary index index_8. Waiting for it become active
2023/09/12 20:59:58 Index is 7196984417536939889 now active
2023/09/12 21:00:04 Created the secondary index index_9. Waiting for it become active
2023/09/12 21:00:04 Index is 6420473611235779044 now active
2023/09/12 21:00:24 Failing over: [127.0.0.1:9002]
2023/09/12 21:00:25 Build the deferred index index_11. Waiting for the index to become active
2023/09/12 21:00:25 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:26 TestFailureAndRebalanceDuringInitialIndexBuild: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/12 21:00:26 Kicking off failover recovery, type: full
2023/09/12 21:00:26 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:27 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:28 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:29 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:30 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:31 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:32 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:33 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:33 Rebalance progress: 20
2023/09/12 21:00:34 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:35 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:36 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:37 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:38 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:38 Rebalance progress: 20
2023/09/12 21:00:39 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:40 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:41 Waiting for index 3598160911800967097 to go active ...
2023/09/12 21:00:42 Index is 3598160911800967097 now active
2023/09/12 21:00:43 Rebalance progress: 20
2023/09/12 21:00:48 Rebalance progress: 20
2023/09/12 21:00:53 Rebalance progress: 20
2023/09/12 21:00:58 Rebalance progress: 20
2023/09/12 21:01:03 Rebalance progress: 20
2023/09/12 21:01:08 Rebalance progress: 20
2023/09/12 21:01:13 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 21:01:13 set14_rebalance_test.go::TestFailureAndRebalanceDuringInitialIndexBuild: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestFailureAndRebalanceDuringInitialIndexBuild (134.32s)
=== RUN TestRedistributeWhenNodeIsAddedForFalse
2023/09/12 21:01:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 21:01:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 1. Setting up initial cluster configuration
2023/09/12 21:01:13 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 21:01:18 Rebalance progress: 87.5
2023-09-12T21:01:24.228+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.244+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.256+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.274+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.284+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.505+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023/09/12 21:01:24 Rebalance progress: 100
2023/09/12 21:01:24 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023-09-12T21:01:24.520+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.630+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.642+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.656+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:01:24.697+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023/09/12 21:01:27 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:01:28 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:01:51 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 21:02:06 Rebalance progress: 0
2023/09/12 21:02:11 Rebalance progress: 0
2023/09/12 21:02:16 Rebalance progress: 0
2023/09/12 21:02:21 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 21:02:21 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 21:02:51 Woke-up from sleep
2023/09/12 21:02:56 Rebalance progress: 75
2023/09/12 21:03:01 Rebalance progress: 100
2023/09/12 21:03:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 2. Changing indexer.settings.rebalance.redistribute_indexes to false
2023/09/12 21:03:01 Changing config key indexer.settings.rebalance.redistribute_indexes to value false
2023/09/12 21:03:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 3. Setup is completed
2023/09/12 21:03:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 21:03:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse 1. Creating 10 indexes: non-partitioned, 0-REPLICA, non-deferred
2023/09/12 21:03:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS__id_isActive on `default`(_id, isActive) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:03:07 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS__id_isActive index is now active.
2023/09/12 21:03:07 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_docid_balance on `default`(docid, balance) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:03:14 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_docid_balance index is now active.
2023/09/12 21:03:14 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_guid_picture on `default`(guid, picture) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:03:22 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_guid_picture index is now active.
2023/09/12 21:03:22 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_isActive_age on `default`(isActive, age) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:03:29 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_isActive_age index is now active.
2023/09/12 21:03:29 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:03:36 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_balance_eyeColor index is now active.
2023/09/12 21:03:36 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_picture_name on `default`(picture, name) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:03:43 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_picture_name index is now active.
2023/09/12 21:03:43 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_age_gender on `default`(age, gender) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:03:50 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_age_gender index is now active.
2023/09/12 21:03:50 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_eyeColor_company on `default`(eyeColor, company) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:03:58 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_eyeColor_company index is now active.
2023/09/12 21:03:58 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_name_email on `default`(name, email) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:04:05 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_name_email index is now active.
2023/09/12 21:04:05 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_gender_phone on `default`(gender, phone) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:04:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_gender_phone index is now active.
2023/09/12 21:04:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse 2. Creating 4 indexes: 5-PARTITION, 0-REPLICA, non-deferred
2023/09/12 21:04:13 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 21:04:20 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS__id_balance index is now active.
2023/09/12 21:04:20 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 21:04:28 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_docid_picture index is now active.
2023/09/12 21:04:28 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_guid_age on `default`(guid, age) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 21:04:35 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_guid_age index is now active.
2023/09/12 21:04:35 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor on `default`(isActive, eyeColor) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 21:04:43 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor index is now active.
2023/09/12 21:04:43 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/12 21:04:43 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Adding node 127.0.0.1:9002 with service index to the cluster
2023/09/12 21:04:43 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 21:04:56 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 21:05:01 Rebalance progress: 83.33333333333333
2023/09/12 21:05:06 Rebalance progress: 100
2023/09/12 21:05:06 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/12 21:05:06 for GetIndexLocalMetadata http://127.0.0.1:9114/getLocalIndexMetadata
--- PASS: TestRedistributeWhenNodeIsAddedForFalse (233.32s)
=== RUN TestRedistributeWhenNodeIsAddedForTrue
2023/09/12 21:05:06 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 21:05:06 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 1. Setting up initial cluster configuration
2023/09/12 21:05:06 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 21:05:12 Rebalance progress: 83.33333333333333
2023-09-12T21:05:16.405+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.406+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.410+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.410+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.415+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.426+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.427+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.433+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.446+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.448+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.467+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.468+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.476+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.477+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.480+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.484+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.484+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.487+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.488+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.492+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.502+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.502+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:05:16.502+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:8ca36278f40b080186d3558749462e40@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc00d02a1b0 0xc00aa41f00 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3277312e+07 couch_docs_data_size:1.3750834e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.9425704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1762937856e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5921 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=50452526&uuid=24ebaa2fe1a9f5d23cb1dd6205439390] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 328f64a1c82e43110b8b87ef89b3ce04}] {0xc00d02a1b0 0xc00aa41f00 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3277312e+07 couch_docs_data_size:1.3750834e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.9425704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1762937856e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5921 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023-09-12T21:05:16.502+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:8ca36278f40b080186d3558749462e40@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc00d811170 0xc016602100 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3277312e+07 couch_docs_data_size:1.3750834e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.9425704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1762937856e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5921 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=50452526&uuid=24ebaa2fe1a9f5d23cb1dd6205439390] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 328f64a1c82e43110b8b87ef89b3ce04}] {0xc00d811170 0xc016602100 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3277312e+07 couch_docs_data_size:1.3750834e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.9425704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1762937856e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5921 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023/09/12 21:05:17 Rebalance progress: 100
2023/09/12 21:05:17 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:05:19 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:05:20 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:05:40 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 21:05:56 Rebalance progress: 0
2023/09/12 21:06:01 Rebalance progress: 0
2023/09/12 21:06:06 Rebalance progress: 0
2023/09/12 21:06:11 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 21:06:11 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 21:06:41 Woke-up from sleep
2023/09/12 21:06:46 Rebalance progress: 75
2023/09/12 21:06:51 Rebalance progress: 100
2023/09/12 21:06:51 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 2. Changing indexer.settings.rebalance.redistribute_indexes to true
2023/09/12 21:06:51 Changing config key indexer.settings.rebalance.redistribute_indexes to value true
2023/09/12 21:06:51 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 3. Setup is completed
2023/09/12 21:06:51 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 21:06:51 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue 1. Creating 10 indexes: non-partitioned, 0-REPLICA, non-deferred
2023/09/12 21:06:51 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS__id_isActive on `default`(_id, isActive) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:06:56 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS__id_isActive index is now active.
2023/09/12 21:06:56 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_docid_balance on `default`(docid, balance) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:07:04 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_docid_balance index is now active.
2023/09/12 21:07:04 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_guid_picture on `default`(guid, picture) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:07:12 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_guid_picture index is now active.
2023/09/12 21:07:12 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_isActive_age on `default`(isActive, age) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:07:19 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_isActive_age index is now active.
2023/09/12 21:07:19 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:07:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_balance_eyeColor index is now active.
2023/09/12 21:07:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_picture_name on `default`(picture, name) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:07:33 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_picture_name index is now active.
2023/09/12 21:07:33 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_age_gender on `default`(age, gender) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:07:40 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_age_gender index is now active.
2023/09/12 21:07:40 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_eyeColor_company on `default`(eyeColor, company) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:07:48 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_eyeColor_company index is now active.
2023/09/12 21:07:48 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_name_email on `default`(name, email) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:07:55 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_name_email index is now active.
2023/09/12 21:07:55 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_gender_phone on `default`(gender, phone) with { "nodes":["127.0.0.1:9001"]}
2023/09/12 21:08:03 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_gender_phone index is now active.
2023/09/12 21:08:03 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue 2. Creating 4 indexes: 5-PARTITION, 0-REPLICA, non-deferred
2023/09/12 21:08:03 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 21:08:11 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS__id_balance index is now active.
2023/09/12 21:08:11 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 21:08:18 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_docid_picture index is now active.
2023/09/12 21:08:18 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_guid_age on `default`(guid, age) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 21:08:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_guid_age index is now active.
2023/09/12 21:08:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor on `default`(isActive, eyeColor) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/12 21:08:33 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor index is now active.
2023/09/12 21:08:33 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/12 21:08:33 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Adding node 127.0.0.1:9002 with service index to the cluster
2023/09/12 21:08:33 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 21:08:46 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 21:08:51 Rebalance progress: 23.33333333333333
2023/09/12 21:08:57 Rebalance progress: 23.33333333333333
2023/09/12 21:09:02 Rebalance progress: 50.48658417906457
2023/09/12 21:09:06 Rebalance progress: 100
2023/09/12 21:09:06 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/12 21:09:06 for GetIndexLocalMetadata http://127.0.0.1:9114/getLocalIndexMetadata
--- PASS: TestRedistributeWhenNodeIsAddedForTrue (240.18s)
=== RUN TestRebalanceResetCluster
2023/09/12 21:09:06 set14_rebalance_test.go::TestRebalanceResetCluster: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/12 21:09:06 set14_rebalance_test.go::TestRebalanceResetCluster: 1. Restoring indexer.settings.rebalance.redistribute_indexes to false
2023/09/12 21:09:07 Changing config key indexer.settings.rebalance.redistribute_indexes to value false
2023/09/12 21:09:07 set14_rebalance_test.go::TestRebalanceResetCluster: 2. Resetting cluster to initial configuration
2023/09/12 21:09:07 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 21:09:12 Rebalance progress: 83.33333333333333
2023-09-12T21:09:15.934+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.940+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.951+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.951+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.956+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.956+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.976+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.977+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.985+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.988+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.993+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.993+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:15.997+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.000+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.005+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.011+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.012+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.023+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.024+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.029+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.029+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.029+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:8ca36278f40b080186d3558749462e40@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc00f6f0480 0xc0137b3fe0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3744256e+07 couch_docs_data_size:1.3753514e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:5.1874824e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.149929472e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6162 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=50452526&uuid=24ebaa2fe1a9f5d23cb1dd6205439390] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 328f64a1c82e43110b8b87ef89b3ce04}] {0xc00f6f0480 0xc0137b3fe0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3744256e+07 couch_docs_data_size:1.3753514e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:5.1874824e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.149929472e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6162 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023-09-12T21:09:16.035+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:09:16.035+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:8ca36278f40b080186d3558749462e40@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc00f6f0bd0 0xc03528a920 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3744256e+07 couch_docs_data_size:1.3753514e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:5.1874824e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.149929472e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6162 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=50452526&uuid=24ebaa2fe1a9f5d23cb1dd6205439390] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 328f64a1c82e43110b8b87ef89b3ce04}] {0xc00f6f0bd0 0xc03528a920 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3744256e+07 couch_docs_data_size:1.3753514e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:5.1874824e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.149929472e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6162 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023/09/12 21:09:17 Rebalance progress: 100
2023/09/12 21:09:17 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:09:18 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:09:19 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:09:40 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 21:09:56 Rebalance progress: 0
2023/09/12 21:10:01 Rebalance progress: 0
2023/09/12 21:10:06 Rebalance progress: 0
2023/09/12 21:10:11 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 21:10:11 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 21:10:41 Woke-up from sleep
2023/09/12 21:10:46 Rebalance progress: 75
2023/09/12 21:10:51 Rebalance progress: 100
2023/09/12 21:10:51 set14_rebalance_test.go::TestRebalanceResetCluster: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceResetCluster (106.91s)
=== RUN TestAlterIndexIncrReplica
2023/09/12 21:10:53 In TestAlterIndexIncrReplica()
2023/09/12 21:10:53 This test creates an index with one replica and then increments replica count to 2
2023/09/12 21:10:53 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 21:10:59 Rebalance progress: 75
2023-09-12T21:11:01.152+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:01.153+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:01.159+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:01.186+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.296+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.296+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.301+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.301+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.320+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.321+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.353+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.353+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.364+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.365+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.389+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.390+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.419+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.425+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.453+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.456+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.475+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.475+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:8ca36278f40b080186d3558749462e40@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc008b1c870 0xc02a92e5c0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3744256e+07 couch_docs_data_size:1.3753514e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.6973704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.2000210944e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6266 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=50452526&uuid=24ebaa2fe1a9f5d23cb1dd6205439390] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 328f64a1c82e43110b8b87ef89b3ce04}] {0xc008b1c870 0xc02a92e5c0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3744256e+07 couch_docs_data_size:1.3753514e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.6973704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.2000210944e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6266 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023-09-12T21:11:02.476+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-12T21:11:02.476+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:8ca36278f40b080186d3558749462e40@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc0086566c0 0xc021206820 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3744256e+07 couch_docs_data_size:1.3753514e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.6973704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.2000210944e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6266 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=50452526&uuid=24ebaa2fe1a9f5d23cb1dd6205439390] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 328f64a1c82e43110b8b87ef89b3ce04}] {0xc0086566c0 0xc021206820 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true 24ebaa2fe1a9f5d23cb1dd6205439390 [{default /poolsStreaming/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390 /pools/default?uuid=24ebaa2fe1a9f5d23cb1dd6205439390}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.3744256e+07 couch_docs_data_size:1.3753514e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.6973704e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.2000210944e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6266 7.6.0-1467-rel-EE-enterprise true [kv n1ql] a60568fb03bcf4b70d28796b4c57c083 inet 37316822 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023/09/12 21:11:04 Rebalance progress: 100
2023/09/12 21:11:04 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:11:22 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 21:11:37 Rebalance progress: 0
2023/09/12 21:11:42 Rebalance progress: 0
2023/09/12 21:11:47 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 21:11:47 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 21:12:17 Woke-up from sleep
2023/09/12 21:12:23 Rebalance progress: 75
2023/09/12 21:12:28 Rebalance progress: 100
2023/09/12 21:12:28 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 21:12:38 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 21:12:44 Rebalance progress: 83.33333333333333
2023/09/12 21:12:49 Rebalance progress: 100
2023/09/12 21:12:49 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/12 21:12:59 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/12 21:13:05 Rebalance progress: 87.5
2023/09/12 21:13:10 Rebalance progress: 100
2023/09/12 21:13:10 In DropAllSecondaryIndexes()
2023/09/12 21:13:58 Flushed the bucket default, Response body:
2023/09/12 21:14:05 Created the secondary index idx_1. Waiting for it become active
2023/09/12 21:14:05 Index is 16808525526408205446 now active
2023/09/12 21:14:05 Executing alter index command: alter index `default`.idx_1 with {"action":"replica_count", "num_replica":2}
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
2023/09/12 21:14:31 Using n1ql client
--- PASS: TestAlterIndexIncrReplica (218.32s)
=== RUN TestAlterIndexDecrReplica
2023/09/12 21:14:32 In TestAlterIndexDecrReplica()
2023/09/12 21:14:32 This test creates an index with two replicas and then decrements replica count to 1
2023/09/12 21:14:32 In DropAllSecondaryIndexes()
2023/09/12 21:14:32 Index found: idx_1
2023/09/12 21:14:32 Dropped index idx_1
2023/09/12 21:14:52 Created the secondary index idx_2. Waiting for it become active
2023/09/12 21:14:52 Index is 18282956260669575628 now active
2023/09/12 21:14:52 Executing alter index command: alter index `default`.idx_2 with {"action":"replica_count", "num_replica":1}
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
2023/09/12 21:15:18 Using n1ql client
--- PASS: TestAlterIndexDecrReplica (46.44s)
=== RUN TestAlterIndexDropReplica
2023/09/12 21:15:18 In TestAlterIndexDropReplica()
2023/09/12 21:15:18 This test creates an index with two replicas and then drops one replica from cluster
2023/09/12 21:15:18 In DropAllSecondaryIndexes()
2023/09/12 21:15:18 Index found: idx_2
2023/09/12 21:15:18 Dropped index idx_2
2023/09/12 21:15:35 Created the secondary index idx_3. Waiting for it become active
2023/09/12 21:15:35 Index is 2700761055863751350 now active
2023/09/12 21:15:35 Executing alter index command: alter index `default`.idx_3 with {"action":"drop_replica", "replicaId":0}
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
2023/09/12 21:16:05 Using n1ql client
--- PASS: TestAlterIndexDropReplica (47.23s)
=== RUN TestResetCluster_1
2023/09/12 21:16:05 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 21:16:11 Rebalance progress: 87.5
2023/09/12 21:16:16 Rebalance progress: 87.5
2023/09/12 21:16:21 Rebalance progress: 100
2023/09/12 21:16:21 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:16:44 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 21:16:59 Rebalance progress: 0
2023/09/12 21:17:04 Rebalance progress: 0
2023/09/12 21:17:10 Rebalance progress: 0
2023/09/12 21:17:14 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 21:17:14 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 21:17:44 Woke-up from sleep
2023/09/12 21:17:50 Rebalance progress: 75
2023/09/12 21:17:55 Rebalance progress: 100
--- PASS: TestResetCluster_1 (109.40s)
=== RUN TestPartitionDistributionWithReplica
2023/09/12 21:17:55 In TestPartitionDistributionWithReplica()
2023/09/12 21:17:55 This test will create a paritioned index with replica and checks the parition distribution
2023/09/12 21:17:55 Parititions with same ID beloning to both replica and source index should not be on the same node
2023/09/12 21:17:55 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 21:18:00 Rebalance progress: 75
2023/09/12 21:18:05 Rebalance progress: 100
2023/09/12 21:18:05 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:18:06 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:18:25 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 21:18:40 Rebalance progress: 0
2023/09/12 21:18:45 Rebalance progress: 0
2023/09/12 21:18:50 Rebalance progress: 0
2023/09/12 21:18:55 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 21:18:55 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 21:19:25 Woke-up from sleep
2023/09/12 21:19:30 Rebalance progress: 75
2023/09/12 21:19:35 Rebalance progress: 100
2023/09/12 21:19:35 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/12 21:19:47 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/12 21:19:53 Rebalance progress: 83.33333333333333
2023/09/12 21:19:58 Rebalance progress: 100
2023/09/12 21:19:58 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/12 21:20:08 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/12 21:20:14 Rebalance progress: 87.5
2023/09/12 21:20:19 Rebalance progress: 100
2023/09/12 21:20:19 In DropAllSecondaryIndexes()
2023/09/12 21:21:06 Flushed the bucket default, Response body:
2023/09/12 21:21:06 Executing create partition index command on: create index `idx_partn` on `default`(age) partition by hash(meta().id) with {"num_partition":8, "num_replica":1}
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:32 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
2023/09/12 21:21:33 Using n1ql client
--- PASS: TestPartitionDistributionWithReplica (220.39s)
=== RUN TestPartitionedPartialIndex
2023/09/12 21:21:36 Executing create index command: CREATE INDEX `idx_regular` ON `default`(partn_name)
2023/09/12 21:21:40 Using n1ql client
2023/09/12 21:21:41 Dropping the secondary index idx_regular
2023/09/12 21:21:42 Index dropped
2023/09/12 21:21:42 Executing create index command: CREATE INDEX `idx_partial` ON `default`(partn_name) WHERE partn_age >= 0
2023/09/12 21:21:47 Using n1ql client
2023/09/12 21:21:47 Using n1ql client
2023/09/12 21:21:47 Using n1ql client
2023/09/12 21:21:47 Dropping the secondary index idx_partial
2023/09/12 21:21:47 Index dropped
2023/09/12 21:21:48 Executing create index command: CREATE INDEX `idx_partitioned` ON `default`(partn_name) PARTITION BY HASH(meta().id)
2023/09/12 21:21:59 Using n1ql client
2023/09/12 21:21:59 Using n1ql client
2023/09/12 21:21:59 Dropping the secondary index idx_partitioned
2023/09/12 21:21:59 Index dropped
2023/09/12 21:22:00 Executing create index command: CREATE INDEX `idx_partitioned_partial` ON `default`(partn_name) PARTITION BY HASH(meta().id) WHERE partn_age >= 0
2023/09/12 21:22:09 Using n1ql client
2023/09/12 21:22:09 Using n1ql client
2023/09/12 21:22:09 Using n1ql client
2023/09/12 21:22:09 Using n1ql client
2023/09/12 21:22:09 Dropping the secondary index idx_partitioned_partial
2023/09/12 21:22:10 Index dropped
--- PASS: TestPartitionedPartialIndex (38.69s)
=== RUN TestResetCluster_2
2023/09/12 21:22:14 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/12 21:22:19 Rebalance progress: 87.5
2023/09/12 21:22:25 Rebalance progress: 87.5
2023/09/12 21:22:29 Rebalance progress: 100
2023/09/12 21:22:29 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/12 21:22:55 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/12 21:23:10 Rebalance progress: 0
2023/09/12 21:23:15 Rebalance progress: 0
2023/09/12 21:23:20 Rebalance progress: 0
2023/09/12 21:23:25 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/12 21:23:25 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/12 21:23:55 Woke-up from sleep
2023/09/12 21:24:00 Rebalance progress: 75
2023/09/12 21:24:05 Rebalance progress: 100
--- PASS: TestResetCluster_2 (111.47s)
=== RUN TestCollectionSetup
2023/09/12 21:24:05 In TestCollectionSetup()
2023/09/12 21:24:05 In DropAllSecondaryIndexes()
2023/09/12 21:24:15 http://127.0.0.1:9000/pools/default/buckets/default/scopes/_system
2023/09/12 21:24:15 &{DELETE http://127.0.0.1:9000/pools/default/buckets/default/scopes/_system HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/12 21:24:15 &{400 Bad Request 400 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate]