Building
Started building at 2023/09/14 01:32:41
Using pegged server, 1467 build
Calculating base
Updating mirror
Basing run on 7.6.0-1467 8820063a7b
Updating tree for run 14.09.2023-01.32
query is at fc4ec6b, changes since last good build: none
gometa is at 96e745a, changes since last good build: none
ns_server is at 57d74a0, changes since last good build: none
couchstore is at c392c9b, changes since last good build: none
forestdb is at 7af87ef, changes since last good build: none
kv_engine is at e36344c, changes since last good build: none
Switching indexing to unstable
indexing is at 297566c, changes since last good build:
297566c2 MB-57932 CI fix flaky unit test
3b3ffd02 MB-58588 - fix client TLS config for peer server
a8f06769 MB-57930 - move plasma dependencies to separate file
5bd6d70f MB-58538 Handle failures during index recovery
Switching plasma to unstable
plasma is at 40f4da5, changes since last good build:
fatal: Invalid revision range 7431dcb1d1cb4337557ced397279a998bf143db0..HEAD
Switching nitro to unstable
nitro is at f6a9378, changes since last good build: none
Switching gometa to master
gometa is at 96e745a, changes since last good build: none
Switching testrunner to master
Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client'
Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI'
Submodule 'magma_loader/DocLoader' (https://github.com/couchbaselabs/DocLoader.git) registered for path 'magma_loader/DocLoader'
Cloning into '/opt/build/testrunner/java_sdk_client'...
Cloning into '/opt/build/testrunner/lib/capellaAPI'...
Cloning into '/opt/build/testrunner/magma_loader/DocLoader'...
Submodule path 'java_sdk_client': checked out 'de89b059ce28567dbac18afb032271a4eaa674ff'
Submodule path 'lib/capellaAPI': checked out '557b895de72d7530684697546ccff737db801efd'
Submodule path 'magma_loader/DocLoader': checked out '0f32672eea77681939c9b26d43f60bd4b3478936'
testrunner is at 5aa9ede, changes since last good build: none
Pulling in uncommitted change 191342 at refs/changes/42/191342/10
Total 9 (delta 4), reused 9 (delta 4)
[unstable d2a7fd42] MB-57427: disable array index tests
Author: Dhruvil Shah
Date: Mon May 22 10:24:11 2023 +0530
1 file changed, 3 insertions(+)
Pulling in uncommitted change 193825 at refs/changes/25/193825/1
Total 6 (delta 5), reused 6 (delta 5)
[unstable 79186c55] MB100: CIFail - Enable info level client logs after TestScheduleIndexBasic
Author: Sai Krishna Teja Kommaraju
Date: Fri Jul 14 00:58:44 2023 +0530
1 file changed, 3 insertions(+)
Pulling in uncommitted change 196894 at refs/changes/94/196894/2
Total 7 (delta 5), reused 7 (delta 5)
[unstable 3e7a4585] MB-57930: Refactor Prometheus storage stats
Author: jineshparakh
Date: Sat Sep 9 18:43:17 2023 +0530
3 files changed, 173 insertions(+), 125 deletions(-)
create mode 100644 secondary/indexer/storage_stats_manager_community.go
create mode 100644 secondary/indexer/storage_stats_manager_enterprise.go
Pulling in uncommitted change 197069 at refs/changes/69/197069/1
Total 32 (delta 27), reused 32 (delta 27)
[unstable bdc7823b] MB-100 getHosts from getIndexStatus instead of indexStatus
Author: Varun Velamuri
Date: Tue Sep 12 21:20:24 2023 -0700
3 files changed, 26 insertions(+), 24 deletions(-)
Pulling in uncommitted change 197133 at refs/changes/33/197133/2
Total 5 (delta 4), reused 5 (delta 4)
[unstable 6505cad9] MB-58279 Reset slot book-keeping data structures for new solution
Author: Varun Velamuri
Date: Wed Sep 13 12:56:23 2023 -0700
1 file changed, 2 insertions(+)
Pulling in uncommitted change 196557 at refs/changes/57/196557/9
Total 11 (delta 9), reused 11 (delta 9)
[unstable 572997f] MB-58423: Perform tenant quota adjustment asynchronously
Author: jliang00
Date: Fri Sep 1 09:30:02 2023 -0700
6 files changed, 321 insertions(+), 48 deletions(-)
Pulling in uncommitted change 197072 at refs/changes/72/197072/1
Total 6 (delta 1), reused 2 (delta 1)
[unstable 3f8129c] MB-57825: Fix double flush buffer adjustment
Author: Saptarshi Sen
Date: Wed Sep 6 13:21:03 2023 -0700
4 files changed, 65 insertions(+), 3 deletions(-)
Pulling in uncommitted change 197073 at refs/changes/73/197073/1
Total 10 (delta 3), reused 5 (delta 3)
[unstable d917231] MB-57825: Do not exceed minBufRatio on resume IO with idleLSS
Author: Saptarshi Sen
Date: Mon Aug 28 16:12:34 2023 -0700
2 files changed, 127 insertions(+), 6 deletions(-)
Pulling in uncommitted change 197074 at refs/changes/74/197074/1
Total 19 (delta 10), reused 13 (delta 10)
[unstable 7d5b321] MB-57825: Defer new flush buffer allocation until next IO
Author: Saptarshi Sen
Date: Wed Sep 6 16:09:35 2023 -0700
7 files changed, 172 insertions(+), 65 deletions(-)
Pulling in uncommitted change 197075 at refs/changes/75/197075/1
Total 24 (delta 15), reused 19 (delta 15)
[unstable d356855] MB-57825: Prevent flush buffer accumulation with outstanding IO
Author: Saptarshi Sen
Date: Wed Sep 6 17:00:00 2023 -0700
3 files changed, 173 insertions(+), 12 deletions(-)
Pulling in uncommitted change 197076 at refs/changes/76/197076/1
Total 28 (delta 18), reused 23 (delta 18)
[unstable b807b4f] MB-57825: Use assignedQuota for flush buffer usage ratio
Author: Saptarshi Sen
Date: Tue Aug 29 08:12:41 2023 -0700
2 files changed, 14 insertions(+), 10 deletions(-)
Pulling in uncommitted change 197077 at refs/changes/77/197077/1
Total 35 (delta 22), reused 28 (delta 22)
[unstable 21ad203] MB-57825: Use moving average to estimate max lss block size
Author: Saptarshi Sen
Date: Sun Sep 3 08:54:30 2023 -0700
5 files changed, 173 insertions(+), 43 deletions(-)
Pulling in uncommitted change 197078 at refs/changes/78/197078/1
Total 39 (delta 25), reused 32 (delta 25)
[unstable ad4d16c] MB-57825: Add weighted LSS flush buffer adjustment
Author: Saptarshi Sen
Date: Thu Sep 7 01:09:49 2023 -0700
2 files changed, 157 insertions(+), 61 deletions(-)
Pulling in uncommitted change 197079 at refs/changes/79/197079/1
Total 44 (delta 30), reused 38 (delta 30)
[unstable 59b4b37] MB-57825: Add config limits for minimum flush buffer size
Author: Saptarshi Sen
Date: Thu Sep 7 09:13:54 2023 -0700
3 files changed, 62 insertions(+)
Pulling in uncommitted change 197080 at refs/changes/80/197080/1
Total 49 (delta 33), reused 42 (delta 33)
[unstable 1fb6c92] MB-57825: Add max flush buffer quota (maxBufRatio)
Author: Saptarshi Sen
Date: Thu Sep 7 16:48:53 2023 -0700
3 files changed, 316 insertions(+), 104 deletions(-)
Building community edition
Building cmakefiles and deps [CE]
Building main product [CE]
Build CE finished
BUILD_ENTERPRISE empty. Building enterprise edition
Building Enterprise Edition
Building cmakefiles and deps [EE]
Building main product [EE]
Build EE finished
Testing
Started testing at 2023/09/14 02:29:51
Testing mode: sanity,unit,functional,serverless,integration
Using storage type: memdb
Setting ulimit to 200000
Simple Test
Sep 14 02:31:32 suite_setUp (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 14 02:36:00 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 14 02:40:25 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 14 02:45:00 b" 'stop_on_failure': 'True'}"
Sep 14 02:45:00 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=50000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True,doc_ops=create;update;delete'
Sep 14 02:45:00 b"{'nodes_in': '3', 'replicas': '1', 'items': '50000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 1, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-14_02-30-15/test_1'}"
Sep 14 02:45:00 b'-->result: '
Sep 14 02:45:00 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0'
Sep 14 02:45:00 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,bucket_type=ephemeral,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Sep 14 02:45:00 b"{'nodes_in': '3', 'bucket_type': 'ephemeral', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 2, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-14_02-30-15/test_2'}"
Sep 14 02:45:00 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 14 02:45:00 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t memcapable.WarmUpMemcachedTest.do_warmup_100k,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True'
Sep 14 02:45:00 b"{'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 3, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-14_02-30-15/test_3'}"
Sep 14 02:45:00 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 14 02:45:00 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 14 02:45:00 b'failures so far...'
Sep 14 02:45:00 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.createdeleteview.CreateDeleteViewTests.test_view_ops,ddoc_ops=create,test_with_view=True,num_ddocs=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,num_views_per_ddoc=10,items=1000,skip_cleanup=False,get-logs-cluster-run=True'
Sep 14 02:45:00 b"{'ddoc_ops': 'create', 'test_with_view': 'True', 'num_ddocs': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'num_views_per_ddoc': '10', 'items': '1000', 'skip_cleanup': 'False', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 4, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-14_02-30-15/test_4'}"
Sep 14 02:46:17 b'http://127.0.0.1:9003/pools/default with status False: unknown pool'ok
Sep 14 02:56:17 test_employee_dataset_startkey_endkey_queries_rebalance_in (view.viewquerytests.ViewQueryTests) ... ok
Sep 14 02:57:06 test_simple_dataset_stale_queries_data_modification (view.viewquerytests.ViewQueryTests) ... ok
Sep 14 03:01:20 load_with_ops (xdcr.uniXDCR.unidirectional) ... ok
Sep 14 03:03:32 load_with_failover (xdcr.uniXDCR.unidirectional) ...
Sep 14 03:03:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 14 03:03:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 14 03:03:32 b'failures so far...'
Sep 14 03:03:32 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 14 03:03:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,num_nodes_to_add=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,docs-per-day=1,timeout=1200,get-logs-cluster-run=True'
Sep 14 03:03:32 b"{'num_nodes_to_add': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'docs-per-day': '1', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 5, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-14_02-30-15/test_5'}"
Sep 14 03:03:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 14 03:03:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 14 03:03:32 b'failures so far...'
Sep 14 03:03:32 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 14 03:03:32 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0'
Sep 14 03:03:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'
Sep 14 03:03:32 b"{'num-docs': '1000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 6, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-14_02-30-15/test_6'}"
Sep 14 03:03:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 14 03:03:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 14 03:03:32 b'failures so far...'
Sep 14 03:03:32 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 14 03:03:32 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 14 03:03:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_ops,replicas=1,items=10000,value_size=128,ctopology=chain,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,rdirection=unidirection,doc-ops=update-delete,get-logs-cluster-run=True'
Sep 14 03:03:32 b"{'replicas': '1', 'items': '10000', 'value_size': '128', 'ctopology': 'chain', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 7, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-14_02-30-15/test_7'}"
Sep 14 03:03:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 14 03:03:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 14 03:03:32 b'failures so far...'
Sep 14 03:03:32 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 14 03:03:32 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 14 03:03:32 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0'
Sep 14 03:03:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Sep 14 03:03:32 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-14_02-30-15/test_8'}"
Sep 14 03:05:37 b'http://127.0.0.1:9001/pools/default with status False: unknown pool'ok
Sep 14 03:08:28 suite_tearDown (xdcr.uniXDCR.unidirectional) ... ok
Sep 14 03:08:30 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 14 03:08:30 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 14 03:08:30 b'failures so far...'
Sep 14 03:08:30 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 14 03:08:30 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 14 03:08:30 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0'
Sep 14 03:08:30 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Sep 14 03:08:30 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Sep 14 03:08:30 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Sep 14 03:08:30 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' fail ')"
Sep 14 03:08:30 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' pass')"
Sep 14 03:08:30 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' pass')"
Sep 14 03:08:30 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' pass')"
Sep 14 03:08:30 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' pass')"
Sep 14 03:08:30 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' pass')"
Sep 14 03:08:30 Makefile:30: recipe for target 'simple-test' failed
Unit tests
=== RUN TestMerger
--- PASS: TestMerger (0.01s)
=== RUN TestInsert
--- PASS: TestInsert (0.00s)
=== RUN TestInsertPerf
16000000 items took 29.615850875s -> 540251.2346355134 items/s conflicts 51
--- PASS: TestInsertPerf (29.62s)
=== RUN TestGetPerf
16000000 items took 5.473634333s -> 2.923103559099223e+06 items/s
--- PASS: TestGetPerf (6.07s)
=== RUN TestGetRangeSplitItems
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3335,
"memory_used": 37335632,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749842,
"level1": 187736,
"level2": 46865,
"level3": 11594,
"level4": 2947,
"level5": 751,
"level6": 193,
"level7": 51,
"level8": 19,
"level9": 1,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Split range keys [152931 285781 511972 623847 693868 756624 964126]
No of items in each range [152931 132850 226191 111875 70021 62756 207502 35874]
--- PASS: TestGetRangeSplitItems (0.60s)
=== RUN TestBuilder
{
"node_count": 50000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3334,
"memory_used": 1866741856,
"node_allocs": 50000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 37498522,
"level1": 9374747,
"level2": 2344660,
"level3": 586506,
"level4": 146651,
"level5": 36402,
"level6": 9444,
"level7": 2313,
"level8": 549,
"level9": 161,
"level10": 29,
"level11": 12,
"level12": 3,
"level13": 1,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 7.682591137s to build 50000000 items, 6.508221e+06 items/sec
Took 401.641179ms to iterate 50000000 items
--- PASS: TestBuilder (8.08s)
=== RUN TestNodeDCAS
--- PASS: TestNodeDCAS (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/memdb/skiplist 44.624s
=== RUN TestInsert
Set IO Concurrency: 716
--- PASS: TestInsert (0.01s)
=== RUN TestInsertPerf
20000000 items took 51.746128931s -> 386502.34158904257 items/s snapshots_created 210 live_snapshots 1
--- PASS: TestInsertPerf (64.94s)
=== RUN TestInsertDuplicates
--- PASS: TestInsertDuplicates (0.36s)
=== RUN TestGetPerf
16000000 items took 11.676809838s -> 1.3702372670257061e+06 items/s
--- PASS: TestGetPerf (12.92s)
=== RUN TestLoadStoreDisk
Inserting 1000000 items took 1.58126379s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 14,
"next_pointers_per_node": 1.3337,
"memory_used": 57339648,
"node_allocs": 1002245,
"node_frees": 0,
"level_node_distribution":{
"level0": 749592,
"level1": 187959,
"level2": 46785,
"level3": 11756,
"level4": 2948,
"level5": 711,
"level6": 186,
"level7": 43,
"level8": 13,
"level9": 7,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
2023-09-14T03:10:56.178+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[4845 102144 38942 79278 55377 34860 63258 49989 18012 74513 60604 41802 27767 24516 48802 275291]] total count [1000000] snap count [1000009] size per shard [[38760 817152 311536 634224 443016 278880 506064 399912 144096 596104 484832 334416 222136 196128 390416 2202328]] total size [8000000] memoryInUse [57339648]
Storing to disk took 342.966757ms
Loading from disk took 772.390398ms
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3339,
"memory_used": 57342592,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749640,
"level1": 187709,
"level2": 46903,
"level3": 11844,
"level4": 2969,
"level5": 692,
"level6": 192,
"level7": 36,
"level8": 11,
"level9": 3,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestLoadStoreDisk (4.06s)
=== RUN TestConcurrentLoadCloseFragmentation
Done Inserting 2000000 items
frag = NaN%
2023-09-14T03:11:02.715+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[44557 64376 54009 93823 18273 18374 49604 119004 107759 138401 91619 91317 44515 200088 178361 685920]] total count [2000000] snap count [2000000] size per shard [[356456 515008 432072 750584 146184 146992 396832 952032 862072 1107208 732952 730536 356120 1600704 1426888 5487360]] total size [16000000] memoryInUse [114651120]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentation (6.09s)
=== RUN TestConcurrentLoadCloseFragmentationSmall
Done Inserting 10 items
frag = NaN%
2023-09-14T03:11:04.288+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationSmall (0.55s)
=== RUN TestConcurrentLoadCloseFragmentationEmpty
Done Inserting 0 items
frag = NaN%
2023-09-14T03:11:04.838+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationEmpty (0.26s)
=== RUN TestConcurrentCloseSingleNode
A
--- PASS: TestConcurrentCloseSingleNode (0.01s)
=== RUN TestStoreDiskShutdown
Inserting 1000000 items took 1.394210721s
{
"node_count": 999999,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 13,
"next_pointers_per_node": 1.3322,
"memory_used": 57314480,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 750102,
"level1": 187911,
"level2": 46696,
"level3": 11536,
"level4": 2827,
"level5": 697,
"level6": 173,
"level7": 46,
"level8": 9,
"level9": 2,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
Prepare returns error: MemDB instance has been shutdown
--- PASS: TestStoreDiskShutdown (2.16s)
=== RUN TestDelete
{
"node_count": 10,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.1000,
"memory_used": 556,
"node_allocs": 10,
"node_frees": 0,
"level_node_distribution":{
"level0": 9,
"level1": 1,
"level2": 0,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
{
"node_count": 10,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.5000,
"memory_used": 620,
"node_allocs": 20,
"node_frees": 10,
"level_node_distribution":{
"level0": 6,
"level1": 3,
"level2": 1,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestDelete (1.39s)
=== RUN TestGCPerf
final_node_count = 16000, average_live_node_count = 67901, wait_time_for_collection = 20ms
--- PASS: TestGCPerf (34.68s)
=== RUN TestMemoryInUse
ItemsCount: 5000, MemoryInUse: 295392, NodesCount: 5000
ItemsCount: 0, MemoryInUse: 80, NodesCount: 0
--- PASS: TestMemoryInUse (1.01s)
=== RUN TestFullScan
Inserting 1600000 items took 2.426814776s
{
"node_count": 1600018,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 12,
"next_pointers_per_node": 1.3333,
"memory_used": 91737936,
"node_allocs": 1600000,
"node_frees": 0,
"level_node_distribution":{
"level0": 1200102,
"level1": 299863,
"level2": 75016,
"level3": 18824,
"level4": 4649,
"level5": 1168,
"level6": 295,
"level7": 77,
"level8": 19,
"level9": 3,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Full iteration of 1600000 items took 250.592869ms
--- PASS: TestFullScan (4.13s)
=== RUN TestVisitor
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3327,
"memory_used": 57323632,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749955,
"level1": 187943,
"level2": 46662,
"level3": 11610,
"level4": 2830,
"level5": 761,
"level6": 185,
"level7": 42,
"level8": 8,
"level9": 3,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 42.202836ms to iterate 1000000 items, 2.369509e+07 items/s
shard - 0 count = 22810, range: 0-22809
shard - 1 count = 10218, range: 22810-33027
shard - 2 count = 30530, range: 33028-63557
shard - 3 count = 29868, range: 63558-93425
shard - 4 count = 177009, range: 93426-270434
shard - 5 count = 1313, range: 270435-271747
shard - 6 count = 29497, range: 271748-301244
shard - 7 count = 28908, range: 301245-330152
shard - 8 count = 5089, range: 330153-335241
shard - 9 count = 4509, range: 335242-339750
shard - 10 count = 29682, range: 339751-369432
shard - 11 count = 41210, range: 369433-410642
shard - 12 count = 28282, range: 410643-438924
shard - 13 count = 10411, range: 438925-449335
shard - 14 count = 88840, range: 449336-538175
shard - 15 count = 60849, range: 538176-599024
shard - 16 count = 32970, range: 599025-631994
shard - 17 count = 27037, range: 631995-659031
shard - 18 count = 14976, range: 659032-674007
shard - 19 count = 35868, range: 674008-709875
shard - 20 count = 8083, range: 709876-717958
shard - 21 count = 59458, range: 717959-777416
shard - 22 count = 22071, range: 777417-799487
shard - 23 count = 21546, range: 799488-821033
shard - 24 count = 65817, range: 821034-886850
shard - 25 count = 28602, range: 886851-915452
shard - 26 count = 70231, range: 915453-985683
shard - 27 count = 14316, range: 985684-999999
shard - 28 count = 0, range: 0-0
shard - 29 count = 0, range: 0-0
shard - 30 count = 0, range: 0-0
shard - 31 count = 0, range: 0-0
--- PASS: TestVisitor (1.47s)
=== RUN TestVisitorError
--- PASS: TestVisitorError (0.13s)
=== RUN TestLoadDeltaStoreDisk
snap count = 1000000
2023-09-14T03:11:54.197+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 57799 258271 70044 36921 82367 425482 64392]] total count [995276] snap count [1000000] size per shard [[0 0 0 0 0 0 0 0 0 462392 2066168 560352 295368 658936 3403856 515136]] total size [7962208] memoryInUse [126294336]
Storing to disk took 14.772061251s
Loading from disk took 1.400916018s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3330,
"memory_used": 57327520,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 750397,
"level1": 187029,
"level2": 46954,
"level3": 11703,
"level4": 2958,
"level5": 733,
"level6": 174,
"level7": 38,
"level8": 9,
"level9": 5,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Restored 4724
RestoredFailed 423675
--- PASS: TestLoadDeltaStoreDisk (18.11s)
=== RUN TestExecuteConcurrGCWorkers
--- PASS: TestExecuteConcurrGCWorkers (0.67s)
=== RUN TestCloseWithActiveIterators
--- PASS: TestCloseWithActiveIterators (36.33s)
=== RUN TestDiskCorruption
Inserting 100000 items took 105.571093ms
{
"node_count": 100000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 4,
"next_pointers_per_node": 1.3356,
"memory_used": 5736944,
"node_allocs": 100000,
"node_frees": 0,
"level_node_distribution":{
"level0": 74887,
"level1": 18761,
"level2": 4759,
"level3": 1217,
"level4": 275,
"level5": 81,
"level6": 17,
"level7": 2,
"level8": 1,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
2023-09-14T03:12:45.332+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[3452 10888 7471 12128 4272 4749 11125 11487 9133 12085 13210 0 0 0 0 0]] total count [100000] snap count [100000] size per shard [[27616 87104 59768 97024 34176 37992 89000 91896 73064 96680 105680 0 0 0 0 0]] total size [800000] memoryInUse [5736944]
Storing to disk took 77.380447ms
Loading from disk took 71.017671ms
--- PASS: TestDiskCorruption (0.32s)
=== RUN TestSnapshotStats
--- PASS: TestSnapshotStats (0.00s)
=== RUN TestInsertDeleteConcurrent
total items in snapshot: 8435570 items deleted: 1564430
{
"node_count": 8435570,
"soft_deletes": 0,
"read_conflicts": 11509,
"insert_conflicts": 127,
"next_pointers_per_node": 1.3334,
"memory_used": 483650312,
"node_allocs": 10000000,
"node_frees": 10000002,
"level_node_distribution":{
"level0": 6327053,
"level1": 1580636,
"level2": 395714,
"level3": 99265,
"level4": 24579,
"level5": 6276,
"level6": 1517,
"level7": 395,
"level8": 106,
"level9": 21,
"level10": 5,
"level11": 3,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
allocs: 20000002 frees: 20000002
--- PASS: TestInsertDeleteConcurrent (16.47s)
=== RUN TestNodeList
--- PASS: TestNodeList (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/memdb 206.360s
=== RUN TestInteger
--- PASS: TestInteger (0.00s)
=== RUN TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN TestFloat
--- PASS: TestFloat (0.00s)
=== RUN TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN TestReference
--- PASS: TestReference (0.00s)
=== RUN TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618]
PASS
TESTING [0]
PASS
TESTING [0.0]
PASS
TESTING [0.0000]
PASS
TESTING [0.0000000]
PASS
TESTING [-0]
PASS
TESTING [-0.0]
PASS
TESTING [-0.0000]
PASS
TESTING [-0.0000000]
PASS
TESTING [1]
PASS
TESTING [20]
PASS
TESTING [3456]
PASS
TESTING [7645000]
PASS
TESTING [9223372036854775807]
PASS
TESTING [9223372036854775806]
PASS
TESTING [9223372036854775808]
PASS
TESTING [92233720368547758071234000]
PASS
TESTING [92233720368547758071234987437653]
PASS
TESTING [12300000000000000000000000000000056]
PASS
TESTING [12300000000000000000000000000000000]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [210690]
PASS
TESTING [90000]
PASS
TESTING [123000000]
PASS
TESTING [3.60e2]
PASS
TESTING [36e2]
PASS
TESTING [1.9999999999e10]
PASS
TESTING [1.99999e10]
PASS
TESTING [1.99999e5]
PASS
TESTING [0.00000000000012e15]
PASS
TESTING [7.64507352e8]
PASS
TESTING [9.2233720368547758071234987437653e31]
PASS
TESTING [2650e-1]
PASS
TESTING [26500e-1]
PASS
TESTING [-1]
PASS
TESTING [-20]
PASS
TESTING [-3456]
PASS
TESTING [-7645000]
PASS
TESTING [-9223372036854775808]
PASS
TESTING [-9223372036854775807]
PASS
TESTING [-9223372036854775806]
PASS
TESTING [-9223372036854775809]
PASS
TESTING [-92233720368547758071234000]
PASS
TESTING [-92233720368547758071234987437653]
PASS
TESTING [-12300000000000000000000000000000056]
PASS
TESTING [-12300000000000000000000000000000000]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [-210690]
PASS
TESTING [-90000]
PASS
TESTING [-123000000]
PASS
TESTING [-3.60e2]
PASS
TESTING [-36e2]
PASS
TESTING [-1.9999999999e10]
PASS
TESTING [-1.99999e10]
PASS
TESTING [-1.99999e5]
PASS
TESTING [-0.00000000000012e15]
PASS
TESTING [-2650e-1]
PASS
TESTING [-26500e-1]
PASS
TESTING [0.03]
PASS
TESTING [198.60]
PASS
TESTING [2000045.178]
PASS
TESTING [1.7976931348623157e+308]
PASS
TESTING [0.000000000000000000890]
PASS
TESTING [257953786.9864236576]
PASS
TESTING [257953786.9864236576e8]
PASS
TESTING [36.912e3]
PASS
TESTING [2761.67e0]
PASS
TESTING [2761.67e00]
PASS
TESTING [2761.67e000]
PASS
TESTING [7676546.67e-3]
PASS
TESTING [-0.03]
PASS
TESTING [-198.60]
PASS
TESTING [-2000045.178]
PASS
TESTING [-1.7976931348623157e+308]
PASS
TESTING [-0.000000000000000000890]
PASS
TESTING [-257953786.9864236576]
PASS
TESTING [-257953786.9864236576e8]
PASS
TESTING [-36.912e3]
PASS
TESTING [-2761.67e0]
PASS
TESTING [-2761.67e00]
PASS
TESTING [-2761.67e000]
PASS
TESTING [-7676546.67e-3]
PASS
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/collatejson 0.036s
=== RUN TestForestDBIterator
2023-09-14T03:13:30.988+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 5981 us
2023-09-14T03:13:30.989+05:30 [INFO][FDB] Forestdb opened database file test
2023-09-14T03:13:30.993+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.01s)
=== RUN TestForestDBIteratorSeek
2023-09-14T03:13:30.993+05:30 [INFO][FDB] Forestdb opened database file test
2023-09-14T03:13:30.996+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.00s)
=== RUN TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN TestMemDBInsertionPerf
Maximum number of file descriptors = 200000
Set IO Concurrency: 7200
2023-09-14T03:13:31.980+05:30 DEBU REGU.impl.init.0.func1() at aggrecorder.go:57 [id 40] will report aggregate recorder stats every 5m0s
Initial build: 10000000 items took 1m5.924311264s -> 151689.1084376153 items/s
Incr build: 10000000 items took 2m45.106238356s -> 60567.06336218578 items/s
Main Index: {
"node_count": 18000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 2,
"next_pointers_per_node": 1.3335,
"memory_used": 1695963900,
"node_allocs": 18000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 13499572,
"level1": 3373636,
"level2": 844484,
"level3": 211556,
"level4": 53056,
"level5": 13319,
"level6": 3295,
"level7": 803,
"level8": 204,
"level9": 52,
"level10": 17,
"level11": 4,
"level12": 2,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (231.03s)
=== RUN TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN TestDequeueA
--- PASS: TestDequeueA (1.21s)
=== RUN TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.01s)
=== RUN TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.01s)
PASS
ok github.com/couchbase/indexing/secondary/indexer 255.089s
=== RUN TestConnPoolBasicSanity
2023-09-14T03:17:50.940+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-14T03:17:50.940+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-14T03:17:51.169+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:17:51.169+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:17:51.940+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN TestCloseActiveConnectionsUnsetFlag
2023-09-14T03:17:55.943+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-14T03:17:55.943+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-14T03:17:56.158+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:17:56.158+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:17:56.943+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestCloseActiveConnectionsUnsetFlag (9.22s)
=== RUN TestCloseActiveConnectionsSetFlag
2023-09-14T03:18:05.163+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-14T03:18:05.163+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-14T03:18:05.383+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:18:05.383+05:30 [Info] Closing active connection from 127.0.0.1:34840 to 127.0.0.1:15151
2023-09-14T03:18:05.384+05:30 [Info] Closing active connection from 127.0.0.1:34842 to 127.0.0.1:15151
2023-09-14T03:18:05.384+05:30 [Info] Closing active connection from 127.0.0.1:34844 to 127.0.0.1:15151
2023-09-14T03:18:05.384+05:30 [Info] Closing active connection from 127.0.0.1:34846 to 127.0.0.1:15151
2023-09-14T03:18:05.384+05:30 [Info] Closing active connection from 127.0.0.1:34848 to 127.0.0.1:15151
2023-09-14T03:18:05.384+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:18:06.164+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestCloseActiveConnectionsSetFlag (4.22s)
=== RUN TestMaintainActiveConnections
2023-09-14T03:18:09.386+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-14T03:18:09.386+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-14T03:18:09.761+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:18:09.761+05:30 [Info] Closing active connection from 127.0.0.1:34862 to 127.0.0.1:15151
2023-09-14T03:18:09.761+05:30 [Info] Closing active connection from 127.0.0.1:34864 to 127.0.0.1:15151
2023-09-14T03:18:09.761+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:18:10.386+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestMaintainActiveConnections (4.38s)
=== RUN TestConnectionPoolRenew
2023-09-14T03:18:13.763+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-14T03:18:13.763+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-14T03:18:13.984+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:34874"
2023-09-14T03:18:13.985+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:34866"
2023-09-14T03:18:13.986+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:34868"
2023-09-14T03:18:13.986+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:34870"
2023-09-14T03:18:13.987+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:34872"
2023-09-14T03:18:13.997+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:18:13.997+05:30 [Info] Closing active connection from 127.0.0.1:34878 to 127.0.0.1:15151
2023-09-14T03:18:13.997+05:30 [Info] Closing active connection from 127.0.0.1:34880 to 127.0.0.1:15151
2023-09-14T03:18:13.997+05:30 [Info] Closing active connection from 127.0.0.1:34876 to 127.0.0.1:15151
2023-09-14T03:18:13.997+05:30 [Info] Closing active connection from 127.0.0.1:34882 to 127.0.0.1:15151
2023-09-14T03:18:13.998+05:30 [Info] Closing active connection from 127.0.0.1:34884 to 127.0.0.1:15151
2023-09-14T03:18:13.998+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:18:14.763+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
2023-09-14T03:18:15.999+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:34880"
2023-09-14T03:18:15.999+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing connection "127.0.0.1:34886" -> "127.0.0.1:15151" as the pool is closed
--- PASS: TestConnectionPoolRenew (4.24s)
=== RUN TestConnRelease
2023-09-14T03:18:18.000+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-14T03:18:18.001+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2023-09-14T03:18:57.817+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:18:57.817+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:18:58.020+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.82s)
=== RUN TestLongevity
2023-09-14T03:19:01.820+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-14T03:19:01.820+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Releasing 2 conns.
Getting 4 conns.
Releasing 4 conns.
Getting 2 conns.
Releasing 3 conns.
Getting 2 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 1 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 0 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 2 conns.
Releasing 4 conns.
Getting 4 conns.
Releasing 3 conns.
Getting 1 conns.
Releasing 1 conns.
Getting 2 conns.
Releasing 4 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 2 conns.
2023-09-14T03:19:40.184+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:19:40.184+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:19:40.836+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.37s)
=== RUN TestSustainedHighConns
2023-09-14T03:19:44.186+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-14T03:19:44.186+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Allocating 18 Connections
Returning 4 Connections
cp.curActConns = 0
cp.curActConns = 11
Returning 2 Connections
cp.curActConns = 12
Allocating 11 Connections
Returning 2 Connections
cp.curActConns = 21
Returning 1 Connections
Allocating 11 Connections
cp.curActConns = 22
Returning 1 Connections
cp.curActConns = 30
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 33
Returning 4 Connections
Allocating 13 Connections
cp.curActConns = 34
Returning 2 Connections
cp.curActConns = 40
Returning 1 Connections
Allocating 8 Connections
cp.curActConns = 46
Returning 1 Connections
cp.curActConns = 46
Allocating 16 Connections
Returning 4 Connections
cp.curActConns = 57
Returning 1 Connections
Allocating 20 Connections
cp.curActConns = 58
Returning 1 Connections
cp.curActConns = 69
Returning 0 Connections
cp.curActConns = 76
Returning 1 Connections
Allocating 17 Connections
cp.curActConns = 81
Returning 1 Connections
cp.curActConns = 91
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 91
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 91
Returning 3 Connections
Allocating 10 Connections
cp.curActConns = 92
Returning 2 Connections
cp.curActConns = 96
Returning 1 Connections
Allocating 8 Connections
cp.curActConns = 103
Returning 4 Connections
Allocating 8 Connections
cp.curActConns = 103
Returning 0 Connections
cp.curActConns = 107
Returning 4 Connections
Allocating 19 Connections
cp.curActConns = 115
Returning 1 Connections
cp.curActConns = 121
Returning 2 Connections
Allocating 7 Connections
cp.curActConns = 126
Returning 2 Connections
Allocating 12 Connections
cp.curActConns = 126
Returning 4 Connections
cp.curActConns = 132
Returning 1 Connections
Allocating 10 Connections
cp.curActConns = 137
Returning 4 Connections
cp.curActConns = 137
Returning 2 Connections
Allocating 18 Connections
cp.curActConns = 148
Returning 1 Connections
cp.curActConns = 152
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 150
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 149
Returning 0 Connections
Allocating 11 Connections
cp.curActConns = 159
Returning 2 Connections
cp.curActConns = 158
Allocating 7 Connections
Returning 3 Connections
cp.curActConns = 162
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 161
Returning 4 Connections
Allocating 20 Connections
cp.curActConns = 170
Returning 3 Connections
cp.curActConns = 174
Returning 2 Connections
Allocating 18 Connections
cp.curActConns = 181
Returning 1 Connections
cp.curActConns = 189
Returning 1 Connections
Allocating 5 Connections
cp.curActConns = 192
Returning 0 Connections
cp.curActConns = 193
Allocating 10 Connections
Returning 2 Connections
cp.curActConns = 201
Returning 4 Connections
Allocating 24 Connections
cp.curActConns = 203
Returning 2 Connections
cp.curActConns = 214
Returning 4 Connections
cp.curActConns = 215
Allocating 2 Connections
Returning 4 Connections
cp.curActConns = 213
Allocating 0 Connections
Returning 0 Connections
cp.curActConns = 213
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 211
Allocating 1 Connections
Returning 3 Connections
cp.curActConns = 209
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 209
Allocating 3 Connections
Returning 2 Connections
cp.curActConns = 210
Allocating 2 Connections
Returning 0 Connections
cp.curActConns = 212
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 211
Allocating 2 Connections
Returning 2 Connections
cp.curActConns = 211
Returning 4 Connections
Allocating 0 Connections
cp.curActConns = 207
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 206
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 207
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 205
Allocating 3 Connections
Returning 2 Connections
cp.curActConns = 206
Allocating 4 Connections
Returning 3 Connections
cp.curActConns = 207
Allocating 1 Connections
Returning 3 Connections
cp.curActConns = 205
Allocating 0 Connections
Returning 3 Connections
cp.curActConns = 202
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 202
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 202
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 203
Allocating 1 Connections
Returning 1 Connections
cp.curActConns = 203
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 203
Allocating 4 Connections
Returning 1 Connections
cp.curActConns = 206
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 203
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 205
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 203
Returning 4 Connections
Allocating 7 Connections
cp.curActConns = 206
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 206
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 205
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 205
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 203
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 204
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 202
Returning 4 Connections
Allocating 12 Connections
cp.curActConns = 210
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 207
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 204
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 201
Returning 4 Connections
Allocating 6 Connections
cp.curActConns = 203
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 206
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 210
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 211
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 215
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 214
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 215
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 215
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 215
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 214
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 213
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 212
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 214
Retuning from startDeallocatorRoutine
Retuning from startAllocatorRoutine
2023-09-14T03:20:39.255+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:20:39.255+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:20:40.220+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.07s)
=== RUN TestLowWM
2023-09-14T03:20:43.256+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2023-09-14T03:20:43.256+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-14T03:21:43.275+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-09-14T03:22:43.293+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-09-14T03:22:48.776+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:22:48.776+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:22:49.295+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.52s)
=== RUN TestTotalConns
2023-09-14T03:22:52.777+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2023-09-14T03:22:52.778+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-14T03:23:07.014+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:23:07.014+05:30 [Info] Closing active connection from 127.0.0.1:36286 to 127.0.0.1:15151
2023-09-14T03:23:07.014+05:30 [Info] Closing active connection from 127.0.0.1:36432 to 127.0.0.1:15151
2023-09-14T03:23:07.014+05:30 [Info] Closing active connection from 127.0.0.1:36306 to 127.0.0.1:15151
2023-09-14T03:23:07.014+05:30 [Info] Closing active connection from 127.0.0.1:36312 to 127.0.0.1:15151
2023-09-14T03:23:07.014+05:30 [Info] Closing active connection from 127.0.0.1:36382 to 127.0.0.1:15151
2023-09-14T03:23:07.014+05:30 [Info] Closing active connection from 127.0.0.1:36300 to 127.0.0.1:15151
2023-09-14T03:23:07.014+05:30 [Info] Closing active connection from 127.0.0.1:36420 to 127.0.0.1:15151
2023-09-14T03:23:07.014+05:30 [Info] Closing active connection from 127.0.0.1:36428 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36364 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36426 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36350 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36380 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36414 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36258 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36280 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36418 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36254 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36392 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36406 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36284 to 127.0.0.1:15151
2023-09-14T03:23:07.015+05:30 [Info] Closing active connection from 127.0.0.1:36328 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36386 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36396 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36370 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36376 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36388 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36408 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36332 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36356 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36358 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36296 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36422 to 127.0.0.1:15151
2023-09-14T03:23:07.016+05:30 [Info] Closing active connection from 127.0.0.1:36266 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36430 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36256 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36290 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36334 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36360 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36336 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36394 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36342 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36372 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36444 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36260 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36310 to 127.0.0.1:15151
2023-09-14T03:23:07.017+05:30 [Info] Closing active connection from 127.0.0.1:36272 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36354 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36438 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36366 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36400 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36294 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36362 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36270 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36282 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36352 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36368 to 127.0.0.1:15151
2023-09-14T03:23:07.018+05:30 [Info] Closing active connection from 127.0.0.1:36416 to 127.0.0.1:15151
2023-09-14T03:23:07.019+05:30 [Info] Closing active connection from 127.0.0.1:36278 to 127.0.0.1:15151
2023-09-14T03:23:07.019+05:30 [Info] Closing active connection from 127.0.0.1:36314 to 127.0.0.1:15151
2023-09-14T03:23:07.019+05:30 [Info] Closing active connection from 127.0.0.1:36398 to 127.0.0.1:15151
2023-09-14T03:23:07.019+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:23:07.786+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.24s)
=== RUN TestUpdateTickRate
2023-09-14T03:23:11.021+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2023-09-14T03:23:11.021+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-14T03:23:31.880+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-14T03:23:31.880+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-14T03:23:32.037+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.86s)
PASS
ok github.com/couchbase/indexing/secondary/queryport/client 344.995s
Starting server: attempt 1
Functional tests
2023/09/14 03:26:02 In TestMain()
2023/09/14 03:26:02 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2023/09/14 03:26:02 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2023/09/14 03:26:03 Initialising web UI on node: 127.0.0.1:9000
2023/09/14 03:26:03 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2023/09/14 03:26:04 Setting data quota of 1500M and Index quota of 1500M
2023/09/14 03:26:05 Adding node: https://127.0.0.1:19001 with role: kv,index to the cluster
2023/09/14 03:26:22 AddNode: Successfully added node: 127.0.0.1:9001 (role kv,index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/14 03:26:27 Rebalance progress: 0
2023/09/14 03:26:32 Rebalance progress: 0
2023/09/14 03:26:37 Rebalance progress: 75
2023/09/14 03:26:42 Rebalance progress: 100
2023/09/14 03:26:47 Created bucket default, responseBody:
2023/09/14 03:26:52 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 03:26:52 Successfully initialised cluster
2023/09/14 03:26:52 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 03:26:52 Changing config key queryport.client.settings.backfillLimit to value 0
2023/09/14 03:26:52 Changing config key queryport.client.log_level to value Warn
2023/09/14 03:26:53 Changing config key indexer.api.enableTestServer to value true
2023/09/14 03:26:53 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2023/09/14 03:26:53 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2023/09/14 03:26:53 Changing config key indexer.settings.log_level to value info
2023/09/14 03:26:53 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2023/09/14 03:26:53 Using memory_optimized for creating indexes
2023/09/14 03:26:53 Changing config key indexer.settings.storage_mode to value memory_optimized
2023/09/14 03:26:58 Data file exists. Skipping download
2023/09/14 03:26:58 Data file exists. Skipping download
2023/09/14 03:27:00 In DropAllSecondaryIndexes()
2023/09/14 03:27:00 Emptying the default bucket
2023/09/14 03:27:03 Flush Enabled on bucket default, responseBody:
2023/09/14 03:27:41 Flushed the bucket default, Response body:
2023/09/14 03:27:41 Create Index On the empty default Bucket()
2023/09/14 03:27:44 Created the secondary index index_eyeColor. Waiting for it become active
2023/09/14 03:27:44 Index is 13079784934405811430 now active
2023/09/14 03:27:44 Populating the default bucket
=== RUN TestScanAfterBucketPopulate
2023/09/14 03:27:54 In TestScanAfterBucketPopulate()
2023/09/14 03:27:54 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/09/14 03:27:54 Using n1ql client
2023-09-14T03:27:54.032+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2023/09/14 03:27:54 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.11s)
=== RUN TestRestartNilSnapshot
2023/09/14 03:27:54 In TestRestartNilSnapshot()
2023/09/14 03:27:58 Created the secondary index idx_age. Waiting for it become active
2023/09/14 03:27:58 Index is 6339094135256639246 now active
2023/09/14 03:27:58 Restarting indexer process ...
2023/09/14 03:27:58 []
2023-09-14T03:27:58.466+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-14T03:27:58.469+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/14 03:31:18 Using n1ql client
2023-09-14T03:31:18.444+05:30 [Error] transport error between 127.0.0.1:59310->127.0.0.1:9107: write tcp 127.0.0.1:59310->127.0.0.1:9107: write: broken pipe
2023-09-14T03:31:18.444+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -7751506020957258921 request transport failed `write tcp 127.0.0.1:59310->127.0.0.1:9107: write: broken pipe`
2023-09-14T03:31:18.445+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-14T03:31:18.445+05:30 [Error] metadataClient:PickRandom: Replicas - [10835964000246136346], PrunedReplica - map[], FilteredReplica map[]
2023/09/14 03:31:18 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.36s)
=== RUN TestThreeIndexCreates
2023/09/14 03:31:18 In TestThreeIndexCreates()
2023/09/14 03:31:22 Created the secondary index index_balance. Waiting for it become active
2023/09/14 03:31:22 Index is 5048586801454454872 now active
2023/09/14 03:31:22 Create docs mutations
2023/09/14 03:31:23 Using n1ql client
2023/09/14 03:31:23 Expected and Actual scan responses are the same
2023/09/14 03:31:29 Created the secondary index index_email. Waiting for it become active
2023/09/14 03:31:29 Index is 16908681763840415627 now active
2023/09/14 03:31:29 Create docs mutations
2023/09/14 03:31:29 Using n1ql client
2023/09/14 03:31:29 Expected and Actual scan responses are the same
2023/09/14 03:31:35 Created the secondary index index_pin. Waiting for it become active
2023/09/14 03:31:35 Index is 11721145622397274975 now active
2023/09/14 03:31:35 Delete docs mutations
2023/09/14 03:31:36 Using n1ql client
2023/09/14 03:31:36 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (17.62s)
=== RUN TestMultipleIndexCreatesDropsWithMutations
2023/09/14 03:31:36 In TestThreeIndexCreates()
2023/09/14 03:31:42 Created the secondary index index_state. Waiting for it become active
2023/09/14 03:31:42 Index is 13360881248307520846 now active
2023/09/14 03:31:42 Create docs mutations
2023/09/14 03:31:42 Using n1ql client
2023/09/14 03:31:42 Expected and Actual scan responses are the same
2023/09/14 03:31:48 Created the secondary index index_registered. Waiting for it become active
2023/09/14 03:31:48 Index is 1521828995723641939 now active
2023/09/14 03:31:48 Create docs mutations
2023/09/14 03:31:49 Using n1ql client
2023/09/14 03:31:49 Expected and Actual scan responses are the same
2023/09/14 03:31:55 Created the secondary index index_gender. Waiting for it become active
2023/09/14 03:31:55 Index is 15387475302757383923 now active
2023/09/14 03:31:55 Create docs mutations
2023/09/14 03:31:55 Using n1ql client
2023/09/14 03:31:55 Expected and Actual scan responses are the same
2023/09/14 03:31:55 Dropping the secondary index index_registered
2023/09/14 03:31:55 Index dropped
2023/09/14 03:31:55 Create docs mutations
2023/09/14 03:31:56 Delete docs mutations
2023/09/14 03:31:56 Using n1ql client
2023/09/14 03:31:56 Expected and Actual scan responses are the same
2023/09/14 03:32:02 Created the secondary index index_longitude. Waiting for it become active
2023/09/14 03:32:02 Index is 16013378329160412464 now active
2023/09/14 03:32:02 Create docs mutations
2023/09/14 03:32:02 Using n1ql client
2023/09/14 03:32:03 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (26.91s)
=== RUN TestCreateDropScan
2023/09/14 03:32:03 In TestCreateDropScan()
2023/09/14 03:32:09 Created the secondary index index_cd. Waiting for it become active
2023/09/14 03:32:09 Index is 15442204184376891713 now active
2023/09/14 03:32:09 Using n1ql client
2023/09/14 03:32:09 Expected and Actual scan responses are the same
2023/09/14 03:32:09 Dropping the secondary index index_cd
2023/09/14 03:32:09 Index dropped
2023/09/14 03:32:09 Using n1ql client
2023/09/14 03:32:09 Scan failed as expected with error: Index Not Found - cause: GSI index index_cd not found.
--- PASS: TestCreateDropScan (6.47s)
=== RUN TestCreateDropCreate
2023/09/14 03:32:09 In TestCreateDropCreate()
2023/09/14 03:32:15 Created the secondary index index_cdc. Waiting for it become active
2023/09/14 03:32:15 Index is 18171185878862689671 now active
2023/09/14 03:32:15 Using n1ql client
2023/09/14 03:32:15 Expected and Actual scan responses are the same
2023/09/14 03:32:15 Dropping the secondary index index_cdc
2023/09/14 03:32:15 Index dropped
2023/09/14 03:32:15 Using n1ql client
2023/09/14 03:32:15 Scan 2 failed as expected with error: Index Not Found - cause: GSI index index_cdc not found.
2023/09/14 03:32:22 Created the secondary index index_cdc. Waiting for it become active
2023/09/14 03:32:22 Index is 7209768673235327433 now active
2023/09/14 03:32:22 Using n1ql client
2023/09/14 03:32:22 Expected and Actual scan responses are the same
2023/09/14 03:32:22 (Inclusion 1) Lengths of expected and actual scan results are 5057 and 5057. Num of docs in bucket = 10402
2023/09/14 03:32:22 Using n1ql client
2023/09/14 03:32:22 Expected and Actual scan responses are the same
2023/09/14 03:32:22 (Inclusion 3) Lengths of expected and actual scan results are 5057 and 5057. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (12.82s)
=== RUN TestCreate2Drop1Scan2
2023/09/14 03:32:22 In TestCreate2Drop1Scan2()
2023/09/14 03:32:28 Created the secondary index index_i1. Waiting for it become active
2023/09/14 03:32:28 Index is 16119960010066468239 now active
2023/09/14 03:32:34 Created the secondary index index_i2. Waiting for it become active
2023/09/14 03:32:34 Index is 16005657535229306204 now active
2023/09/14 03:32:35 Using n1ql client
2023/09/14 03:32:35 Expected and Actual scan responses are the same
2023/09/14 03:32:35 Using n1ql client
2023/09/14 03:32:35 Expected and Actual scan responses are the same
2023/09/14 03:32:35 Dropping the secondary index index_i1
2023/09/14 03:32:35 Index dropped
2023/09/14 03:32:35 Using n1ql client
2023/09/14 03:32:35 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (13.01s)
=== RUN TestIndexNameCaseSensitivity
2023/09/14 03:32:35 In TestIndexNameCaseSensitivity()
2023/09/14 03:32:41 Created the secondary index index_age. Waiting for it become active
2023/09/14 03:32:41 Index is 7836538272844686077 now active
2023/09/14 03:32:41 Using n1ql client
2023/09/14 03:32:41 Expected and Actual scan responses are the same
2023/09/14 03:32:41 Using n1ql client
2023/09/14 03:32:41 Scan failed as expected with error: Index Not Found - cause: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (6.26s)
=== RUN TestCreateDuplicateIndex
2023/09/14 03:32:41 In TestCreateDuplicateIndex()
2023/09/14 03:32:47 Created the secondary index index_di1. Waiting for it become active
2023/09/14 03:32:47 Index is 10454522521512773649 now active
2023/09/14 03:32:47 Index found: index_di1
2023/09/14 03:32:47 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (6.21s)
=== RUN TestDropNonExistingIndex
2023/09/14 03:32:47 In TestDropNonExistingIndex()
2023/09/14 03:32:47 Dropping the secondary index 123456
2023/09/14 03:32:47 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.03s)
=== RUN TestCreateIndexNonExistentBucket
2023/09/14 03:32:47 In TestCreateIndexNonExistentBucket()
2023-09-14T03:32:48.344+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-09-14T03:32:59.346+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023/09/14 03:32:59 Index create failed as expected with error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- PASS: TestCreateIndexNonExistentBucket (11.53s)
=== RUN TestScanWithNoTimeout
2023/09/14 03:32:59 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/09/14 03:32:59 Changing config key indexer.settings.scan_timeout to value 0
2023/09/14 03:32:59 Using n1ql client
2023/09/14 03:32:59 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.38s)
=== RUN TestIndexingOnBinaryBucketMeta
2023/09/14 03:32:59 In TestIndexingOnBinaryBucketMeta()
2023/09/14 03:32:59 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2023/09/14 03:32:59 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2023/09/14 03:33:02 Modified parameters of bucket default, responseBody:
2023/09/14 03:33:02 Created bucket binaryBucket, responseBody:
2023/09/14 03:33:21 Created the secondary index index_binary_meta_id. Waiting for it become active
2023/09/14 03:33:21 Index is 16122343863919615045 now active
2023/09/14 03:33:26 items_count stat is 10 for index index_binary_meta_id
2023/09/14 03:33:26 Dropping the secondary index index_binary_meta_id
2023/09/14 03:33:26 Index dropped
2023/09/14 03:33:29 Created the secondary index index_binary_meta_cas. Waiting for it become active
2023/09/14 03:33:29 Index is 4722709570333063953 now active
2023/09/14 03:33:34 items_count stat is 10 for index index_binary_meta_cas
2023/09/14 03:33:34 Dropping the secondary index index_binary_meta_cas
2023/09/14 03:33:34 Index dropped
2023/09/14 03:33:37 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2023/09/14 03:33:37 Index is 3330405504459736687 now active
2023/09/14 03:33:42 items_count stat is 10 for index index_binary_meta_expiration
2023/09/14 03:33:42 Dropping the secondary index index_binary_meta_expiration
2023/09/14 03:33:42 Index dropped
2023/09/14 03:33:43 Deleted bucket binaryBucket, responseBody:
2023/09/14 03:33:46 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnBinaryBucketMeta (62.16s)
=== RUN TestRetainDeleteXATTRBinaryDocs
2023/09/14 03:34:01 In TestRetainDeleteXATTRBinaryDocs()
2023/09/14 03:34:01 1. Populate a bucket with binary docs having system XATTRS
2023/09/14 03:34:01 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2023/09/14 03:34:01 3. Delete the documents in the bucket
2023/09/14 03:34:01 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2023/09/14 03:34:04 Modified parameters of bucket default, responseBody:
2023/09/14 03:34:05 Created bucket binaryBucket, responseBody:
2023/09/14 03:34:23 Created the secondary index index_system_xattr. Waiting for it become active
2023/09/14 03:34:23 Index is 6005306473989591963 now active
2023/09/14 03:34:28 Deleted all the documents in the bucket: binaryBucket successfully
2023/09/14 03:34:31 Deleted bucket binaryBucket, responseBody:
2023/09/14 03:34:34 Modified parameters of bucket default, responseBody:
--- PASS: TestRetainDeleteXATTRBinaryDocs (47.58s)
=== RUN TestIndexingOnXATTRs
2023/09/14 03:34:49 In TestIndexingOnXATTRs()
2023/09/14 03:34:52 Modified parameters of bucket default, responseBody:
2023/09/14 03:34:52 Created bucket bucket_xattrs, responseBody:
2023/09/14 03:35:11 Created the secondary index index_sync_rev. Waiting for it become active
2023/09/14 03:35:11 Index is 17282321693282130450 now active
2023/09/14 03:35:18 Created the secondary index index_sync_channels. Waiting for it become active
2023/09/14 03:35:18 Index is 285332198788765048 now active
2023/09/14 03:35:24 Created the secondary index index_sync_test. Waiting for it become active
2023/09/14 03:35:24 Index is 13390248364741127356 now active
2023/09/14 03:35:29 items_count stat is 100 for index index_sync_rev
2023/09/14 03:35:29 items_count stat is 100 for index index_sync_channels
2023/09/14 03:35:29 items_count stat is 100 for index index_sync_test
2023/09/14 03:35:29 Using n1ql client
2023-09-14T03:35:29.963+05:30 [Info] GSIC[default/bucket_xattrs-_default-_default-1694642729959072242] started ...
2023/09/14 03:35:29 Dropping the secondary index index_sync_rev
2023/09/14 03:35:30 Index dropped
2023/09/14 03:35:30 Using n1ql client
2023/09/14 03:35:30 Dropping the secondary index index_sync_channels
2023/09/14 03:35:30 Index dropped
2023/09/14 03:35:30 Using n1ql client
2023/09/14 03:35:30 Dropping the secondary index index_sync_test
2023/09/14 03:35:30 Index dropped
2023/09/14 03:35:32 Deleted bucket bucket_xattrs, responseBody:
2023/09/14 03:35:35 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnXATTRs (61.07s)
=== RUN TestSimpleIndex_FloatDataType
2023/09/14 03:35:50 In TestSimpleIndex_FloatDataType()
2023/09/14 03:35:50 Index found: index_age
2023/09/14 03:35:50 Using n1ql client
2023/09/14 03:35:50 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.02s)
=== RUN TestSimpleIndex_StringDataType
2023/09/14 03:35:50 In TestSimpleIndex_StringDataType()
2023/09/14 03:35:55 Created the secondary index index_company. Waiting for it become active
2023/09/14 03:35:55 Index is 12325109475823641763 now active
2023/09/14 03:35:55 Using n1ql client
2023/09/14 03:35:55 Expected and Actual scan responses are the same
2023/09/14 03:35:55 Using n1ql client
2023/09/14 03:35:55 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.68s)
=== RUN TestSimpleIndex_FieldValueCaseSensitivity
2023/09/14 03:35:55 In TestSimpleIndex_StringCaseSensitivity()
2023/09/14 03:35:55 Index found: index_company
2023/09/14 03:35:55 Using n1ql client
2023/09/14 03:35:55 Expected and Actual scan responses are the same
2023/09/14 03:35:55 Using n1ql client
2023/09/14 03:35:55 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.07s)
=== RUN TestSimpleIndex_BoolDataType
2023/09/14 03:35:55 In TestSimpleIndex_BoolDataType()
2023/09/14 03:36:01 Created the secondary index index_isActive. Waiting for it become active
2023/09/14 03:36:01 Index is 14540922529212186903 now active
2023/09/14 03:36:02 Using n1ql client
2023/09/14 03:36:02 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (6.75s)
=== RUN TestBasicLookup
2023/09/14 03:36:02 In TestBasicLookup()
2023/09/14 03:36:02 Index found: index_company
2023/09/14 03:36:02 Using n1ql client
2023/09/14 03:36:02 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.01s)
=== RUN TestIndexOnNonExistentField
2023/09/14 03:36:02 In TestIndexOnNonExistentField()
2023/09/14 03:36:08 Created the secondary index index_height. Waiting for it become active
2023/09/14 03:36:08 Index is 1677459385519102890 now active
2023/09/14 03:36:08 Using n1ql client
2023/09/14 03:36:08 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (6.64s)
=== RUN TestIndexPartiallyMissingField
2023/09/14 03:36:08 In TestIndexPartiallyMissingField()
2023/09/14 03:36:15 Created the secondary index index_nationality. Waiting for it become active
2023/09/14 03:36:15 Index is 3794544941078896271 now active
2023/09/14 03:36:15 Using n1ql client
2023/09/14 03:36:15 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (6.63s)
=== RUN TestScanNonMatchingDatatype
2023/09/14 03:36:15 In TestScanNonMatchingDatatype()
2023/09/14 03:36:15 Index found: index_age
2023/09/14 03:36:15 Using n1ql client
2023/09/14 03:36:15 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.01s)
=== RUN TestInclusionNeither
2023/09/14 03:36:15 In TestInclusionNeither()
2023/09/14 03:36:15 Index found: index_age
2023/09/14 03:36:15 Using n1ql client
2023/09/14 03:36:15 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.02s)
=== RUN TestInclusionLow
2023/09/14 03:36:15 In TestInclusionLow()
2023/09/14 03:36:15 Index found: index_age
2023/09/14 03:36:15 Using n1ql client
2023/09/14 03:36:15 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.03s)
=== RUN TestInclusionHigh
2023/09/14 03:36:15 In TestInclusionHigh()
2023/09/14 03:36:15 Index found: index_age
2023/09/14 03:36:15 Using n1ql client
2023/09/14 03:36:15 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.03s)
=== RUN TestInclusionBoth
2023/09/14 03:36:15 In TestInclusionBoth()
2023/09/14 03:36:15 Index found: index_age
2023/09/14 03:36:15 Using n1ql client
2023/09/14 03:36:15 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.02s)
=== RUN TestNestedIndex_String
2023/09/14 03:36:15 In TestNestedIndex_String()
2023/09/14 03:36:21 Created the secondary index index_streetname. Waiting for it become active
2023/09/14 03:36:21 Index is 5481697030669765189 now active
2023/09/14 03:36:21 Using n1ql client
2023/09/14 03:36:22 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (6.58s)
=== RUN TestNestedIndex_Float
2023/09/14 03:36:22 In TestNestedIndex_Float()
2023/09/14 03:36:28 Created the secondary index index_floor. Waiting for it become active
2023/09/14 03:36:28 Index is 709539517109909483 now active
2023/09/14 03:36:28 Using n1ql client
2023/09/14 03:36:28 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (6.65s)
=== RUN TestNestedIndex_Bool
2023/09/14 03:36:28 In TestNestedIndex_Bool()
2023/09/14 03:36:35 Created the secondary index index_isresidential. Waiting for it become active
2023/09/14 03:36:35 Index is 17416929957010278547 now active
2023/09/14 03:36:35 Using n1ql client
2023/09/14 03:36:35 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (6.65s)
=== RUN TestLookupJsonObject
2023/09/14 03:36:35 In TestLookupJsonObject()
2023/09/14 03:36:41 Created the secondary index index_streetaddress. Waiting for it become active
2023/09/14 03:36:41 Index is 12276126086805666143 now active
2023/09/14 03:36:41 Using n1ql client
2023/09/14 03:36:41 Count of docScanResults is 1
2023/09/14 03:36:41 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/14 03:36:41 Count of scanResults is 1
2023/09/14 03:36:41 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/14 03:36:41 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.61s)
=== RUN TestLookupObjDifferentOrdering
2023/09/14 03:36:41 In TestLookupObjDifferentOrdering()
2023/09/14 03:36:41 Index found: index_streetaddress
2023/09/14 03:36:41 Using n1ql client
2023/09/14 03:36:41 Count of docScanResults is 1
2023/09/14 03:36:41 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/14 03:36:41 Count of scanResults is 1
2023/09/14 03:36:41 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/14 03:36:41 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.02s)
=== RUN TestRangeJsonObject
2023/09/14 03:36:41 In TestRangeJsonObject()
2023/09/14 03:36:41 Index found: index_streetaddress
2023/09/14 03:36:41 Using n1ql client
2023/09/14 03:36:41 Count of scanResults is 2
2023/09/14 03:36:41 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2023/09/14 03:36:41 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/14 03:36:41 Count of docScanResults is 2
2023/09/14 03:36:41 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/14 03:36:41 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2023/09/14 03:36:41 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.00s)
=== RUN TestLookupFloatDiffForms
2023/09/14 03:36:41 In TestLookupFloatDiffForms()
2023/09/14 03:36:48 Created the secondary index index_latitude. Waiting for it become active
2023/09/14 03:36:48 Index is 1963183393966728640 now active
2023/09/14 03:36:48 Scan 1
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 2
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 3
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 4
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 5
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 6
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (6.84s)
=== RUN TestRangeFloatInclVariations
2023/09/14 03:36:48 In TestRangeFloatInclVariations()
2023/09/14 03:36:48 Index found: index_latitude
2023/09/14 03:36:48 Scan 1
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 2
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 3
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 4
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 5
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
2023/09/14 03:36:48 Scan 6
2023/09/14 03:36:48 Using n1ql client
2023/09/14 03:36:48 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.03s)
=== RUN TestScanAll
2023/09/14 03:36:48 In TestScanAll()
2023/09/14 03:36:55 Created the secondary index index_name. Waiting for it become active
2023/09/14 03:36:55 Index is 2622853683118714748 now active
2023/09/14 03:36:55 Length of docScanResults = 10503
2023/09/14 03:36:55 Using n1ql client
2023/09/14 03:36:55 Length of scanResults = 10503
2023/09/14 03:36:55 Expected and Actual scan responses are the same
--- PASS: TestScanAll (6.83s)
=== RUN TestScanAllNestedField
2023/09/14 03:36:55 In TestScanAllNestedField()
2023/09/14 03:36:55 Index found: index_streetname
2023/09/14 03:36:55 Length of docScanResults = 2
2023/09/14 03:36:55 Using n1ql client
2023/09/14 03:36:55 Length of scanResults = 2
2023/09/14 03:36:55 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN TestBasicPrimaryIndex
2023/09/14 03:36:55 In TestBasicPrimaryIndex()
2023/09/14 03:37:02 Created the secondary index index_p1. Waiting for it become active
2023/09/14 03:37:02 Index is 12195717257623386525 now active
2023-09-14T03:37:02.612+05:30 [Error] transport error between 127.0.0.1:59000->127.0.0.1:9107: write tcp 127.0.0.1:59000->127.0.0.1:9107: write: broken pipe
2023-09-14T03:37:02.612+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:59000->127.0.0.1:9107: write: broken pipe`
2023-09-14T03:37:02.612+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-14T03:37:02.612+05:30 [Error] metadataClient:PickRandom: Replicas - [2444812610099424191], PrunedReplica - map[], FilteredReplica map[]
2023/09/14 03:37:02 Expected and Actual scan responses are the same
2023/09/14 03:37:02 CountRange() expected and actual is: 1853 and 1853
2023/09/14 03:37:02 lookupkey for CountLookup() = User90d8c130-a8e6-4c6d-bf8b-7730d04dd618
2023/09/14 03:37:02 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (7.05s)
=== RUN TestBasicNullDataType
2023/09/14 03:37:02 In TestBasicNullDataType()
2023/09/14 03:37:02 Index found: index_email
2023/09/14 03:37:02 Using n1ql client
2023/09/14 03:37:02 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.01s)
=== RUN TestBasicArrayDataType_ScanAll
2023/09/14 03:37:02 In TestBasicArrayDataType_ScanAll()
2023/09/14 03:37:09 Created the secondary index index_tags. Waiting for it become active
2023/09/14 03:37:09 Index is 14329113490330336760 now active
2023/09/14 03:37:09 Using n1ql client
2023/09/14 03:37:09 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (6.86s)
=== RUN TestBasicArrayDataType_Lookup
2023/09/14 03:37:09 In TestBasicArrayDataType_Lookup()
2023/09/14 03:37:11 Index found: index_tags
2023/09/14 03:37:11 Count of scanResults is 1
2023/09/14 03:37:11 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75 Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN TestArrayDataType_LookupMissingArrayValue
2023/09/14 03:37:11 In TestArrayDataType_LookupMissingArrayValue()
2023/09/14 03:37:11 Index found: index_tags
2023/09/14 03:37:11 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.00s)
=== RUN TestArrayDataType_LookupWrongOrder
2023/09/14 03:37:11 In TestArrayDataType_LookupWrongOrder()
2023/09/14 03:37:11 Index found: index_tags
2023/09/14 03:37:11 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN TestArrayDataType_LookupSubset
2023/09/14 03:37:11 In TestArrayDataType_LookupSubset()
2023/09/14 03:37:11 Index found: index_tags
2023/09/14 03:37:11 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN TestScanLimitParameter
2023/09/14 03:37:11 In TestScanLimitParameter()
2023/09/14 03:37:11 Index found: index_age
2023/09/14 03:37:11 Using n1ql client
2023/09/14 03:37:11 Using n1ql client
--- PASS: TestScanLimitParameter (0.01s)
=== RUN TestCountRange
2023/09/14 03:37:11 In TestRangeCount()
2023/09/14 03:37:11 Index found: index_age
2023/09/14 03:37:11 Count of expected and actual Range is: 2424 and 2424
2023/09/14 03:37:11 Count of expected and actual Range is: 10003 and 10003
2023/09/14 03:37:11 Count of expected and actual Range are: 0 and 0
2023/09/14 03:37:11 Count of expected and actual Range are: 487 and 487
2023/09/14 03:37:11 Testing CountRange() for key <= val
2023/09/14 03:37:11 Count of expected and actual CountRange for key <= 30 are: 5208 and 5208
2023/09/14 03:37:11 Testing CountRange() for key >= val
2023/09/14 03:37:11 Count of expected and actual CountRange for key >= 25 are: 7674 and 7674
2023/09/14 03:37:11 Testing CountRange() for null < key <= val
2023/09/14 03:37:11 Count of expected and actual CountRange for key > null && key <= 30 are: 5208 and 5208
2023/09/14 03:37:11 Testing CountRange() for val <= key < null
2023/09/14 03:37:11 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2023/09/14 03:37:11 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.05s)
=== RUN TestCountLookup
2023/09/14 03:37:11 In TestCountLookup()
2023/09/14 03:37:11 Index found: index_age
2023/09/14 03:37:11 Count of expected and actual Range are: 507 and 507
2023/09/14 03:37:11 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.01s)
=== RUN TestRangeStatistics
2023/09/14 03:37:11 In TestRangeCount()
2023/09/14 03:37:11 Index found: index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN TestIndexCreateWithWhere
2023/09/14 03:37:11 In TestIndexCreateWithWhere()
2023/09/14 03:37:16 Created the secondary index index_ageabove30. Waiting for it become active
2023/09/14 03:37:16 Index is 659799010272135797 now active
2023/09/14 03:37:16 Using n1ql client
2023/09/14 03:37:16 Expected and Actual scan responses are the same
2023/09/14 03:37:16 Lengths of expected and actual scanReuslts are: 4308 and 4308
2023/09/14 03:37:22 Created the secondary index index_ageteens. Waiting for it become active
2023/09/14 03:37:22 Index is 10422233154048614329 now active
2023/09/14 03:37:23 Using n1ql client
2023/09/14 03:37:23 Expected and Actual scan responses are the same
2023/09/14 03:37:23 Lengths of expected and actual scanReuslts are: 0 and 0
2023/09/14 03:37:29 Created the secondary index index_age35to45. Waiting for it become active
2023/09/14 03:37:29 Index is 17218360765251572052 now active
2023/09/14 03:37:29 Using n1ql client
2023/09/14 03:37:29 Expected and Actual scan responses are the same
2023/09/14 03:37:29 Lengths of expected and actual scanReuslts are: 2911 and 2911
--- PASS: TestIndexCreateWithWhere (17.94s)
=== RUN TestDeferredIndexCreate
2023/09/14 03:37:29 In TestDeferredIndexCreate()
2023/09/14 03:37:29 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2023/09/14 03:37:31 Build the deferred index index_deferred. Waiting for the index to become active
2023/09/14 03:37:31 Waiting for index 18222165118271973745 to go active ...
2023/09/14 03:37:32 Waiting for index 18222165118271973745 to go active ...
2023/09/14 03:37:33 Waiting for index 18222165118271973745 to go active ...
2023/09/14 03:37:34 Waiting for index 18222165118271973745 to go active ...
2023/09/14 03:37:35 Waiting for index 18222165118271973745 to go active ...
2023/09/14 03:37:36 Index is 18222165118271973745 now active
2023/09/14 03:37:36 Using n1ql client
2023/09/14 03:37:36 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (7.16s)
=== RUN TestCompositeIndex_NumAndString
2023/09/14 03:37:36 In TestCompositeIndex()
2023/09/14 03:37:43 Created the secondary index index_composite1. Waiting for it become active
2023/09/14 03:37:43 Index is 3557589286657124971 now active
2023/09/14 03:37:43 Using n1ql client
2023/09/14 03:37:43 Using n1ql client
2023/09/14 03:37:43 Using n1ql client
2023/09/14 03:37:43 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (6.90s)
=== RUN TestCompositeIndex_TwoNumberFields
2023/09/14 03:37:43 In TestCompositeIndex()
2023/09/14 03:37:50 Created the secondary index index_composite2. Waiting for it become active
2023/09/14 03:37:50 Index is 6412777277134198713 now active
2023/09/14 03:37:50 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (6.67s)
=== RUN TestNumbers_Int64_Float64
2023/09/14 03:37:50 In TestNumbers_Int64_Float64()
2023/09/14 03:37:56 Created the secondary index idx_numbertest. Waiting for it become active
2023/09/14 03:37:56 Index is 18130637391335006443 now active
2023/09/14 03:37:56
==== Int64 test #0
2023/09/14 03:37:56 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Int64 test #1
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Int64 test #2
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Int64 test #3
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Int64 test #4
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Int64 test #5
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Int64 test #6
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Int64 test #7
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Int64 test #8
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Float64 test #0
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Float64 test #1
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Float64 test #2
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
2023/09/14 03:37:57
==== Float64 test #3
2023/09/14 03:37:57 Using n1ql client
2023/09/14 03:37:57 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (7.27s)
=== RUN TestRestartIndexer
2023/09/14 03:37:57 In TestRestartIndexer()
2023/09/14 03:37:57 []
2023-09-14T03:37:57.680+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-14T03:37:57.680+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/14 03:38:17 Using n1ql client
2023-09-14T03:38:17.668+05:30 [Error] transport error between 127.0.0.1:59852->127.0.0.1:9107: write tcp 127.0.0.1:59852->127.0.0.1:9107: write: broken pipe
2023-09-14T03:38:17.669+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -2308093284034988247 request transport failed `write tcp 127.0.0.1:59852->127.0.0.1:9107: write: broken pipe`
2023/09/14 03:38:17 Len of expected and actual scan results are : 10004 and 10004
2023/09/14 03:38:17 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.11s)
=== RUN TestCreateDocsMutation
2023/09/14 03:38:17 In TestCreateDocsMutation()
2023/09/14 03:38:17 Index found: index_age
2023/09/14 03:38:17 Using n1ql client
2023/09/14 03:38:17 Len of expected and actual scan results are : 10004 and 10004
2023/09/14 03:38:17 Expected and Actual scan responses are the same
2023/09/14 03:38:17 Using n1ql client
2023/09/14 03:38:18 Index Scan after mutations took 37.018734ms
2023/09/14 03:38:18 Len of expected and actual scan results are : 10104 and 10104
2023/09/14 03:38:18 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.30s)
=== RUN TestRestartProjector
2023/09/14 03:38:18 In TestRestartProjector()
2023/09/14 03:38:18 []
2023/09/14 03:38:38 Using n1ql client
2023/09/14 03:38:38 Len of expected and actual scan results are : 10104 and 10104
2023/09/14 03:38:38 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.08s)
=== RUN TestDeleteDocsMutation
2023/09/14 03:38:38 In TestDeleteDocsMutation()
2023/09/14 03:38:38 Index found: index_age
2023/09/14 03:38:38 Using n1ql client
2023/09/14 03:38:38 Len of expected and actual scan results are : 10104 and 10104
2023/09/14 03:38:38 Expected and Actual scan responses are the same
2023/09/14 03:38:38 Using n1ql client
2023/09/14 03:38:38 Index Scan after mutations took 38.452803ms
2023/09/14 03:38:38 Len of expected and actual scan results are : 9904 and 9904
2023/09/14 03:38:38 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (0.41s)
=== RUN TestUpdateDocsMutation
2023/09/14 03:38:38 In TestUpdateDocsMutation()
2023/09/14 03:38:38 Index found: index_age
2023/09/14 03:38:38 Using n1ql client
2023/09/14 03:38:38 Len of expected and actual scan results are : 9433 and 9433
2023/09/14 03:38:38 Expected and Actual scan responses are the same
2023/09/14 03:38:38 Num of keysFromMutDocs: 100
2023/09/14 03:38:38 Updating number of documents: 100
2023/09/14 03:38:38 Using n1ql client
2023/09/14 03:38:38 Index Scan after mutations took 48.995835ms
2023/09/14 03:38:38 Len of expected and actual scan results are : 9431 and 9431
2023/09/14 03:38:38 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.35s)
=== RUN TestLargeMutations
2023/09/14 03:38:38 In TestLargeMutations()
2023/09/14 03:38:38 In DropAllSecondaryIndexes()
2023/09/14 03:38:38 Index found: index_p1
2023/09/14 03:38:38 Dropped index index_p1
2023/09/14 03:38:38 Index found: index_ageteens
2023/09/14 03:38:39 Dropped index index_ageteens
2023/09/14 03:38:39 Index found: index_age35to45
2023/09/14 03:38:39 Dropped index index_age35to45
2023/09/14 03:38:39 Index found: index_latitude
2023/09/14 03:38:39 Dropped index index_latitude
2023/09/14 03:38:39 Index found: index_di1
2023/09/14 03:38:39 Dropped index index_di1
2023/09/14 03:38:39 Index found: idx_age
2023/09/14 03:38:39 Dropped index idx_age
2023/09/14 03:38:39 Index found: index_tags
2023/09/14 03:38:39 Dropped index index_tags
2023/09/14 03:38:39 Index found: index_cdc
2023/09/14 03:38:39 Dropped index index_cdc
2023/09/14 03:38:39 Index found: index_deferred
2023/09/14 03:38:39 Dropped index index_deferred
2023/09/14 03:38:39 Index found: index_isresidential
2023/09/14 03:38:39 Dropped index index_isresidential
2023/09/14 03:38:39 Index found: index_composite2
2023/09/14 03:38:39 Dropped index index_composite2
2023/09/14 03:38:39 Index found: index_gender
2023/09/14 03:38:39 Dropped index index_gender
2023/09/14 03:38:39 Index found: index_floor
2023/09/14 03:38:39 Dropped index index_floor
2023/09/14 03:38:39 Index found: index_ageabove30
2023/09/14 03:38:40 Dropped index index_ageabove30
2023/09/14 03:38:40 Index found: index_isActive
2023/09/14 03:38:40 Dropped index index_isActive
2023/09/14 03:38:40 Index found: index_nationality
2023/09/14 03:38:40 Dropped index index_nationality
2023/09/14 03:38:40 Index found: index_company
2023/09/14 03:38:40 Dropped index index_company
2023/09/14 03:38:40 Index found: index_email
2023/09/14 03:38:40 Dropped index index_email
2023/09/14 03:38:40 Index found: index_streetname
2023/09/14 03:38:40 Dropped index index_streetname
2023/09/14 03:38:40 Index found: index_streetaddress
2023/09/14 03:38:40 Dropped index index_streetaddress
2023/09/14 03:38:40 Index found: index_pin
2023/09/14 03:38:40 Dropped index index_pin
2023/09/14 03:38:40 Index found: index_longitude
2023/09/14 03:38:40 Dropped index index_longitude
2023/09/14 03:38:40 Index found: index_i2
2023/09/14 03:38:40 Dropped index index_i2
2023/09/14 03:38:40 Index found: index_age
2023/09/14 03:38:40 Dropped index index_age
2023/09/14 03:38:40 Index found: index_composite1
2023/09/14 03:38:40 Dropped index index_composite1
2023/09/14 03:38:40 Index found: index_balance
2023/09/14 03:38:40 Dropped index index_balance
2023/09/14 03:38:40 Index found: index_name
2023/09/14 03:38:40 Dropped index index_name
2023/09/14 03:38:40 Index found: index_height
2023/09/14 03:38:40 Dropped index index_height
2023/09/14 03:38:40 Index found: index_eyeColor
2023/09/14 03:38:40 Dropped index index_eyeColor
2023/09/14 03:38:40 Index found: index_state
2023/09/14 03:38:40 Dropped index index_state
2023/09/14 03:38:40 Index found: idx_numbertest
2023/09/14 03:38:41 Dropped index idx_numbertest
2023/09/14 03:38:59 Created the secondary index indexmut_1. Waiting for it become active
2023/09/14 03:38:59 Index is 8196867950937835900 now active
2023/09/14 03:38:59 Using n1ql client
2023/09/14 03:39:00 Expected and Actual scan responses are the same
2023/09/14 03:39:00 Len of expected and actual scan results are : 29904 and 29904
2023/09/14 03:39:00 ITERATION 0
2023/09/14 03:39:17 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:39:17 Index is 1844051867522316066 now active
2023/09/14 03:39:17 Using n1ql client
2023/09/14 03:39:17 Expected and Actual scan responses are the same
2023/09/14 03:39:17 Len of expected and actual scan results are : 39904 and 39904
2023/09/14 03:39:17 Using n1ql client
2023/09/14 03:39:18 Expected and Actual scan responses are the same
2023/09/14 03:39:18 Len of expected and actual scan results are : 39904 and 39904
2023/09/14 03:39:18 Dropping the secondary index indexmut_2
2023/09/14 03:39:18 Index dropped
2023/09/14 03:39:18 ITERATION 1
2023/09/14 03:39:34 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:39:34 Index is 11460028930128148947 now active
2023/09/14 03:39:34 Using n1ql client
2023/09/14 03:39:34 Expected and Actual scan responses are the same
2023/09/14 03:39:34 Len of expected and actual scan results are : 49904 and 49904
2023/09/14 03:39:34 Using n1ql client
2023/09/14 03:39:35 Expected and Actual scan responses are the same
2023/09/14 03:39:35 Len of expected and actual scan results are : 49904 and 49904
2023/09/14 03:39:35 Dropping the secondary index indexmut_2
2023/09/14 03:39:35 Index dropped
2023/09/14 03:39:35 ITERATION 2
2023/09/14 03:39:51 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:39:51 Index is 306094280321243996 now active
2023/09/14 03:39:51 Using n1ql client
2023/09/14 03:39:52 Expected and Actual scan responses are the same
2023/09/14 03:39:52 Len of expected and actual scan results are : 59904 and 59904
2023/09/14 03:39:52 Using n1ql client
2023/09/14 03:39:52 Expected and Actual scan responses are the same
2023/09/14 03:39:52 Len of expected and actual scan results are : 59904 and 59904
2023/09/14 03:39:52 Dropping the secondary index indexmut_2
2023/09/14 03:39:52 Index dropped
2023/09/14 03:39:52 ITERATION 3
2023/09/14 03:40:10 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:40:10 Index is 3220987192015048106 now active
2023/09/14 03:40:10 Using n1ql client
2023/09/14 03:40:11 Expected and Actual scan responses are the same
2023/09/14 03:40:11 Len of expected and actual scan results are : 69904 and 69904
2023/09/14 03:40:11 Using n1ql client
2023/09/14 03:40:12 Expected and Actual scan responses are the same
2023/09/14 03:40:12 Len of expected and actual scan results are : 69904 and 69904
2023/09/14 03:40:12 Dropping the secondary index indexmut_2
2023/09/14 03:40:12 Index dropped
2023/09/14 03:40:12 ITERATION 4
2023/09/14 03:40:31 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:40:31 Index is 1122803534050114375 now active
2023/09/14 03:40:32 Using n1ql client
2023/09/14 03:40:33 Expected and Actual scan responses are the same
2023/09/14 03:40:33 Len of expected and actual scan results are : 79904 and 79904
2023/09/14 03:40:33 Using n1ql client
2023/09/14 03:40:34 Expected and Actual scan responses are the same
2023/09/14 03:40:34 Len of expected and actual scan results are : 79904 and 79904
2023/09/14 03:40:34 Dropping the secondary index indexmut_2
2023/09/14 03:40:34 Index dropped
2023/09/14 03:40:34 ITERATION 5
2023/09/14 03:40:53 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:40:53 Index is 15440105772693975356 now active
2023/09/14 03:40:53 Using n1ql client
2023/09/14 03:40:53 Expected and Actual scan responses are the same
2023/09/14 03:40:53 Len of expected and actual scan results are : 89904 and 89904
2023/09/14 03:40:53 Using n1ql client
2023/09/14 03:40:54 Expected and Actual scan responses are the same
2023/09/14 03:40:54 Len of expected and actual scan results are : 89904 and 89904
2023/09/14 03:40:54 Dropping the secondary index indexmut_2
2023/09/14 03:40:54 Index dropped
2023/09/14 03:40:54 ITERATION 6
2023/09/14 03:41:13 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:41:13 Index is 13891655394069233410 now active
2023/09/14 03:41:13 Using n1ql client
2023/09/14 03:41:14 Expected and Actual scan responses are the same
2023/09/14 03:41:14 Len of expected and actual scan results are : 99904 and 99904
2023/09/14 03:41:14 Using n1ql client
2023/09/14 03:41:15 Expected and Actual scan responses are the same
2023/09/14 03:41:15 Len of expected and actual scan results are : 99904 and 99904
2023/09/14 03:41:15 Dropping the secondary index indexmut_2
2023/09/14 03:41:15 Index dropped
2023/09/14 03:41:15 ITERATION 7
2023/09/14 03:41:34 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:41:34 Index is 1274042027888023432 now active
2023/09/14 03:41:34 Using n1ql client
2023/09/14 03:41:35 Expected and Actual scan responses are the same
2023/09/14 03:41:35 Len of expected and actual scan results are : 109904 and 109904
2023/09/14 03:41:35 Using n1ql client
2023/09/14 03:41:37 Expected and Actual scan responses are the same
2023/09/14 03:41:37 Len of expected and actual scan results are : 109904 and 109904
2023/09/14 03:41:37 Dropping the secondary index indexmut_2
2023/09/14 03:41:37 Index dropped
2023/09/14 03:41:37 ITERATION 8
2023/09/14 03:41:57 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:41:57 Index is 4513701807170534869 now active
2023/09/14 03:41:58 Using n1ql client
2023/09/14 03:41:59 Expected and Actual scan responses are the same
2023/09/14 03:41:59 Len of expected and actual scan results are : 119904 and 119904
2023/09/14 03:41:59 Using n1ql client
2023/09/14 03:42:01 Expected and Actual scan responses are the same
2023/09/14 03:42:01 Len of expected and actual scan results are : 119904 and 119904
2023/09/14 03:42:01 Dropping the secondary index indexmut_2
2023/09/14 03:42:01 Index dropped
2023/09/14 03:42:01 ITERATION 9
2023/09/14 03:42:22 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:42:22 Index is 2653051892485208915 now active
2023/09/14 03:42:22 Using n1ql client
2023/09/14 03:42:23 Expected and Actual scan responses are the same
2023/09/14 03:42:23 Len of expected and actual scan results are : 129904 and 129904
2023/09/14 03:42:23 Using n1ql client
2023/09/14 03:42:24 Expected and Actual scan responses are the same
2023/09/14 03:42:24 Len of expected and actual scan results are : 129904 and 129904
2023/09/14 03:42:24 Dropping the secondary index indexmut_2
2023/09/14 03:42:24 Index dropped
2023/09/14 03:42:24 ITERATION 10
2023/09/14 03:42:44 Created the secondary index indexmut_2. Waiting for it become active
2023/09/14 03:42:44 Index is 2908505390980338763 now active
2023/09/14 03:42:45 Using n1ql client
2023/09/14 03:42:45 Expected and Actual scan responses are the same
2023/09/14 03:42:45 Len of expected and actual scan results are : 139904 and 139904
2023/09/14 03:42:46 Using n1ql client
2023/09/14 03:42:47 Expected and Actual scan responses are the same
2023/09/14 03:42:47 Len of expected and actual scan results are : 139904 and 139904
2023/09/14 03:42:47 Dropping the secondary index indexmut_2
2023/09/14 03:42:47 Index dropped
--- PASS: TestLargeMutations (248.49s)
=== RUN TestPlanner
2023/09/14 03:42:47 In TestPlanner()
2023/09/14 03:42:47 -------------------------------------------
2023/09/14 03:42:47 initial placement - 20-50M, 10 index, 3 replica, 2x
2023-09-14T03:42:47.375+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:47.378+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-14T03:42:47.381+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T03:42:47.381+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T03:42:47.382+05:30 [Info] switched currmeta from 485 -> 486 force true
2023-09-14T03:42:47.385+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T03:42:47.385+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T03:42:47.387+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-14T03:42:47.389+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T03:42:47.389+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T03:42:47.392+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-14T03:42:47.458+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:47.458+05:30 [Info] Score: 0.03055343552302701
2023-09-14T03:42:47.458+05:30 [Info] Memory Quota: 54852080222 (51.085G)
2023-09-14T03:42:47.458+05:30 [Info] CPU Quota: 12
2023-09-14T03:42:47.458+05:30 [Info] Indexer Memory Mean 32889048293 (30.6303G)
2023-09-14T03:42:47.458+05:30 [Info] Indexer Memory Deviation 2009746832 (1.87172G) (6.11%)
2023-09-14T03:42:47.458+05:30 [Info] Indexer Memory Utilization 0.5996
2023-09-14T03:42:47.458+05:30 [Info] Indexer CPU Mean 7.8335
2023-09-14T03:42:47.458+05:30 [Info] Indexer CPU Deviation 2.25 (28.66%)
2023-09-14T03:42:47.458+05:30 [Info] Indexer CPU Utilization 0.6528
2023-09-14T03:42:47.458+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:47.458+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:47.459+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:47.459+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:47.459+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:47.459+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:47.459+05:30 [Info] Indexer Data Size Mean 32889048293 (30.6303G)
2023-09-14T03:42:47.459+05:30 [Info] Indexer Data Size Deviation 2009746832 (1.87172G) (6.11%)
2023-09-14T03:42:47.459+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:47.459+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:47.459+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:47.459+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:47 -------------------------------------------
2023/09/14 03:42:47 initial placement - 20-50M, 30 index, 3 replica, 2x
2023-09-14T03:42:47.460+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:48.352+05:30 [Info] Score: 0.032620202364208206
2023-09-14T03:42:48.352+05:30 [Info] Memory Quota: 70427172970 (65.5904G)
2023-09-14T03:42:48.352+05:30 [Info] CPU Quota: 12
2023-09-14T03:42:48.352+05:30 [Info] Indexer Memory Mean 45334522824 (42.2211G)
2023-09-14T03:42:48.353+05:30 [Info] Indexer Memory Deviation 2957642617 (2.75452G) (6.52%)
2023-09-14T03:42:48.353+05:30 [Info] Indexer Memory Utilization 0.6437
2023-09-14T03:42:48.353+05:30 [Info] Indexer CPU Mean 13.4279
2023-09-14T03:42:48.353+05:30 [Info] Indexer CPU Deviation 2.94 (21.93%)
2023-09-14T03:42:48.353+05:30 [Info] Indexer CPU Utilization 1.1190
2023-09-14T03:42:48.353+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:48.353+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:48.353+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:48.353+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:48.353+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:48.353+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:48.353+05:30 [Info] Indexer Data Size Mean 45334522824 (42.2211G)
2023-09-14T03:42:48.353+05:30 [Info] Indexer Data Size Deviation 2957642617 (2.75452G) (6.52%)
2023-09-14T03:42:48.353+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:48.353+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:48.353+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:48.353+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:48 -------------------------------------------
2023/09/14 03:42:48 initial placement - 20-50M, 30 index, 3 replica, 4x
2023-09-14T03:42:48.353+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:48.637+05:30 [Info] Score: 0.01650821679852983
2023-09-14T03:42:48.637+05:30 [Info] Memory Quota: 115698057436 (107.752G)
2023-09-14T03:42:48.637+05:30 [Info] CPU Quota: 24
2023-09-14T03:42:48.637+05:30 [Info] Indexer Memory Mean 74451664627 (69.3385G)
2023-09-14T03:42:48.637+05:30 [Info] Indexer Memory Deviation 2458128441 (2.28931G) (3.30%)
2023-09-14T03:42:48.637+05:30 [Info] Indexer Memory Utilization 0.6435
2023-09-14T03:42:48.637+05:30 [Info] Indexer CPU Mean 21.2219
2023-09-14T03:42:48.637+05:30 [Info] Indexer CPU Deviation 3.88 (18.29%)
2023-09-14T03:42:48.637+05:30 [Info] Indexer CPU Utilization 0.8842
2023-09-14T03:42:48.637+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:48.637+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:48.637+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:48.637+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:48.637+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:48.637+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:48.638+05:30 [Info] Indexer Data Size Mean 74451664627 (69.3385G)
2023-09-14T03:42:48.638+05:30 [Info] Indexer Data Size Deviation 2458128441 (2.28931G) (3.30%)
2023-09-14T03:42:48.638+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:48.638+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:48.638+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:48.638+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:48 -------------------------------------------
2023/09/14 03:42:48 initial placement - 200-500M, 10 index, 3 replica, 2x
2023-09-14T03:42:48.638+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:48.693+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:48.693+05:30 [Info] Score: 0.02604789574266321
2023-09-14T03:42:48.693+05:30 [Info] Memory Quota: 465624647218 (433.647G)
2023-09-14T03:42:48.693+05:30 [Info] CPU Quota: 12
2023-09-14T03:42:48.694+05:30 [Info] Indexer Memory Mean 361345055786 (336.529G)
2023-09-14T03:42:48.694+05:30 [Info] Indexer Memory Deviation 18824556680 (17.5317G) (5.21%)
2023-09-14T03:42:48.694+05:30 [Info] Indexer Memory Utilization 0.7760
2023-09-14T03:42:48.694+05:30 [Info] Indexer CPU Mean 10.4972
2023-09-14T03:42:48.694+05:30 [Info] Indexer CPU Deviation 1.83 (17.47%)
2023-09-14T03:42:48.694+05:30 [Info] Indexer CPU Utilization 0.8748
2023-09-14T03:42:48.694+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:48.694+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:48.694+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:48.694+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:48.694+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:48.694+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:48.694+05:30 [Info] Indexer Data Size Mean 361345055786 (336.529G)
2023-09-14T03:42:48.694+05:30 [Info] Indexer Data Size Deviation 18824556680 (17.5317G) (5.21%)
2023-09-14T03:42:48.694+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:48.694+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:48.694+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:48.694+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:48 -------------------------------------------
2023/09/14 03:42:48 initial placement - 200-500M, 30 index, 3 replica, 2x
2023-09-14T03:42:48.694+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:49.699+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:49.699+05:30 [Info] Score: 0.02094220788242603
2023-09-14T03:42:49.699+05:30 [Info] Memory Quota: 517369384062 (481.838G)
2023-09-14T03:42:49.699+05:30 [Info] CPU Quota: 12
2023-09-14T03:42:49.699+05:30 [Info] Indexer Memory Mean 410815142255 (382.601G)
2023-09-14T03:42:49.699+05:30 [Info] Indexer Memory Deviation 17206752220 (16.025G) (4.19%)
2023-09-14T03:42:49.699+05:30 [Info] Indexer Memory Utilization 0.7940
2023-09-14T03:42:49.699+05:30 [Info] Indexer CPU Mean 11.9604
2023-09-14T03:42:49.699+05:30 [Info] Indexer CPU Deviation 3.18 (26.60%)
2023-09-14T03:42:49.699+05:30 [Info] Indexer CPU Utilization 0.9967
2023-09-14T03:42:49.699+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:49.699+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:49.699+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:49.699+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:49.699+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:49.699+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:49.699+05:30 [Info] Indexer Data Size Mean 410815142255 (382.601G)
2023-09-14T03:42:49.699+05:30 [Info] Indexer Data Size Deviation 17206752220 (16.025G) (4.19%)
2023-09-14T03:42:49.699+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:49.699+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:49.699+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:49.699+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:49 -------------------------------------------
2023/09/14 03:42:49 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2023-09-14T03:42:49.700+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:50.086+05:30 [Info] Score: 0.014770950558840151
2023-09-14T03:42:50.086+05:30 [Info] Memory Quota: 349612258608 (325.602G)
2023-09-14T03:42:50.086+05:30 [Info] CPU Quota: 12
2023-09-14T03:42:50.086+05:30 [Info] Indexer Memory Mean 281829227433 (262.474G)
2023-09-14T03:42:50.086+05:30 [Info] Indexer Memory Deviation 8325771168 (7.75398G) (2.95%)
2023-09-14T03:42:50.086+05:30 [Info] Indexer Memory Utilization 0.8061
2023-09-14T03:42:50.086+05:30 [Info] Indexer CPU Mean 9.3716
2023-09-14T03:42:50.086+05:30 [Info] Indexer CPU Deviation 4.53 (48.32%)
2023-09-14T03:42:50.086+05:30 [Info] Indexer CPU Utilization 0.7810
2023-09-14T03:42:50.086+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:50.086+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:50.086+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:50.086+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.086+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:50.086+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.086+05:30 [Info] Indexer Data Size Mean 281829227433 (262.474G)
2023-09-14T03:42:50.086+05:30 [Info] Indexer Data Size Deviation 8325771168 (7.75398G) (2.95%)
2023-09-14T03:42:50.086+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:50.086+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:50.086+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:50.086+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:50 -------------------------------------------
2023/09/14 03:42:50 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2023-09-14T03:42:50.087+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:50.793+05:30 [Info] Score: 0.04296834619279881
2023-09-14T03:42:50.793+05:30 [Info] Memory Quota: 284035840455 (264.529G)
2023-09-14T03:42:50.793+05:30 [Info] CPU Quota: 20
2023-09-14T03:42:50.793+05:30 [Info] Indexer Memory Mean 193017518799 (179.762G)
2023-09-14T03:42:50.793+05:30 [Info] Indexer Memory Deviation 16587287138 (15.4481G) (8.59%)
2023-09-14T03:42:50.793+05:30 [Info] Indexer Memory Utilization 0.6796
2023-09-14T03:42:50.793+05:30 [Info] Indexer CPU Mean 8.3619
2023-09-14T03:42:50.793+05:30 [Info] Indexer CPU Deviation 2.96 (35.41%)
2023-09-14T03:42:50.793+05:30 [Info] Indexer CPU Utilization 0.4181
2023-09-14T03:42:50.793+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:50.793+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:50.793+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:50.793+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.793+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:50.793+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.793+05:30 [Info] Indexer Data Size Mean 193017518799 (179.762G)
2023-09-14T03:42:50.793+05:30 [Info] Indexer Data Size Deviation 16587287138 (15.4481G) (8.59%)
2023-09-14T03:42:50.793+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:50.793+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:50.793+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:50.793+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:50 -------------------------------------------
2023/09/14 03:42:50 initial placement - 6 2M index, 1 replica, 2x
2023-09-14T03:42:50.804+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:50.820+05:30 [Info] Score: 0
2023-09-14T03:42:50.820+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2023-09-14T03:42:50.820+05:30 [Info] CPU Quota: 2
2023-09-14T03:42:50.820+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2023-09-14T03:42:50.820+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:50.820+05:30 [Info] Indexer Memory Utilization 0.4290
2023-09-14T03:42:50.820+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-14T03:42:50.820+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:50.820+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-14T03:42:50.820+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:50.820+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:50.820+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:50.820+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.820+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:50.820+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.820+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2023-09-14T03:42:50.820+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:50.820+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:50.820+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:50.820+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:50.820+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:50 -------------------------------------------
2023/09/14 03:42:50 initial placement - 5 20M primary index, 2 replica, 2x
2023-09-14T03:42:50.830+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:50.870+05:30 [Info] Score: 0
2023-09-14T03:42:50.870+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2023-09-14T03:42:50.870+05:30 [Info] CPU Quota: 2
2023-09-14T03:42:50.870+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2023-09-14T03:42:50.870+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:50.870+05:30 [Info] Indexer Memory Utilization 0.7659
2023-09-14T03:42:50.870+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-14T03:42:50.870+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:50.870+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-14T03:42:50.870+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:50.870+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:50.870+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:50.870+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.870+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:50.870+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.870+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2023-09-14T03:42:50.870+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:50.870+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:50.870+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:50.870+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:50.870+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:50 -------------------------------------------
2023/09/14 03:42:50 initial placement - 5 20M array index, 2 replica, 2x
2023-09-14T03:42:50.880+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:50.919+05:30 [Info] Score: 0
2023-09-14T03:42:50.919+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2023-09-14T03:42:50.919+05:30 [Info] CPU Quota: 2
2023-09-14T03:42:50.919+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2023-09-14T03:42:50.919+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:50.919+05:30 [Info] Indexer Memory Utilization 0.8063
2023-09-14T03:42:50.919+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-14T03:42:50.919+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:50.919+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-14T03:42:50.919+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:50.919+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:50.919+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:50.919+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.919+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:50.919+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.919+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2023-09-14T03:42:50.919+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:50.919+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:50.919+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:50.919+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:50.919+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:50 -------------------------------------------
2023/09/14 03:42:50 initial placement - 3 replica constraint, 2 index, 2x
2023-09-14T03:42:50.923+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:50.964+05:30 [Info] Score: 0
2023-09-14T03:42:50.964+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-14T03:42:50.964+05:30 [Info] CPU Quota: 2
2023-09-14T03:42:50.964+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-14T03:42:50.964+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:50.964+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-14T03:42:50.964+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:50.964+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:50.964+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:50.964+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:50.964+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:50.964+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:50.964+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.964+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:50.964+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:50.965+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-14T03:42:50.965+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:50.965+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:50.965+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:50.965+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:50.965+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:50 -------------------------------------------
2023/09/14 03:42:50 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2023-09-14T03:42:50.975+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.027504585177025163
2023-09-14T03:42:51.107+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:51.107+05:30 [Info] Score: 0.007189938568471697
2023-09-14T03:42:51.107+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2023-09-14T03:42:51.107+05:30 [Info] CPU Quota: 27
2023-09-14T03:42:51.107+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2023-09-14T03:42:51.107+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2023-09-14T03:42:51.107+05:30 [Info] Indexer Memory Utilization 0.5679
2023-09-14T03:42:51.107+05:30 [Info] Indexer CPU Mean 20.1734
2023-09-14T03:42:51.107+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2023-09-14T03:42:51.107+05:30 [Info] Indexer CPU Utilization 0.7472
2023-09-14T03:42:51.107+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:51.107+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:51.107+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:51.107+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.107+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:51.107+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.107+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2023-09-14T03:42:51.107+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2023-09-14T03:42:51.107+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:51.107+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:51.107+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:51.107+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:51 -------------------------------------------
2023/09/14 03:42:51 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2023-09-14T03:42:51.119+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0025241014507311936
2023-09-14T03:42:51.357+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:51.357+05:30 [Info] Score: 0.00043718596495524715
2023-09-14T03:42:51.357+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-14T03:42:51.357+05:30 [Info] CPU Quota: 20
2023-09-14T03:42:51.357+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2023-09-14T03:42:51.357+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2023-09-14T03:42:51.357+05:30 [Info] Indexer Memory Utilization 0.7321
2023-09-14T03:42:51.357+05:30 [Info] Indexer CPU Mean 14.2305
2023-09-14T03:42:51.357+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2023-09-14T03:42:51.357+05:30 [Info] Indexer CPU Utilization 0.7115
2023-09-14T03:42:51.357+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:51.357+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:51.357+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:51.357+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.357+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:51.357+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.357+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2023-09-14T03:42:51.357+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2023-09-14T03:42:51.357+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:51.357+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:51.357+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:51.357+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:51 -------------------------------------------
2023/09/14 03:42:51 incr placement - 3 server group, 3 replica, 1x
2023-09-14T03:42:51.360+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:51.374+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:51.374+05:30 [Info] Score: 0
2023-09-14T03:42:51.374+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-14T03:42:51.374+05:30 [Info] CPU Quota: 16
2023-09-14T03:42:51.374+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-14T03:42:51.374+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:51.374+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-14T03:42:51.374+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:51.374+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:51.374+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:51.374+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:51.374+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:51.374+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:51.374+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.374+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:51.374+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.374+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-14T03:42:51.374+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:51.374+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:51.374+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:51.374+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:51.374+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:51 -------------------------------------------
2023/09/14 03:42:51 incr placement - 2 server group, 3 replica, 1x
2023-09-14T03:42:51.376+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2023-09-14T03:42:51.376+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2023-09-14T03:42:51.376+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2023-09-14T03:42:51.376+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:51.390+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:51.390+05:30 [Info] Score: 0
2023-09-14T03:42:51.390+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-14T03:42:51.390+05:30 [Info] CPU Quota: 16
2023-09-14T03:42:51.390+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-14T03:42:51.390+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:51.390+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-14T03:42:51.390+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:51.390+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:51.390+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:51.390+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:51.390+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:51.390+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:51.390+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.390+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:51.390+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.390+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-14T03:42:51.390+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:51.390+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:51.390+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:51.390+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:51.390+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:51 -------------------------------------------
2023/09/14 03:42:51 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2023-09-14T03:42:51.392+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.23302170839479605
2023-09-14T03:42:51.392+05:30 [Info] Planner::initial temperature: initial resource variation 0.23302170839479605 temp 0.023302170839479608
2023-09-14T03:42:51.565+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:51.565+05:30 [Info] Score: 0.17319521570344848
2023-09-14T03:42:51.565+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-09-14T03:42:51.565+05:30 [Info] CPU Quota: 30
2023-09-14T03:42:51.565+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-09-14T03:42:51.565+05:30 [Info] Indexer Memory Deviation 3234211188 (3.01209G) (3.64%)
2023-09-14T03:42:51.565+05:30 [Info] Indexer Memory Utilization 0.6367
2023-09-14T03:42:51.565+05:30 [Info] Indexer CPU Mean 24.0538
2023-09-14T03:42:51.565+05:30 [Info] Indexer CPU Deviation 3.32 (13.82%)
2023-09-14T03:42:51.565+05:30 [Info] Indexer CPU Utilization 0.8018
2023-09-14T03:42:51.565+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:51.565+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:51.565+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:51.565+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.566+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:51.566+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.566+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-09-14T03:42:51.566+05:30 [Info] Indexer Data Size Deviation 3234211188 (3.01209G) (3.64%)
2023-09-14T03:42:51.566+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2023-09-14T03:42:51.566+05:30 [Info] Index Data Moved (exclude new node) 330.068G (33.23%)
2023-09-14T03:42:51.566+05:30 [Info] No. Index (from non-deleted node) 90
2023-09-14T03:42:51.566+05:30 [Info] No. Index Moved (exclude new node) 28 (31.11%)
2023/09/14 03:42:51 -------------------------------------------
2023/09/14 03:42:51 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2023-09-14T03:42:51.567+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2292157051101437
2023-09-14T03:42:51.567+05:30 [Info] Planner::initial temperature: initial resource variation 0.2292157051101437 temp 0.022921570511014372
2023-09-14T03:42:51.662+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-14T03:42:51.669+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T03:42:51.669+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T03:42:51.670+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-14T03:42:51.674+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T03:42:51.674+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T03:42:51.675+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-14T03:42:51.791+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:51.791+05:30 [Info] Score: 0.20257871267645433
2023-09-14T03:42:51.791+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-14T03:42:51.791+05:30 [Info] CPU Quota: 20
2023-09-14T03:42:51.791+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-09-14T03:42:51.791+05:30 [Info] Indexer Memory Deviation 30852505098 (28.7336G) (7.86%)
2023-09-14T03:42:51.791+05:30 [Info] Indexer Memory Utilization 0.7311
2023-09-14T03:42:51.791+05:30 [Info] Indexer CPU Mean 13.9305
2023-09-14T03:42:51.791+05:30 [Info] Indexer CPU Deviation 3.09 (22.19%)
2023-09-14T03:42:51.791+05:30 [Info] Indexer CPU Utilization 0.6965
2023-09-14T03:42:51.791+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:51.791+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:51.791+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:51.791+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.791+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:51.791+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.791+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-09-14T03:42:51.791+05:30 [Info] Indexer Data Size Deviation 30852505098 (28.7336G) (7.86%)
2023-09-14T03:42:51.791+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2023-09-14T03:42:51.791+05:30 [Info] Index Data Moved (exclude new node) 2.08449T (48.66%)
2023-09-14T03:42:51.791+05:30 [Info] No. Index (from non-deleted node) 90
2023-09-14T03:42:51.791+05:30 [Info] No. Index Moved (exclude new node) 20 (22.22%)
2023/09/14 03:42:51 -------------------------------------------
2023/09/14 03:42:51 rebalance - travel sample, 10% shuffle, 1x
2023-09-14T03:42:51.792+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.23680133137265638
2023-09-14T03:42:51.792+05:30 [Info] Planner::initial temperature: initial resource variation 0.23680133137265638 temp 0.02368013313726564
2023-09-14T03:42:51.820+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:51.820+05:30 [Info] Score: 0.04715225965046212
2023-09-14T03:42:51.821+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-14T03:42:51.821+05:30 [Info] CPU Quota: 8
2023-09-14T03:42:51.821+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-09-14T03:42:51.821+05:30 [Info] Indexer Memory Deviation 1632564 (1.55693M) (9.33%)
2023-09-14T03:42:51.821+05:30 [Info] Indexer Memory Utilization 0.0326
2023-09-14T03:42:51.821+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:51.821+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:51.821+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:51.821+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:51.821+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:51.821+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:51.821+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.821+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:51.821+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:51.821+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-14T03:42:51.821+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:51.821+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:51.821+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:51.821+05:30 [Info] No. Index (from non-deleted node) 10
2023-09-14T03:42:51.821+05:30 [Info] No. Index Moved (exclude new node) 1 (10.00%)
2023/09/14 03:42:51 -------------------------------------------
2023/09/14 03:42:51 rebalance - 20-50M, 90 index, swap 2, 1x
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-09-14T03:42:51.822+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-09-14T03:42:51.822+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4095843409677649
2023-09-14T03:42:51.823+05:30 [Info] Planner::initial temperature: initial resource variation 0.4095843409677649 temp 0.04095843409677649
2023-09-14T03:42:52.037+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:52.037+05:30 [Info] Score: 0.015321766197257369
2023-09-14T03:42:52.037+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-09-14T03:42:52.037+05:30 [Info] CPU Quota: 30
2023-09-14T03:42:52.037+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-09-14T03:42:52.037+05:30 [Info] Indexer Memory Deviation 2723492012 (2.53645G) (3.06%)
2023-09-14T03:42:52.037+05:30 [Info] Indexer Memory Utilization 0.6367
2023-09-14T03:42:52.037+05:30 [Info] Indexer CPU Mean 24.0538
2023-09-14T03:42:52.037+05:30 [Info] Indexer CPU Deviation 1.24 (5.14%)
2023-09-14T03:42:52.037+05:30 [Info] Indexer CPU Utilization 0.8018
2023-09-14T03:42:52.037+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:52.037+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:52.037+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:52.037+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:52.037+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:52.037+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:52.037+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-09-14T03:42:52.037+05:30 [Info] Indexer Data Size Deviation 2723492012 (2.53645G) (3.06%)
2023-09-14T03:42:52.037+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:52.037+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:52.037+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:52.037+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:52 -------------------------------------------
2023/09/14 03:42:52 rebalance - mixed small/medium, 90 index, swap 2, 1x
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-09-14T03:42:52.039+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-09-14T03:42:52.039+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4082556623939647
2023-09-14T03:42:52.039+05:30 [Info] Planner::initial temperature: initial resource variation 0.4082556623939647 temp 0.040825566239396475
2023-09-14T03:42:52.201+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:52.201+05:30 [Info] Score: 0.0012961754397692459
2023-09-14T03:42:52.202+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-14T03:42:52.202+05:30 [Info] CPU Quota: 20
2023-09-14T03:42:52.202+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-09-14T03:42:52.202+05:30 [Info] Indexer Memory Deviation 1017512243 (970.375M) (0.26%)
2023-09-14T03:42:52.202+05:30 [Info] Indexer Memory Utilization 0.7311
2023-09-14T03:42:52.202+05:30 [Info] Indexer CPU Mean 13.9305
2023-09-14T03:42:52.202+05:30 [Info] Indexer CPU Deviation 0.68 (4.91%)
2023-09-14T03:42:52.202+05:30 [Info] Indexer CPU Utilization 0.6965
2023-09-14T03:42:52.202+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:52.202+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:52.202+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:52.202+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:52.202+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:52.202+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:52.202+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-09-14T03:42:52.202+05:30 [Info] Indexer Data Size Deviation 1017512243 (970.375M) (0.26%)
2023-09-14T03:42:52.202+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:52.202+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:52.202+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:52.202+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:52 -------------------------------------------
2023/09/14 03:42:52 rebalance - travel sample, swap 2, 1x
2023-09-14T03:42:52.202+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 192.168.1.8:9000
2023-09-14T03:42:52.202+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-14T03:42:52.203+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0086622738872069
2023-09-14T03:42:52.203+05:30 [Info] Planner::initial temperature: initial resource variation 1.0086622738872069 temp 0.1008662273887207
2023-09-14T03:42:52.331+05:30 [Info] Score: 0.00031929273712825843
2023-09-14T03:42:52.331+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-14T03:42:52.331+05:30 [Info] CPU Quota: 8
2023-09-14T03:42:52.331+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-09-14T03:42:52.331+05:30 [Info] Indexer Memory Deviation 22354 (21.8301K) (0.13%)
2023-09-14T03:42:52.331+05:30 [Info] Indexer Memory Utilization 0.0326
2023-09-14T03:42:52.331+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:52.331+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:52.331+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:52.331+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:52.331+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:52.331+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:52.331+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:52.331+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:52.331+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:52.331+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-14T03:42:52.331+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:52.331+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:52.331+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:52.331+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:52.331+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:52 -------------------------------------------
2023/09/14 03:42:52 rebalance - 8 identical index, add 4, 1x
2023-09-14T03:42:52.332+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-14T03:42:52.332+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-14T03:42:52.332+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-14T03:42:52.332+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-14T03:42:52.332+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1
2023-09-14T03:42:52.332+05:30 [Info] Planner::initial temperature: initial resource variation 1 temp 0.1
2023-09-14T03:42:52.829+05:30 [Info] connected with 1 indexers
2023-09-14T03:42:52.829+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-14T03:42:52.847+05:30 [Info] num concurrent scans {0}
2023-09-14T03:42:52.847+05:30 [Info] average scan response {1 ms}
2023-09-14T03:42:53.562+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-14T03:42:54.082+05:30 [Info] connected with 1 indexers
2023-09-14T03:42:54.082+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-14T03:42:54.088+05:30 [Info] GSIC[default/default-_default-_default-1694642274029617899] logstats "default" {"gsi_scan_count":109,"gsi_scan_duration":12050791107,"gsi_throttle_duration":1085595290,"gsi_prime_duration":676528720,"gsi_blocked_duration":1898502699,"gsi_total_temp_files":0,"gsi_backfill_size":0}
2023-09-14T03:42:54.088+05:30 [Info] num concurrent scans {0}
2023-09-14T03:42:54.088+05:30 [Info] average scan response {637 ms}
2023-09-14T03:42:54.778+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-14T03:42:56.701+05:30 [Info] Score: 0
2023-09-14T03:42:56.701+05:30 [Info] Memory Quota: 930294000 (887.197M)
2023-09-14T03:42:56.701+05:30 [Info] CPU Quota: 2
2023-09-14T03:42:56.701+05:30 [Info] Indexer Memory Mean 260000000 (247.955M)
2023-09-14T03:42:56.701+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:56.701+05:30 [Info] Indexer Memory Utilization 0.2795
2023-09-14T03:42:56.702+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:56.702+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:56.702+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:56.702+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:56.702+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:56.702+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:56.702+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:56.702+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:56.702+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:56.702+05:30 [Info] Indexer Data Size Mean 260000000 (247.955M)
2023-09-14T03:42:56.702+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:56.702+05:30 [Info] Total Index Data (from non-deleted node) 1.93715G
2023-09-14T03:42:56.702+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:56.702+05:30 [Info] No. Index (from non-deleted node) 8
2023-09-14T03:42:56.702+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:56 -------------------------------------------
2023/09/14 03:42:56 rebalance - 8 identical index, delete 2, 2x
2023-09-14T03:42:56.702+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:56.702+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023-09-14T03:42:56.750+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:56.750+05:30 [Info] Score: 0
2023-09-14T03:42:56.750+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2023-09-14T03:42:56.750+05:30 [Info] CPU Quota: 4
2023-09-14T03:42:56.750+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2023-09-14T03:42:56.750+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:56.750+05:30 [Info] Indexer Memory Utilization 0.0098
2023-09-14T03:42:56.750+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:56.750+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:56.750+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:56.750+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:56.750+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:56.750+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:56.750+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:56.750+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:56.750+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:56.750+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2023-09-14T03:42:56.750+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:56.750+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:56.750+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:56.750+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:56.750+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:56 -------------------------------------------
2023/09/14 03:42:56 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2023-09-14T03:42:56.751+05:30 [Warn] There is more replica than available nodes. Will not move index replica (default,,,country) from ejected node 127.0.0.1:9002
2023-09-14T03:42:56.751+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-14T03:42:56.751+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-14T03:42:56.751+05:30 [Info] Score: 0
2023-09-14T03:42:56.751+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-14T03:42:56.751+05:30 [Info] CPU Quota: 16
2023-09-14T03:42:56.751+05:30 [Info] Indexer Memory Mean 0 (0)
2023-09-14T03:42:56.751+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:56.751+05:30 [Info] Indexer Memory Utilization 0.0000
2023-09-14T03:42:56.751+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:56.751+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:56.751+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:56.751+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:56.751+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:56.751+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:56.751+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:56.751+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:56.751+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:56.751+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-14T03:42:56.751+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:56.751+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:56.751+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:56.751+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:56.751+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:56 -------------------------------------------
2023/09/14 03:42:56 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2023-09-14T03:42:56.751+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-14T03:42:56.751+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-14T03:42:56.751+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9003
2023-09-14T03:42:56.751+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-14T03:42:56.751+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-14T03:42:56.752+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-14T03:42:56.752+05:30 [Info] Score: 0
2023-09-14T03:42:56.752+05:30 [Info] Memory Quota: 268435456 (256M)
2023-09-14T03:42:56.752+05:30 [Info] CPU Quota: 8
2023-09-14T03:42:56.752+05:30 [Info] Indexer Memory Mean 0 (0)
2023-09-14T03:42:56.752+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-14T03:42:56.752+05:30 [Info] Indexer Memory Utilization 0.0000
2023-09-14T03:42:56.752+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:42:56.752+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:42:56.752+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:42:56.752+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:42:56.752+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:42:56.752+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:42:56.752+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:56.752+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:42:56.752+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:42:56.752+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-14T03:42:56.752+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:42:56.752+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:42:56.752+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:42:56.752+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:42:56.752+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/14 03:42:56 -------------------------------------------
2023/09/14 03:42:56 Minimum memory test 1: min memory = 0
2023-09-14T03:42:56.753+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-14T03:42:56.753+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-14T03:42:56.756+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/14 03:42:56 -------------------------------------------
2023/09/14 03:42:56 Minimum memory test 2: min memory > quota
2023-09-14T03:42:56.756+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-14T03:42:56.756+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-09-14T03:42:56.756+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=4us
2023-09-14T03:42:56.756+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-14T03:42:56.756+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/09/14 03:42:57 -------------------------------------------
2023/09/14 03:42:57 Minimum memory test 3: min memory < quota
2023-09-14T03:42:57.794+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-14T03:42:57.794+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/09/14 03:42:58 -------------------------------------------
2023/09/14 03:42:58 Minimum memory test 4: replica repair with min memory > quota
2023-09-14T03:42:58.991+05:30 [Info] Rebuilding lost replica for (default,,,country,0,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:58.992+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=9us
2023-09-14T03:42:58.992+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=11us
2023-09-14T03:42:58.992+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=11us
2023-09-14T03:42:58.995+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-14T03:42:58.995+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-14T03:42:58.995+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-14T03:42:58.995+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:58.995+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3ms
2023-09-14T03:42:58.995+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-14T03:42:58.995+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-14T03:42:58.996+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-14T03:42:58.996+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:58.996+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=574us
2023-09-14T03:42:58.996+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster. Will not rebuild lost replica.
2023-09-14T03:42:58.996+05:30 [Warn]
MemoryQuota: 200
CpuQuota: 8
--- Violations for index (mem 130, cpu 0) at node 127.0.0.1:9003
Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2023-09-14T03:42:58.996+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-14T03:42:58.996+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0 is less than threshold: 0. No nodes have been added or deleted and there are no violations observed
2023-09-14T03:42:58.996+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023/09/14 03:42:58 -------------------------------------------
2023/09/14 03:42:58 Minimum memory test 5: replica repair with min memory < quota
2023-09-14T03:42:58.997+05:30 [Info] Rebuilding lost replica for (default,,,country,0,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:58.997+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-14T03:42:58.997+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-14T03:42:59.040+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Minimum memory test 6: rebalance with min memory > quota
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=10us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=9us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=9us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=7us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=6us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=6us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=8us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=7us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=6us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=6us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=6us
2023-09-14T03:42:59.041+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=5us
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Minimum memory test 7: rebalance-out with min memory > quota
2023-09-14T03:42:59.042+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=7us
2023-09-14T03:42:59.042+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=9us
2023-09-14T03:42:59.042+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=8us
2023-09-14T03:42:59.042+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=9us
2023-09-14T03:42:59.042+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=10us
2023-09-14T03:42:59.042+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=10us
2023-09-14T03:42:59.042+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-14T03:42:59.042+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-14T03:42:59.043+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-14T03:42:59.044+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Minimum memory test 8: plan with min memory > quota
2023-09-14T03:42:59.048+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-09-14T03:42:59.049+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-14T03:42:59.049+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:59.049+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=1ms
2023-09-14T03:42:59.049+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=8us
2023-09-14T03:42:59.049+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-09-14T03:42:59.049+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-14T03:42:59.049+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=6us
2023-09-14T03:42:59.049+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=7us
2023-09-14T03:42:59.049+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-14T03:42:59.049+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-09-14T03:42:59.050+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Minimum memory test 9: single node rebalance with min memory > quota
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=9us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=3us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=3us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=5us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=5us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=6us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=6us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=36us
2023-09-14T03:42:59.050+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=8us
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Minimum memory test 10: plan with partitioned index on empty cluster
2023-09-14T03:42:59.063+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.7071067811865476
2023-09-14T03:42:59.105+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 iterationTest :: Remove one node - failure
2023-09-14T03:42:59.105+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.09208503455704939
2023-09-14T03:42:59.193+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:59.194+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.194+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.194+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.194+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.194+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1219165747493647).
2023-09-14T03:42:59.194+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=387us
2023-09-14T03:42:59.194+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.194+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.194+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.194+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.194+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1216559508824664).
2023-09-14T03:42:59.194+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=344us
2023-09-14T03:42:59.194+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.194+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.195+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.195+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.195+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.16541210084125266).
2023-09-14T03:42:59.195+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=341us
2023-09-14T03:42:59.195+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.195+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.195+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.195+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.195+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13417343443054655).
2023-09-14T03:42:59.195+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=354us
2023-09-14T03:42:59.195+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.195+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.195+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.195+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.195+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.11571916189049117).
2023-09-14T03:42:59.195+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=341us
2023-09-14T03:42:59.196+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.196+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.196+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.196+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.196+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.18105060123598077).
2023-09-14T03:42:59.196+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=343us
2023-09-14T03:42:59.196+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-14T03:42:59.196+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.196+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.196+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.196+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.196+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1216559508824664).
2023-09-14T03:42:59.196+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=313us
2023-09-14T03:42:59.196+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.196+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.196+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.196+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.197+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.11571916189049117).
2023-09-14T03:42:59.197+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=350us
2023-09-14T03:42:59.197+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.197+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.197+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.197+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.197+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.19515010894947976).
2023-09-14T03:42:59.197+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=433us
2023-09-14T03:42:59.197+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.197+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.197+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.197+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.197+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1276173721218414).
2023-09-14T03:42:59.198+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=442us
2023-09-14T03:42:59.198+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.198+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.198+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.198+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.198+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.15911719244409225).
2023-09-14T03:42:59.198+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=467us
2023-09-14T03:42:59.198+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.015859454393988136
2023-09-14T03:42:59.198+05:30 [Info] Planner::initial temperature: initial resource variation 0.015859454393988136 temp 0.03341405456060119
2023-09-14T03:42:59.198+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.198+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-14T03:42:59.198+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.17136708394822378).
2023-09-14T03:42:59.199+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=362us
2023-09-14T03:42:59.199+05:30 [Error]
MemoryQuota: 5302940000000
CpuQuota: 6
--- Violations for index <10712866500846691205, bucket1, , > (mem 23.9133G, cpu 2.94268) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.62733T, free cpu -35.207800000000006)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63273T, free cpu -25.46808)
--- Violations for index <7398246595690941470, bucket1, , > (mem 17.1064G, cpu 4.26048) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.62733T, free cpu -35.207800000000006)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63273T, free cpu -25.46808)
--- Violations for index <13653787365614958760, bucket1, , > (mem 18.7818G, cpu 2.89952) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.62733T, free cpu -35.207800000000006)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63273T, free cpu -25.46808)
--- Violations for index <4207236696131667275, bucket1, , > (mem 14.6088G, cpu 4.2449200000000005) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.62733T, free cpu -35.207800000000006)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63273T, free cpu -25.46808)
--- Violations for index <16078972601731644862, bucket1, , > (mem 14.8462G, cpu 5.2964) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.62733T, free cpu -35.207800000000006)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63273T, free cpu -25.46808)
--- Violations for index <3420553906452789488, bucket1, , > (mem 14.5466G, cpu 4.13112) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.62733T, free cpu -35.207800000000006)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63273T, free cpu -25.46808)
--- Violations for index <6172255568961087923, bucket1, , > (mem 16.0193G, cpu 2.46172) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.62733T, free cpu -35.207800000000006)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63273T, free cpu -25.46808)
--- Violations for index <13065141307383193415, bucket1, , > (mem 20.0717G, cpu 3.29176) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.62733T, free cpu -35.207800000000006)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.63273T, free cpu -25.46808)
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 iterationTest :: Remove one node - success
2023-09-14T03:42:59.199+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.17858631718295365
2023-09-14T03:42:59.289+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:59.290+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.02400030759445626
2023-09-14T03:42:59.290+05:30 [Info] Planner::initial temperature: initial resource variation 0.02400030759445626 temp 0.022599969240554376
2023-09-14T03:42:59.290+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-14T03:42:59.290+05:30 [Info] Planner::Finished planner run after 9 iterations.
2023-09-14T03:42:59.290+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.014668402489761381).
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 iterationTest :: Index rebuild - success
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i10,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i13,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i15,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i18,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i22,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i0,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i5,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i4,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i8,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i11,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i24,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i26,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i28,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i27,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i6,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i12,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i14,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.293+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i20,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i23,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i17,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i19,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i21,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i25,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i29,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i7,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i9,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-14T03:42:59.294+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i16,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-14T03:42:59.295+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6018490028422596
2023-09-14T03:42:59.295+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0.6018490028422596 is less than threshold: 0.8. No nodes have been added or deleted and there are no violations observed
2023-09-14T03:42:59.295+05:30 [Info] Planner::initial temperature: initial resource variation 0.6018490028422596 temp 0.019815099715774043
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 iterationTest :: Index rebuild - initial placement - success
2023-09-14T03:42:59.295+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-09-14T03:42:59.295+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-14T03:42:59.295+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-14T03:42:59.295+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.295+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.296+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.296+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6236095644623236
2023-09-14T03:42:59.296+05:30 [Info] Planner::initial temperature: initial resource variation 0.6236095644623236 temp 0.03663904355376764
2023-09-14T03:42:59.296+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:42:59.296+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:59.296+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.6236095644623236).
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 iterationTest :: Index rebuild - initial placement - numReplica > numSG - success
2023-09-14T03:42:59.296+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-09-14T03:42:59.296+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-14T03:42:59.296+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-14T03:42:59.296+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.296+05:30 [Info] Rebuilding lost replica for (default,,,idx1,2,0) with initial placement on node: 127.0.0.1:9002
2023-09-14T03:42:59.297+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.297+05:30 [Info] Rebuilding lost replica for (default,,,idx2,2,0) with initial placement on node: 127.0.0.1:9002
2023-09-14T03:42:59.297+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:42:59.297+05:30 [Info] Rebuilding lost replica for (default,,,idx3,2,0) with initial placement on node: 127.0.0.1:9000
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-09-14T03:42:59.297+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.36851386559504445
2023-09-14T03:42:59.297+05:30 [Info] Planner::initial temperature: initial resource variation 0.36851386559504445 temp 0.06214861344049556
2023-09-14T03:42:59.297+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:42:59.297+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:42:59.297+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.36851386559504445).
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 scaling with excludeIn - 8 identical index, add 1, 1x
2023-09-14T03:42:59.298+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-09-14T03:42:59.298+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 swap with excludeIn - 8 identical index, add 1, 1x
2023-09-14T03:42:59.461+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-09-14T03:42:59.461+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023-09-14T03:42:59.461+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 replica repair with excludeIn - 3 replica, 4 zone, delete 1, 1x
2023-09-14T03:42:59.462+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-14T03:42:59.462+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 heterogenous rebalance - keep vertically scaled Node, swap 1, 1x
2023-09-14T03:42:59.462+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.1237823254333867
2023-09-14T03:42:59.462+05:30 [Info] Planner::initial temperature: initial resource variation 1.1237823254333867 temp 0.11237823254333867
2023-09-14T03:42:59.462+05:30 [Info] Planner::finalizing the solution as final solution is found.
--- PASS: TestPlanner (12.09s)
=== RUN TestGreedyPlanner
2023/09/14 03:42:59 In TestGreedyPlanner()
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Single Index Instance - 3 empty nodes - 1 SG
2023-09-14T03:42:59.465+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Single Index Instance - 2 empty nodes, 1 non-empty node - 1 SG
2023-09-14T03:42:59.467+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Single Index Instance - 1 empty node, 2 non-empty nodes - 1 SG
2023-09-14T03:42:59.469+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Single Index Instance - 3 non-empty nodes - 1 SG
2023-09-14T03:42:59.471+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 1 Replica - 3 empty nodes - 1 SG
2023-09-14T03:42:59.473+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 1 SG
2023-09-14T03:42:59.475+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 1 SG
2023-09-14T03:42:59.477+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 1 Replica - 3 non-empty nodes - 1 SG
2023-09-14T03:42:59.479+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 2 Replica - 3 empty nodes - 1 SG
2023-09-14T03:42:59.481+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 2 Replica - 3 non-empty nodes - 1 SG
2023-09-14T03:42:59.483+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 2 SG
2023-09-14T03:42:59.485+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 2 SG
2023-09-14T03:42:59.487+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Index With 1 Replica - 3 non-empty nodes - 2 SG
2023-09-14T03:42:59.490+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Equivalent Index Without any replica - 3 non-empty nodes - 1 SG
2023-09-14T03:42:59.493+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Skip least loaded node
2023-09-14T03:42:59.496+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Use least loaded node
2023-09-14T03:42:59.499+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place 60 index instaces on 3 empty nodes - 1 SG
2023-09-14T03:42:59.501+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-14T03:42:59.503+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-14T03:42:59.505+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-14T03:42:59.507+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-14T03:42:59.509+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-14T03:42:59.511+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-14T03:42:59.514+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-14T03:42:59.516+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-14T03:42:59.517+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-14T03:42:59.519+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-14T03:42:59.521+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-14T03:42:59.522+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-14T03:42:59.524+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-14T03:42:59.526+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-14T03:42:59.527+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-14T03:42:59.529+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-14T03:42:59.531+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-14T03:42:59.533+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-14T03:42:59.534+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-14T03:42:59.536+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-14T03:42:59.538+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-14T03:42:59.539+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-14T03:42:59.541+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-14T03:42:59.543+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-14T03:42:59.544+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-14T03:42:59.546+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-14T03:42:59.548+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-14T03:42:59.550+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-14T03:42:59.551+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-14T03:42:59.553+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-14T03:42:59.555+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-14T03:42:59.557+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-14T03:42:59.558+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-14T03:42:59.561+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-14T03:42:59.562+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-14T03:42:59.564+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-14T03:42:59.566+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-14T03:42:59.567+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-14T03:42:59.569+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-14T03:42:59.571+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-14T03:42:59.573+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-14T03:42:59.574+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-14T03:42:59.576+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-14T03:42:59.578+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-14T03:42:59.580+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-14T03:42:59.581+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-14T03:42:59.583+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-14T03:42:59.585+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-14T03:42:59.587+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-14T03:42:59.589+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-14T03:42:59.591+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-14T03:42:59.592+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-14T03:42:59.594+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-14T03:42:59.596+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-14T03:42:59.598+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-14T03:42:59.600+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-14T03:42:59.601+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-14T03:42:59.603+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-14T03:42:59.605+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-14T03:42:59.608+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-14T03:42:59.608+05:30 [Info] Actual variance of deferred index count across nodes is 0
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place 60 index instaces on 1 empty and 1 10 percent filled node - 1 SG
2023-09-14T03:42:59.610+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-14T03:42:59.611+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-14T03:42:59.613+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-14T03:42:59.615+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-14T03:42:59.616+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-14T03:42:59.618+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-14T03:42:59.620+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-14T03:42:59.621+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-14T03:42:59.623+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-14T03:42:59.624+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-14T03:42:59.626+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-14T03:42:59.628+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-14T03:42:59.630+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-14T03:42:59.631+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-14T03:42:59.633+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-14T03:42:59.635+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-14T03:42:59.636+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-14T03:42:59.638+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-14T03:42:59.640+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-14T03:42:59.641+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-14T03:42:59.643+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-14T03:42:59.645+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-14T03:42:59.646+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-14T03:42:59.648+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-14T03:42:59.650+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-14T03:42:59.651+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-14T03:42:59.653+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-14T03:42:59.655+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-14T03:42:59.657+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-14T03:42:59.658+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-14T03:42:59.660+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-14T03:42:59.662+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-14T03:42:59.664+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-14T03:42:59.665+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-14T03:42:59.667+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-14T03:42:59.668+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-14T03:42:59.670+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-14T03:42:59.672+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-14T03:42:59.673+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-14T03:42:59.675+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-14T03:42:59.677+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-14T03:42:59.678+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-14T03:42:59.680+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-14T03:42:59.682+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-14T03:42:59.683+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-14T03:42:59.685+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-14T03:42:59.687+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-14T03:42:59.688+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-14T03:42:59.690+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-14T03:42:59.692+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-14T03:42:59.693+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-14T03:42:59.695+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-14T03:42:59.697+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-14T03:42:59.699+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-14T03:42:59.700+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-14T03:42:59.702+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-14T03:42:59.704+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-14T03:42:59.706+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-14T03:42:59.707+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-14T03:42:59.709+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-14T03:42:59.709+05:30 [Info] Actual variance of deferred index count across nodes is 8
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place 60 index instaces on 1 empty and 1 30 percent filled node - 1 SG
2023-09-14T03:42:59.711+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-14T03:42:59.713+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-14T03:42:59.715+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-14T03:42:59.716+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-14T03:42:59.718+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-14T03:42:59.720+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-14T03:42:59.721+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-14T03:42:59.723+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-14T03:42:59.725+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-14T03:42:59.726+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-14T03:42:59.728+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-14T03:42:59.730+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-14T03:42:59.731+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-14T03:42:59.733+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-14T03:42:59.735+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-14T03:42:59.736+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-14T03:42:59.738+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-14T03:42:59.740+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-14T03:42:59.741+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-14T03:42:59.743+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-14T03:42:59.745+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-14T03:42:59.746+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-14T03:42:59.748+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-14T03:42:59.750+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-14T03:42:59.752+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-14T03:42:59.755+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-14T03:42:59.757+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-14T03:42:59.761+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-14T03:42:59.764+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-14T03:42:59.767+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-14T03:42:59.776+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-14T03:42:59.781+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-14T03:42:59.790+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-14T03:42:59.793+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-14T03:42:59.801+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-14T03:42:59.805+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-14T03:42:59.809+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-14T03:42:59.812+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-14T03:42:59.815+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-14T03:42:59.819+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-14T03:42:59.827+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-14T03:42:59.831+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-14T03:42:59.836+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-14T03:42:59.839+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-14T03:42:59.841+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-14T03:42:59.843+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-14T03:42:59.848+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-14T03:42:59.855+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-14T03:42:59.858+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-14T03:42:59.860+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-14T03:42:59.868+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-14T03:42:59.872+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-14T03:42:59.877+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-14T03:42:59.879+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-14T03:42:59.883+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-14T03:42:59.887+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-14T03:42:59.890+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-14T03:42:59.893+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-14T03:42:59.900+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-14T03:42:59.904+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-14T03:42:59.904+05:30 [Info] Actual variance of deferred index count across nodes is 98
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place 5 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-09-14T03:42:59.907+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-14T03:42:59.910+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-14T03:42:59.912+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-14T03:42:59.915+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-14T03:42:59.920+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-14T03:42:59.920+05:30 [Info] Actual variance of deferred index count across nodes is 4.5
2023/09/14 03:42:59 -------------------------------------------
2023/09/14 03:42:59 Place 60 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-09-14T03:42:59.929+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-14T03:42:59.934+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-14T03:42:59.936+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-14T03:42:59.942+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-14T03:42:59.945+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-14T03:42:59.949+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-14T03:42:59.953+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-14T03:42:59.955+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-14T03:42:59.960+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-14T03:42:59.963+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-14T03:42:59.966+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-14T03:42:59.972+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-14T03:42:59.977+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-14T03:42:59.980+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-14T03:42:59.983+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-14T03:42:59.986+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-14T03:42:59.989+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-14T03:42:59.991+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-14T03:42:59.994+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-14T03:43:00.002+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-14T03:43:00.007+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-14T03:43:00.009+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-14T03:43:00.012+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-14T03:43:00.018+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-14T03:43:00.022+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-14T03:43:00.024+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-14T03:43:00.027+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-14T03:43:00.031+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-14T03:43:00.036+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-14T03:43:00.041+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-14T03:43:00.046+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-14T03:43:00.048+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-14T03:43:00.051+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-14T03:43:00.056+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-14T03:43:00.067+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-14T03:43:00.074+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-14T03:43:00.088+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-14T03:43:00.093+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-14T03:43:00.097+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-14T03:43:00.106+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-14T03:43:00.112+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-14T03:43:00.116+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-14T03:43:00.119+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-14T03:43:00.124+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-14T03:43:00.126+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-14T03:43:00.130+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-14T03:43:00.133+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-14T03:43:00.138+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-14T03:43:00.141+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-14T03:43:00.146+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-14T03:43:00.149+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-14T03:43:00.152+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-14T03:43:00.155+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-14T03:43:00.157+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-14T03:43:00.159+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-14T03:43:00.161+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-14T03:43:00.163+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-14T03:43:00.164+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-14T03:43:00.166+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-14T03:43:00.168+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-14T03:43:00.168+05:30 [Info] Actual variance of deferred index count across nodes is 648
--- PASS: TestGreedyPlanner (0.71s)
=== RUN TestTenantAwarePlanner
2023/09/14 03:43:00 In TestTenantAwarePlanner()
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 1 empty node - 1 SG
2023-09-14T03:43:00.172+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-09-14T03:43:00.172+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.172+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 empty nodes - 2 SG
2023-09-14T03:43:00.176+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9003 127.0.0.1:9002]]
2023-09-14T03:43:00.176+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.176+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9002]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 1 node - 1 SG
2023-09-14T03:43:00.179+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.179+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-09-14T03:43:00.179+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-09-14T03:43:00.179+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 2 nodes - 1 SG
2023-09-14T03:43:00.182+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.182+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.182+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-09-14T03:43:00.182+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-09-14T03:43:00.182+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(a)
2023-09-14T03:43:00.185+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.185+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.185+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9004 127.0.0.1:9003]]
2023-09-14T03:43:00.185+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9002]
2023-09-14T03:43:00.186+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(b)
2023-09-14T03:43:00.189+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.189+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.189+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9002]]
2023-09-14T03:43:00.189+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.189+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(c)
2023-09-14T03:43:00.192+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.192+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.192+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.192+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.192+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-14T03:43:00.192+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.192+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Memory Above LWM
2023-09-14T03:43:00.195+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.195+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-14T03:43:00.195+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.195+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-14T03:43:00.195+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.195+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.195+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Units Above LWM
2023-09-14T03:43:00.200+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.200+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-14T03:43:00.200+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.200+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5000 Tenants 0
2023-09-14T03:43:00.200+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.200+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.200+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(a)
2023-09-14T03:43:00.204+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.204+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-14T03:43:00.204+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.204+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-14T03:43:00.204+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.204+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.204+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(b)
2023-09-14T03:43:00.207+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.207+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-14T03:43:00.208+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.208+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-14T03:43:00.208+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.208+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.208+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Units HWM
2023-09-14T03:43:00.212+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 8000 Tenants 0
2023-09-14T03:43:00.212+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.212+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.212+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 8000 Tenants 0
2023-09-14T03:43:00.212+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-14T03:43:00.212+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.212+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-09-14T03:43:00.215+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-14T03:43:00.215+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-09-14T03:43:00.215+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-14T03:43:00.215+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-09-14T03:43:00.215+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.215+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.215+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-09-14T03:43:00.223+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.223+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.223+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.223+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-14T03:43:00.223+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.223+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-14T03:43:00.223+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.223+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-09-14T03:43:00.228+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.228+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.228+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.228+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.228+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-14T03:43:00.228+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.228+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-09-14T03:43:00.231+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.231+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.231+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.231+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-14T03:43:00.231+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.231+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-14T03:43:00.231+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.231+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-09-14T03:43:00.233+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.233+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.233+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.233+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.233+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-14T03:43:00.233+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.233+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 2 empty nodes - 1 SG
2023-09-14T03:43:00.236+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-09-14T03:43:00.236+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.236+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9002]
2023-09-14T03:43:00.236+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9001]
2023-09-14T03:43:00.236+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Unable to find any valid SubCluster
2023/09/14 03:43:00 Expected error Planner not able to find any node for placement - Unable to find any valid SubCluster
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Memory HWM
2023-09-14T03:43:00.237+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-09-14T03:43:00.237+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.237+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.237+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-09-14T03:43:00.237+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-14T03:43:00.237+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.237+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2023/09/14 03:43:00 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Memory Above LWM
2023-09-14T03:43:00.238+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 680000000 Units 1000 Tenants 0
2023-09-14T03:43:00.238+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-14T03:43:00.238+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 680000000 Units 1000 Tenants 0
2023-09-14T03:43:00.238+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-14T03:43:00.238+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.238+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-14T03:43:00.238+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2023/09/14 03:43:00 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-09-14T03:43:00.239+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-14T03:43:00.239+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-09-14T03:43:00.239+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 0 Units 4500 Tenants 0
2023-09-14T03:43:00.239+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-14T03:43:00.239+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-09-14T03:43:00.239+05:30 [Error] Planner::validateSubClusterGrouping Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/09/14 03:43:00 Expected error Planner Constraint Violation. Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-09-14T03:43:00.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-14T03:43:00.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/14 03:43:00 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-09-14T03:43:00.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.240+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.241+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/14 03:43:00 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-09-14T03:43:00.241+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.241+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.241+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-14T03:43:00.241+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-14T03:43:00.241+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/14 03:43:00 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-09-14T03:43:00.242+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.242+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.242+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9004 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/14 03:43:00 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 3 SG, 1 empty, 1 Memory Above HWM
2023-09-14T03:43:00.243+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.243+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-09-14T03:43:00.243+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.243+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-09-14T03:43:00.243+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.243+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.243+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.243+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500
2023-09-14T03:43:00.243+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.243+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 3 SG, 1 empty, 1 Units Above HWM
2023-09-14T03:43:00.244+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 8000 Tenants 0
2023-09-14T03:43:00.244+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 400000000 Units 1000 Tenants 0
2023-09-14T03:43:00.244+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 8000 Tenants 0
2023-09-14T03:43:00.244+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 400000000 Units 1000 Tenants 0
2023-09-14T03:43:00.244+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.244+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.244+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.244+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000
2023-09-14T03:43:00.244+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.244+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 3 SG, 1 empty, Both Memory/Units Above HWM
2023-09-14T03:43:00.245+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.245+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.245+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.245+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.245+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.245+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.246+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.246+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.246+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-14T03:43:00.246+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.246+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.246+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 3 SG, Multiple tenants to move, single source, multiple destination
2023-09-14T03:43:00.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.247+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.247+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.247+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.247+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.247+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000
2023-09-14T03:43:00.247+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000
2023-09-14T03:43:00.247+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.247+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.247+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 3 SG, Multiple tenants to move, no nodes below LWM
2023-09-14T03:43:00.248+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-14T03:43:00.248+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-09-14T03:43:00.248+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 700000000 Units 3000 Tenants 0
2023-09-14T03:43:00.248+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-14T03:43:00.248+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-09-14T03:43:00.248+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 700000000 Units 3000 Tenants 0
2023-09-14T03:43:00.248+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.248+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.248+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.248+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-09-14T03:43:00.248+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-09-14T03:43:00.248+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-09-14T03:43:00.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.249+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000
2023-09-14T03:43:00.249+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.249+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.249+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.249+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.249+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.249+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.250+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.250+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.250+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-09-14T03:43:00.251+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.251+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.251+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.251+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.251+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.251+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-14T03:43:00.251+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.251+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.251+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.251+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.251+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.251+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.251+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.251+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.251+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 3 SG, Single Large Tenant, Nothing to move
2023-09-14T03:43:00.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-09-14T03:43:00.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 2000 Tenants 0
2023-09-14T03:43:00.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-09-14T03:43:00.253+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 2000 Tenants 0
2023-09-14T03:43:00.253+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.253+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.253+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.253+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000
2023-09-14T03:43:00.253+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.253+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(zero usage tenants)
2023-09-14T03:43:00.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.255+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.255+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 3 SG, 1 Partial Subcluster
2023-09-14T03:43:00.256+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-09-14T03:43:00.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.257+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-09-14T03:43:00.257+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003]]
2023-09-14T03:43:00.257+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.257+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.257+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.257+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-09-14T03:43:00.257+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-09-14T03:43:00.257+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9003]
2023-09-14T03:43:00.257+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.257+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.257+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Replica Repair - 4 SG, Missing Replicas for multiple tenants in SG
2023-09-14T03:43:00.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.258+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.258+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.258+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-14T03:43:00.258+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-09-14T03:43:00.258+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-14T03:43:00.258+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-14T03:43:00.258+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over
2023-09-14T03:43:00.259+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.259+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.259+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.259+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.259+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.259+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-09-14T03:43:00.259+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9004
2023-09-14T03:43:00.259+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-14T03:43:00.259+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9004
2023-09-14T03:43:00.260+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-14T03:43:00.260+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-14T03:43:00.260+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.260+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over, No replacement
2023-09-14T03:43:00.260+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.260+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.260+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.260+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.260+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.260+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.260+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9001] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.261+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Replica Repair - 4 SG, Missing Replicas, one replica missing with pendingDelete true
2023-09-14T03:43:00.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.262+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.262+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.262+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-14T03:43:00.262+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-09-14T03:43:00.262+05:30 [Info] Planner::findMissingReplicaForIndexerNode Skipping Replica Repair for 88883:81813:0. PendingDelete true
2023-09-14T03:43:00.262+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx2,1) on 127.0.0.1:9005
2023-09-14T03:43:00.262+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Replica Repair - 2 SG, Missing Replicas with Nodes over HWM
2023-09-14T03:43:00.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 7000 Tenants 0
2023-09-14T03:43:00.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.263+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 7000 Tenants 0
2023-09-14T03:43:00.263+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.263+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket9,,,idx2,1) on 127.0.0.1:9005
2023-09-14T03:43:00.263+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.263+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-09-14T03:43:00.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700
2023-09-14T03:43:00.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-09-14T03:43:00.263+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000
2023-09-14T03:43:00.263+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.263+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes
2023-09-14T03:43:00.264+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9004]
2023-09-14T03:43:00.264+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9004]
2023-09-14T03:43:00.264+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9001]
2023-09-14T03:43:00.264+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006 127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.265+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9008 127.0.0.1:9006 127.0.0.1:9007]
2023-09-14T03:43:00.265+05:30 [Info] Moving index 7777:7171:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-14T03:43:00.265+05:30 [Info] Moving index 8888:8181:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-14T03:43:00.265+05:30 [Info] Moving index 9999:9191:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-14T03:43:00.265+05:30 [Info] Moving index 101010:101101:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-14T03:43:00.265+05:30 [Info] Moving index 111111:112112:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-14T03:43:00.265+05:30 [Info] Moving index 121212:121121:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-14T03:43:00.265+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.265+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.265+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.265+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.265+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.265+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.265+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-09-14T03:43:00.265+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-14T03:43:00.265+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.265+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.265+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.265+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 1100000000 Units 8100 Tenants 0
2023-09-14T03:43:00.265+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008] [127.0.0.1:9003 127.0.0.1:9005] [127.0.0.1:9006] [127.0.0.1:9007]]
2023-09-14T03:43:00.265+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9006] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.265+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.265+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes(different SG)
2023-09-14T03:43:00.266+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004 127.0.0.1:9005]
2023-09-14T03:43:00.266+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004 127.0.0.1:9005]
2023-09-14T03:43:00.266+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-14T03:43:00.266+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.266+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.266+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.266+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.266+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.266+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.266+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.266+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.266+05:30 [Info] Moving index 7777:17171:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-14T03:43:00.266+05:30 [Info] Moving index 8888:18181:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-14T03:43:00.266+05:30 [Info] Moving index 9999:19191:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-14T03:43:00.267+05:30 [Info] Moving index 101010:1101101:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-14T03:43:00.267+05:30 [Info] Moving index 111111:1112112:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-14T03:43:00.267+05:30 [Info] Moving index 121212:1121121:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-14T03:43:00.267+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-14T03:43:00.267+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-09-14T03:43:00.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.267+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.267+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9003] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.267+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Swap Rebalance - 4 SG, Swap 1 SG with 2 new nodes
2023-09-14T03:43:00.268+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.268+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.268+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-14T03:43:00.268+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.268+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.268+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-14T03:43:00.268+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-14T03:43:00.268+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-14T03:43:00.268+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-14T03:43:00.268+05:30 [Info] Moving index 5555:5151:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-14T03:43:00.268+05:30 [Info] Moving index 6666:6161:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-14T03:43:00.268+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.268+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.268+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.268+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.268+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.268+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.268+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-09-14T03:43:00.268+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-14T03:43:00.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.268+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.268+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.268+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Swap Rebalance - 4 SG, Swap 1 node with 2 new nodes
2023-09-14T03:43:00.269+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-14T03:43:00.269+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-14T03:43:00.269+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-14T03:43:00.269+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008 127.0.0.1:9006]
2023-09-14T03:43:00.269+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.269+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.269+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.269+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.269+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.269+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.269+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-14T03:43:00.269+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-14T03:43:00.269+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.270+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.270+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003] [127.0.0.1:9008] [127.0.0.1:9007]]
2023-09-14T03:43:00.270+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.270+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9008] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.270+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.270+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Swap Rebalance - 4 SG, Swap 1 empty node with 2 new nodes
2023-09-14T03:43:00.271+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-14T03:43:00.271+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-09-14T03:43:00.271+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-14T03:43:00.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.271+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.271+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-09-14T03:43:00.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9006
2023-09-14T03:43:00.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9006
2023-09-14T03:43:00.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9006
2023-09-14T03:43:00.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9006
2023-09-14T03:43:00.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9006
2023-09-14T03:43:00.271+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket6,,,idx2,1) on 127.0.0.1:9006
2023-09-14T03:43:00.271+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.271+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Swap Rebalance - 1 SG, Swap 1 node - Failed swap rebalance
2023-09-14T03:43:00.272+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-14T03:43:00.272+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-14T03:43:00.272+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-14T03:43:00.272+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.272+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-14T03:43:00.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-14T03:43:00.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.272+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9008 as replacement node for deleted node 127.0.0.1:9004.
2023-09-14T03:43:00.272+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.272+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.272+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.272+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.272+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 600000000 Units 4000
2023-09-14T03:43:00.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.272+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 500000000 Units 4100 Tenants 0
2023-09-14T03:43:00.272+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008]]
2023-09-14T03:43:00.272+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Swap Rebalance - 1 SG, Swap 2 node - server group mismatch
2023-09-14T03:43:00.273+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-14T03:43:00.273+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-14T03:43:00.273+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9002 127.0.0.1:9001]
2023-09-14T03:43:00.273+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9004]
2023/09/14 03:43:00 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 subcluster, Enough Capacity
2023-09-14T03:43:00.274+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.274+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.275+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 600000000 Units 4500 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 600000000 Units 4500 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 600000000 Units 4100 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 600000000 Units 4100 Tenants 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.275+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity
2023-09-14T03:43:00.276+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-14T03:43:00.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-14T03:43:00.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.276+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.276+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 on any target
2023-09-14T03:43:00.276+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 on any target
2023-09-14T03:43:00.276+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 on any target
2023-09-14T03:43:00.276+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.276+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.276+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/14 03:43:00 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 node, Pair node not deleted(Failed swap rebalance of 1 node)
2023-09-14T03:43:00.278+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001]
2023-09-14T03:43:00.278+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001]
2023-09-14T03:43:00.278+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004]
2023-09-14T03:43:00.278+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.278+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9009 as replacement node for deleted node 127.0.0.1:9001.
2023-09-14T03:43:00.278+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-14T03:43:00.278+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-14T03:43:00.278+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-14T03:43:00.278+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-14T03:43:00.278+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 600000000 Units 4000
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 500000000 Units 4100 Tenants 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9004 127.0.0.1:9009] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9004 127.0.0.1:9009]]
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9009]
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.278+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.278+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 node, Pair node already deleted
2023-09-14T03:43:00.279+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002]
2023-09-14T03:43:00.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002]
2023-09-14T03:43:00.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes []
2023-09-14T03:43:00.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-14T03:43:00.279+05:30 [Info] Planner::moveTenantsFromDeletedNodes Pair node not found for deleted node 127.0.0.1:9002.
2023-09-14T03:43:00.279+05:30 [Error] Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/09/14 03:43:00 Expected error Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 subcluster, empty nodes
2023-09-14T03:43:00.280+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9005 127.0.0.1:9007 127.0.0.1:9008]
2023-09-14T03:43:00.280+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-09-14T03:43:00.280+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-09-14T03:43:00.280+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-09-14T03:43:00.280+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-09-14T03:43:00.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-14T03:43:00.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 800000000 Units 7000 Tenants 0
2023-09-14T03:43:00.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-14T03:43:00.280+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.280+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.280+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9002] with len 1. Skipping replica repair attempt.
2023-09-14T03:43:00.280+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 subcluster, Deleted Nodes more than added nodes
2023-09-14T03:43:00.281+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.281+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.281+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-14T03:43:00.281+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-09-14T03:43:00.281+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 1
2023-09-14T03:43:00.281+05:30 [Error] Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/09/14 03:43:00 Expected error Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 node, Add 1 node in, server group mismatch
2023-09-14T03:43:00.281+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9006]
2023-09-14T03:43:00.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9006]
2023-09-14T03:43:00.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9003]
2023-09-14T03:43:00.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9007]
2023/09/14 03:43:00 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 node, Pair node exists
2023-09-14T03:43:00.282+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-14T03:43:00.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-14T03:43:00.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-14T03:43:00.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-14T03:43:00.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-14T03:43:00.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.282+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.282+05:30 [Info] Planner::moveTenantsFromDeletedNodes No replacement node found for deleted node 127.0.0.1:9004.
2023-09-14T03:43:00.282+05:30 [Error] Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/09/14 03:43:00 Expected error Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 subcluster, No nodes under LWM
2023-09-14T03:43:00.283+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-14T03:43:00.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-14T03:43:00.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-14T03:43:00.283+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.283+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-14T03:43:00.283+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/14 03:43:00 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity, Partial Subcluster
2023-09-14T03:43:00.284+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.284+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.284+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-14T03:43:00.284+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.284+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-14T03:43:00.284+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.284+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 100000000 UnitsUsage 500
2023-09-14T03:43:00.284+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 500
2023-09-14T03:43:00.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 200000000 Units 1000
2023-09-14T03:43:00.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 200000000 Units 1000
2023-09-14T03:43:00.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.284+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-14T03:43:00.284+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9006]
2023-09-14T03:43:00.284+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-14T03:43:00.284+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/14 03:43:00 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 2 SG, Move out 1 non-empty and 1 empty node
2023-09-14T03:43:00.285+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9007 127.0.0.1:9004]
2023-09-14T03:43:00.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-14T03:43:00.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-14T03:43:00.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-09-14T03:43:00.285+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9008]
2023-09-14T03:43:00.285+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.285+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.285+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.285+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.285+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.285+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.285+05:30 [Info] Moving index 171717:1171171:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.285+05:30 [Info] Moving index 141414:1141141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-14T03:43:00.285+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 0 Units 0
2023-09-14T03:43:00.285+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-14T03:43:00.285+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-14T03:43:00.285+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-14T03:43:00.285+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9008 127.0.0.1:9001]]
2023-09-14T03:43:00.285+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM
2023-09-14T03:43:00.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.286+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.286+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-14T03:43:00.286+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.286+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.286+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-14T03:43:00.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-14T03:43:00.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-14T03:43:00.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-14T03:43:00.286+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-14T03:43:00.286+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.286+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 2 Subclusters, 1 below LWM, 1 above HWM
2023-09-14T03:43:00.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.287+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.287+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.287+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.287+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.287+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-14T03:43:00.287+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.287+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.287+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-14T03:43:00.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-14T03:43:00.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 600000000 Units 4000 Tenants 0
2023-09-14T03:43:00.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-14T03:43:00.287+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 600000000 Units 4000 Tenants 0
2023-09-14T03:43:00.287+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.287+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 3 Subclusters, 1 empty, 1 Above HWM, 1 below LWM
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.289+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.289+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.289+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-14T03:43:00.289+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.289+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.289+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.289+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.289+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-09-14T03:43:00.289+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-09-14T03:43:00.289+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-14T03:43:00.289+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 2 Subclusters, 1 above LWM/below HWM, 1 empty
2023-09-14T03:43:00.290+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-14T03:43:00.290+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-14T03:43:00.290+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.290+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 2 Subclusters, Both above LWM/below HWM
2023-09-14T03:43:00.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-14T03:43:00.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-09-14T03:43:00.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-14T03:43:00.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-09-14T03:43:00.291+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.291+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-14T03:43:00.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-14T03:43:00.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-09-14T03:43:00.291+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-14T03:43:00.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-09-14T03:43:00.292+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.292+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM (partial replica repair)
2023-09-14T03:43:00.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.292+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 550000000 Units 5500 Tenants 0
2023-09-14T03:43:00.292+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.293+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-09-14T03:43:00.293+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-09-14T03:43:00.293+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.293+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.293+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.293+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-14T03:43:00.293+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.293+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.293+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-14T03:43:00.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-14T03:43:00.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-14T03:43:00.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-14T03:43:00.293+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-14T03:43:00.293+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.293+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM(full replica repair)
2023-09-14T03:43:00.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-14T03:43:00.294+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.294+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx1,1) on 127.0.0.1:9001
2023-09-14T03:43:00.294+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9001
2023-09-14T03:43:00.294+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx1,1) on 127.0.0.1:9001
2023-09-14T03:43:00.294+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9001
2023-09-14T03:43:00.294+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9001
2023-09-14T03:43:00.294+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,1) on 127.0.0.1:9001
2023-09-14T03:43:00.294+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9004 127.0.0.1:9001]]
2023-09-14T03:43:00.294+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9001]
2023-09-14T03:43:00.294+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.294+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-14T03:43:00.294+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.294+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.294+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-14T03:43:00.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-14T03:43:00.294+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-14T03:43:00.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-14T03:43:00.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-14T03:43:00.295+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.295+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 ScaleIn- 2 Subclusters, Both below LWM, Positive Case
2023-09-14T03:43:00.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.295+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.296+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.296+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.296+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-09-14T03:43:00.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2023-09-14T03:43:00.296+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-14T03:43:00.296+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.296+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9003 SG sg1 Memory 0 Units 0
2023-09-14T03:43:00.296+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9006 SG sg3 Memory 0 Units 0
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 ScaleIn- 2 Subclusters, One below LWM/ 1 Empty
2023-09-14T03:43:00.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-14T03:43:00.297+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.297+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. No ScaleIn.
2023-09-14T03:43:00.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-14T03:43:00.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-14T03:43:00.297+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.297+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.297+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.297+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.298+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.298+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-09-14T03:43:00.298+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.298+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.298+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.298+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.298+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-09-14T03:43:00.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-09-14T03:43:00.298+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.298+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-14T03:43:00.298+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. ScaleIn.
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.299+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.299+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.299+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-14T03:43:00.299+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-09-14T03:43:00.299+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.299+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.299+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.299+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.299+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.299+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.299+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-09-14T03:43:00.299+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-14T03:43:00.299+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-14T03:43:00.299+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-09-14T03:43:00.299+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-14T03:43:00.299+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-09-14T03:43:00.299+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-09-14T03:43:00.299+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Rebalance - 1 Subcluster, Below HWM (partial replica repair)
2023-09-14T03:43:00.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-09-14T03:43:00.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 350000000 Units 500 Tenants 0
2023-09-14T03:43:00.300+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.300+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-09-14T03:43:00.300+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-09-14T03:43:00.300+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-14T03:43:00.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-09-14T03:43:00.300+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 500000000 Units 800 Tenants 0
2023-09-14T03:43:00.300+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-14T03:43:00.300+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Resume - 1 tenant, Empty node in cluster.
2023-09-14T03:43:00.301+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-14T03:43:00.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.301+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.301+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.301+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-14T03:43:00.302+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-14T03:43:00.302+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Resume - 1 tenant, No empty node in cluster.
2023-09-14T03:43:00.303+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-14T03:43:00.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.304+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.304+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.304+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-14T03:43:00.304+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.304+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Resume - 1 tenant, No node below LWM in the cluster.
2023-09-14T03:43:00.305+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-14T03:43:00.305+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.305+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 5000 Tenants 0
2023-09-14T03:43:00.306+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 5000 Tenants 0
2023-09-14T03:43:00.306+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.306+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-14T03:43:00.306+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM []
2023/09/14 03:43:00 Expected error No SubCluster Below Low Usage Threshold
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Resume - 1 tenant, Not enough capacity in the cluster.
2023-09-14T03:43:00.307+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-14T03:43:00.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-14T03:43:00.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-14T03:43:00.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.307+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-14T03:43:00.307+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.307+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250
2023-09-14T03:43:00.307+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-09-14T03:43:00.307+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250 on any target
2023/09/14 03:43:00 Expected error Not Enough Capacity To Place Tenant
--- PASS: TestTenantAwarePlanner (0.14s)
=== RUN TestPlanDuringHeterogenousScaleup
2023/09/14 03:43:00 In TestPlanDuringHeterogenousScaleup()
=== RUN TestPlanDuringHeterogenousScaleup/GreedyPlanner
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-14T03:43:00.309+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-14T03:43:00.311+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-14T03:43:00.313+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-09-14T03:43:00.316+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-09-14T03:43:00.318+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-14T03:43:00.320+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-09-14T03:43:00.322+05:30 [Info] Using greedy index placement for index 987654
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-09-14T03:43:00.324+05:30 [Info] Using greedy index placement for index 987654
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-14T03:43:00.326+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.2180081556498616
2023-09-14T03:43:00.424+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:00.424+05:30 [Info] Score: 0.5118702120133598
2023-09-14T03:43:00.424+05:30 [Info] variation: 1.0237404240267196
2023-09-14T03:43:00.424+05:30 [Info] ElapsedTime: 98ms
2023-09-14T03:43:00.424+05:30 [Info] ConvergenceTime: 96ms
2023-09-14T03:43:00.424+05:30 [Info] Iteration: 6800
2023-09-14T03:43:00.424+05:30 [Info] Move: 3880
2023-09-14T03:43:00.424+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.424+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.424+05:30 [Info] Indexer Memory Mean 126888575449 (118.174G)
2023-09-14T03:43:00.424+05:30 [Info] Indexer Memory Deviation 80354383758 (74.8359G) (63.33%)
2023-09-14T03:43:00.424+05:30 [Info] Indexer Memory Utilization 2.3004
2023-09-14T03:43:00.424+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:00.424+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:00.424+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:00.424+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.424+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.424+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.424+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.424+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.424+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.424+05:30 [Info] Indexer Data Size Mean 18082106963 (16.8403G)
2023-09-14T03:43:00.424+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (141.42%)
2023-09-14T03:43:00.424+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.424+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.424+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.424+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.424+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.424+05:30 [Info] Number of indexes: 13
2023-09-14T03:43:00.424+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.424+05:30 [Info] Avg Index Size: 29281978949 (27.271G)
2023-09-14T03:43:00.424+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:00.424+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-14T03:43:00.424+05:30 [Info] Avg Index Cpu: 3.5385
2023-09-14T03:43:00.424+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:00.424+05:30 [Info] Num Estimation Run: 11
2023-09-14T03:43:00.424+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.424+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:00.424+05:30 [Info] CPU Quota 27
2023-09-14T03:43:00.424+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.424+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.424+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.424+05:30 [Info] Total iteration: 6810
2023-09-14T03:43:00.425+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.425+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.425+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.425+05:30 [Info] RandomMove time: 0ns
2023-09-14T03:43:00.425+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-14T03:43:00.425+05:30 [Info] ExhaustMove time: 41ms
2023-09-14T03:43:00.425+05:30 [Info] ExhaustMove call: 6810
2023-09-14T03:43:00.425+05:30 [Info] ExhaustMove average time: 6us
2023-09-14T03:43:00.425+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.425+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.425+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.425+05:30 [Info]
2023-09-14T03:43:00.425+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:00.425+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-14T03:43:00.425+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.37390490588193165 allowDDLDuringScaleup:true
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info]
2023-09-14T03:43:00.425+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:00.425+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.425+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7501886306380632 allowDDLDuringScaleup:true
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:17456336713219527771, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info]
2023-09-14T03:43:00.425+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:00.425+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:0 (0), data:0 (0) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-14T03:43:00.425+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.07590646348000514 allowDDLDuringScaleup:true
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.425+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.425+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.425+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.425+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-14T03:43:00.428+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6856271841119315
2023-09-14T03:43:00.492+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:00.492+05:30 [Info] Score: 0.28937833136341934
2023-09-14T03:43:00.492+05:30 [Info] variation: 0.5787566627268387
2023-09-14T03:43:00.492+05:30 [Info] ElapsedTime: 64ms
2023-09-14T03:43:00.492+05:30 [Info] ConvergenceTime: 62ms
2023-09-14T03:43:00.492+05:30 [Info] Iteration: 4200
2023-09-14T03:43:00.492+05:30 [Info] Move: 2594
2023-09-14T03:43:00.492+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.492+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.492+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-14T03:43:00.492+05:30 [Info] Indexer Memory Deviation 65295744085 (60.8114G) (45.04%)
2023-09-14T03:43:00.492+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-14T03:43:00.492+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:00.492+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:00.492+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:00.492+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.492+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.492+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.492+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.492+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.492+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.492+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-14T03:43:00.492+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-14T03:43:00.492+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.492+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.492+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.492+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.492+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.492+05:30 [Info] Number of indexes: 14
2023-09-14T03:43:00.492+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.492+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-09-14T03:43:00.492+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:00.492+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-14T03:43:00.492+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-14T03:43:00.492+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:00.492+05:30 [Info] Num Estimation Run: 11
2023-09-14T03:43:00.492+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:00.493+05:30 [Info] CPU Quota 27
2023-09-14T03:43:00.493+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.493+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.493+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Total iteration: 4500
2023-09-14T03:43:00.493+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.493+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.493+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.493+05:30 [Info] RandomMove time: 21ms
2023-09-14T03:43:00.493+05:30 [Info] RandomMove call: 4199 (empty index 0)
2023-09-14T03:43:00.493+05:30 [Info] RandomMove average time: 5us
2023-09-14T03:43:00.493+05:30 [Info] ExhaustMove time: 7us
2023-09-14T03:43:00.493+05:30 [Info] ExhaustMove call: 1
2023-09-14T03:43:00.493+05:30 [Info] ExhaustMove average time: 7us
2023-09-14T03:43:00.493+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.493+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.493+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.493+05:30 [Info]
2023-09-14T03:43:00.493+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:00.493+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-14T03:43:00.493+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32726796943638176 allowDDLDuringScaleup:true
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.493+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.493+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.493+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.493+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.493+05:30 [Info]
2023-09-14T03:43:00.493+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:00.493+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.493+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.493+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.493+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.493+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.493+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.493+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.493+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:15473477902532172413, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.493+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.494+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.494+05:30 [Info]
2023-09-14T03:43:00.494+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:00.494+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.494+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-14T03:43:00.494+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.494+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.494+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.494+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.494+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.494+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.494+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.494+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.494+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.494+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.494+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.494+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.494+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.494+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.494+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.494+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.494+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.494+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:15473477902532172413, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.494+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.494+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-14T03:43:00.496+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5390079019871991
2023-09-14T03:43:00.500+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-14T03:43:00.500+05:30 [Info] Score: 0.13929460298637122
2023-09-14T03:43:00.500+05:30 [Info] variation: 0.27858920597274245
2023-09-14T03:43:00.500+05:30 [Info] ElapsedTime: 3ms
2023-09-14T03:43:00.500+05:30 [Info] ConvergenceTime: 1ms
2023-09-14T03:43:00.500+05:30 [Info] Iteration: 1
2023-09-14T03:43:00.500+05:30 [Info] Move: 1
2023-09-14T03:43:00.500+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.500+05:30 [Info] Indexer Memory Mean 163052789375 (151.855G)
2023-09-14T03:43:00.500+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (55.72%)
2023-09-14T03:43:00.500+05:30 [Info] Indexer Memory Utilization 2.9561
2023-09-14T03:43:00.500+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:00.500+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:00.500+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:00.500+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.500+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.500+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.500+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.500+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.500+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.500+05:30 [Info] Indexer Data Size Mean 54246320889 (50.5208G)
2023-09-14T03:43:00.500+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:43:00.500+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.500+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.500+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.500+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.500+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Number of indexes: 15
2023-09-14T03:43:00.500+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.500+05:30 [Info] Avg Index Size: 21761293697 (20.2668G)
2023-09-14T03:43:00.500+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:00.500+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-14T03:43:00.500+05:30 [Info] Avg Index Cpu: 3.0667
2023-09-14T03:43:00.500+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:00.500+05:30 [Info] Num Estimation Run: 230
2023-09-14T03:43:00.500+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:00.500+05:30 [Info] CPU Quota 27
2023-09-14T03:43:00.500+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.500+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.500+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Total iteration: 521
2023-09-14T03:43:00.500+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.500+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.500+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.500+05:30 [Info] RandomMove time: 7us
2023-09-14T03:43:00.500+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-09-14T03:43:00.500+05:30 [Info] RandomMove average time: 7us
2023-09-14T03:43:00.500+05:30 [Info] ExhaustMove time: 1ms
2023-09-14T03:43:00.500+05:30 [Info] ExhaustMove call: 220
2023-09-14T03:43:00.500+05:30 [Info] ExhaustMove average time: 4us
2023-09-14T03:43:00.500+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.500+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.500+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.500+05:30 [Info]
2023-09-14T03:43:00.500+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:00.500+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.500+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5575132033129112 allowDDLDuringScaleup:true
2023-09-14T03:43:00.500+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.500+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.500+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.500+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.500+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.500+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.500+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.500+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.500+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.500+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.500+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.500+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.500+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:5447778551137487408, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.500+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.500+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.500+05:30 [Info]
2023-09-14T03:43:00.500+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:00.500+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.500+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.3168776165275712 allowDDLDuringScaleup:true
2023-09-14T03:43:00.500+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.500+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.500+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:5447778551137487408, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info]
2023-09-14T03:43:00.501+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:00.501+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.501+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3256091801595177 allowDDLDuringScaleup:true
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.501+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.501+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:5447778551137487408, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.501+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.501+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-09-14T03:43:00.503+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0155476961840748
2023-09-14T03:43:00.697+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:00.697+05:30 [Info] Score: 0.358469577773188
2023-09-14T03:43:00.697+05:30 [Info] variation: 0.716939155546376
2023-09-14T03:43:00.697+05:30 [Info] ElapsedTime: 193ms
2023-09-14T03:43:00.697+05:30 [Info] ConvergenceTime: 189ms
2023-09-14T03:43:00.697+05:30 [Info] Iteration: 7600
2023-09-14T03:43:00.697+05:30 [Info] Move: 5770
2023-09-14T03:43:00.697+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.697+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.697+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-14T03:43:00.697+05:30 [Info] Indexer Memory Deviation 105360564648 (98.1247G) (72.68%)
2023-09-14T03:43:00.697+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-14T03:43:00.697+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:00.697+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:00.697+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:00.697+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.697+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.697+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.697+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.697+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.697+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.697+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-14T03:43:00.697+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-14T03:43:00.697+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.697+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.697+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.697+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.697+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.697+05:30 [Info] Number of indexes: 14
2023-09-14T03:43:00.697+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.697+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-09-14T03:43:00.697+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:00.697+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-14T03:43:00.697+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-14T03:43:00.697+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:00.697+05:30 [Info] Num Estimation Run: 11
2023-09-14T03:43:00.697+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.697+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:00.697+05:30 [Info] CPU Quota 27
2023-09-14T03:43:00.697+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.697+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.697+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.697+05:30 [Info] Total iteration: 19926
2023-09-14T03:43:00.697+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.697+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.697+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.697+05:30 [Info] RandomMove time: 44ms
2023-09-14T03:43:00.697+05:30 [Info] RandomMove call: 7599 (empty index 0)
2023-09-14T03:43:00.697+05:30 [Info] RandomMove average time: 5us
2023-09-14T03:43:00.697+05:30 [Info] ExhaustMove time: 125us
2023-09-14T03:43:00.697+05:30 [Info] ExhaustMove call: 11
2023-09-14T03:43:00.697+05:30 [Info] ExhaustMove average time: 11us
2023-09-14T03:43:00.697+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.697+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.697+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.697+05:30 [Info]
2023-09-14T03:43:00.697+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:00.697+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.697+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7021056124497257 allowDDLDuringScaleup:true
2023-09-14T03:43:00.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.697+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.697+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.697+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.697+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:2578552179227791152, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info]
2023-09-14T03:43:00.698+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:00.698+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.698+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:2578552179227791152, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info]
2023-09-14T03:43:00.698+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:00.698+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:0 (0), data:0 (0) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-14T03:43:00.698+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.06643869545280173 allowDDLDuringScaleup:true
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.698+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.698+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.698+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.698+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-09-14T03:43:00.701+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3952038770958589
2023-09-14T03:43:00.705+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-14T03:43:00.705+05:30 [Info] Score: 0.36056429186996203
2023-09-14T03:43:00.705+05:30 [Info] variation: 0.7211285837399241
2023-09-14T03:43:00.705+05:30 [Info] ElapsedTime: 3ms
2023-09-14T03:43:00.705+05:30 [Info] ConvergenceTime: 1ms
2023-09-14T03:43:00.705+05:30 [Info] Iteration: 1
2023-09-14T03:43:00.705+05:30 [Info] Move: 1
2023-09-14T03:43:00.705+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.705+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.705+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-14T03:43:00.705+05:30 [Info] Indexer Memory Deviation 106575253176 (99.2559G) (73.52%)
2023-09-14T03:43:00.705+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-14T03:43:00.705+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:00.705+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:00.705+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:00.705+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.705+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.705+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.705+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.705+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.705+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.705+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-14T03:43:00.705+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-14T03:43:00.705+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.705+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.705+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.705+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.705+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.705+05:30 [Info] Number of indexes: 14
2023-09-14T03:43:00.705+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.705+05:30 [Info] Avg Index Size: 23315671818 (21.7144G)
2023-09-14T03:43:00.705+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:00.705+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-14T03:43:00.705+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-14T03:43:00.705+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:00.705+05:30 [Info] Num Estimation Run: 230
2023-09-14T03:43:00.705+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.705+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:00.705+05:30 [Info] CPU Quota 27
2023-09-14T03:43:00.705+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.705+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.705+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.705+05:30 [Info] Total iteration: 522
2023-09-14T03:43:00.705+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.705+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.705+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.705+05:30 [Info] RandomMove time: 8us
2023-09-14T03:43:00.705+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-09-14T03:43:00.705+05:30 [Info] RandomMove average time: 8us
2023-09-14T03:43:00.705+05:30 [Info] ExhaustMove time: 1ms
2023-09-14T03:43:00.705+05:30 [Info] ExhaustMove call: 220
2023-09-14T03:43:00.705+05:30 [Info] ExhaustMove average time: 5us
2023-09-14T03:43:00.705+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.705+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.705+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.706+05:30 [Info]
2023-09-14T03:43:00.706+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:00.706+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.706+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7021056124497257 allowDDLDuringScaleup:true
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:1351178562227543686, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info]
2023-09-14T03:43:00.706+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:00.706+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:0 (0), data:0 (0) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-14T03:43:00.706+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.05661804908412874 allowDDLDuringScaleup:true
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info]
2023-09-14T03:43:00.706+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:00.706+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-14T03:43:00.706+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.706+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.706+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.706+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.706+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.707+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.707+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.707+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.707+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.707+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.707+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.707+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.707+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.707+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:1351178562227543686, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.707+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.707+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-14T03:43:00.709+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.9611163603287702
2023-09-14T03:43:00.709+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-14T03:43:00.709+05:30 [Info] Score: 0.4863052536963559
2023-09-14T03:43:00.709+05:30 [Info] variation: 0.9726105073927118
2023-09-14T03:43:00.709+05:30 [Info] ElapsedTime: 251us
2023-09-14T03:43:00.709+05:30 [Info] ConvergenceTime: 195us
2023-09-14T03:43:00.709+05:30 [Info] Iteration: 1
2023-09-14T03:43:00.709+05:30 [Info] Move: 1
2023-09-14T03:43:00.709+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.709+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.709+05:30 [Info] Indexer Memory Mean 14745215094 (13.7326G)
2023-09-14T03:43:00.709+05:30 [Info] Indexer Memory Deviation 7829819102 (7.29209G) (53.10%)
2023-09-14T03:43:00.709+05:30 [Info] Indexer Memory Utilization 1.6384
2023-09-14T03:43:00.709+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-14T03:43:00.709+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-14T03:43:00.709+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-14T03:43:00.709+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.709+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.709+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.709+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.709+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.709+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.709+05:30 [Info] Indexer Data Size Mean 2745215094 (2.55668G)
2023-09-14T03:43:00.709+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (141.42%)
2023-09-14T03:43:00.709+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.709+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.709+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.709+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.709+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.709+05:30 [Info] Number of indexes: 4
2023-09-14T03:43:00.709+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.709+05:30 [Info] Avg Index Size: 11058911320 (10.2994G)
2023-09-14T03:43:00.710+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-14T03:43:00.710+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-14T03:43:00.710+05:30 [Info] Avg Index Cpu: 0.7500
2023-09-14T03:43:00.710+05:30 [Info] Max Index Cpu: 1.0000
2023-09-14T03:43:00.710+05:30 [Info] Num Estimation Run: 7
2023-09-14T03:43:00.710+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.710+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-14T03:43:00.710+05:30 [Info] CPU Quota 8
2023-09-14T03:43:00.710+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.710+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.710+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.710+05:30 [Info] Total iteration: 8
2023-09-14T03:43:00.710+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.710+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.710+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.710+05:30 [Info] RandomMove time: 0ns
2023-09-14T03:43:00.710+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-14T03:43:00.710+05:30 [Info] ExhaustMove time: 60us
2023-09-14T03:43:00.710+05:30 [Info] ExhaustMove call: 8
2023-09-14T03:43:00.710+05:30 [Info] ExhaustMove average time: 7us
2023-09-14T03:43:00.710+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.710+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.710+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.710+05:30 [Info]
2023-09-14T03:43:00.710+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-14T03:43:00.710+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:00.710+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.3390930527717129 allowDDLDuringScaleup:true
2023-09-14T03:43:00.710+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.710+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.710+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.710+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.710+05:30 [Info]
2023-09-14T03:43:00.710+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-14T03:43:00.710+05:30 [Info] Indexer total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:0 (0), data:0 (0) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:00.710+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0813823326652111 allowDDLDuringScaleup:true
2023-09-14T03:43:00.710+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.710+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.710+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.710+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.710+05:30 [Info]
2023-09-14T03:43:00.710+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-14T03:43:00.710+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:00.710+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.779524614563076 allowDDLDuringScaleup:true
2023-09-14T03:43:00.710+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.710+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.710+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.710+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.710+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.710+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:9524986768125657275, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.710+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.710+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-09-14T03:43:00.712+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-14T03:43:00.712+05:30 [Warn] Definition 987654 Instance 2735229017035723342 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-09-14T03:43:00.712+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-14T03:43:00.712+05:30 [Warn] Definition 987654 Instance 2735229017035723342 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-09-14T03:43:00.713+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3967837224306421
2023-09-14T03:43:00.769+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:00.769+05:30 [Info] Score: 0.25290029571859646
2023-09-14T03:43:00.769+05:30 [Info] variation: 0.5058005914371929
2023-09-14T03:43:00.769+05:30 [Info] ElapsedTime: 56ms
2023-09-14T03:43:00.769+05:30 [Info] ConvergenceTime: 55ms
2023-09-14T03:43:00.769+05:30 [Info] Iteration: 3800
2023-09-14T03:43:00.769+05:30 [Info] Move: 2361
2023-09-14T03:43:00.769+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.769+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.769+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-09-14T03:43:00.769+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-09-14T03:43:00.769+05:30 [Info] Indexer Memory Utilization 1.9434
2023-09-14T03:43:00.769+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-14T03:43:00.769+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-14T03:43:00.769+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-14T03:43:00.769+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.769+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.770+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.770+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.770+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.770+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.770+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-09-14T03:43:00.770+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-09-14T03:43:00.770+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.770+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.770+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.770+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.770+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.770+05:30 [Info] Number of indexes: 5
2023-09-14T03:43:00.770+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.770+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-09-14T03:43:00.770+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-14T03:43:00.770+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-14T03:43:00.770+05:30 [Info] Avg Index Cpu: 0.6000
2023-09-14T03:43:00.770+05:30 [Info] Max Index Cpu: 1.0000
2023-09-14T03:43:00.770+05:30 [Info] Num Estimation Run: 7
2023-09-14T03:43:00.770+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.770+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-14T03:43:00.770+05:30 [Info] CPU Quota 8
2023-09-14T03:43:00.770+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.770+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.770+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.770+05:30 [Info] Total iteration: 3980
2023-09-14T03:43:00.770+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.770+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.770+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.770+05:30 [Info] RandomMove time: 18ms
2023-09-14T03:43:00.770+05:30 [Info] RandomMove call: 3799 (empty index 0)
2023-09-14T03:43:00.770+05:30 [Info] RandomMove average time: 4us
2023-09-14T03:43:00.770+05:30 [Info] ExhaustMove time: 8us
2023-09-14T03:43:00.770+05:30 [Info] ExhaustMove call: 1
2023-09-14T03:43:00.770+05:30 [Info] ExhaustMove average time: 8us
2023-09-14T03:43:00.770+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.770+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.770+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.770+05:30 [Info]
2023-09-14T03:43:00.770+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-14T03:43:00.770+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:00.770+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-09-14T03:43:00.770+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.770+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.770+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.770+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.770+05:30 [Info]
2023-09-14T03:43:00.770+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-14T03:43:00.770+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:00.770+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-09-14T03:43:00.770+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.770+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.770+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.770+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.770+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.770+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:2735229017035723342, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.770+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.770+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.770+05:30 [Info]
2023-09-14T03:43:00.770+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-14T03:43:00.770+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:00.770+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-09-14T03:43:00.770+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.771+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.771+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.771+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.771+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.771+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:2735229017035723342, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.771+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.771+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-09-14T03:43:00.773+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-14T03:43:00.773+05:30 [Warn] Definition 987654 Instance 10228433250455900565 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-09-14T03:43:00.773+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-14T03:43:00.773+05:30 [Warn] Definition 987654 Instance 10228433250455900565 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-09-14T03:43:00.773+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6782899285088768
2023-09-14T03:43:00.828+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:00.828+05:30 [Info] Score: 0.25290029571859646
2023-09-14T03:43:00.828+05:30 [Info] variation: 0.5058005914371929
2023-09-14T03:43:00.828+05:30 [Info] ElapsedTime: 54ms
2023-09-14T03:43:00.828+05:30 [Info] ConvergenceTime: 53ms
2023-09-14T03:43:00.828+05:30 [Info] Iteration: 3700
2023-09-14T03:43:00.828+05:30 [Info] Move: 2419
2023-09-14T03:43:00.828+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.828+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.828+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-09-14T03:43:00.828+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-09-14T03:43:00.828+05:30 [Info] Indexer Memory Utilization 1.9434
2023-09-14T03:43:00.828+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-14T03:43:00.828+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-14T03:43:00.828+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-14T03:43:00.828+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.828+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.828+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.828+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.828+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.828+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.828+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-09-14T03:43:00.828+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-09-14T03:43:00.828+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.828+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.828+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.828+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.828+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.828+05:30 [Info] Number of indexes: 5
2023-09-14T03:43:00.828+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.828+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-09-14T03:43:00.828+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-14T03:43:00.828+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-14T03:43:00.828+05:30 [Info] Avg Index Cpu: 0.6000
2023-09-14T03:43:00.828+05:30 [Info] Max Index Cpu: 1.0000
2023-09-14T03:43:00.828+05:30 [Info] Num Estimation Run: 7
2023-09-14T03:43:00.828+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.828+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-14T03:43:00.828+05:30 [Info] CPU Quota 8
2023-09-14T03:43:00.828+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.828+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.828+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.828+05:30 [Info] Total iteration: 3880
2023-09-14T03:43:00.828+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.828+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.828+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.828+05:30 [Info] RandomMove time: 17ms
2023-09-14T03:43:00.828+05:30 [Info] RandomMove call: 3699 (empty index 0)
2023-09-14T03:43:00.828+05:30 [Info] RandomMove average time: 4us
2023-09-14T03:43:00.828+05:30 [Info] ExhaustMove time: 6us
2023-09-14T03:43:00.828+05:30 [Info] ExhaustMove call: 1
2023-09-14T03:43:00.828+05:30 [Info] ExhaustMove average time: 6us
2023-09-14T03:43:00.828+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.828+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.828+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.828+05:30 [Info]
2023-09-14T03:43:00.828+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-14T03:43:00.829+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:00.829+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-09-14T03:43:00.829+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.829+05:30 [Info] Index name:nonEquiv 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.829+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.829+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.829+05:30 [Info]
2023-09-14T03:43:00.829+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-14T03:43:00.829+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:00.829+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-09-14T03:43:00.829+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.829+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.829+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.829+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.829+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.829+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:10228433250455900565, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.829+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.829+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.829+05:30 [Info]
2023-09-14T03:43:00.829+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-14T03:43:00.829+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:00.829+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-09-14T03:43:00.829+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.829+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.829+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.829+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.829+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.829+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:10228433250455900565, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.829+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.829+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-14T03:43:00.831+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4923177782510672
2023-09-14T03:43:00.946+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:00.946+05:30 [Info] Score: 0.1784816836053567
2023-09-14T03:43:00.946+05:30 [Info] variation: 0.3569633672107134
2023-09-14T03:43:00.946+05:30 [Info] ElapsedTime: 114ms
2023-09-14T03:43:00.946+05:30 [Info] ConvergenceTime: 111ms
2023-09-14T03:43:00.946+05:30 [Info] Iteration: 5400
2023-09-14T03:43:00.946+05:30 [Info] Move: 3811
2023-09-14T03:43:00.946+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.946+05:30 [Info] Using SAPlanner
2023-09-14T03:43:00.946+05:30 [Info] Indexer Memory Mean 154201322596 (143.611G)
2023-09-14T03:43:00.946+05:30 [Info] Indexer Memory Deviation 82829246465 (77.1407G) (53.72%)
2023-09-14T03:43:00.946+05:30 [Info] Indexer Memory Utilization 2.7956
2023-09-14T03:43:00.946+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:00.946+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:00.946+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:00.946+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:00.946+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:00.946+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:00.946+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.946+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:00.946+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:00.946+05:30 [Info] Indexer Data Size Mean 45394854109 (42.2773G)
2023-09-14T03:43:00.946+05:30 [Info] Indexer Data Size Deviation 8024752292 (7.47363G) (17.68%)
2023-09-14T03:43:00.946+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:00.946+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.946+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:00.946+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:00.946+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.946+05:30 [Info] Number of indexes: 20
2023-09-14T03:43:00.946+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:00.947+05:30 [Info] Avg Index Size: 23130198389 (21.5417G)
2023-09-14T03:43:00.947+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:00.947+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-14T03:43:00.947+05:30 [Info] Avg Index Cpu: 2.3000
2023-09-14T03:43:00.947+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:00.947+05:30 [Info] Num Estimation Run: 22
2023-09-14T03:43:00.947+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.947+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:00.947+05:30 [Info] CPU Quota 27
2023-09-14T03:43:00.947+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:00.947+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:00.947+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.947+05:30 [Info] Total iteration: 8794
2023-09-14T03:43:00.947+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:00.947+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:00.947+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:00.947+05:30 [Info] RandomMove time: 30ms
2023-09-14T03:43:00.947+05:30 [Info] RandomMove call: 5399 (empty index 0)
2023-09-14T03:43:00.947+05:30 [Info] RandomMove average time: 5us
2023-09-14T03:43:00.947+05:30 [Info] ExhaustMove time: 8us
2023-09-14T03:43:00.947+05:30 [Info] ExhaustMove call: 1
2023-09-14T03:43:00.947+05:30 [Info] ExhaustMove average time: 8us
2023-09-14T03:43:00.947+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:00.947+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:00.947+05:30 [Info] ----------------------------------------
2023-09-14T03:43:00.947+05:30 [Info]
2023-09-14T03:43:00.947+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:00.947+05:30 [Info] Indexer total memory:301827829691 (281.099G), mem:271267444887 (252.637G), overhead:30560384804 (28.4616G), min:34046140582 (31.7079G), data:34046140582 (31.7079G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:6
2023-09-14T03:43:00.947+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5018354321742201 allowDDLDuringScaleup:true
2023-09-14T03:43:00.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.947+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.947+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.947+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.947+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.947+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.947+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.947+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.947+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.947+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.947+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.947+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.947+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.947+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:15679281130583638136, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.947+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.947+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.947+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.947+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:15679281130583638136, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info]
2023-09-14T03:43:00.948+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:00.948+05:30 [Info] Indexer total memory:108440151874 (100.993G), mem:92108996936 (85.7832G), overhead:16331154938 (15.2096G), min:51069210873 (47.5619G), data:51069210873 (47.5619G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-14T03:43:00.948+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3444658974194678 allowDDLDuringScaleup:true
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:15679281130583638136, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:15679281130583638136, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:15679281130583638136, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info]
2023-09-14T03:43:00.948+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:00.948+05:30 [Info] Indexer total memory:122670760385 (114.246G), mem:99227525965 (92.4128G), overhead:23443234420 (21.8332G), min:51069210873 (47.5619G), data:51069210873 (47.5619G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-14T03:43:00.948+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.35369867040631203 allowDDLDuringScaleup:true
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:15679281130583638136, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:15679281130583638136, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:00.948+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:00.948+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:15679281130583638136, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:00.948+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:00.948+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:00 -------------------------------------------
2023/09/14 03:43:00 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-14T03:43:00.951+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.1449077211373998
2023-09-14T03:43:01.095+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.095+05:30 [Info] Score: 0.13739736706800032
2023-09-14T03:43:01.095+05:30 [Info] variation: 0.27479473413600064
2023-09-14T03:43:01.095+05:30 [Info] ElapsedTime: 144ms
2023-09-14T03:43:01.095+05:30 [Info] ConvergenceTime: 141ms
2023-09-14T03:43:01.095+05:30 [Info] Iteration: 6800
2023-09-14T03:43:01.095+05:30 [Info] Move: 4849
2023-09-14T03:43:01.095+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.095+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.095+05:30 [Info] Indexer Memory Mean 208747525973 (194.411G)
2023-09-14T03:43:01.095+05:30 [Info] Indexer Memory Deviation 77823744009 (72.479G) (37.28%)
2023-09-14T03:43:01.095+05:30 [Info] Indexer Memory Utilization 3.7845
2023-09-14T03:43:01.095+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:01.095+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:01.095+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:01.095+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.095+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.095+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.095+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.095+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.095+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.095+05:30 [Info] Indexer Data Size Mean 45221342736 (42.1157G)
2023-09-14T03:43:01.095+05:30 [Info] Indexer Data Size Deviation 7994079525 (7.44507G) (17.68%)
2023-09-14T03:43:01.095+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.095+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.095+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.095+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.095+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.095+05:30 [Info] Number of indexes: 20
2023-09-14T03:43:01.095+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.095+05:30 [Info] Avg Index Size: 31312128896 (29.1617G)
2023-09-14T03:43:01.095+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:01.095+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-14T03:43:01.096+05:30 [Info] Avg Index Cpu: 2.3000
2023-09-14T03:43:01.096+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:01.096+05:30 [Info] Num Estimation Run: 23
2023-09-14T03:43:01.096+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.096+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.096+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.096+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.096+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Total iteration: 10528
2023-09-14T03:43:01.096+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.096+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.096+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.096+05:30 [Info] RandomMove time: 38ms
2023-09-14T03:43:01.096+05:30 [Info] RandomMove call: 6799 (empty index 0)
2023-09-14T03:43:01.096+05:30 [Info] RandomMove average time: 5us
2023-09-14T03:43:01.096+05:30 [Info] ExhaustMove time: 14us
2023-09-14T03:43:01.096+05:30 [Info] ExhaustMove call: 1
2023-09-14T03:43:01.096+05:30 [Info] ExhaustMove average time: 14us
2023-09-14T03:43:01.096+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.096+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.096+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.096+05:30 [Info]
2023-09-14T03:43:01.096+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:01.096+05:30 [Info] Indexer total memory:301697696161 (280.978G), mem:271137311357 (252.516G), overhead:30560384804 (28.4616G), min:33916007052 (31.5867G), data:33916007052 (31.5867G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:6
2023-09-14T03:43:01.096+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4097753531140166 allowDDLDuringScaleup:true
2023-09-14T03:43:01.096+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.096+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.096+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.096+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.096+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.096+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.096+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.096+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.096+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.096+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.096+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.096+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.096+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:12931271456800698231, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.096+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.096+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.096+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:12931271456800698231, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.096+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.096+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.096+05:30 [Info]
2023-09-14T03:43:01.096+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:01.096+05:30 [Info] Indexer total memory:337728715583 (314.534G), mem:256072940893 (238.487G), overhead:81655774690 (76.0479G), min:50874010578 (47.3801G), data:50874010578 (47.3801G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-14T03:43:01.096+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.470342252272453 allowDDLDuringScaleup:true
2023-09-14T03:43:01.096+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.096+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.096+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.096+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.096+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:12931271456800698231, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:12931271456800698231, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:12931271456800698231, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info]
2023-09-14T03:43:01.097+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:01.097+05:30 [Info] Indexer total memory:122475560090 (114.064G), mem:99032325670 (92.231G), overhead:23443234420 (21.8332G), min:50874010578 (47.3801G), data:50874010578 (47.3801G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-14T03:43:01.097+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3198823946135304 allowDDLDuringScaleup:true
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:12931271456800698231, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:12931271456800698231, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.097+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.097+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:12931271456800698231, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.097+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.097+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:01 -------------------------------------------
2023/09/14 03:43:01 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-14T03:43:01.100+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2672029527791626
2023-09-14T03:43:01.638+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.638+05:30 [Info] Score: 0.17706412772512403
2023-09-14T03:43:01.638+05:30 [Info] variation: 0.35412825545024806
2023-09-14T03:43:01.638+05:30 [Info] ElapsedTime: 538ms
2023-09-14T03:43:01.638+05:30 [Info] ConvergenceTime: 534ms
2023-09-14T03:43:01.638+05:30 [Info] Iteration: 8900
2023-09-14T03:43:01.638+05:30 [Info] Move: 4219
2023-09-14T03:43:01.638+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.638+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.638+05:30 [Info] Indexer Memory Mean 143980261622 (134.092G)
2023-09-14T03:43:01.638+05:30 [Info] Indexer Memory Deviation 89248780316 (83.1194G) (61.99%)
2023-09-14T03:43:01.638+05:30 [Info] Indexer Memory Utilization 2.6103
2023-09-14T03:43:01.639+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:01.639+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:01.639+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:01.639+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.639+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.639+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.639+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.639+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.639+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.639+05:30 [Info] Indexer Data Size Mean 35173793136 (32.7581G)
2023-09-14T03:43:01.639+05:30 [Info] Indexer Data Size Deviation 3108953455 (2.89544G) (8.84%)
2023-09-14T03:43:01.639+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.639+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.639+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.639+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.639+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Number of indexes: 28
2023-09-14T03:43:01.639+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.639+05:30 [Info] Avg Index Size: 15426456602 (14.367G)
2023-09-14T03:43:01.639+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:01.639+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-14T03:43:01.639+05:30 [Info] Avg Index Cpu: 1.6429
2023-09-14T03:43:01.639+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:01.639+05:30 [Info] Num Estimation Run: 31
2023-09-14T03:43:01.639+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.639+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.639+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.639+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.639+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Total iteration: 9713
2023-09-14T03:43:01.639+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.639+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.639+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.639+05:30 [Info] RandomMove time: 113ms
2023-09-14T03:43:01.639+05:30 [Info] RandomMove call: 8895 (empty index 0)
2023-09-14T03:43:01.639+05:30 [Info] RandomMove average time: 12us
2023-09-14T03:43:01.639+05:30 [Info] ExhaustMove time: 68us
2023-09-14T03:43:01.639+05:30 [Info] ExhaustMove call: 8
2023-09-14T03:43:01.639+05:30 [Info] ExhaustMove average time: 8us
2023-09-14T03:43:01.639+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.639+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.639+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.639+05:30 [Info]
2023-09-14T03:43:01.639+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:01.639+05:30 [Info] Indexer total memory:300757120174 (280.102G), mem:270196735370 (251.64G), overhead:30560384804 (28.4616G), min:32975431065 (30.7108G), data:32975431065 (30.7108G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-14T03:43:01.639+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5628246900996924 allowDDLDuringScaleup:true
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.639+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.639+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.639+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.639+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.639+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.639+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.639+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.639+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.639+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.639+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.639+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.639+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.639+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.639+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.639+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.639+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.639+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.639+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info]
2023-09-14T03:43:01.640+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:01.640+05:30 [Info] Indexer total memory:96941458279 (90.2838G), mem:80610303341 (75.0742G), overhead:16331154938 (15.2096G), min:39570517278 (36.8529G), data:39570517278 (36.8529G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-09-14T03:43:01.640+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.336974103161804 allowDDLDuringScaleup:true
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info]
2023-09-14T03:43:01.640+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:01.640+05:30 [Info] Indexer total memory:104576980577 (97.3949G), mem:81133746157 (75.5617G), overhead:23443234420 (21.8332G), min:32975431065 (30.7108G), data:32975431065 (30.7108G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-14T03:43:01.640+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3002012067385037 allowDDLDuringScaleup:true
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.640+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.640+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.640+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.640+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.641+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.641+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.641+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.641+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.641+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.641+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.641+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.641+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.641+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.641+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.641+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:3158499165943282345, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.641+05:30 [Info] Index total memory:6595086213 (6.14215G), mem:6595086213 (6.14215G), overhead:0 (0), min:6595086213 (6.14215G), data:6595086213 (6.14215G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.641+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:01 -------------------------------------------
2023/09/14 03:43:01 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-14T03:43:01.644+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.1594072689907387
2023-09-14T03:43:01.797+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.797+05:30 [Info] Score: 0.11475962811811741
2023-09-14T03:43:01.797+05:30 [Info] variation: 0.22951925623623481
2023-09-14T03:43:01.797+05:30 [Info] ElapsedTime: 153ms
2023-09-14T03:43:01.797+05:30 [Info] ConvergenceTime: 150ms
2023-09-14T03:43:01.797+05:30 [Info] Iteration: 6300
2023-09-14T03:43:01.798+05:30 [Info] Move: 4077
2023-09-14T03:43:01.798+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.798+05:30 [Info] Indexer Memory Mean 211591134437 (197.06G)
2023-09-14T03:43:01.798+05:30 [Info] Indexer Memory Deviation 78426288854 (73.0402G) (37.07%)
2023-09-14T03:43:01.798+05:30 [Info] Indexer Memory Utilization 3.8361
2023-09-14T03:43:01.798+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:01.798+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:01.798+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:01.798+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.798+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.798+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.798+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.798+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.798+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.798+05:30 [Info] Indexer Data Size Mean 48064951200 (44.764G)
2023-09-14T03:43:01.798+05:30 [Info] Indexer Data Size Deviation 4248381616 (3.95661G) (8.84%)
2023-09-14T03:43:01.798+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.798+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.798+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.798+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.798+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Number of indexes: 28
2023-09-14T03:43:01.798+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.798+05:30 [Info] Avg Index Size: 22670478689 (21.1135G)
2023-09-14T03:43:01.798+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:01.798+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-14T03:43:01.798+05:30 [Info] Avg Index Cpu: 1.6429
2023-09-14T03:43:01.798+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:01.798+05:30 [Info] Num Estimation Run: 29
2023-09-14T03:43:01.798+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.798+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.798+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.798+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.798+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Total iteration: 10290
2023-09-14T03:43:01.798+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.798+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.798+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.798+05:30 [Info] RandomMove time: 41ms
2023-09-14T03:43:01.798+05:30 [Info] RandomMove call: 6299 (empty index 0)
2023-09-14T03:43:01.798+05:30 [Info] RandomMove average time: 6us
2023-09-14T03:43:01.798+05:30 [Info] ExhaustMove time: 10us
2023-09-14T03:43:01.798+05:30 [Info] ExhaustMove call: 1
2023-09-14T03:43:01.798+05:30 [Info] ExhaustMove average time: 10us
2023-09-14T03:43:01.798+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.798+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.798+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.798+05:30 [Info]
2023-09-14T03:43:01.798+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:01.798+05:30 [Info] Indexer total memory:312842580859 (291.357G), mem:282282196055 (262.896G), overhead:30560384804 (28.4616G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-14T03:43:01.798+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4543185477672772 allowDDLDuringScaleup:true
2023-09-14T03:43:01.798+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.798+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.798+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.798+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.798+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.798+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.798+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.798+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.798+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.798+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.798+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.798+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.798+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.798+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.798+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.798+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.798+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info]
2023-09-14T03:43:01.799+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:01.799+05:30 [Info] Indexer total memory:331915596755 (309.12G), mem:250259822065 (233.073G), overhead:81655774690 (76.0479G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-14T03:43:01.799+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.42405038546912194 allowDDLDuringScaleup:true
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info]
2023-09-14T03:43:01.799+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:01.799+05:30 [Info] Indexer total memory:125674619612 (117.044G), mem:102231385192 (95.2104G), overhead:23443234420 (21.8332G), min:54073070100 (50.3595G), data:54073070100 (50.3595G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-09-14T03:43:01.799+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32163106676360087 allowDDLDuringScaleup:true
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.799+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.799+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.799+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.799+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.800+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.800+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.800+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.800+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.800+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.800+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.800+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.800+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.800+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.800+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.800+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.800+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.800+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.800+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.800+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.800+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.800+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.800+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.800+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.800+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.800+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.800+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.800+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.800+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:14712476166380166702, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.800+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.800+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:01 -------------------------------------------
2023/09/14 03:43:01 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-14T03:43:01.803+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.32331614869228603
2023-09-14T03:43:01.837+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.838+05:30 [Info] Score: 0.14532097559770876
2023-09-14T03:43:01.838+05:30 [Info] variation: 0.2906419511954175
2023-09-14T03:43:01.838+05:30 [Info] ElapsedTime: 35ms
2023-09-14T03:43:01.838+05:30 [Info] ConvergenceTime: 5ms
2023-09-14T03:43:01.838+05:30 [Info] Iteration: 8
2023-09-14T03:43:01.838+05:30 [Info] Move: 8
2023-09-14T03:43:01.838+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.838+05:30 [Info] Indexer Memory Mean 156291089214 (145.557G)
2023-09-14T03:43:01.838+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (58.13%)
2023-09-14T03:43:01.838+05:30 [Info] Indexer Memory Utilization 2.8335
2023-09-14T03:43:01.838+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:01.838+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:01.838+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:01.838+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.838+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.838+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.838+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.838+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.838+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.838+05:30 [Info] Indexer Data Size Mean 47484620728 (44.2235G)
2023-09-14T03:43:01.838+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:43:01.838+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.838+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.838+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.838+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.838+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Number of indexes: 36
2023-09-14T03:43:01.838+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.838+05:30 [Info] Avg Index Size: 13024257434 (12.1298G)
2023-09-14T03:43:01.838+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:01.838+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-14T03:43:01.838+05:30 [Info] Avg Index Cpu: 1.2778
2023-09-14T03:43:01.838+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:01.838+05:30 [Info] Num Estimation Run: 32
2023-09-14T03:43:01.838+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.838+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.838+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.838+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.838+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Total iteration: 6700
2023-09-14T03:43:01.838+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.838+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.838+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.838+05:30 [Info] RandomMove time: 63us
2023-09-14T03:43:01.838+05:30 [Info] RandomMove call: 7 (empty index 0)
2023-09-14T03:43:01.838+05:30 [Info] RandomMove average time: 9us
2023-09-14T03:43:01.838+05:30 [Info] ExhaustMove time: 17us
2023-09-14T03:43:01.838+05:30 [Info] ExhaustMove call: 1
2023-09-14T03:43:01.838+05:30 [Info] ExhaustMove average time: 17us
2023-09-14T03:43:01.838+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.838+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.838+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.838+05:30 [Info]
2023-09-14T03:43:01.838+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:01.838+05:30 [Info] Indexer total memory:315266309837 (293.615G), mem:284705925033 (265.153G), overhead:30560384804 (28.4616G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-14T03:43:01.838+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5643277764120702 allowDDLDuringScaleup:true
2023-09-14T03:43:01.838+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.838+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.838+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.838+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.838+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.838+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.838+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.838+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.838+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.838+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.838+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.838+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.838+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.838+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.838+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.838+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.838+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info]
2023-09-14T03:43:01.839+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:01.839+05:30 [Info] Indexer total memory:104855561729 (97.6544G), mem:88524406791 (82.4448G), overhead:16331154938 (15.2096G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-14T03:43:01.839+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3132814509590003 allowDDLDuringScaleup:true
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.839+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.839+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.839+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.839+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info]
2023-09-14T03:43:01.840+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:01.840+05:30 [Info] Indexer total memory:119086170240 (110.908G), mem:95642935820 (89.0744G), overhead:23443234420 (21.8332G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-14T03:43:01.840+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3223907726289295 allowDDLDuringScaleup:true
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.840+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.840+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:12402166766115745032, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.840+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.840+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:01 -------------------------------------------
2023/09/14 03:43:01 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-14T03:43:01.843+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.18653382311035305
2023-09-14T03:43:01.877+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.877+05:30 [Info] Score: 0.09796819540510597
2023-09-14T03:43:01.877+05:30 [Info] variation: 0.19593639081021194
2023-09-14T03:43:01.877+05:30 [Info] ElapsedTime: 34ms
2023-09-14T03:43:01.877+05:30 [Info] ConvergenceTime: 5ms
2023-09-14T03:43:01.877+05:30 [Info] Iteration: 6
2023-09-14T03:43:01.877+05:30 [Info] Move: 6
2023-09-14T03:43:01.877+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.877+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.877+05:30 [Info] Indexer Memory Mean 210829304949 (196.35G)
2023-09-14T03:43:01.877+05:30 [Info] Indexer Memory Deviation 82618266177 (76.9443G) (39.19%)
2023-09-14T03:43:01.877+05:30 [Info] Indexer Memory Utilization 3.8223
2023-09-14T03:43:01.877+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-14T03:43:01.877+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-14T03:43:01.877+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-14T03:43:01.877+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.877+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.877+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.877+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.877+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.877+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.877+05:30 [Info] Indexer Data Size Mean 47303121712 (44.0545G)
2023-09-14T03:43:01.877+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:43:01.877+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.877+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.877+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.877+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.877+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.877+05:30 [Info] Number of indexes: 36
2023-09-14T03:43:01.877+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.877+05:30 [Info] Avg Index Size: 17569108745 (16.3625G)
2023-09-14T03:43:01.877+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-14T03:43:01.877+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-14T03:43:01.877+05:30 [Info] Avg Index Cpu: 1.2778
2023-09-14T03:43:01.877+05:30 [Info] Max Index Cpu: 5.0000
2023-09-14T03:43:01.877+05:30 [Info] Num Estimation Run: 33
2023-09-14T03:43:01.877+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.877+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.877+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.877+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.877+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.877+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.877+05:30 [Info] Total iteration: 6787
2023-09-14T03:43:01.877+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.877+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.877+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.877+05:30 [Info] RandomMove time: 93us
2023-09-14T03:43:01.877+05:30 [Info] RandomMove call: 5 (empty index 0)
2023-09-14T03:43:01.877+05:30 [Info] RandomMove average time: 18us
2023-09-14T03:43:01.877+05:30 [Info] ExhaustMove time: 21us
2023-09-14T03:43:01.877+05:30 [Info] ExhaustMove call: 1
2023-09-14T03:43:01.877+05:30 [Info] ExhaustMove average time: 21us
2023-09-14T03:43:01.877+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.877+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.877+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.877+05:30 [Info]
2023-09-14T03:43:01.877+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-14T03:43:01.877+05:30 [Info] Indexer total memory:315084810821 (293.446G), mem:284524426017 (264.984G), overhead:30560384804 (28.4616G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-14T03:43:01.878+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4699097510048492 allowDDLDuringScaleup:true
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info]
2023-09-14T03:43:01.878+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-14T03:43:01.878+05:30 [Info] Indexer total memory:334157826717 (311.209G), mem:252502052027 (235.161G), overhead:81655774690 (76.0479G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-14T03:43:01.878+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43953221501885753 allowDDLDuringScaleup:true
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.878+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.878+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.878+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.878+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info]
2023-09-14T03:43:01.879+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-14T03:43:01.879+05:30 [Info] Indexer total memory:118904671224 (110.739G), mem:95461436804 (88.9054G), overhead:23443234420 (21.8332G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-14T03:43:01.879+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.29055803397629315 allowDDLDuringScaleup:true
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.879+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.879+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:16026278162329928228, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.879+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.879+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/CommandRepair
2023/09/14 03:43:01 -------------------------------------------
2023/09/14 03:43:01 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-14T03:43:01.880+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-14T03:43:01.880+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-14T03:43:01.880+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=8us
2023-09-14T03:43:01.880+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-09-14T03:43:01.880+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-14T03:43:01.880+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-09-14T03:43:01.880+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-09-14T03:43:01.880+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:43:01.880+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.880+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=133us
2023-09-14T03:43:01.881+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-09-14T03:43:01.881+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-09-14T03:43:01.881+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:43:01.881+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.881+05:30 [Info] Score: 0.22489777375378742
2023-09-14T03:43:01.881+05:30 [Info] variation: 0.8995910950151497
2023-09-14T03:43:01.881+05:30 [Info] ElapsedTime: 76us
2023-09-14T03:43:01.881+05:30 [Info] ConvergenceTime: 2us
2023-09-14T03:43:01.881+05:30 [Info] Iteration: 0
2023-09-14T03:43:01.881+05:30 [Info] Move: 0
2023-09-14T03:43:01.881+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.881+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.881+05:30 [Info] Indexer Memory Mean 122486397174 (114.074G)
2023-09-14T03:43:01.881+05:30 [Info] Indexer Memory Deviation 110187672158 (102.62G) (89.96%)
2023-09-14T03:43:01.881+05:30 [Info] Indexer Memory Utilization 2.2206
2023-09-14T03:43:01.881+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:43:01.881+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:43:01.881+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:43:01.881+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.881+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.881+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.881+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.881+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.881+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.881+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-14T03:43:01.881+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:43:01.881+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.881+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.881+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.881+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.881+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.881+05:30 [Info] Number of indexes: 4
2023-09-14T03:43:01.881+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.881+05:30 [Info] Avg Index Size: 91864797880 (85.5558G)
2023-09-14T03:43:01.881+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-14T03:43:01.881+05:30 [Info] Max Indexer Overhead: 46891539742 (43.6711G)
2023-09-14T03:43:01.881+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-14T03:43:01.881+05:30 [Info] Max Index Cpu: 0.0000
2023-09-14T03:43:01.881+05:30 [Info] Num Estimation Run: 0
2023-09-14T03:43:01.881+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.881+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.881+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.881+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.881+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.881+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.881+05:30 [Info] Total iteration: 0
2023-09-14T03:43:01.881+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.881+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.881+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.881+05:30 [Info] RandomMove time: 0ns
2023-09-14T03:43:01.881+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-14T03:43:01.881+05:30 [Info] ExhaustMove time: 0ns
2023-09-14T03:43:01.881+05:30 [Info] ExhaustMove call: 0
2023-09-14T03:43:01.881+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.881+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.881+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.881+05:30 [Info]
2023-09-14T03:43:01.881+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-14T03:43:01.881+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:01.881+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.45435427408637796 allowDDLDuringScaleup:true
2023-09-14T03:43:01.881+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.881+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.881+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.881+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.881+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.881+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:7997351066219152336, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.881+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.881+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.881+05:30 [Info]
2023-09-14T03:43:01.881+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-14T03:43:01.881+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:01.881+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.06701117350131312 allowDDLDuringScaleup:true
2023-09-14T03:43:01.881+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.881+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.881+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.881+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.881+05:30 [Info]
2023-09-14T03:43:01.881+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-14T03:43:01.881+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:01.881+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0786345524123089 allowDDLDuringScaleup:true
2023-09-14T03:43:01.881+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.881+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.881+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.881+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:01 -------------------------------------------
2023/09/14 03:43:01 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-14T03:43:01.882+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:43:01.882+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2,0) with initial placement on node: 127.0.0.1:9002
2023-09-14T03:43:01.882+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=7us
2023-09-14T03:43:01.882+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-09-14T03:43:01.882+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-14T03:43:01.882+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-09-14T03:43:01.882+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=6us
2023-09-14T03:43:01.882+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-09-14T03:43:01.882+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-09-14T03:43:01.882+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:43:01.882+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.882+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=156us
2023-09-14T03:43:01.882+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-14T03:43:01.882+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-09-14T03:43:01.882+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-09-14T03:43:01.882+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:43:01.882+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.882+05:30 [Info] Score: 0.019876174419669376
2023-09-14T03:43:01.882+05:30 [Info] variation: 0.0795046976786775
2023-09-14T03:43:01.882+05:30 [Info] ElapsedTime: 75us
2023-09-14T03:43:01.882+05:30 [Info] ConvergenceTime: 2us
2023-09-14T03:43:01.882+05:30 [Info] Iteration: 0
2023-09-14T03:43:01.882+05:30 [Info] Move: 0
2023-09-14T03:43:01.882+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.882+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.882+05:30 [Info] Indexer Memory Mean 266954004690 (248.62G)
2023-09-14T03:43:01.882+05:30 [Info] Indexer Memory Deviation 21224097436 (19.7665G) (7.95%)
2023-09-14T03:43:01.882+05:30 [Info] Indexer Memory Utilization 4.8398
2023-09-14T03:43:01.882+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:43:01.882+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:43:01.882+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:43:01.882+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.882+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.882+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.882+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.882+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.883+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.883+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-14T03:43:01.883+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:43:01.883+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.883+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.883+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.883+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.883+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.883+05:30 [Info] Number of indexes: 5
2023-09-14T03:43:01.883+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.883+05:30 [Info] Avg Index Size: 160172402814 (149.172G)
2023-09-14T03:43:01.883+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-14T03:43:01.883+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-09-14T03:43:01.883+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-14T03:43:01.883+05:30 [Info] Max Index Cpu: 0.0000
2023-09-14T03:43:01.883+05:30 [Info] Num Estimation Run: 0
2023-09-14T03:43:01.883+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.883+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.883+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.883+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.883+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.883+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.883+05:30 [Info] Total iteration: 0
2023-09-14T03:43:01.883+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.883+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.883+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.883+05:30 [Info] RandomMove time: 0ns
2023-09-14T03:43:01.883+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-14T03:43:01.883+05:30 [Info] ExhaustMove time: 0ns
2023-09-14T03:43:01.883+05:30 [Info] ExhaustMove call: 0
2023-09-14T03:43:01.883+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.883+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.883+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.883+05:30 [Info]
2023-09-14T03:43:01.883+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-14T03:43:01.883+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:01.883+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1777244769790758 allowDDLDuringScaleup:true
2023-09-14T03:43:01.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.883+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.883+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.883+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.883+05:30 [Info]
2023-09-14T03:43:01.883+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-14T03:43:01.883+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:01.883+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.20847118640616036 allowDDLDuringScaleup:true
2023-09-14T03:43:01.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.883+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.883+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.883+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.883+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:14800717174773041383, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.883+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.883+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.883+05:30 [Info]
2023-09-14T03:43:01.883+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-14T03:43:01.883+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:01.883+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2138043366147638 allowDDLDuringScaleup:true
2023-09-14T03:43:01.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.883+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.883+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.883+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.883+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.883+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:16858137452761283413, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.883+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.883+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:01 -------------------------------------------
2023/09/14 03:43:01 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-14T03:43:01.883+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-14T03:43:01.884+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-14T03:43:01.884+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-09-14T03:43:01.884+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-14T03:43:01.884+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-14T03:43:01.884+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-09-14T03:43:01.884+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-09-14T03:43:01.884+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:43:01.884+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.884+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=125us
2023-09-14T03:43:01.884+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-09-14T03:43:01.884+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-09-14T03:43:01.884+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:43:01.884+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.884+05:30 [Info] Score: 0.17469212089072378
2023-09-14T03:43:01.884+05:30 [Info] variation: 0.6987684835628951
2023-09-14T03:43:01.884+05:30 [Info] ElapsedTime: 73us
2023-09-14T03:43:01.884+05:30 [Info] ConvergenceTime: 2us
2023-09-14T03:43:01.884+05:30 [Info] Iteration: 0
2023-09-14T03:43:01.884+05:30 [Info] Move: 0
2023-09-14T03:43:01.884+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.884+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.884+05:30 [Info] Indexer Memory Mean 231925826675 (215.998G)
2023-09-14T03:43:01.884+05:30 [Info] Indexer Memory Deviation 162062458205 (150.932G) (69.88%)
2023-09-14T03:43:01.884+05:30 [Info] Indexer Memory Utilization 4.2047
2023-09-14T03:43:01.884+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:43:01.884+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:43:01.884+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:43:01.884+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.884+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.884+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.884+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.884+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.884+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.884+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-14T03:43:01.884+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:43:01.884+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.884+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.884+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.884+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.884+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.884+05:30 [Info] Number of indexes: 4
2023-09-14T03:43:01.884+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.884+05:30 [Info] Avg Index Size: 173944370006 (161.998G)
2023-09-14T03:43:01.884+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-14T03:43:01.884+05:30 [Info] Max Indexer Overhead: 49341212983 (45.9526G)
2023-09-14T03:43:01.884+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-14T03:43:01.884+05:30 [Info] Max Index Cpu: 0.0000
2023-09-14T03:43:01.884+05:30 [Info] Num Estimation Run: 0
2023-09-14T03:43:01.884+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.884+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.884+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.884+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.884+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.884+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.884+05:30 [Info] Total iteration: 0
2023-09-14T03:43:01.884+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.884+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.884+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.884+05:30 [Info] RandomMove time: 0ns
2023-09-14T03:43:01.884+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-14T03:43:01.884+05:30 [Info] ExhaustMove time: 0ns
2023-09-14T03:43:01.884+05:30 [Info] ExhaustMove call: 0
2023-09-14T03:43:01.884+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.884+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.884+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.884+05:30 [Info]
2023-09-14T03:43:01.884+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-14T03:43:01.884+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:01.884+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.38151873032984485 allowDDLDuringScaleup:true
2023-09-14T03:43:01.884+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.884+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.884+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.884+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.884+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.884+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:12635692986927409912, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.885+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.885+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.885+05:30 [Info]
2023-09-14T03:43:01.885+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-14T03:43:01.885+05:30 [Info] Indexer total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:01.885+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1769522034317959 allowDDLDuringScaleup:true
2023-09-14T03:43:01.885+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.885+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.885+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.885+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.885+05:30 [Info]
2023-09-14T03:43:01.885+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-14T03:43:01.885+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:01.885+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0415290662383593 allowDDLDuringScaleup:true
2023-09-14T03:43:01.885+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.885+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.885+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.885+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/14 03:43:01 -------------------------------------------
2023/09/14 03:43:01 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-14T03:43:01.885+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-14T03:43:01.885+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2,0) with initial placement on node: 127.0.0.1:9002
2023-09-14T03:43:01.885+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-14T03:43:01.885+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=4us
2023-09-14T03:43:01.885+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-14T03:43:01.885+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-09-14T03:43:01.885+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=6us
2023-09-14T03:43:01.885+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-09-14T03:43:01.885+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-09-14T03:43:01.885+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:43:01.885+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.885+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=125us
2023-09-14T03:43:01.885+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-14T03:43:01.885+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-09-14T03:43:01.885+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-09-14T03:43:01.885+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-14T03:43:01.885+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-14T03:43:01.885+05:30 [Info] Score: 0.06809310854298714
2023-09-14T03:43:01.885+05:30 [Info] variation: 0.27237243417194856
2023-09-14T03:43:01.886+05:30 [Info] ElapsedTime: 73us
2023-09-14T03:43:01.886+05:30 [Info] ConvergenceTime: 2us
2023-09-14T03:43:01.886+05:30 [Info] Iteration: 0
2023-09-14T03:43:01.886+05:30 [Info] Move: 0
2023-09-14T03:43:01.886+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Using SAPlanner
2023-09-14T03:43:01.886+05:30 [Info] Indexer Memory Mean 321673719440 (299.582G)
2023-09-14T03:43:01.886+05:30 [Info] Indexer Memory Deviation 87615053973 (81.5979G) (27.24%)
2023-09-14T03:43:01.886+05:30 [Info] Indexer Memory Utilization 5.8318
2023-09-14T03:43:01.886+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-14T03:43:01.886+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-14T03:43:01.886+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-14T03:43:01.886+05:30 [Info] Indexer IO Mean 0.0000
2023-09-14T03:43:01.886+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-14T03:43:01.886+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-14T03:43:01.886+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.886+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-14T03:43:01.886+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-14T03:43:01.886+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-14T03:43:01.886+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-14T03:43:01.886+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-14T03:43:01.886+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.886+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-14T03:43:01.886+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-14T03:43:01.886+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Number of indexes: 5
2023-09-14T03:43:01.886+05:30 [Info] Number of indexers: 3
2023-09-14T03:43:01.886+05:30 [Info] Avg Index Size: 193004231664 (179.749G)
2023-09-14T03:43:01.886+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-14T03:43:01.886+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-09-14T03:43:01.886+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-14T03:43:01.886+05:30 [Info] Max Index Cpu: 0.0000
2023-09-14T03:43:01.886+05:30 [Info] Num Estimation Run: 0
2023-09-14T03:43:01.886+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-14T03:43:01.886+05:30 [Info] CPU Quota 27
2023-09-14T03:43:01.886+05:30 [Info] Max Cpu Utilization -1
2023-09-14T03:43:01.886+05:30 [Info] Max Memory Utilization -1
2023-09-14T03:43:01.886+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Total iteration: 0
2023-09-14T03:43:01.886+05:30 [Info] RandomSwap time: 0ns
2023-09-14T03:43:01.886+05:30 [Info] RandomSwap call: 0
2023-09-14T03:43:01.886+05:30 [Info] RandomSwap iteration: 0
2023-09-14T03:43:01.886+05:30 [Info] RandomMove time: 0ns
2023-09-14T03:43:01.886+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-14T03:43:01.886+05:30 [Info] ExhaustMove time: 0ns
2023-09-14T03:43:01.886+05:30 [Info] ExhaustMove call: 0
2023-09-14T03:43:01.886+05:30 [Info] ExhaustSwap time: 0ns
2023-09-14T03:43:01.886+05:30 [Info] ExhaustSwap call: 0
2023-09-14T03:43:01.886+05:30 [Info] ----------------------------------------
2023-09-14T03:43:01.886+05:30 [Info]
2023-09-14T03:43:01.886+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-14T03:43:01.886+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-14T03:43:01.886+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.14749187761902688 allowDDLDuringScaleup:true
2023-09-14T03:43:01.886+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.886+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.886+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.886+05:30 [Info]
2023-09-14T03:43:01.886+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-14T03:43:01.886+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:01.886+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.2750739074297335 allowDDLDuringScaleup:true
2023-09-14T03:43:01.886+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.886+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.886+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.886+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:5172831746069882343, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.886+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.886+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.886+05:30 [Info]
2023-09-14T03:43:01.886+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-14T03:43:01.886+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-14T03:43:01.886+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.17743421495123962 allowDDLDuringScaleup:true
2023-09-14T03:43:01.886+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.886+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.886+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-14T03:43:01.886+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-14T03:43:01.886+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:2301060848798936044, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-14T03:43:01.886+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-14T03:43:01.886+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
--- PASS: TestPlanDuringHeterogenousScaleup (1.58s)
--- PASS: TestPlanDuringHeterogenousScaleup/GreedyPlanner (0.02s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner (1.56s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests (0.50s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex (1.05s)
--- PASS: TestPlanDuringHeterogenousScaleup/CommandRepair (0.01s)
=== RUN TestRestfulAPI
2023/09/14 03:43:01 In TestRestfulAPI()
2023/09/14 03:43:01 In DropAllSecondaryIndexes()
2023/09/14 03:43:01 Index found: indexmut_1
2023/09/14 03:43:02 Dropped index indexmut_1
2023/09/14 03:43:02 Setting JSON docs in KV
2023/09/14 03:43:02 GET all indexes
2023/09/14 03:43:02 200 OK
2023/09/14 03:43:02 FOUND indexes: []
2023/09/14 03:43:02 DROP index: badindexid
2023/09/14 03:43:03 status: 400 Bad Request
2023/09/14 03:43:03 DROP index: 23544142
2023/09/14 03:43:03 status: 500 Internal Server Error
2023/09/14 03:43:03 TEST: malformed body
2023/09/14 03:43:03 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"
2023/09/14 03:43:03 TEST: missing field ``name``
2023/09/14 03:43:03 400 Bad Request "missing field name"
2023/09/14 03:43:03 TEST: empty field ``name``
2023/09/14 03:43:03 400 Bad Request "empty field name"
2023/09/14 03:43:03 TEST: missing field ``bucket``
2023/09/14 03:43:03 400 Bad Request "missing field bucket"
2023/09/14 03:43:03 TEST: empty field ``bucket``
2023/09/14 03:43:03 400 Bad Request "empty field bucket"
2023/09/14 03:43:03 TEST: missing field ``secExprs``
2023/09/14 03:43:03 400 Bad Request "missing field secExprs"
2023/09/14 03:43:03 TEST: empty field ``secExprs``
2023/09/14 03:43:03 400 Bad Request "empty field secExprs"
2023/09/14 03:43:03 TEST: incomplete field ``desc``
2023/09/14 03:43:03 400 Bad Request "incomplete desc information [true]"
2023/09/14 03:43:03 TEST: invalid field ``desc``
2023/09/14 03:43:03 400 Bad Request "incomplete desc information [1]"
2023/09/14 03:43:03
2023/09/14 03:43:03 CREATE INDEX: idx1
2023/09/14 03:43:12 status : 201 Created
2023/09/14 03:43:12 {"id": "3935282140590983099"}
2023/09/14 03:43:12 CREATE INDEX: idx2 (defer)
2023/09/14 03:43:12 status : 201 Created
2023/09/14 03:43:12 {"id": "8120442205481374498"}
2023/09/14 03:43:12 CREATE INDEX: idx3 (defer)
2023/09/14 03:43:12 status : 201 Created
2023/09/14 03:43:12 {"id": "9560068627293947726"}
2023/09/14 03:43:12 CREATE INDEX: idx4 (defer)
2023/09/14 03:43:12 status : 201 Created
2023/09/14 03:43:12 {"id": "3223301576514859606"}
2023/09/14 03:43:12 CREATE INDEX: idx5
2023/09/14 03:43:25 status : 201 Created
2023/09/14 03:43:25 {"id": "5850754062956964780"}
2023/09/14 03:43:25 BUILD single deferred index
2023/09/14 03:43:25 202 Accepted
2023/09/14 03:43:26 GET all indexes
2023/09/14 03:43:26 200 OK
2023/09/14 03:43:26 index idx1 in INDEX_STATE_ACTIVE
2023/09/14 03:43:26 GET all indexes
2023/09/14 03:43:26 200 OK
2023/09/14 03:43:26 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:27 GET all indexes
2023/09/14 03:43:27 200 OK
2023/09/14 03:43:27 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:28 GET all indexes
2023/09/14 03:43:28 200 OK
2023/09/14 03:43:28 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:29 GET all indexes
2023/09/14 03:43:29 200 OK
2023/09/14 03:43:29 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:30 GET all indexes
2023/09/14 03:43:30 200 OK
2023/09/14 03:43:30 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:31 GET all indexes
2023/09/14 03:43:31 200 OK
2023/09/14 03:43:31 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:32 GET all indexes
2023/09/14 03:43:32 200 OK
2023/09/14 03:43:32 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:33 GET all indexes
2023/09/14 03:43:33 200 OK
2023/09/14 03:43:33 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:34 GET all indexes
2023/09/14 03:43:34 200 OK
2023/09/14 03:43:34 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:35 GET all indexes
2023/09/14 03:43:35 200 OK
2023/09/14 03:43:35 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:36 GET all indexes
2023/09/14 03:43:36 200 OK
2023/09/14 03:43:36 index idx2 in INDEX_STATE_INITIAL
2023/09/14 03:43:37 GET all indexes
2023/09/14 03:43:37 200 OK
2023/09/14 03:43:37 index idx2 in INDEX_STATE_CATCHUP
2023/09/14 03:43:38 GET all indexes
2023/09/14 03:43:38 200 OK
2023/09/14 03:43:38 index idx2 in INDEX_STATE_ACTIVE
2023/09/14 03:43:38 BUILD many deferred index
2023/09/14 03:43:38 202 Accepted
2023/09/14 03:43:38 GET all indexes
2023/09/14 03:43:38 200 OK
2023/09/14 03:43:38 index idx1 in INDEX_STATE_ACTIVE
2023/09/14 03:43:38 GET all indexes
2023/09/14 03:43:38 200 OK
2023/09/14 03:43:38 index idx2 in INDEX_STATE_ACTIVE
2023/09/14 03:43:38 GET all indexes
2023/09/14 03:43:38 200 OK
2023/09/14 03:43:38 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:39 GET all indexes
2023/09/14 03:43:39 200 OK
2023/09/14 03:43:39 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:40 GET all indexes
2023/09/14 03:43:40 200 OK
2023/09/14 03:43:40 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:41 GET all indexes
2023/09/14 03:43:41 200 OK
2023/09/14 03:43:41 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:42 GET all indexes
2023/09/14 03:43:42 200 OK
2023/09/14 03:43:42 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:43 GET all indexes
2023/09/14 03:43:43 200 OK
2023/09/14 03:43:43 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:44 GET all indexes
2023/09/14 03:43:44 200 OK
2023/09/14 03:43:44 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:45 GET all indexes
2023/09/14 03:43:45 200 OK
2023/09/14 03:43:45 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:46 GET all indexes
2023/09/14 03:43:46 200 OK
2023/09/14 03:43:46 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:48 GET all indexes
2023/09/14 03:43:48 200 OK
2023/09/14 03:43:48 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:49 GET all indexes
2023/09/14 03:43:49 200 OK
2023/09/14 03:43:49 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:50 GET all indexes
2023/09/14 03:43:50 200 OK
2023/09/14 03:43:50 index idx3 in INDEX_STATE_INITIAL
2023/09/14 03:43:51 GET all indexes
2023/09/14 03:43:51 200 OK
2023/09/14 03:43:51 index idx3 in INDEX_STATE_CATCHUP
2023/09/14 03:43:52 GET all indexes
2023/09/14 03:43:52 200 OK
2023/09/14 03:43:52 index idx3 in INDEX_STATE_ACTIVE
2023/09/14 03:43:52 GET all indexes
2023/09/14 03:43:52 200 OK
2023/09/14 03:43:52 index idx4 in INDEX_STATE_ACTIVE
2023/09/14 03:43:52 GET all indexes
2023/09/14 03:43:52 200 OK
2023/09/14 03:43:52 index idx5 in INDEX_STATE_ACTIVE
2023/09/14 03:43:52 GET all indexes
2023/09/14 03:43:52 200 OK
2023/09/14 03:43:52 CREATED indexes: [3935282140590983099 8120442205481374498 9560068627293947726 3223301576514859606 5850754062956964780]
2023/09/14 03:43:52
2023/09/14 03:43:52 LOOKUP missing index
2023/09/14 03:43:52 status : 404 Not Found
2023/09/14 03:43:52 LOOKUP Pyongyang
2023/09/14 03:43:52 status : 200 OK
2023/09/14 03:43:52 number of entries 554
2023/09/14 03:43:52 Expected and Actual scan responses are the same
2023/09/14 03:43:52 LOOKUP with stale as false
2023/09/14 03:43:52 status : 200 OK
2023/09/14 03:43:52 number of entries 554
2023/09/14 03:43:52 Expected and Actual scan responses are the same
2023/09/14 03:43:52 LOOKUP with Rome
2023/09/14 03:43:52 status : 200 OK
2023/09/14 03:43:52 number of entries 540
2023/09/14 03:43:52 Expected and Actual scan responses are the same
2023/09/14 03:43:52 RANGE missing index
2023/09/14 03:43:52 Status : 404 Not Found
2023/09/14 03:43:52 RANGE cities - none
2023/09/14 03:43:52 Status : 200 OK
2023/09/14 03:43:57 number of entries 140904
2023/09/14 03:43:59 Expected and Actual scan responses are the same
2023/09/14 03:43:59 RANGE cities -low
2023/09/14 03:43:59 Status : 200 OK
2023/09/14 03:44:03 number of entries 140904
2023/09/14 03:44:04 Expected and Actual scan responses are the same
2023/09/14 03:44:04 RANGE cities -high
2023/09/14 03:44:04 Status : 200 OK
2023/09/14 03:44:09 number of entries 140904
2023/09/14 03:44:10 Expected and Actual scan responses are the same
2023/09/14 03:44:10 RANGE cities - both
2023/09/14 03:44:10 Status : 200 OK
2023/09/14 03:44:14 number of entries 140904
2023/09/14 03:44:15 Expected and Actual scan responses are the same
2023/09/14 03:44:15 RANGE missing cities
2023/09/14 03:44:15 Status : 200 OK
2023/09/14 03:44:15 number of entries 0
2023/09/14 03:44:15 Expected and Actual scan responses are the same
2023/09/14 03:44:15
2023/09/14 03:44:15 SCANALL missing index
2023/09/14 03:44:15 {"limit":1000000,"stale":"ok"}
2023/09/14 03:44:15 Status : 404 Not Found
2023/09/14 03:44:15 SCANALL stale ok
2023/09/14 03:44:15 {"limit":1000000,"stale":"ok"}
2023/09/14 03:44:15 Status : 200 OK
2023/09/14 03:44:20 number of entries 140904
2023/09/14 03:44:21 Expected and Actual scan responses are the same
2023/09/14 03:44:21 SCANALL stale false
2023/09/14 03:44:21 {"limit":1000000,"stale":"false"}
2023/09/14 03:44:21 Status : 200 OK
2023/09/14 03:44:26 number of entries 140904
2023/09/14 03:44:27 Expected and Actual scan responses are the same
2023/09/14 03:44:27
2023/09/14 03:44:27 COUNT missing index
2023/09/14 03:44:27 Status : 404 Not Found
2023/09/14 03:44:27 COUNT cities - none
2023/09/14 03:44:27 Status : 200 OK
2023/09/14 03:44:27 number of entries 140904
2023/09/14 03:44:28 COUNT cities -low
2023/09/14 03:44:28 Status : 200 OK
2023/09/14 03:44:28 number of entries 140904
2023/09/14 03:44:28 COUNT cities -high
2023/09/14 03:44:28 Status : 200 OK
2023/09/14 03:44:28 number of entries 140904
2023/09/14 03:44:28 COUNT cities - both
2023/09/14 03:44:28 Status : 200 OK
2023/09/14 03:44:28 number of entries 140904
2023/09/14 03:44:28 COUNT missing cities
2023/09/14 03:44:29 Status : 200 OK
2023/09/14 03:44:29 number of entries 0
2023/09/14 03:44:29
2023/09/14 03:44:30 STATS: Testing URLs with valid authentication
2023/09/14 03:44:30 STATS: Testing URLs with invalid authentication
2023/09/14 03:44:30 STATS: Testing invalid URLs
2023/09/14 03:44:30 STATS: Testing unsupported methods
2023/09/14 03:44:30
--- PASS: TestRestfulAPI (88.61s)
=== RUN TestStatIndexInstFilter
2023/09/14 03:44:30 CREATE INDEX: statIdx1
2023/09/14 03:44:40 status : 201 Created
2023/09/14 03:44:40 {"id": "13802367576529756159"}
2023/09/14 03:44:40 CREATE INDEX: statIdx2
2023/09/14 03:44:52 status : 201 Created
2023/09/14 03:44:52 {"id": "4832998038358234444"}
2023/09/14 03:44:52 Instance Id for statIdx2 is 18240564059239544135, common.IndexInstId
--- PASS: TestStatIndexInstFilter (22.44s)
=== RUN TestBucketDefaultDelete
2023-09-14T03:44:53.090+05:30 [Warn] Client:runObserveStreamingEndpoint streaming endpoint for /pools/default/bs/default returned err EOF
2023-09-14T03:44:53.090+05:30 [Warn] serviceChangeNotifier: Connection terminated for collection manifest notifier instance of http://%40query@127.0.0.1:9000-default, bucket: default, (EOF)
2023/09/14 03:44:55 Deleted bucket default, responseBody:
2023/09/14 03:45:10 Created bucket default, responseBody:
2023/09/14 03:45:26 Populating the default bucket
2023/09/14 03:45:34 Using n1ql client
2023-09-14T03:45:34.292+05:30 [Info] GSIC[default/default-_default-_default-1694643334290016867] started ...
2023/09/14 03:45:34 Scan failed as expected with error: Index Not Found - cause: GSI index index_isActive not found.
2023/09/14 03:45:34 Populating the default bucket after it was deleted
2023/09/14 03:45:43 Created the secondary index index_isActive. Waiting for it become active
2023/09/14 03:45:43 Index is 1965740597322302676 now active
2023/09/14 03:45:43 Using n1ql client
2023/09/14 03:45:43 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (50.66s)
=== RUN TestMixedDatatypesScanAll
2023/09/14 03:45:43 In TestMixedDatatypesScanAll()
2023/09/14 03:45:43 Before test begin: Length of kv docs is 10002
2023/09/14 03:45:43 In DropAllSecondaryIndexes()
2023/09/14 03:45:43 Index found: index_isActive
2023/09/14 03:45:43 Dropped index index_isActive
2023/09/14 03:45:43 Number of number fields is: 248
2023/09/14 03:45:43 Number of string fields is: 244
2023/09/14 03:45:43 Number of json fields is: 279
2023/09/14 03:45:43 Number of true bool fields is: 113
2023/09/14 03:45:43 Number of false bool fields is: 116
2023/09/14 03:45:43 After generate docs: Length of kv docs is 11002
2023/09/14 03:45:43 Setting mixed datatypes JSON docs in KV
2023/09/14 03:45:49 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/14 03:45:49 Index is 2280974869091556077 now active
2023/09/14 03:45:49 Using n1ql client
2023/09/14 03:45:49 Expected and Actual scan responses are the same
2023/09/14 03:45:49 Lengths of expected and actual scan results are: 1000 and 1000
2023/09/14 03:45:49 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (5.66s)
=== RUN TestMixedDatatypesRange_Float
2023/09/14 03:45:49 In TestMixedDatatypesRange_Float()
2023/09/14 03:45:49 In DropAllSecondaryIndexes()
2023/09/14 03:45:49 Index found: index_mixeddt
2023/09/14 03:45:49 Dropped index index_mixeddt
2023/09/14 03:45:49 Number of number fields is: 236
2023/09/14 03:45:49 Number of string fields is: 238
2023/09/14 03:45:49 Number of json fields is: 261
2023/09/14 03:45:49 Number of true bool fields is: 134
2023/09/14 03:45:49 Number of false bool fields is: 131
2023/09/14 03:45:49 Setting mixed datatypes JSON docs in KV
2023/09/14 03:45:54 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/14 03:45:54 Index is 16073819576777006935 now active
2023/09/14 03:45:54 Using n1ql client
2023/09/14 03:45:54 Expected and Actual scan responses are the same
2023/09/14 03:45:54 Lengths of expected and actual scan results are: 12 and 12
2023/09/14 03:45:54 Using n1ql client
2023/09/14 03:45:54 Expected and Actual scan responses are the same
2023/09/14 03:45:54 Lengths of expected and actual scan results are: 3 and 3
2023/09/14 03:45:54 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (5.61s)
=== RUN TestMixedDatatypesRange_String
2023/09/14 03:45:54 In TestMixedDatatypesRange_String()
2023/09/14 03:45:54 In DropAllSecondaryIndexes()
2023/09/14 03:45:54 Index found: index_mixeddt
2023/09/14 03:45:55 Dropped index index_mixeddt
2023/09/14 03:45:55 Number of number fields is: 248
2023/09/14 03:45:55 Number of string fields is: 242
2023/09/14 03:45:55 Number of json fields is: 252
2023/09/14 03:45:55 Number of true bool fields is: 140
2023/09/14 03:45:55 Number of false bool fields is: 118
2023/09/14 03:45:55 Setting mixed datatypes JSON docs in KV
2023/09/14 03:46:00 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/14 03:46:00 Index is 4371843600467738264 now active
2023/09/14 03:46:00 Using n1ql client
2023/09/14 03:46:00 Expected and Actual scan responses are the same
2023/09/14 03:46:00 Lengths of expected and actual scan results are: 187 and 187
2023/09/14 03:46:00 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (6.02s)
=== RUN TestMixedDatatypesRange_Json
2023/09/14 03:46:00 In TestMixedDatatypesRange_Json()
2023/09/14 03:46:00 In DropAllSecondaryIndexes()
2023/09/14 03:46:00 Index found: index_mixeddt
2023/09/14 03:46:01 Dropped index index_mixeddt
2023/09/14 03:46:01 Number of number fields is: 260
2023/09/14 03:46:01 Number of string fields is: 252
2023/09/14 03:46:01 Number of json fields is: 238
2023/09/14 03:46:01 Number of true bool fields is: 118
2023/09/14 03:46:01 Number of false bool fields is: 132
2023/09/14 03:46:01 Setting mixed datatypes JSON docs in KV
2023/09/14 03:46:06 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/14 03:46:06 Index is 11473339211980064997 now active
2023/09/14 03:46:06 Using n1ql client
2023/09/14 03:46:06 Expected and Actual scan responses are the same
2023/09/14 03:46:06 Lengths of expected and actual scan results are: 751 and 751
2023/09/14 03:46:06 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (5.89s)
=== RUN TestMixedDatatypesScan_Bool
2023/09/14 03:46:06 In TestMixedDatatypesScan_Bool()
2023/09/14 03:46:06 In DropAllSecondaryIndexes()
2023/09/14 03:46:06 Index found: index_mixeddt
2023/09/14 03:46:06 Dropped index index_mixeddt
2023/09/14 03:46:06 Number of number fields is: 253
2023/09/14 03:46:06 Number of string fields is: 229
2023/09/14 03:46:06 Number of json fields is: 263
2023/09/14 03:46:06 Number of true bool fields is: 136
2023/09/14 03:46:06 Number of false bool fields is: 119
2023/09/14 03:46:06 Setting mixed datatypes JSON docs in KV
2023/09/14 03:46:12 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/14 03:46:12 Index is 13429924643333181114 now active
2023/09/14 03:46:12 Using n1ql client
2023/09/14 03:46:12 Expected and Actual scan responses are the same
2023/09/14 03:46:12 Lengths of expected and actual scan results are: 528 and 528
2023/09/14 03:46:13 Using n1ql client
2023/09/14 03:46:13 Expected and Actual scan responses are the same
2023/09/14 03:46:13 Lengths of expected and actual scan results are: 500 and 500
2023/09/14 03:46:13 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (6.26s)
=== RUN TestLargeSecondaryKeyLength
2023/09/14 03:46:13 In TestLargeSecondaryKeyLength()
2023/09/14 03:46:13 In DropAllSecondaryIndexes()
2023/09/14 03:46:13 Index found: index_mixeddt
2023/09/14 03:46:13 Dropped index index_mixeddt
2023/09/14 03:46:13 Setting JSON docs in KV
2023/09/14 03:46:18 Created the secondary index index_LongSecField. Waiting for it become active
2023/09/14 03:46:18 Index is 14356852075687481102 now active
2023/09/14 03:46:18 Using n1ql client
2023/09/14 03:46:18 ScanAll: Lengths of expected and actual scan results are: 1000 and 1000
2023/09/14 03:46:18 Expected and Actual scan responses are the same
2023/09/14 03:46:18 Using n1ql client
2023/09/14 03:46:18 Range: Lengths of expected and actual scan results are: 830 and 830
2023/09/14 03:46:18 Expected and Actual scan responses are the same
2023/09/14 03:46:18 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (5.78s)
=== RUN TestLargePrimaryKeyLength
2023/09/14 03:46:18 In TestLargePrimaryKeyLength()
2023/09/14 03:46:18 In DropAllSecondaryIndexes()
2023/09/14 03:46:18 Index found: index_LongSecField
2023/09/14 03:46:18 Dropped index index_LongSecField
2023/09/14 03:46:19 Setting JSON docs in KV
2023/09/14 03:46:24 Created the secondary index index_LongPrimaryField. Waiting for it become active
2023/09/14 03:46:24 Index is 6383798425481933622 now active
2023/09/14 03:46:24 Using n1ql client
2023/09/14 03:46:26 Lengths of num of docs and scanResults are: 17002 and 17002
2023/09/14 03:46:26 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (7.17s)
=== RUN TestUpdateMutations_DeleteField
2023/09/14 03:46:26 In TestUpdateMutations_DeleteField()
2023/09/14 03:46:26 Setting JSON docs in KV
2023/09/14 03:46:32 Created the secondary index index_bal. Waiting for it become active
2023/09/14 03:46:32 Index is 12544825879964732424 now active
2023/09/14 03:46:32 Using n1ql client
2023/09/14 03:46:32 Expected and Actual scan responses are the same
2023/09/14 03:46:32 Using n1ql client
2023/09/14 03:46:33 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (7.01s)
=== RUN TestUpdateMutations_AddField
2023/09/14 03:46:33 In TestUpdateMutations_AddField()
2023/09/14 03:46:33 Setting JSON docs in KV
2023/09/14 03:46:39 Created the secondary index index_newField. Waiting for it become active
2023/09/14 03:46:39 Index is 7781573069391884902 now active
2023/09/14 03:46:39 Using n1ql client
2023/09/14 03:46:39 Count of scan results before add field mutations: 0
2023/09/14 03:46:39 Expected and Actual scan responses are the same
2023/09/14 03:46:40 Using n1ql client
2023/09/14 03:46:40 Count of scan results after add field mutations: 300
2023/09/14 03:46:40 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (7.10s)
=== RUN TestUpdateMutations_DataTypeChange
2023/09/14 03:46:40 In TestUpdateMutations_DataTypeChange()
2023/09/14 03:46:40 Setting JSON docs in KV
2023/09/14 03:46:48 Created the secondary index index_isUserActive. Waiting for it become active
2023/09/14 03:46:48 Index is 12626904888766164719 now active
2023/09/14 03:46:48 Using n1ql client
2023/09/14 03:46:48 Expected and Actual scan responses are the same
2023/09/14 03:46:48 Using n1ql client
2023/09/14 03:46:48 Expected and Actual scan responses are the same
2023/09/14 03:46:48 Using n1ql client
2023/09/14 03:46:48 Expected and Actual scan responses are the same
2023/09/14 03:46:48 Using n1ql client
2023/09/14 03:46:48 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (8.43s)
=== RUN TestMultipleBuckets
2023/09/14 03:46:48 In TestMultipleBuckets()
2023/09/14 03:46:48 In DropAllSecondaryIndexes()
2023/09/14 03:46:48 Index found: index_LongPrimaryField
2023/09/14 03:46:48 Dropped index index_LongPrimaryField
2023/09/14 03:46:48 Index found: index_bal
2023/09/14 03:46:48 Dropped index index_bal
2023/09/14 03:46:48 Index found: index_newField
2023/09/14 03:46:48 Dropped index index_newField
2023/09/14 03:46:48 Index found: index_isUserActive
2023/09/14 03:46:48 Dropped index index_isUserActive
2023/09/14 03:47:27 Flushed the bucket default, Response body:
2023/09/14 03:47:30 Modified parameters of bucket default, responseBody:
2023/09/14 03:47:30 Created bucket testbucket2, responseBody:
2023/09/14 03:47:30 Created bucket testbucket3, responseBody:
2023/09/14 03:47:30 Created bucket testbucket4, responseBody:
2023/09/14 03:47:45 Generating docs and Populating all the buckets
2023/09/14 03:47:49 Created the secondary index bucket1_age. Waiting for it become active
2023/09/14 03:47:49 Index is 8721414541619661683 now active
2023/09/14 03:47:55 Created the secondary index bucket2_city. Waiting for it become active
2023/09/14 03:47:55 Index is 8013410145018537201 now active
2023/09/14 03:48:02 Created the secondary index bucket3_gender. Waiting for it become active
2023/09/14 03:48:02 Index is 17211792511882319666 now active
2023/09/14 03:48:08 Created the secondary index bucket4_balance. Waiting for it become active
2023/09/14 03:48:08 Index is 17892910459090705063 now active
2023/09/14 03:48:11 Using n1ql client
2023/09/14 03:48:11 Expected and Actual scan responses are the same
2023/09/14 03:48:11 Using n1ql client
2023-09-14T03:48:11.976+05:30 [Info] GSIC[default/testbucket2-_default-_default-1694643491971693184] started ...
2023/09/14 03:48:11 Expected and Actual scan responses are the same
2023/09/14 03:48:11 Using n1ql client
2023-09-14T03:48:11.993+05:30 [Info] GSIC[default/testbucket3-_default-_default-1694643491990811625] started ...
2023/09/14 03:48:12 Expected and Actual scan responses are the same
2023/09/14 03:48:12 Using n1ql client
2023-09-14T03:48:12.029+05:30 [Info] GSIC[default/testbucket4-_default-_default-1694643492025985527] started ...
2023/09/14 03:48:12 Expected and Actual scan responses are the same
2023/09/14 03:48:14 Deleted bucket testbucket2, responseBody:
2023/09/14 03:48:16 Deleted bucket testbucket3, responseBody:
2023/09/14 03:48:19 Deleted bucket testbucket4, responseBody:
2023/09/14 03:48:22 Modified parameters of bucket default, responseBody:
--- PASS: TestMultipleBuckets (108.82s)
=== RUN TestBucketFlush
2023/09/14 03:48:37 In TestBucketFlush()
2023/09/14 03:48:37 In DropAllSecondaryIndexes()
2023/09/14 03:48:37 Index found: bucket1_age
2023/09/14 03:48:37 Dropped index bucket1_age
2023/09/14 03:49:15 Flushed the bucket default, Response body:
2023/09/14 03:49:19 Created the secondary index index_age. Waiting for it become active
2023/09/14 03:49:19 Index is 15019403841098314106 now active
2023/09/14 03:49:19 Using n1ql client
2023/09/14 03:49:19 Expected and Actual scan responses are the same
2023/09/14 03:49:26 Created the secondary index index_gender. Waiting for it become active
2023/09/14 03:49:26 Index is 14447943135076665395 now active
2023/09/14 03:49:26 Using n1ql client
2023/09/14 03:49:27 Expected and Actual scan responses are the same
2023/09/14 03:49:32 Created the secondary index index_city. Waiting for it become active
2023/09/14 03:49:32 Index is 4138540673174423512 now active
2023/09/14 03:49:32 Using n1ql client
2023/09/14 03:49:32 Expected and Actual scan responses are the same
2023/09/14 03:50:10 Flushed the bucket default, Response body:
2023/09/14 03:50:10 TestBucketFlush:: Flushed the bucket
2023/09/14 03:50:10 Using n1ql client
2023/09/14 03:50:10 Using n1ql client
2023/09/14 03:50:10 Using n1ql client
--- PASS: TestBucketFlush (93.14s)
=== RUN TestLargeDocumentSize
2023/09/14 03:50:10 In TestLargeDocumentSize()
2023/09/14 03:50:10 Data file exists. Skipping download
2023/09/14 03:50:10 Length of docs and largeDocs = 200 and 200
2023/09/14 03:50:15 Created the secondary index index_userscreenname. Waiting for it become active
2023/09/14 03:50:15 Index is 9420836987869819895 now active
2023/09/14 03:50:15 Using n1ql client
2023/09/14 03:50:16 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (5.55s)
=== RUN TestFieldsWithSpecialCharacters
2023/09/14 03:50:16 In TestFieldsWithSpecialCharacters()
2023/09/14 03:50:21 Created the secondary index index_specialchar. Waiting for it become active
2023/09/14 03:50:21 Index is 17282718553476950989 now active
2023/09/14 03:50:21 Looking up for value x2Šyµv©
2023/09/14 03:50:21 Using n1ql client
2023/09/14 03:50:21 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (5.20s)
=== RUN TestLargeKeyLookup
2023/09/14 03:50:21 In TestLargeKeyLookup()
2023/09/14 03:50:27 Created the secondary index index_largeKeyLookup. Waiting for it become active
2023/09/14 03:50:27 Index is 13857631060138309792 now active
2023/09/14 03:50:27 Looking up for a large key
2023/09/14 03:50:27 Using n1ql client
2023/09/14 03:50:28 Expected and Actual scan responses are the same
--- PASS: TestLargeKeyLookup (7.30s)
=== RUN TestIndexNameValidation
2023/09/14 03:50:28 In TestIndexNameValidation()
2023/09/14 03:50:28 Setting JSON docs in KV
2023/09/14 03:50:29 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected
2023/09/14 03:50:33 Created the secondary index #primary-Index_test. Waiting for it become active
2023/09/14 03:50:33 Index is 2602147955657639740 now active
2023/09/14 03:50:33 Using n1ql client
2023/09/14 03:50:34 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (6.28s)
=== RUN TestSameFieldNameAtDifferentLevels
2023/09/14 03:50:34 In TestSameFieldNameAtDifferentLevels()
2023/09/14 03:50:35 Setting JSON docs in KV
2023/09/14 03:50:40 Created the secondary index cityindex. Waiting for it become active
2023/09/14 03:50:40 Index is 15174339542797206651 now active
2023/09/14 03:50:40 Using n1ql client
2023/09/14 03:50:40 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (5.45s)
=== RUN TestSameIndexNameInTwoBuckets
2023/09/14 03:50:40 In TestSameIndexNameInTwoBuckets()
2023/09/14 03:50:40 In DropAllSecondaryIndexes()
2023/09/14 03:50:40 Index found: index_specialchar
2023/09/14 03:50:40 Dropped index index_specialchar
2023/09/14 03:50:40 Index found: cityindex
2023/09/14 03:50:40 Dropped index cityindex
2023/09/14 03:50:40 Index found: index_userscreenname
2023/09/14 03:50:40 Dropped index index_userscreenname
2023/09/14 03:50:40 Index found: index_age
2023/09/14 03:50:40 Dropped index index_age
2023/09/14 03:50:40 Index found: index_largeKeyLookup
2023/09/14 03:50:40 Dropped index index_largeKeyLookup
2023/09/14 03:50:40 Index found: index_city
2023/09/14 03:50:40 Dropped index index_city
2023/09/14 03:50:40 Index found: #primary-Index_test
2023/09/14 03:50:40 Dropped index #primary-Index_test
2023/09/14 03:50:40 Index found: index_gender
2023/09/14 03:50:40 Dropped index index_gender
2023/09/14 03:51:18 Flushed the bucket default, Response body:
2023/09/14 03:51:21 Modified parameters of bucket default, responseBody:
2023/09/14 03:51:22 Created bucket buck2, responseBody:
2023/09/14 03:51:37 Generating docs and Populating all the buckets
2023/09/14 03:51:41 Created the secondary index b_idx. Waiting for it become active
2023/09/14 03:51:41 Index is 6157445515622167830 now active
2023/09/14 03:51:47 Created the secondary index b_idx. Waiting for it become active
2023/09/14 03:51:47 Index is 8433492587436081534 now active
2023/09/14 03:51:50 Using n1ql client
2023/09/14 03:51:50 Expected and Actual scan responses are the same
2023/09/14 03:51:50 Using n1ql client
2023-09-14T03:51:50.337+05:30 [Info] GSIC[default/buck2-_default-_default-1694643710333547676] started ...
2023/09/14 03:51:50 Expected and Actual scan responses are the same
2023/09/14 03:51:53 Modified parameters of bucket default, responseBody:
2023/09/14 03:51:55 Deleted bucket buck2, responseBody:
--- PASS: TestSameIndexNameInTwoBuckets (90.41s)
=== RUN TestLargeKeysSplChars
2023/09/14 03:52:10 In TestLargeKeysSplChars()
2023/09/14 03:52:20 Created the secondary index idspl1. Waiting for it become active
2023/09/14 03:52:20 Index is 7143760421917683602 now active
2023/09/14 03:52:27 Created the secondary index idspl2. Waiting for it become active
2023/09/14 03:52:27 Index is 16795401552814577627 now active
2023/09/14 03:52:34 Created the secondary index idspl3. Waiting for it become active
2023/09/14 03:52:34 Index is 6921304223178552637 now active
2023/09/14 03:52:34 Using n1ql client
2023/09/14 03:52:34 Expected and Actual scan responses are the same
2023-09-14T03:52:34.587+05:30 [Error] transport error between 127.0.0.1:34524->127.0.0.1:9107: write tcp 127.0.0.1:34524->127.0.0.1:9107: write: broken pipe
2023-09-14T03:52:34.587+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:34524->127.0.0.1:9107: write: broken pipe`
2023-09-14T03:52:34.587+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-14T03:52:34.587+05:30 [Error] metadataClient:PickRandom: Replicas - [6746948590339085002], PrunedReplica - map[], FilteredReplica map[]
2023/09/14 03:52:34 Expected and Actual scan responses are the same
2023/09/14 03:52:34 Using n1ql client
2023/09/14 03:52:35 Expected and Actual scan responses are the same
--- PASS: TestLargeKeysSplChars (24.32s)
=== RUN TestVeryLargeIndexKey
2023/09/14 03:52:35 In DropAllSecondaryIndexes()
2023/09/14 03:52:35 Index found: idspl3
2023/09/14 03:52:35 Dropped index idspl3
2023/09/14 03:52:35 Index found: idspl2
2023/09/14 03:52:35 Dropped index idspl2
2023/09/14 03:52:35 Index found: b_idx
2023/09/14 03:52:35 Dropped index b_idx
2023/09/14 03:52:35 Index found: idspl1
2023/09/14 03:52:35 Dropped index idspl1
2023/09/14 03:53:13 Flushed the bucket default, Response body:
2023/09/14 03:53:13 TestVeryLargeIndexKey:: Flushed the bucket
2023/09/14 03:53:14 clusterconfig.KVAddress = 127.0.0.1:9000
2023/09/14 03:53:18 Created the secondary index i1. Waiting for it become active
2023/09/14 03:53:18 Index is 309349112549627813 now active
2023/09/14 03:53:18 Using n1ql client
2023/09/14 03:53:18 Expected and Actual scan responses are the same
2023/09/14 03:53:25 Created the secondary index i2. Waiting for it become active
2023/09/14 03:53:25 Index is 17875278551018710298 now active
2023/09/14 03:53:25 Using n1ql client
2023/09/14 03:53:26 Expected and Actual scan responses are the same
2023/09/14 03:53:26 In DropAllSecondaryIndexes()
2023/09/14 03:53:26 Index found: i2
2023/09/14 03:53:26 Dropped index i2
2023/09/14 03:53:26 Index found: i1
2023/09/14 03:53:26 Dropped index i1
2023/09/14 03:54:05 Flushed the bucket default, Response body:
--- PASS: TestVeryLargeIndexKey (90.10s)
=== RUN TestTempBufScanResult
2023/09/14 03:54:05 In DropAllSecondaryIndexes()
2023/09/14 03:54:43 Flushed the bucket default, Response body:
2023/09/14 03:54:43 TestTempBufScanResult:: Flushed the bucket
2023/09/14 03:54:46 Created the secondary index index_idxKey. Waiting for it become active
2023/09/14 03:54:46 Index is 14010018026159607243 now active
2023/09/14 03:54:46 Using n1ql client
2023/09/14 03:54:46 Expected and Actual scan responses are the same
2023/09/14 03:54:46 In DropAllSecondaryIndexes()
2023/09/14 03:54:46 Index found: index_idxKey
2023/09/14 03:54:46 Dropped index index_idxKey
2023/09/14 03:55:24 Flushed the bucket default, Response body:
--- PASS: TestTempBufScanResult (79.38s)
=== RUN TestBuildDeferredAnotherBuilding
2023/09/14 03:55:24 In TestBuildDeferredAnotherBuilding()
2023/09/14 03:55:24 In DropAllSecondaryIndexes()
2023/09/14 03:56:07 Setting JSON docs in KV
2023/09/14 03:58:04 Build the deferred index id_age1. Waiting for the index to become active
2023/09/14 03:58:04 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:05 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:06 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:07 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:08 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:09 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:10 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:11 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:12 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:13 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:14 Waiting for index 1127132836542879889 to go active ...
2023/09/14 03:58:15 Index is 1127132836542879889 now active
2023/09/14 03:58:15 Build command issued for the deferred indexes [4285791607682698434]
2023/09/14 03:58:17 Build index failed as expected: Build index failed. Encountered transient error. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2023/09/14 03:58:17 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:18 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:19 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:20 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:21 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:22 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:23 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:24 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:25 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:26 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:27 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:28 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:29 Waiting for index 4285791607682698434 to go active ...
2023/09/14 03:58:30 Index is 4285791607682698434 now active
2023/09/14 03:58:30 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:31 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:32 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:33 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:34 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:35 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:36 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:37 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:38 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:39 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:40 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:41 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:42 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:43 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:44 Waiting for index 8715069404892582074 to go active ...
2023/09/14 03:58:45 Index is 8715069404892582074 now active
2023/09/14 03:58:45 Using n1ql client
2023/09/14 03:58:46 Expected and Actual scan responses are the same
2023/09/14 03:58:46 Using n1ql client
2023/09/14 03:58:47 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (202.60s)
=== RUN TestMultipleBucketsDeferredBuild
2023/09/14 03:58:47 In TestMultipleBucketsDeferredBuild()
2023/09/14 03:58:47 In DropAllSecondaryIndexes()
2023/09/14 03:58:47 Index found: id_company
2023/09/14 03:58:47 Dropped index id_company
2023/09/14 03:58:47 Index found: id_age1
2023/09/14 03:58:47 Dropped index id_age1
2023/09/14 03:58:47 Index found: id_age
2023/09/14 03:58:47 Dropped index id_age
2023/09/14 03:59:25 Flushed the bucket default, Response body:
2023/09/14 03:59:28 Modified parameters of bucket default, responseBody:
2023/09/14 03:59:28 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2023/09/14 03:59:28 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/14 03:59:28 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Wed, 13 Sep 2023 22:29:27 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0007ff480 31 [] false false map[] 0xc00ddefa00 }
2023/09/14 03:59:28 DeleteBucket failed for bucket defertest_buck2
2023/09/14 03:59:28 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2023/09/14 03:59:28 Created bucket defertest_buck2, responseBody:
2023/09/14 03:59:43 Setting JSON docs in KV
2023/09/14 04:00:58 Build command issued for the deferred indexes [5953974256545156496]
2023/09/14 04:00:59 Build command issued for the deferred indexes [14818266643826284941 15609907395304955925]
2023/09/14 04:00:59 Index state of 15609907395304955925 is INDEX_STATE_READY
2023/09/14 04:00:59 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:00 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:01 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:02 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:03 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:04 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:05 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:06 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:07 Waiting for index 5953974256545156496 to go active ...
2023/09/14 04:01:08 Index is 5953974256545156496 now active
2023/09/14 04:01:08 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:09 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:10 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:11 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:12 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:13 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:14 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:15 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:16 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:17 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:18 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:19 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:20 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:21 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:22 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:23 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:24 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:25 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:26 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:27 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:28 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:29 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:30 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:31 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:32 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:33 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:34 Waiting for index 14818266643826284941 to go active ...
2023/09/14 04:01:35 Index is 14818266643826284941 now active
2023/09/14 04:01:35 Using n1ql client
2023/09/14 04:01:35 Expected and Actual scan responses are the same
2023/09/14 04:01:35 Using n1ql client
2023/09/14 04:01:35 Expected and Actual scan responses are the same
2023/09/14 04:01:35 Using n1ql client
2023-09-14T04:01:35.498+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1694644295496250654] started ...
2023/09/14 04:01:35 Expected and Actual scan responses are the same
2023/09/14 04:01:38 Modified parameters of bucket default, responseBody:
2023/09/14 04:01:40 Deleted bucket defertest_buck2, responseBody:
--- PASS: TestMultipleBucketsDeferredBuild (178.72s)
=== RUN TestCreateDropCreateDeferredIndex
2023/09/14 04:01:45 In TestCreateDropCreateDeferredIndex()
2023/09/14 04:01:45 In DropAllSecondaryIndexes()
2023/09/14 04:01:45 Index found: buck1_id2
2023/09/14 04:01:45 Dropped index buck1_id2
2023/09/14 04:01:45 Index found: buck1_id1
2023/09/14 04:01:45 Dropped index buck1_id1
2023/09/14 04:01:48 Setting JSON docs in KV
2023/09/14 04:02:00 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:02:00 Index is 16040627335270591163 now active
2023/09/14 04:02:01 Dropping the secondary index id_age
2023/09/14 04:02:01 Index dropped
2023/09/14 04:02:04 Setting JSON docs in KV
2023/09/14 04:02:13 Using n1ql client
2023/09/14 04:02:13 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (27.38s)
=== RUN TestMultipleDeferredIndexes_BuildTogether
2023/09/14 04:02:13 In TestMultipleDeferredIndexes_BuildTogether()
2023/09/14 04:02:13 In DropAllSecondaryIndexes()
2023/09/14 04:02:13 Index found: id_company
2023/09/14 04:02:13 Dropped index id_company
2023/09/14 04:02:15 Setting JSON docs in KV
2023/09/14 04:02:29 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:02:29 Index is 2088500641225668873 now active
2023/09/14 04:02:31 Build command issued for the deferred indexes [id_age id_gender id_isActive], bucket: default, scope: _default, coll: _default
2023/09/14 04:02:31 Waiting for the index id_age to become active
2023/09/14 04:02:31 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:32 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:33 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:34 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:35 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:36 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:37 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:38 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:39 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:40 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:41 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:42 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:43 Waiting for index 17540772940927121418 to go active ...
2023/09/14 04:02:44 Index is 17540772940927121418 now active
2023/09/14 04:02:44 Waiting for the index id_gender to become active
2023/09/14 04:02:44 Index is 14077552069286050292 now active
2023/09/14 04:02:44 Waiting for the index id_isActive to become active
2023/09/14 04:02:44 Index is 8229280636992160464 now active
2023/09/14 04:02:44 Using n1ql client
2023/09/14 04:02:44 Expected and Actual scan responses are the same
2023/09/14 04:02:47 Setting JSON docs in KV
2023/09/14 04:02:55 Using n1ql client
2023/09/14 04:02:55 Expected and Actual scan responses are the same
2023/09/14 04:02:55 Using n1ql client
2023/09/14 04:02:56 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (42.96s)
=== RUN TestMultipleDeferredIndexes_BuildOneByOne
2023/09/14 04:02:56 In TestMultipleDeferredIndexes_BuildOneByOne()
2023/09/14 04:02:56 In DropAllSecondaryIndexes()
2023/09/14 04:02:56 Index found: id_age
2023/09/14 04:02:56 Dropped index id_age
2023/09/14 04:02:56 Index found: id_company
2023/09/14 04:02:56 Dropped index id_company
2023/09/14 04:02:56 Index found: id_isActive
2023/09/14 04:02:56 Dropped index id_isActive
2023/09/14 04:02:56 Index found: id_gender
2023/09/14 04:02:56 Dropped index id_gender
2023/09/14 04:03:00 Setting JSON docs in KV
2023/09/14 04:03:13 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:03:13 Index is 10027117669701011176 now active
2023/09/14 04:03:15 Build command issued for the deferred indexes [id_age], bucket: default, scope: _default, coll: _default
2023/09/14 04:03:15 Waiting for the index id_age to become active
2023/09/14 04:03:15 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:16 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:17 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:18 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:19 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:20 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:21 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:22 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:23 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:24 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:25 Waiting for index 8516676433001284137 to go active ...
2023/09/14 04:03:26 Index is 8516676433001284137 now active
2023/09/14 04:03:26 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/14 04:03:26 Waiting for the index id_gender to become active
2023/09/14 04:03:26 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:27 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:28 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:29 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:30 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:31 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:32 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:33 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:34 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:35 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:36 Waiting for index 9791033975925966045 to go active ...
2023/09/14 04:03:37 Index is 9791033975925966045 now active
2023/09/14 04:03:37 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/09/14 04:03:37 Waiting for the index id_isActive to become active
2023/09/14 04:03:37 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:38 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:39 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:40 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:41 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:42 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:43 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:44 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:45 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:46 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:47 Waiting for index 4968400349347895178 to go active ...
2023/09/14 04:03:48 Index is 4968400349347895178 now active
2023/09/14 04:03:48 Using n1ql client
2023/09/14 04:03:48 Expected and Actual scan responses are the same
2023/09/14 04:03:50 Setting JSON docs in KV
2023/09/14 04:03:59 Using n1ql client
2023/09/14 04:03:59 Expected and Actual scan responses are the same
2023/09/14 04:04:00 Using n1ql client
2023/09/14 04:04:00 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (64.49s)
=== RUN TestDropDeferredIndexWhileOthersBuilding
2023/09/14 04:04:00 In TestDropDeferredIndexWhileOthersBuilding()
2023/09/14 04:04:00 In DropAllSecondaryIndexes()
2023/09/14 04:04:00 Index found: id_age
2023/09/14 04:04:00 Dropped index id_age
2023/09/14 04:04:00 Index found: id_gender
2023/09/14 04:04:00 Dropped index id_gender
2023/09/14 04:04:00 Index found: id_isActive
2023/09/14 04:04:00 Dropped index id_isActive
2023/09/14 04:04:00 Index found: id_company
2023/09/14 04:04:01 Dropped index id_company
2023/09/14 04:04:03 Setting JSON docs in KV
2023/09/14 04:04:17 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:04:17 Index is 12664129379587337982 now active
2023/09/14 04:04:18 Build command issued for the deferred indexes [2298033855980602078 12817829391714109211]
2023/09/14 04:04:20 Dropping the secondary index id_isActive
2023/09/14 04:04:21 Index dropped
2023/09/14 04:04:21 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:22 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:23 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:24 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:25 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:26 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:27 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:28 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:29 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:30 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:31 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:32 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:33 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:34 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:35 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:36 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:37 Waiting for index 2298033855980602078 to go active ...
2023/09/14 04:04:38 Index is 2298033855980602078 now active
2023/09/14 04:04:38 Index is 12817829391714109211 now active
2023/09/14 04:04:39 Using n1ql client
2023/09/14 04:04:39 Expected and Actual scan responses are the same
2023/09/14 04:04:39 Using n1ql client
2023/09/14 04:04:39 Expected and Actual scan responses are the same
2023/09/14 04:04:41 Setting JSON docs in KV
2023/09/14 04:04:50 Using n1ql client
2023/09/14 04:04:50 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (50.35s)
=== RUN TestDropBuildingDeferredIndex
2023/09/14 04:04:50 In TestDropBuildingDeferredIndex()
2023/09/14 04:04:50 In DropAllSecondaryIndexes()
2023/09/14 04:04:50 Index found: id_company
2023/09/14 04:04:51 Dropped index id_company
2023/09/14 04:04:51 Index found: id_gender
2023/09/14 04:04:51 Dropped index id_gender
2023/09/14 04:04:51 Index found: id_age
2023/09/14 04:04:51 Dropped index id_age
2023/09/14 04:04:53 Setting JSON docs in KV
2023/09/14 04:04:58 Build command issued for the deferred indexes [633994127405103029 16722848961171307314]
2023/09/14 04:04:59 Dropping the secondary index id_age
2023/09/14 04:05:00 Index dropped
2023/09/14 04:05:00 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:01 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:02 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:03 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:04 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:05 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:06 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:07 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:08 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:09 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:10 Waiting for index 633994127405103029 to go active ...
2023/09/14 04:05:11 Index is 633994127405103029 now active
2023/09/14 04:05:11 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/14 04:05:11 Waiting for the index id_gender to become active
2023/09/14 04:05:11 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:12 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:13 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:14 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:15 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:16 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:17 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:18 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:19 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:20 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:21 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:22 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:23 Waiting for index 9926835152635259445 to go active ...
2023/09/14 04:05:24 Index is 9926835152635259445 now active
2023/09/14 04:05:25 Using n1ql client
2023/09/14 04:05:25 Expected and Actual scan responses are the same
2023/09/14 04:05:25 Using n1ql client
2023/09/14 04:05:26 Expected and Actual scan responses are the same
2023/09/14 04:05:28 Setting JSON docs in KV
2023/09/14 04:05:36 Using n1ql client
2023/09/14 04:05:37 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (46.63s)
=== RUN TestDropMultipleBuildingDeferredIndexes
2023/09/14 04:05:37 In TestDropMultipleBuildingDeferredIndexes()
2023/09/14 04:05:37 In DropAllSecondaryIndexes()
2023/09/14 04:05:37 Index found: id_company
2023/09/14 04:05:37 Dropped index id_company
2023/09/14 04:05:37 Index found: id_gender
2023/09/14 04:05:37 Dropped index id_gender
2023/09/14 04:05:44 Setting JSON docs in KV
2023/09/14 04:06:16 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:06:16 Index is 6560391905675118222 now active
2023/09/14 04:06:18 Build command issued for the deferred indexes [11297822565510060402 8527343453747933721]
2023/09/14 04:06:19 Dropping the secondary index id_age
2023/09/14 04:06:19 Index dropped
2023/09/14 04:06:19 Dropping the secondary index id_gender
2023/09/14 04:06:32 Index dropped
2023/09/14 04:06:32 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/09/14 04:06:32 Waiting for the index id_isActive to become active
2023/09/14 04:06:32 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:33 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:34 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:35 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:36 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:37 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:38 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:39 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:40 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:41 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:42 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:43 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:44 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:45 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:46 Waiting for index 1977723406846335092 to go active ...
2023/09/14 04:06:47 Index is 1977723406846335092 now active
2023/09/14 04:06:57 Using n1ql client
2023/09/14 04:06:58 Expected and Actual scan responses are the same
2023/09/14 04:06:58 Number of docScanResults and scanResults = 180000 and 180000
2023/09/14 04:06:58 Using n1ql client
2023/09/14 04:07:00 Expected and Actual scan responses are the same
2023/09/14 04:07:00 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (82.55s)
=== RUN TestDropOneIndexSecondDeferBuilding
2023/09/14 04:07:00 In TestDropOneIndexSecondDeferBuilding()
2023/09/14 04:07:00 In DropAllSecondaryIndexes()
2023/09/14 04:07:00 Index found: id_company
2023/09/14 04:07:00 Dropped index id_company
2023/09/14 04:07:00 Index found: id_isActive
2023/09/14 04:07:00 Dropped index id_isActive
2023/09/14 04:07:03 Setting JSON docs in KV
2023/09/14 04:07:08 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/09/14 04:07:08 Waiting for the index id_company to become active
2023/09/14 04:07:08 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:09 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:10 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:11 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:12 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:13 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:14 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:15 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:16 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:17 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:18 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:19 Waiting for index 5186048549666804597 to go active ...
2023/09/14 04:07:20 Index is 5186048549666804597 now active
2023/09/14 04:07:20 Build command issued for the deferred indexes [14296784010302845328]
2023/09/14 04:07:21 Dropping the secondary index id_company
2023/09/14 04:07:21 Index dropped
2023/09/14 04:07:26 Setting JSON docs in KV
2023/09/14 04:07:41 Index is 14296784010302845328 now active
2023/09/14 04:07:41 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/14 04:07:41 Waiting for the index id_gender to become active
2023/09/14 04:07:41 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:42 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:43 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:44 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:45 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:46 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:47 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:48 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:49 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:50 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:51 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:52 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:53 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:54 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:55 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:56 Waiting for index 11295233552563365633 to go active ...
2023/09/14 04:07:57 Index is 11295233552563365633 now active
2023/09/14 04:07:57 Using n1ql client
2023/09/14 04:07:57 Expected and Actual scan responses are the same
2023/09/14 04:07:57 Using n1ql client
2023/09/14 04:07:59 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (58.94s)
=== RUN TestDropSecondIndexSecondDeferBuilding
2023/09/14 04:07:59 In TestDropSecondIndexSecondDeferBuilding()
2023/09/14 04:07:59 In DropAllSecondaryIndexes()
2023/09/14 04:07:59 Index found: id_age
2023/09/14 04:07:59 Dropped index id_age
2023/09/14 04:07:59 Index found: id_gender
2023/09/14 04:07:59 Dropped index id_gender
2023/09/14 04:08:02 Setting JSON docs in KV
2023/09/14 04:08:08 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/09/14 04:08:08 Waiting for the index id_company to become active
2023/09/14 04:08:08 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:09 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:10 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:11 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:12 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:13 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:14 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:15 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:16 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:17 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:18 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:19 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:20 Waiting for index 10527867205528423123 to go active ...
2023/09/14 04:08:21 Index is 10527867205528423123 now active
2023/09/14 04:08:21 Build command issued for the deferred indexes [12311804328078549021]
2023/09/14 04:08:22 Dropping the secondary index id_age
2023/09/14 04:08:22 Index dropped
2023/09/14 04:08:28 Setting JSON docs in KV
2023/09/14 04:08:38 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/14 04:08:38 Waiting for the index id_gender to become active
2023/09/14 04:08:38 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:39 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:40 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:41 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:42 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:43 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:44 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:45 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:46 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:47 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:48 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:49 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:50 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:51 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:52 Waiting for index 15761082945179556343 to go active ...
2023/09/14 04:08:53 Index is 15761082945179556343 now active
2023/09/14 04:08:53 Using n1ql client
2023/09/14 04:08:53 Expected and Actual scan responses are the same
2023/09/14 04:08:54 Using n1ql client
2023/09/14 04:08:55 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (56.62s)
=== RUN TestCreateAfterDropWhileIndexBuilding
2023/09/14 04:08:55 In TestCreateAfterDropWhileIndexBuilding()
2023/09/14 04:08:55 In DropAllSecondaryIndexes()
2023/09/14 04:08:55 Index found: id_gender
2023/09/14 04:08:55 Dropped index id_gender
2023/09/14 04:08:55 Index found: id_company
2023/09/14 04:08:56 Dropped index id_company
2023/09/14 04:09:18 Setting JSON docs in KV
2023/09/14 04:10:15 Build command issued for the deferred indexes [13753174055313739363]
2023/09/14 04:10:16 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:17 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:18 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:19 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:20 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:21 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:22 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:23 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:24 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:25 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:26 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:27 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:28 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:29 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:30 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:31 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:32 Waiting for index 13753174055313739363 to go active ...
2023/09/14 04:10:33 Index is 13753174055313739363 now active
2023/09/14 04:10:34 Build command issued for the deferred indexes [17327090340275713410]
2023/09/14 04:10:35 Dropping the secondary index id_company
2023/09/14 04:10:35 Index dropped
2023/09/14 04:10:35 Dropping the secondary index id_age
2023/09/14 04:10:37 Index dropped
2023/09/14 04:10:42 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/14 04:10:42 Waiting for the index id_gender to become active
2023/09/14 04:10:42 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:43 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:44 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:45 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:46 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:47 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:48 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:49 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:50 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:51 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:52 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:53 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:54 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:55 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:56 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:57 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:58 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:10:59 Waiting for index 1014006908937971339 to go active ...
2023/09/14 04:11:00 Index is 1014006908937971339 now active
2023/09/14 04:11:01 Index is 1014006908937971339 now active
2023/09/14 04:11:02 Using n1ql client
2023/09/14 04:11:04 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (128.63s)
=== RUN TestDropBuildingIndex1
2023/09/14 04:11:04 In TestDropBuildingIndex1()
2023/09/14 04:11:04 In DropAllSecondaryIndexes()
2023/09/14 04:11:04 Index found: id_gender
2023/09/14 04:11:04 Dropped index id_gender
2023/09/14 04:11:08 Setting JSON docs in KV
2023/09/14 04:11:37 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:11:37 Index is 12041944413598494429 now active
2023/09/14 04:12:01 Dropping the secondary index id_age
2023/09/14 04:12:01 Index dropped
2023/09/14 04:12:21 Created the secondary index id_age. Waiting for it become active
2023/09/14 04:12:21 Index is 17122643985618952173 now active
2023/09/14 04:12:23 Setting JSON docs in KV
2023/09/14 04:12:31 Using n1ql client
2023/09/14 04:12:32 Expected and Actual scan responses are the same
2023/09/14 04:12:32 Using n1ql client
2023/09/14 04:12:33 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex1 (89.09s)
=== RUN TestDropBuildingIndex2
2023/09/14 04:12:33 In TestDropBuildingIndex2()
2023/09/14 04:12:33 In DropAllSecondaryIndexes()
2023/09/14 04:12:33 Index found: id_age
2023/09/14 04:12:33 Dropped index id_age
2023/09/14 04:12:33 Index found: id_company
2023/09/14 04:12:33 Dropped index id_company
2023/09/14 04:12:38 Setting JSON docs in KV
2023/09/14 04:13:18 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:13:18 Index is 3651195127418572453 now active
2023/09/14 04:13:42 Dropping the secondary index id_company
2023/09/14 04:13:42 Index dropped
2023/09/14 04:13:42 Index is 3082197762020982082 now active
2023/09/14 04:14:04 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:14:04 Index is 12140231784265604030 now active
2023/09/14 04:14:08 Setting JSON docs in KV
2023/09/14 04:14:16 Using n1ql client
2023/09/14 04:14:16 Expected and Actual scan responses are the same
2023/09/14 04:14:17 Using n1ql client
2023/09/14 04:14:17 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex2 (104.29s)
=== RUN TestDropIndexWithDataLoad
2023/09/14 04:14:17 In TestDropIndexWithDataLoad()
2023/09/14 04:14:17 In DropAllSecondaryIndexes()
2023/09/14 04:14:17 Index found: id_company
2023/09/14 04:14:17 Dropped index id_company
2023/09/14 04:14:17 Index found: id_age
2023/09/14 04:14:18 Dropped index id_age
2023/09/14 04:14:19 Setting JSON docs in KV
2023/09/14 04:14:46 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:14:46 Index is 15643836217099091089 now active
2023/09/14 04:15:11 Created the secondary index id_age. Waiting for it become active
2023/09/14 04:15:11 Index is 12391620758777738211 now active
2023/09/14 04:15:34 Created the secondary index id_gender. Waiting for it become active
2023/09/14 04:15:34 Index is 4355645584387089933 now active
2023/09/14 04:15:57 Created the secondary index id_isActive. Waiting for it become active
2023/09/14 04:15:57 Index is 2191041167781421402 now active
2023/09/14 04:16:05 Setting JSON docs in KV
2023/09/14 04:16:05 In DropIndexWhileKVLoad
2023/09/14 04:16:05 In LoadKVBucket
2023/09/14 04:16:05 Bucket name = default
2023/09/14 04:16:06 Dropping the secondary index id_company
2023/09/14 04:16:06 Index dropped
2023/09/14 04:16:33 Using n1ql client
2023/09/14 04:16:34 Expected and Actual scan responses are the same
2023/09/14 04:16:34 Number of docScanResults and scanResults = 96712 and 96712
2023/09/14 04:16:34 Using n1ql client
2023/09/14 04:16:37 Expected and Actual scan responses are the same
2023/09/14 04:16:37 Number of docScanResults and scanResults = 420000 and 420000
--- PASS: TestDropIndexWithDataLoad (139.95s)
=== RUN TestDropAllIndexesWithDataLoad
2023/09/14 04:16:37 In TestDropAllIndexesWithDataLoad()
2023/09/14 04:16:37 In DropAllSecondaryIndexes()
2023/09/14 04:16:37 Index found: id_gender
2023/09/14 04:16:37 Dropped index id_gender
2023/09/14 04:16:37 Index found: id_isActive
2023/09/14 04:16:37 Dropped index id_isActive
2023/09/14 04:16:37 Index found: id_age
2023/09/14 04:16:38 Dropped index id_age
2023/09/14 04:16:40 Setting JSON docs in KV
2023/09/14 04:17:09 Created the secondary index id_company. Waiting for it become active
2023/09/14 04:17:09 Index is 18116396525982620404 now active
2023/09/14 04:17:34 Created the secondary index id_age. Waiting for it become active
2023/09/14 04:17:34 Index is 1373659559109945401 now active
2023/09/14 04:18:00 Created the secondary index id_gender. Waiting for it become active
2023/09/14 04:18:00 Index is 6478425001225027315 now active
2023/09/14 04:18:26 Created the secondary index id_isActive. Waiting for it become active
2023/09/14 04:18:26 Index is 16993145791991116711 now active
2023/09/14 04:18:33 Setting JSON docs in KV
2023/09/14 04:18:33 In LoadKVBucket
2023/09/14 04:18:33 In DropIndexWhileKVLoad
2023/09/14 04:18:33 In DropIndexWhileKVLoad
2023/09/14 04:18:33 In DropIndexWhileKVLoad
2023/09/14 04:18:33 In DropIndexWhileKVLoad
2023/09/14 04:18:33 Bucket name = default
2023/09/14 04:18:34 Dropping the secondary index id_isActive
2023/09/14 04:18:34 Dropping the secondary index id_company
2023/09/14 04:18:34 Dropping the secondary index id_gender
2023/09/14 04:18:34 Dropping the secondary index id_age
2023/09/14 04:18:34 Index dropped
2023/09/14 04:18:34 Index dropped
2023/09/14 04:18:34 Index dropped
2023/09/14 04:18:35 Index dropped
2023/09/14 04:18:51 Using n1ql client
2023/09/14 04:18:51 Scan failed as expected with error: Index Not Found - cause: GSI index id_company not found.
--- PASS: TestDropAllIndexesWithDataLoad (133.49s)
=== RUN TestCreateBucket_AnotherIndexBuilding
2023/09/14 04:18:51 In TestCreateBucket_AnotherIndexBuilding()
2023/09/14 04:18:51 In DropAllSecondaryIndexes()
2023/09/14 04:19:34 Flushed the bucket default, Response body:
2023/09/14 04:19:37 Modified parameters of bucket default, responseBody:
2023/09/14 04:19:37 http://127.0.0.1:9000/pools/default/buckets/multi_buck2
2023/09/14 04:19:37 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/14 04:19:37 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Wed, 13 Sep 2023 22:49:36 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc001057b40 31 [] false false map[] 0xc00ddeee00 }
2023/09/14 04:19:37 DeleteBucket failed for bucket multi_buck2
2023/09/14 04:19:37 Deleted bucket multi_buck2, responseBody: Requested resource not found.
2023/09/14 04:19:52 Setting JSON docs in KV
2023/09/14 04:21:52 Created bucket multi_buck2, responseBody:
2023/09/14 04:22:16 Index is 12177466668245078128 now active
2023/09/14 04:22:16 Index is 7075047966284907578 now active
2023/09/14 04:22:16 Using n1ql client
2023-09-14T04:22:16.626+05:30 [Info] GSIC[default/multi_buck2-_default-_default-1694645536615624922] started ...
2023/09/14 04:22:16 Expected and Actual scan responses are the same
2023/09/14 04:22:16 Number of docScanResults and scanResults = 10000 and 10000
2023/09/14 04:22:17 Using n1ql client
2023/09/14 04:22:20 Expected and Actual scan responses are the same
2023/09/14 04:22:20 Number of docScanResults and scanResults = 200000 and 200000
2023/09/14 04:22:23 Deleted bucket multi_buck2, responseBody:
2023/09/14 04:23:00 Flushed the bucket default, Response body:
--- PASS: TestCreateBucket_AnotherIndexBuilding (249.28s)
=== RUN TestDropBucket2Index_Bucket1IndexBuilding
2023/09/14 04:23:00 In TestDropBucket2Index_Bucket1IndexBuilding()
2023/09/14 04:23:00 In DropAllSecondaryIndexes()
2023/09/14 04:23:00 Index found: buck1_idx
2023/09/14 04:23:00 Dropped index buck1_idx
2023/09/14 04:23:38 Flushed the bucket default, Response body:
2023/09/14 04:23:41 Modified parameters of bucket default, responseBody:
2023/09/14 04:23:41 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3
2023/09/14 04:23:41 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/14 04:23:41 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Wed, 13 Sep 2023 22:53:41 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc000dfc180 31 [] false false map[] 0xc00dc32200 }
2023/09/14 04:23:41 DeleteBucket failed for bucket multibucket_test3
2023/09/14 04:23:41 Deleted bucket multibucket_test3, responseBody: Requested resource not found.
2023/09/14 04:23:42 Created bucket multibucket_test3, responseBody:
2023/09/14 04:23:57 Setting JSON docs in KV
2023/09/14 04:24:59 Created the secondary index buck2_idx. Waiting for it become active
2023/09/14 04:24:59 Index is 2649279805684979362 now active
2023/09/14 04:25:12 Dropping the secondary index buck2_idx
2023/09/14 04:25:12 Index dropped
2023/09/14 04:25:12 Index is 2945436900957916497 now active
2023/09/14 04:25:13 Using n1ql client
2023/09/14 04:25:14 Expected and Actual scan responses are the same
2023/09/14 04:25:14 Number of docScanResults and scanResults = 100000 and 100000
2023/09/14 04:25:16 Deleted bucket multibucket_test3, responseBody:
2023/09/14 04:25:53 Flushed the bucket default, Response body:
--- PASS: TestDropBucket2Index_Bucket1IndexBuilding (173.49s)
=== RUN TestDeleteBucketWhileInitialIndexBuild
2023/09/14 04:25:53 In TestDeleteBucketWhileInitialIndexBuild()
2023/09/14 04:25:53 ============== DBG: Drop all indexes in all buckets
2023/09/14 04:25:53 In DropAllSecondaryIndexes()
2023/09/14 04:25:53 Index found: buck1_idx
2023/09/14 04:25:54 Dropped index buck1_idx
2023/09/14 04:25:54 ============== DBG: Delete bucket default
2023/09/14 04:25:55 Deleted bucket default, responseBody:
2023/09/14 04:25:55 ============== DBG: Create bucket default
2023/09/14 04:25:55 Created bucket default, responseBody:
2023/09/14 04:25:59 Flush Enabled on bucket default, responseBody:
2023/09/14 04:26:33 Flushed the bucket default, Response body:
2023/09/14 04:26:33 ============== DBG: Delete bucket testbucket2
2023/09/14 04:26:33 http://127.0.0.1:9000/pools/default/buckets/testbucket2
2023/09/14 04:26:33 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/14 04:26:33 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Wed, 13 Sep 2023 22:56:32 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc013140040 31 [] false false map[] 0xc003166000 }
2023/09/14 04:26:33 DeleteBucket failed for bucket testbucket2
2023/09/14 04:26:33 Deleted bucket testbucket2, responseBody: Requested resource not found.
2023/09/14 04:26:33 ============== DBG: Create bucket testbucket2
2023/09/14 04:26:33 Created bucket testbucket2, responseBody:
2023/09/14 04:26:36 Flush Enabled on bucket testbucket2, responseBody:
2023/09/14 04:27:09 Flushed the bucket testbucket2, Response body:
2023/09/14 04:27:09 ============== DBG: Delete bucket testbucket3
2023/09/14 04:27:09 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2023/09/14 04:27:09 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/14 04:27:09 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Wed, 13 Sep 2023 22:57:08 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc01e233f40 31 [] false false map[] 0xc00ab8c000 }
2023/09/14 04:27:09 DeleteBucket failed for bucket testbucket3
2023/09/14 04:27:09 Deleted bucket testbucket3, responseBody: Requested resource not found.
2023/09/14 04:27:09 ============== DBG: Create bucket testbucket3
2023/09/14 04:27:09 Created bucket testbucket3, responseBody:
2023/09/14 04:27:13 Flush Enabled on bucket testbucket3, responseBody:
2023/09/14 04:27:46 Flushed the bucket testbucket3, Response body:
2023/09/14 04:27:46 ============== DBG: Delete bucket testbucket4
2023/09/14 04:27:46 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/09/14 04:27:46 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/14 04:27:46 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Wed, 13 Sep 2023 22:57:45 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc012f09000 31 [] false false map[] 0xc00ab8c000 }
2023/09/14 04:27:46 DeleteBucket failed for bucket testbucket4
2023/09/14 04:27:46 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/09/14 04:27:46 ============== DBG: Create bucket testbucket4
2023/09/14 04:27:46 Created bucket testbucket4, responseBody:
2023/09/14 04:27:49 Flush Enabled on bucket testbucket4, responseBody:
2023/09/14 04:28:23 Flushed the bucket testbucket4, Response body:
2023/09/14 04:28:38 Generating docs and Populating all the buckets
2023/09/14 04:28:38 ============== DBG: Creating docs in bucket default
2023/09/14 04:28:39 ============== DBG: Creating index bucket1_age in bucket default
2023/09/14 04:28:43 Created the secondary index bucket1_age. Waiting for it become active
2023/09/14 04:28:43 Index is 4237745099516967074 now active
2023/09/14 04:28:43 ============== DBG: Creating index bucket1_gender in bucket default
2023/09/14 04:28:49 Created the secondary index bucket1_gender. Waiting for it become active
2023/09/14 04:28:49 Index is 10572774184240421664 now active
2023/09/14 04:28:50 ============== DBG: Creating docs in bucket testbucket2
2023/09/14 04:28:50 ============== DBG: Creating index bucket2_city in bucket testbucket2
2023/09/14 04:28:55 Created the secondary index bucket2_city. Waiting for it become active
2023/09/14 04:28:55 Index is 5163586270197735784 now active
2023/09/14 04:28:55 ============== DBG: Creating index bucket2_company in bucket testbucket2
2023/09/14 04:29:03 Created the secondary index bucket2_company. Waiting for it become active
2023/09/14 04:29:03 Index is 11501544943886293899 now active
2023/09/14 04:29:03 ============== DBG: Creating docs in bucket testbucket3
2023/09/14 04:29:04 ============== DBG: Creating index bucket3_gender in bucket testbucket3
2023/09/14 04:29:08 Created the secondary index bucket3_gender. Waiting for it become active
2023/09/14 04:29:08 Index is 10260106620712797145 now active
2023/09/14 04:29:08 ============== DBG: Creating index bucket3_address in bucket testbucket3
2023/09/14 04:29:16 Created the secondary index bucket3_address. Waiting for it become active
2023/09/14 04:29:16 Index is 14776079158902813641 now active
2023/09/14 04:29:16 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2023/09/14 04:29:16 Using n1ql client
2023-09-14T04:29:16.088+05:30 [Info] metadata provider version changed 1300 -> 1301
2023-09-14T04:29:16.088+05:30 [Info] switched currmeta from 1300 -> 1301 force false
2023-09-14T04:29:16.088+05:30 [Info] GSIC[default/default-_default-_default-1694645956080530118] started ...
2023/09/14 04:29:16 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2023/09/14 04:29:16 Expected and Actual scan responses are the same
2023/09/14 04:29:27 ============== DBG: Creating 50K docs in bucket testbucket4
2023/09/14 04:29:53 ============== DBG: Creating index bucket4_balance asynchronously in bucket testbucket4
2023/09/14 04:30:02 ============== DBG: Deleting bucket testbucket4
2023/09/14 04:30:04 Deleted bucket testbucket4, responseBody:
2023/09/14 04:30:04 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2023/09/14 04:30:04 Using n1ql client
2023/09/14 04:30:04 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2023/09/14 04:30:04 Expected and Actual scan responses are the same
2023/09/14 04:30:04 ============== DBG: Second bucket scan:: Scanning index bucket2_city in bucket testbucket2
2023/09/14 04:30:04 Using n1ql client
2023-09-14T04:30:04.588+05:30 [Info] GSIC[default/testbucket2-_default-_default-1694646004585009327] started ...
2023/09/14 04:30:04 ============== DBG: Second bucket scan:: Expected results = 392 Actual results = 392
2023/09/14 04:30:04 Expected and Actual scan responses are the same
2023/09/14 04:30:04 ============== DBG: Third bucket scan:: Scanning index bucket3_gender in bucket testbucket3
2023/09/14 04:30:04 Using n1ql client
2023-09-14T04:30:04.606+05:30 [Info] metadata provider version changed 1307 -> 1308
2023-09-14T04:30:04.606+05:30 [Info] switched currmeta from 1307 -> 1308 force false
2023-09-14T04:30:04.607+05:30 [Info] GSIC[default/testbucket3-_default-_default-1694646004598855980] started ...
2023/09/14 04:30:04 ============== DBG: Third bucket scan:: Expected results = 492 Actual results = 492
2023/09/14 04:30:04 Expected and Actual scan responses are the same
2023/09/14 04:30:04 ============== DBG: Deleting buckets testbucket2 testbucket3 testbucket4
2023/09/14 04:30:07 Deleted bucket testbucket2, responseBody:
2023/09/14 04:30:09 Deleted bucket testbucket3, responseBody:
2023/09/14 04:30:09 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/09/14 04:30:09 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc00012e000}
2023/09/14 04:30:09 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Wed, 13 Sep 2023 23:00:08 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00a740d40 31 [] false false map[] 0xc00aa99700 }
2023/09/14 04:30:09 DeleteBucket failed for bucket testbucket4
2023/09/14 04:30:09 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/09/14 04:30:12 Modified parameters of bucket default, responseBody:
--- PASS: TestDeleteBucketWhileInitialIndexBuild (273.75s)
=== RUN TestWherClause_UpdateDocument
2023/09/14 04:30:27 In TestWherClause_UpdateDocument()
2023/09/14 04:30:27 In DropAllSecondaryIndexes()
2023/09/14 04:30:27 Index found: bucket1_age
2023/09/14 04:30:27 Dropped index bucket1_age
2023/09/14 04:30:27 Index found: bucket1_gender
2023/09/14 04:30:27 Dropped index bucket1_gender
2023/09/14 04:31:06 Flushed the bucket default, Response body:
2023/09/14 04:31:08 Setting JSON docs in KV
2023/09/14 04:31:16 Created the secondary index id_ageGreaterThan40. Waiting for it become active
2023/09/14 04:31:16 Index is 12265090921735112001 now active
2023/09/14 04:31:16 Using n1ql client
2023/09/14 04:31:16 Expected and Actual scan responses are the same
2023/09/14 04:31:16 Number of docScanResults and scanResults = 5981 and 5981
2023/09/14 04:31:21 Using n1ql client
2023/09/14 04:31:21 Expected and Actual scan responses are the same
2023/09/14 04:31:21 Number of docScanResults and scanResults = 1981 and 1981
--- PASS: TestWherClause_UpdateDocument (53.65s)
=== RUN TestDeferFalse
2023/09/14 04:31:21 In TestDeferFalse()
2023/09/14 04:31:24 Setting JSON docs in KV
2023/09/14 04:31:37 Created the secondary index index_deferfalse1. Waiting for it become active
2023/09/14 04:31:37 Index is 3403568534357193070 now active
2023/09/14 04:31:37 Using n1ql client
2023/09/14 04:31:37 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse (15.80s)
=== RUN TestDeferFalse_CloseClientConnection
2023/09/14 04:31:37 In TestDeferFalse_CloseClientConnection()
2023/09/14 04:31:37 In CloseClientThread
2023/09/14 04:31:37 In CreateIndexThread
2023/09/14 04:31:39 Create Index call failed as expected due to error : Terminate Request due to client termination
2023/09/14 04:31:39 Waiting for index 7373712662872087190 to go active ...
2023/09/14 04:31:40 Waiting for index 7373712662872087190 to go active ...
2023/09/14 04:31:41 Waiting for index 7373712662872087190 to go active ...
2023/09/14 04:31:42 Waiting for index 7373712662872087190 to go active ...
2023/09/14 04:31:43 Waiting for index 7373712662872087190 to go active ...
2023/09/14 04:31:44 Waiting for index 7373712662872087190 to go active ...
2023/09/14 04:31:45 Index is 7373712662872087190 now active
2023/09/14 04:31:45 Using n1ql client
2023/09/14 04:31:45 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse_CloseClientConnection (8.14s)
=== RUN TestOrphanIndexCleanup
2023/09/14 04:31:45 In DropAllSecondaryIndexes()
2023/09/14 04:31:45 Index found: index_deferfalse1
2023/09/14 04:31:45 Dropped index index_deferfalse1
2023/09/14 04:31:45 Index found: index_deferfalse2
2023/09/14 04:31:45 Dropped index index_deferfalse2
2023/09/14 04:31:45 Index found: id_ageGreaterThan40
2023/09/14 04:31:45 Dropped index id_ageGreaterThan40
2023/09/14 04:31:59 Created the secondary index idx1_age_regular. Waiting for it become active
2023/09/14 04:31:59 Index is 15308726793392671328 now active
2023/09/14 04:32:07 Created the secondary index idx2_company_regular. Waiting for it become active
2023/09/14 04:32:07 Index is 8446109114101139959 now active
2023/09/14 04:32:17 Using n1ql client
2023/09/14 04:32:17 Query on idx1_age_regular is successful
2023/09/14 04:32:17 Using n1ql client
2023/09/14 04:32:17 Query on idx2_company_regular is successful
Restarting indexer process ...
2023/09/14 04:32:18 []
2023-09-14T04:32:18.044+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-14T04:32:18.045+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/14 04:32:38 Using n1ql client
2023-09-14T04:32:38.003+05:30 [Error] transport error between 127.0.0.1:35310->127.0.0.1:9107: write tcp 127.0.0.1:35310->127.0.0.1:9107: write: broken pipe
2023-09-14T04:32:38.003+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 8409251626908214053 request transport failed `write tcp 127.0.0.1:35310->127.0.0.1:9107: write: broken pipe`
2023-09-14T04:32:38.003+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-14T04:32:38.003+05:30 [Error] metadataClient:PickRandom: Replicas - [17490160972813001442], PrunedReplica - map[], FilteredReplica map[]
2023/09/14 04:32:38 Query on idx1_age_regular is successful - after indexer restart.
2023/09/14 04:32:38 Using n1ql client
2023/09/14 04:32:38 Query on idx2_company_regular is successful - after indexer restart.
--- PASS: TestOrphanIndexCleanup (52.74s)
=== RUN TestOrphanPartitionCleanup
2023/09/14 04:32:42 Created the secondary index idx3_age_regular. Waiting for it become active
2023/09/14 04:32:42 Index is 5725630911742466185 now active
2023/09/14 04:32:52 Using n1ql client
2023/09/14 04:32:52 Query on idx3_age_regular is successful
Restarting indexer process ...
2023/09/14 04:32:52 []
2023-09-14T04:32:53.003+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-14T04:32:53.004+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/14 04:33:12 Using n1ql client
2023-09-14T04:33:12.978+05:30 [Error] transport error between 127.0.0.1:57802->127.0.0.1:9107: write tcp 127.0.0.1:57802->127.0.0.1:9107: write: broken pipe
2023-09-14T04:33:12.978+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 8824332192338612971 request transport failed `write tcp 127.0.0.1:57802->127.0.0.1:9107: write: broken pipe`
2023-09-14T04:33:12.978+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8. Partition with instances 0
2023-09-14T04:33:12.978+05:30 [Error] metadataClient:PickRandom: Replicas - [6357077045350749953], PrunedReplica - map[], FilteredReplica map[]
2023/09/14 04:33:13 Query on idx3_age_regular is successful - after indexer restart.
--- PASS: TestOrphanPartitionCleanup (34.97s)
=== RUN TestIndexerSettings
2023/09/14 04:33:13 In TestIndexerSettings()
2023/09/14 04:33:13 Changing config key indexer.settings.max_cpu_percent to value 300
2023/09/14 04:33:13 Changing config key indexer.settings.inmemory_snapshot.interval to value 300
2023/09/14 04:33:13 Changing config key indexer.settings.persisted_snapshot.interval to value 20000
2023/09/14 04:33:13 Changing config key indexer.settings.recovery.max_rollbacks to value 3
2023/09/14 04:33:13 Changing config key indexer.settings.log_level to value error
--- PASS: TestIndexerSettings (0.59s)
=== RUN TestRestoreDefaultSettings
2023/09/14 04:33:13 In TestIndexerSettings_RestoreDefault()
2023/09/14 04:33:13 Changing config key indexer.settings.max_cpu_percent to value 0
2023/09/14 04:33:13 Changing config key indexer.settings.inmemory_snapshot.interval to value 200
2023/09/14 04:33:13 Changing config key indexer.settings.persisted_snapshot.interval to value 5000
2023/09/14 04:33:14 Changing config key indexer.settings.recovery.max_rollbacks to value 5
2023/09/14 04:33:14 Changing config key indexer.settings.log_level to value info
--- PASS: TestRestoreDefaultSettings (0.55s)
=== RUN TestStat_ItemsCount
2023/09/14 04:33:14 In TestStat_ItemsCount()
2023/09/14 04:33:14 In DropAllSecondaryIndexes()
2023/09/14 04:33:14 Index found: idx3_age_regular
2023/09/14 04:33:14 Dropped index idx3_age_regular
2023/09/14 04:33:14 Index found: idx2_company_regular
2023/09/14 04:33:14 Dropped index idx2_company_regular
2023/09/14 04:33:14 Index found: idx1_age_regular
2023/09/14 04:33:14 Dropped index idx1_age_regular
2023/09/14 04:33:14 Emptying the default bucket
2023/09/14 04:33:17 Flush Enabled on bucket default, responseBody:
2023/09/14 04:33:55 Flushed the bucket default, Response body:
2023/09/14 04:33:55 Generating JSON docs
2023/09/14 04:33:55 Setting initial JSON docs in KV
2023/09/14 04:34:00 Creating a 2i
2023/09/14 04:34:03 Created the secondary index index_test1. Waiting for it become active
2023/09/14 04:34:03 Index is 1004158382726622075 now active
2023/09/14 04:34:08 items_count stat is 10000
--- PASS: TestStat_ItemsCount (54.35s)
=== RUN TestRangeArrayIndex_Distinct
2023/09/14 04:34:08 In TestRangeArrayIndex_Distinct()
2023/09/14 04:34:08 In DropAllSecondaryIndexes()
2023/09/14 04:34:08 Index found: index_test1
2023/09/14 04:34:08 Dropped index index_test1
2023/09/14 04:34:46 Flushed the bucket default, Response body:
2023/09/14 04:34:50 Created the secondary index arridx_friends. Waiting for it become active
2023/09/14 04:34:50 Index is 18358074826400778353 now active
2023-09-14T04:34:50.426+05:30 [Error] transport error between 127.0.0.1:42502->127.0.0.1:9107: write tcp 127.0.0.1:42502->127.0.0.1:9107: write: broken pipe
2023-09-14T04:34:50.426+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:42502->127.0.0.1:9107: write: broken pipe`
2023-09-14T04:34:50.426+05:30 [Warn] scan failed: requestId queryport 127.0.0.1:9107 inst 14255603888969941359 partition [0]
2023-09-14T04:34:50.426+05:30 [Warn] Scan failed with error for index 18358074826400778353. Trying scan again with replica, reqId: : write tcp 127.0.0.1:42502->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2023-09-14T04:34:50.426+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-14T04:34:50.426+05:30 [Error] metadataClient:PickRandom: Replicas - [14255603888969941359], PrunedReplica - map[], FilteredReplica map[]
2023-09-14T04:34:50.426+05:30 [Warn] Fail to find indexers to satisfy query request. Trying scan again for index 18358074826400778353, reqId: : write tcp 127.0.0.1:42502->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2023/09/14 04:34:50 Expected and Actual scan responses are the same
2023/09/14 04:34:53 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Distinct (44.96s)
=== RUN TestUpdateArrayIndex_Distinct
2023/09/14 04:34:53 In TestUpdateArrayIndex_Distinct()
2023/09/14 04:34:53 In DropAllSecondaryIndexes()
2023/09/14 04:34:53 Index found: arridx_friends
2023/09/14 04:34:53 Dropped index arridx_friends
2023/09/14 04:35:31 Flushed the bucket default, Response body:
2023/09/14 04:35:35 Created the secondary index arridx_friends. Waiting for it become active
2023/09/14 04:35:35 Index is 6854137503031320777 now active
2023/09/14 04:35:35 Expected and Actual scan responses are the same
2023/09/14 04:35:38 Expected and Actual scan responses are the same
2023/09/14 04:35:38 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Distinct (45.52s)
=== RUN TestRangeArrayIndex_Duplicate
2023/09/14 04:35:38 In TestRangeArrayIndex_Duplicate()
2023/09/14 04:35:38 In DropAllSecondaryIndexes()
2023/09/14 04:35:38 Index found: arridx_friends
2023/09/14 04:35:39 Dropped index arridx_friends
2023/09/14 04:36:16 Flushed the bucket default, Response body:
2023/09/14 04:36:20 Created the secondary index arridx_friends. Waiting for it become active
2023/09/14 04:36:20 Index is 16026745778892589367 now active
2023/09/14 04:36:20 Expected and Actual scan responses are the same
2023/09/14 04:36:23 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Duplicate (44.49s)
=== RUN TestUpdateArrayIndex_Duplicate
2023/09/14 04:36:23 In TestUpdateArrayIndex_Duplicate()
2023/09/14 04:36:23 In DropAllSecondaryIndexes()
2023/09/14 04:36:23 Index found: arridx_friends
2023/09/14 04:36:23 Dropped index arridx_friends
2023/09/14 04:37:01 Flushed the bucket default, Response body:
2023/09/14 04:37:05 Created the secondary index arridx_friends. Waiting for it become active
2023/09/14 04:37:05 Index is 8127478111420911985 now active
2023/09/14 04:37:05 Expected and Actual scan responses are the same
2023/09/14 04:37:08 Expected and Actual scan responses are the same
2023/09/14 04:37:08 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Duplicate (45.34s)
=== RUN TestArrayIndexCornerCases
set09_arrayindex_test.go:193: Test disbaled
--- SKIP: TestArrayIndexCornerCases (0.00s)
=== RUN TestArraySizeIncreaseDecrease1
set09_arrayindex_test.go:249: Test disbaled
--- SKIP: TestArraySizeIncreaseDecrease1 (0.00s)
=== RUN TestArraySizeIncreaseDecrease2
set09_arrayindex_test.go:369: Test disbaled
--- SKIP: TestArraySizeIncreaseDecrease2 (0.00s)
=== RUN TestBufferedScan_BackfillDisabled
2023/09/14 04:37:08 In TestBufferedScan_BackfillDisabled()
2023/09/14 04:37:08 In DropAllSecondaryIndexes()
2023/09/14 04:37:08 Index found: arridx_friends
2023/09/14 04:37:08 Dropped index arridx_friends
2023/09/14 04:37:46 Flushed the bucket default, Response body:
2023/09/14 04:38:24 Changing config key queryport.client.settings.backfillLimit to value 0
2023/09/14 04:38:29 Created the secondary index addressidx. Waiting for it become active
2023/09/14 04:38:29 Index is 12099616370524138168 now active
2023-09-14T04:38:29.744+05:30 [Info] metadata provider version changed 1440 -> 1441
2023-09-14T04:38:29.744+05:30 [Info] switched currmeta from 1440 -> 1441 force false
2023-09-14T04:38:29.744+05:30 [Info] GSIC[default/default-_default-_default-1694646509739285590] started ...
2023-09-14T04:38:29.744+05:30 [Warn] MonitorIndexer: Indexer for default:_default:_default is already being monitored
2023/09/14 04:38:29 Non-backfill file found: /tmp/.ICE-unix
2023/09/14 04:38:29 Non-backfill file found: /tmp/.Test-unix
2023/09/14 04:38:29 Non-backfill file found: /tmp/.X11-unix
2023/09/14 04:38:29 Non-backfill file found: /tmp/.XIM-unix
2023/09/14 04:38:29 Non-backfill file found: /tmp/.font-unix
2023/09/14 04:38:29 Non-backfill file found: /tmp/03410908-3dfa-464f-82ca-1d470b12dd04.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/311bab45-db2c-4acc-a281-65880edf8fb6.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/33ada19c-ef97-4f64-b262-2b24f05c8400.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/34978200-1116-4fc0-88ef-88f407134a64.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/7d2c60f2-2800-4e26-991d-a593ec40ddfe.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/866547ed-5481-4d86-a113-bf55f710bcc4.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/8942671b-7f97-4b05-bfd2-49cafc28ecf5.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/8fcc0741-d6f5-45cb-a060-3ec80519f587.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/cc710620-b165-477b-bb65-0c299b5ad5cb.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/d3617195-084a-4343-b0c2-46e7f639b184.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/d98fad10-996d-4261-b828-d5871a94a2d3.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/e3c89ab8-e453-44a1-ad8b-ba920e22f9a3.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_03410908-3dfa-464f-82ca-1d470b12dd04.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_311bab45-db2c-4acc-a281-65880edf8fb6.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_33ada19c-ef97-4f64-b262-2b24f05c8400.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_34978200-1116-4fc0-88ef-88f407134a64.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_7d2c60f2-2800-4e26-991d-a593ec40ddfe.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_866547ed-5481-4d86-a113-bf55f710bcc4.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_8942671b-7f97-4b05-bfd2-49cafc28ecf5.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_8fcc0741-d6f5-45cb-a060-3ec80519f587.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_cc710620-b165-477b-bb65-0c299b5ad5cb.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_d3617195-084a-4343-b0c2-46e7f639b184.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_d98fad10-996d-4261-b828-d5871a94a2d3.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/f_e3c89ab8-e453-44a1-ad8b-ba920e22f9a3.sock
2023/09/14 04:38:29 Non-backfill file found: /tmp/fail.log
2023/09/14 04:38:29 Non-backfill file found: /tmp/go-build1069678413
2023/09/14 04:38:29 Non-backfill file found: /tmp/mdbslice
2023/09/14 04:38:29 Non-backfill file found: /tmp/systemd-private-ab9907e06e9f4111bd02d61025efeeb6-apache2.service-VyXH8y
2023/09/14 04:38:29 Non-backfill file found: /tmp/systemd-private-ab9907e06e9f4111bd02d61025efeeb6-systemd-timesyncd.service-pdWlP3
2023/09/14 04:38:29 limit=1,chsize=256; received 1 items; took 3.632219ms
2023-09-14T04:38:29.793+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T04:38:29.793+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T04:38:29.794+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023-09-14T04:38:29.795+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T04:38:29.795+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T04:38:29.796+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023/09/14 04:38:32 limit=1000,chsize=256; received 1000 items; took 1.279414254s
2023-09-14T04:38:32.825+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-14T04:38:32.831+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T04:38:32.831+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T04:38:32.833+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-14T04:38:32.834+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-14T04:38:32.834+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-14T04:38:32.836+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023-09-14T04:38:33.062+05:30 [Info] gsiKeyspace::Close Closing default:_default:_default
--- PASS: TestBufferedScan_BackfillDisabled (84.26s)
=== RUN TestBufferedScan_BackfillEnabled
2023/09/14 04:38:33 In TestBufferedScan_BackfillEnabled()
2023-09-14T04:38:33.164+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/14 04:38:33 Changing config key queryport.client.settings.backfillLimit to value 1
2023-09-14T04:38:33.190+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"warn","queryport.client.settings.backfillLimit":1,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023/09/14 04:38:33 limit=1,chsize=256; received 1 items; took 13.05625ms
2023/09/14 04:38:34 limit=1000,chsize=256; received 1000 items; took 9.754381ms
2023/09/14 04:38:46 limit=1000,chsize=256; received 1000 items; took 10.363577358s
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
2023/09/14 04:39:00 limit=1000,chsize=256; received 643 items; took 13.172537198s
2023/09/14 04:39:00 limit=1000,chsize=256; received 643 items; took 13.192836114s
2023/09/14 04:39:01 Changing config key queryport.client.settings.backfillLimit to value 0
--- PASS: TestBufferedScan_BackfillEnabled (28.82s)
=== RUN TestMultiScanSetup
2023/09/14 04:39:01 In TestMultiScanSetup()
2023/09/14 04:39:03 Emptying the default bucket
2023/09/14 04:39:06 Flush Enabled on bucket default, responseBody:
2023/09/14 04:39:43 Flushed the bucket default, Response body:
2023/09/14 04:39:43 Populating the default bucket
2023/09/14 04:39:56 Created the secondary index index_companyname. Waiting for it become active
2023/09/14 04:39:56 Index is 8516085883587908717 now active
2023/09/14 04:40:03 Created the secondary index index_company. Waiting for it become active
2023/09/14 04:40:03 Index is 12742041731738101649 now active
2023/09/14 04:40:09 Created the secondary index index_company_name_age. Waiting for it become active
2023/09/14 04:40:09 Index is 7897794170821051474 now active
2023/09/14 04:40:15 Created the secondary index index_primary. Waiting for it become active
2023/09/14 04:40:15 Index is 1550345515572588426 now active
2023/09/14 04:40:22 Created the secondary index index_company_name_age_address. Waiting for it become active
2023/09/14 04:40:22 Index is 16095279752901063850 now active
2023/09/14 04:40:29 Created the secondary index index_company_name_age_address_friends. Waiting for it become active
2023/09/14 04:40:29 Index is 9718341908685713511 now active
--- PASS: TestMultiScanSetup (87.20s)
=== RUN TestMultiScanCount
2023/09/14 04:40:29 In TestMultiScanCount()
2023/09/14 04:40:29
--------- Composite Index with 2 fields ---------
2023/09/14 04:40:29
--- ScanAllNoFilter ---
2023/09/14 04:40:29 distinct = false
2023/09/14 04:40:29 Using n1ql client
2023/09/14 04:40:29 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:40:29
--- ScanAllFilterNil ---
2023/09/14 04:40:29 distinct = false
2023/09/14 04:40:30 Using n1ql client
2023/09/14 04:40:30 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:40:30
--- ScanAll_AllFiltersNil ---
2023/09/14 04:40:30 distinct = false
2023/09/14 04:40:30 Using n1ql client
2023/09/14 04:40:30 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:40:30
--- SingleSeek ---
2023/09/14 04:40:30 distinct = false
2023/09/14 04:40:30 Using n1ql client
2023/09/14 04:40:30 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:40:30
--- MultipleSeek ---
2023/09/14 04:40:30 distinct = false
2023/09/14 04:40:31 Using n1ql client
2023/09/14 04:40:31 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/14 04:40:31
--- SimpleRange ---
2023/09/14 04:40:31 distinct = false
2023/09/14 04:40:31 Using n1ql client
2023/09/14 04:40:31 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/14 04:40:31
--- NonOverlappingRanges ---
2023/09/14 04:40:31 distinct = false
2023/09/14 04:40:32 Using n1ql client
2023/09/14 04:40:32 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2023/09/14 04:40:32
--- OverlappingRanges ---
2023/09/14 04:40:32 distinct = false
2023/09/14 04:40:32 Using n1ql client
2023/09/14 04:40:32 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2023/09/14 04:40:32
--- NonOverlappingFilters ---
2023/09/14 04:40:32 distinct = false
2023/09/14 04:40:32 Using n1ql client
2023/09/14 04:40:32 MultiScanCount = 337 ExpectedMultiScanCount = 337
2023/09/14 04:40:32
--- OverlappingFilters ---
2023/09/14 04:40:32 distinct = false
2023/09/14 04:40:33 Using n1ql client
2023/09/14 04:40:33 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2023/09/14 04:40:33
--- BoundaryFilters ---
2023/09/14 04:40:33 distinct = false
2023/09/14 04:40:33 Using n1ql client
2023/09/14 04:40:33 MultiScanCount = 499 ExpectedMultiScanCount = 499
2023/09/14 04:40:33
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:40:33 distinct = false
2023/09/14 04:40:34 Using n1ql client
2023/09/14 04:40:34 MultiScanCount = 256 ExpectedMultiScanCount = 256
2023/09/14 04:40:34
--- SeekAndFilters_Overlapping ---
2023/09/14 04:40:34 distinct = false
2023/09/14 04:40:34 Using n1ql client
2023/09/14 04:40:34 MultiScanCount = 255 ExpectedMultiScanCount = 255
2023/09/14 04:40:34
--- SimpleRangeLowUnbounded ---
2023/09/14 04:40:34 distinct = false
2023/09/14 04:40:34 Using n1ql client
2023/09/14 04:40:34 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/14 04:40:34
--- SimpleRangeHighUnbounded ---
2023/09/14 04:40:34 distinct = false
2023/09/14 04:40:35 Using n1ql client
2023/09/14 04:40:35 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/14 04:40:35
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:40:35 distinct = false
2023/09/14 04:40:35 Using n1ql client
2023/09/14 04:40:35 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:40:35
--- FiltersWithUnbounded ---
2023/09/14 04:40:35 distinct = false
2023/09/14 04:40:36 Using n1ql client
2023/09/14 04:40:36 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/14 04:40:36
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:40:36 distinct = false
2023/09/14 04:40:36 Using n1ql client
2023/09/14 04:40:36 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/14 04:40:36
--------- Simple Index with 1 field ---------
2023/09/14 04:40:36
--- SingleIndexSimpleRange ---
2023/09/14 04:40:36 distinct = false
2023/09/14 04:40:36 Using n1ql client
2023/09/14 04:40:36 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/14 04:40:36
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:40:36 distinct = false
2023/09/14 04:40:37 Using n1ql client
2023/09/14 04:40:37 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2023/09/14 04:40:37
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:40:37 distinct = false
2023/09/14 04:40:37 Using n1ql client
2023/09/14 04:40:37 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2023/09/14 04:40:37
--------- Composite Index with 3 fields ---------
2023/09/14 04:40:37
--- ScanAllNoFilter ---
2023/09/14 04:40:37 distinct = false
2023/09/14 04:40:38 Using n1ql client
2023/09/14 04:40:38 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:40:38
--- ScanAllFilterNil ---
2023/09/14 04:40:38 distinct = false
2023/09/14 04:40:38 Using n1ql client
2023/09/14 04:40:38 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:40:38
--- ScanAll_AllFiltersNil ---
2023/09/14 04:40:38 distinct = false
2023/09/14 04:40:38 Using n1ql client
2023/09/14 04:40:38 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:40:38
--- 3FieldsSingleSeek ---
2023/09/14 04:40:38 distinct = false
2023/09/14 04:40:39 Using n1ql client
2023/09/14 04:40:39 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:40:39
--- 3FieldsMultipleSeeks ---
2023/09/14 04:40:39 distinct = false
2023/09/14 04:40:39 Using n1ql client
2023/09/14 04:40:39 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/14 04:40:39
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:40:39 distinct = false
2023/09/14 04:40:40 Using n1ql client
2023/09/14 04:40:40 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/14 04:40:40
--------- New scenarios ---------
2023/09/14 04:40:40
--- CompIndexHighUnbounded1 ---
2023/09/14 04:40:40
--- Multi Scan 0 ---
2023/09/14 04:40:40 distinct = false
2023/09/14 04:40:40 Using n1ql client
2023/09/14 04:40:40 Using n1ql client
2023/09/14 04:40:40 len(scanResults) = 8 MultiScanCount = 8
2023/09/14 04:40:40 Expected and Actual scan responses are the same
2023/09/14 04:40:40
--- Multi Scan 1 ---
2023/09/14 04:40:40 distinct = false
2023/09/14 04:40:41 Using n1ql client
2023/09/14 04:40:41 Using n1ql client
2023/09/14 04:40:41 len(scanResults) = 0 MultiScanCount = 0
2023/09/14 04:40:41 Expected and Actual scan responses are the same
2023/09/14 04:40:41
--- Multi Scan 2 ---
2023/09/14 04:40:41 distinct = false
2023/09/14 04:40:41 Using n1ql client
2023/09/14 04:40:41 Using n1ql client
2023/09/14 04:40:41 len(scanResults) = 9 MultiScanCount = 9
2023/09/14 04:40:41 Expected and Actual scan responses are the same
2023/09/14 04:40:41
--- CompIndexHighUnbounded2 ---
2023/09/14 04:40:41
--- Multi Scan 0 ---
2023/09/14 04:40:41 distinct = false
2023/09/14 04:40:41 Using n1ql client
2023/09/14 04:40:41 Using n1ql client
2023/09/14 04:40:41 len(scanResults) = 4138 MultiScanCount = 4138
2023/09/14 04:40:41 Expected and Actual scan responses are the same
2023/09/14 04:40:41
--- Multi Scan 1 ---
2023/09/14 04:40:41 distinct = false
2023/09/14 04:40:42 Using n1ql client
2023/09/14 04:40:42 Using n1ql client
2023/09/14 04:40:42 len(scanResults) = 2746 MultiScanCount = 2746
2023/09/14 04:40:42 Expected and Actual scan responses are the same
2023/09/14 04:40:42
--- Multi Scan 2 ---
2023/09/14 04:40:42 distinct = false
2023/09/14 04:40:42 Using n1ql client
2023/09/14 04:40:42 Using n1ql client
2023/09/14 04:40:42 len(scanResults) = 4691 MultiScanCount = 4691
2023/09/14 04:40:42 Expected and Actual scan responses are the same
2023/09/14 04:40:42
--- CompIndexHighUnbounded3 ---
2023/09/14 04:40:42
--- Multi Scan 0 ---
2023/09/14 04:40:42 distinct = false
2023/09/14 04:40:43 Using n1ql client
2023/09/14 04:40:43 Using n1ql client
2023/09/14 04:40:43 len(scanResults) = 1329 MultiScanCount = 1329
2023/09/14 04:40:43 Expected and Actual scan responses are the same
2023/09/14 04:40:43
--- CompIndexHighUnbounded4 ---
2023/09/14 04:40:43
--- Multi Scan 0 ---
2023/09/14 04:40:43 distinct = false
2023/09/14 04:40:43 Using n1ql client
2023/09/14 04:40:43 Using n1ql client
2023/09/14 04:40:43 len(scanResults) = 5349 MultiScanCount = 5349
2023/09/14 04:40:43 Expected and Actual scan responses are the same
2023/09/14 04:40:43
--- CompIndexHighUnbounded5 ---
2023/09/14 04:40:43
--- Multi Scan 0 ---
2023/09/14 04:40:43 distinct = false
2023/09/14 04:40:44 Using n1ql client
2023/09/14 04:40:44 Using n1ql client
2023/09/14 04:40:44 len(scanResults) = 8210 MultiScanCount = 8210
2023/09/14 04:40:44 Expected and Actual scan responses are the same
2023/09/14 04:40:44
--- SeekBoundaries ---
2023/09/14 04:40:44
--- Multi Scan 0 ---
2023/09/14 04:40:44 distinct = false
2023/09/14 04:40:44 Using n1ql client
2023/09/14 04:40:44 Using n1ql client
2023/09/14 04:40:44 len(scanResults) = 175 MultiScanCount = 175
2023/09/14 04:40:44 Expected and Actual scan responses are the same
2023/09/14 04:40:44
--- Multi Scan 1 ---
2023/09/14 04:40:44 distinct = false
2023/09/14 04:40:44 Using n1ql client
2023/09/14 04:40:44 Using n1ql client
2023/09/14 04:40:44 len(scanResults) = 1 MultiScanCount = 1
2023/09/14 04:40:44 Expected and Actual scan responses are the same
2023/09/14 04:40:44
--- Multi Scan 2 ---
2023/09/14 04:40:44 distinct = false
2023/09/14 04:40:45 Using n1ql client
2023/09/14 04:40:45 Using n1ql client
2023/09/14 04:40:45 len(scanResults) = 555 MultiScanCount = 555
2023/09/14 04:40:45 Expected and Actual scan responses are the same
2023/09/14 04:40:45
--- Multi Scan 3 ---
2023/09/14 04:40:45 distinct = false
2023/09/14 04:40:45 Using n1ql client
2023/09/14 04:40:45 Using n1ql client
2023/09/14 04:40:45 len(scanResults) = 872 MultiScanCount = 872
2023/09/14 04:40:45 Expected and Actual scan responses are the same
2023/09/14 04:40:45
--- Multi Scan 4 ---
2023/09/14 04:40:45 distinct = false
2023/09/14 04:40:46 Using n1ql client
2023/09/14 04:40:46 Using n1ql client
2023/09/14 04:40:46 len(scanResults) = 287 MultiScanCount = 287
2023/09/14 04:40:46 Expected and Actual scan responses are the same
2023/09/14 04:40:46
--- Multi Scan 5 ---
2023/09/14 04:40:46 distinct = false
2023/09/14 04:40:46 Using n1ql client
2023/09/14 04:40:46 Using n1ql client
2023/09/14 04:40:46 len(scanResults) = 5254 MultiScanCount = 5254
2023/09/14 04:40:46 Expected and Actual scan responses are the same
2023/09/14 04:40:46
--- Multi Scan 6 ---
2023/09/14 04:40:46 distinct = false
2023/09/14 04:40:47 Using n1ql client
2023/09/14 04:40:47 Using n1ql client
2023/09/14 04:40:47 len(scanResults) = 5566 MultiScanCount = 5566
2023/09/14 04:40:47 Expected and Actual scan responses are the same
2023/09/14 04:40:47
--- Multi Scan 7 ---
2023/09/14 04:40:47 distinct = false
2023/09/14 04:40:47 Using n1ql client
2023/09/14 04:40:47 Using n1ql client
2023/09/14 04:40:47 len(scanResults) = 8 MultiScanCount = 8
2023/09/14 04:40:47 Expected and Actual scan responses are the same
2023/09/14 04:40:47
--------- With DISTINCT True ---------
2023/09/14 04:40:47
--- ScanAllNoFilter ---
2023/09/14 04:40:47 distinct = true
2023/09/14 04:40:47 Using n1ql client
2023/09/14 04:40:47 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:40:47
--- ScanAllFilterNil ---
2023/09/14 04:40:47 distinct = true
2023/09/14 04:40:48 Using n1ql client
2023/09/14 04:40:48 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:40:48
--- ScanAll_AllFiltersNil ---
2023/09/14 04:40:48 distinct = true
2023/09/14 04:40:48 Using n1ql client
2023/09/14 04:40:48 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:40:48
--- SingleSeek ---
2023/09/14 04:40:48 distinct = true
2023/09/14 04:40:49 Using n1ql client
2023/09/14 04:40:49 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:40:49
--- MultipleSeek ---
2023/09/14 04:40:49 distinct = true
2023/09/14 04:40:49 Using n1ql client
2023/09/14 04:40:49 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/14 04:40:49
--- SimpleRange ---
2023/09/14 04:40:49 distinct = true
2023/09/14 04:40:49 Using n1ql client
2023/09/14 04:40:49 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/14 04:40:49
--- NonOverlappingRanges ---
2023/09/14 04:40:49 distinct = true
2023/09/14 04:40:50 Using n1ql client
2023/09/14 04:40:50 MultiScanCount = 428 ExpectedMultiScanCount = 428
2023/09/14 04:40:50
--- OverlappingRanges ---
2023/09/14 04:40:50 distinct = true
2023/09/14 04:40:50 Using n1ql client
2023/09/14 04:40:50 MultiScanCount = 575 ExpectedMultiScanCount = 575
2023/09/14 04:40:50
--- NonOverlappingFilters ---
2023/09/14 04:40:50 distinct = true
2023/09/14 04:40:51 Using n1ql client
2023/09/14 04:40:51 MultiScanCount = 186 ExpectedMultiScanCount = 186
2023/09/14 04:40:51
--- NonOverlappingFilters2 ---
2023/09/14 04:40:51 distinct = true
2023/09/14 04:40:51 Using n1ql client
2023/09/14 04:40:51 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:40:51
--- OverlappingFilters ---
2023/09/14 04:40:51 distinct = true
2023/09/14 04:40:51 Using n1ql client
2023/09/14 04:40:52 MultiScanCount = 543 ExpectedMultiScanCount = 543
2023/09/14 04:40:52
--- BoundaryFilters ---
2023/09/14 04:40:52 distinct = true
2023/09/14 04:40:52 Using n1ql client
2023/09/14 04:40:52 MultiScanCount = 172 ExpectedMultiScanCount = 172
2023/09/14 04:40:52
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:40:52 distinct = true
2023/09/14 04:40:52 Using n1ql client
2023/09/14 04:40:52 MultiScanCount = 135 ExpectedMultiScanCount = 135
2023/09/14 04:40:52
--- SeekAndFilters_Overlapping ---
2023/09/14 04:40:52 distinct = true
2023/09/14 04:40:53 Using n1ql client
2023/09/14 04:40:53 MultiScanCount = 134 ExpectedMultiScanCount = 134
2023/09/14 04:40:53
--- SimpleRangeLowUnbounded ---
2023/09/14 04:40:53 distinct = false
2023/09/14 04:40:53 Using n1ql client
2023/09/14 04:40:53 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/14 04:40:53
--- SimpleRangeHighUnbounded ---
2023/09/14 04:40:53 distinct = false
2023/09/14 04:40:54 Using n1ql client
2023/09/14 04:40:54 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/14 04:40:54
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:40:54 distinct = false
2023/09/14 04:40:54 Using n1ql client
2023/09/14 04:40:54 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:40:54
--- FiltersWithUnbounded ---
2023/09/14 04:40:54 distinct = false
2023/09/14 04:40:54 Using n1ql client
2023/09/14 04:40:54 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/14 04:40:54
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:40:54 distinct = false
2023/09/14 04:40:55 Using n1ql client
2023/09/14 04:40:55 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/14 04:40:55
--------- Simple Index with 1 field ---------
2023/09/14 04:40:55
--- SingleIndexSimpleRange ---
2023/09/14 04:40:55 distinct = true
2023/09/14 04:40:56 Using n1ql client
2023/09/14 04:40:56 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/14 04:40:56
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:40:56 distinct = true
2023/09/14 04:40:56 Using n1ql client
2023/09/14 04:40:56 MultiScanCount = 713 ExpectedMultiScanCount = 713
2023/09/14 04:40:56
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:40:56 distinct = true
2023/09/14 04:40:57 Using n1ql client
2023/09/14 04:40:57 MultiScanCount = 869 ExpectedMultiScanCount = 869
2023/09/14 04:40:57
--------- Composite Index with 3 fields ---------
2023/09/14 04:40:57
--- ScanAllNoFilter ---
2023/09/14 04:40:57 distinct = true
2023/09/14 04:40:57 Using n1ql client
2023/09/14 04:40:57 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:40:57
--- ScanAllFilterNil ---
2023/09/14 04:40:57 distinct = true
2023/09/14 04:40:57 Using n1ql client
2023/09/14 04:40:57 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:40:57
--- ScanAll_AllFiltersNil ---
2023/09/14 04:40:57 distinct = true
2023/09/14 04:40:58 Using n1ql client
2023/09/14 04:40:58 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:40:58
--- 3FieldsSingleSeek ---
2023/09/14 04:40:58 distinct = true
2023/09/14 04:40:58 Using n1ql client
2023/09/14 04:40:58 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:40:58
--- 3FieldsMultipleSeeks ---
2023/09/14 04:40:58 distinct = true
2023/09/14 04:40:59 Using n1ql client
2023/09/14 04:40:59 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/14 04:40:59
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:40:59 distinct = true
2023/09/14 04:40:59 Using n1ql client
2023/09/14 04:40:59 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanCount (30.68s)
=== RUN TestMultiScanScenarios
2023/09/14 04:40:59 In TestMultiScanScenarios()
2023/09/14 04:40:59
--------- Composite Index with 2 fields ---------
2023/09/14 04:40:59
--- ScanAllNoFilter ---
2023/09/14 04:40:59 distinct = false
2023/09/14 04:41:00 Using n1ql client
2023/09/14 04:41:00 Expected and Actual scan responses are the same
2023/09/14 04:41:00
--- ScanAllFilterNil ---
2023/09/14 04:41:00 distinct = false
2023/09/14 04:41:00 Using n1ql client
2023/09/14 04:41:00 Expected and Actual scan responses are the same
2023/09/14 04:41:00
--- ScanAll_AllFiltersNil ---
2023/09/14 04:41:00 distinct = false
2023/09/14 04:41:01 Using n1ql client
2023/09/14 04:41:01 Expected and Actual scan responses are the same
2023/09/14 04:41:01
--- SingleSeek ---
2023/09/14 04:41:01 distinct = false
2023/09/14 04:41:01 Using n1ql client
2023/09/14 04:41:01 Expected and Actual scan responses are the same
2023/09/14 04:41:01
--- MultipleSeek ---
2023/09/14 04:41:01 distinct = false
2023/09/14 04:41:01 Using n1ql client
2023/09/14 04:41:01 Expected and Actual scan responses are the same
2023/09/14 04:41:01
--- SimpleRange ---
2023/09/14 04:41:01 distinct = false
2023/09/14 04:41:02 Using n1ql client
2023/09/14 04:41:02 Expected and Actual scan responses are the same
2023/09/14 04:41:02
--- NonOverlappingRanges ---
2023/09/14 04:41:02 distinct = false
2023/09/14 04:41:02 Using n1ql client
2023/09/14 04:41:02 Expected and Actual scan responses are the same
2023/09/14 04:41:02
--- OverlappingRanges ---
2023/09/14 04:41:02 distinct = false
2023/09/14 04:41:03 Using n1ql client
2023/09/14 04:41:03 Expected and Actual scan responses are the same
2023/09/14 04:41:03
--- NonOverlappingFilters ---
2023/09/14 04:41:03 distinct = false
2023/09/14 04:41:03 Using n1ql client
2023/09/14 04:41:03 Expected and Actual scan responses are the same
2023/09/14 04:41:03
--- OverlappingFilters ---
2023/09/14 04:41:03 distinct = false
2023/09/14 04:41:04 Using n1ql client
2023/09/14 04:41:04 Expected and Actual scan responses are the same
2023/09/14 04:41:04
--- BoundaryFilters ---
2023/09/14 04:41:04 distinct = false
2023/09/14 04:41:04 Using n1ql client
2023/09/14 04:41:04 Expected and Actual scan responses are the same
2023/09/14 04:41:04
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:41:04 distinct = false
2023/09/14 04:41:05 Using n1ql client
2023/09/14 04:41:05 Expected and Actual scan responses are the same
2023/09/14 04:41:05
--- SeekAndFilters_Overlapping ---
2023/09/14 04:41:05 distinct = false
2023/09/14 04:41:05 Using n1ql client
2023/09/14 04:41:05 Expected and Actual scan responses are the same
2023/09/14 04:41:05
--- SimpleRangeLowUnbounded ---
2023/09/14 04:41:05 distinct = false
2023/09/14 04:41:05 Using n1ql client
2023/09/14 04:41:05 Expected and Actual scan responses are the same
2023/09/14 04:41:05
--- SimpleRangeHighUnbounded ---
2023/09/14 04:41:05 distinct = false
2023/09/14 04:41:06 Using n1ql client
2023/09/14 04:41:06 Expected and Actual scan responses are the same
2023/09/14 04:41:06
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:41:06 distinct = false
2023/09/14 04:41:06 Using n1ql client
2023/09/14 04:41:06 Expected and Actual scan responses are the same
2023/09/14 04:41:06
--- FiltersWithUnbounded ---
2023/09/14 04:41:06 distinct = false
2023/09/14 04:41:07 Using n1ql client
2023/09/14 04:41:07 Expected and Actual scan responses are the same
2023/09/14 04:41:07
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:41:07 distinct = false
2023/09/14 04:41:07 Using n1ql client
2023/09/14 04:41:07 Expected and Actual scan responses are the same
2023/09/14 04:41:07
--------- Simple Index with 1 field ---------
2023/09/14 04:41:07
--- SingleIndexSimpleRange ---
2023/09/14 04:41:07 distinct = false
2023/09/14 04:41:07 Using n1ql client
2023/09/14 04:41:07 Expected and Actual scan responses are the same
2023/09/14 04:41:07
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:41:07 distinct = false
2023/09/14 04:41:08 Using n1ql client
2023/09/14 04:41:08 Expected and Actual scan responses are the same
2023/09/14 04:41:08
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:41:08 distinct = false
2023/09/14 04:41:08 Using n1ql client
2023/09/14 04:41:08 Expected and Actual scan responses are the same
2023/09/14 04:41:08
--------- Composite Index with 3 fields ---------
2023/09/14 04:41:08
--- ScanAllNoFilter ---
2023/09/14 04:41:08 distinct = false
2023/09/14 04:41:09 Using n1ql client
2023/09/14 04:41:09 Expected and Actual scan responses are the same
2023/09/14 04:41:09
--- ScanAllFilterNil ---
2023/09/14 04:41:09 distinct = false
2023/09/14 04:41:09 Using n1ql client
2023/09/14 04:41:09 Expected and Actual scan responses are the same
2023/09/14 04:41:09
--- ScanAll_AllFiltersNil ---
2023/09/14 04:41:09 distinct = false
2023/09/14 04:41:10 Using n1ql client
2023/09/14 04:41:10 Expected and Actual scan responses are the same
2023/09/14 04:41:10
--- 3FieldsSingleSeek ---
2023/09/14 04:41:10 distinct = false
2023/09/14 04:41:10 Using n1ql client
2023/09/14 04:41:10 Expected and Actual scan responses are the same
2023/09/14 04:41:10
--- 3FieldsMultipleSeeks ---
2023/09/14 04:41:10 distinct = false
2023/09/14 04:41:11 Using n1ql client
2023/09/14 04:41:11 Expected and Actual scan responses are the same
2023/09/14 04:41:11
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:41:11 distinct = false
2023/09/14 04:41:11 Using n1ql client
2023/09/14 04:41:11 Expected and Actual scan responses are the same
2023/09/14 04:41:11
--------- New scenarios ---------
2023/09/14 04:41:11
--- CompIndexHighUnbounded1 ---
2023/09/14 04:41:11
--- Multi Scan 0 ---
2023/09/14 04:41:11 distinct = false
2023/09/14 04:41:12 Using n1ql client
2023/09/14 04:41:12 Expected and Actual scan responses are the same
2023/09/14 04:41:12
--- Multi Scan 1 ---
2023/09/14 04:41:12 distinct = false
2023/09/14 04:41:12 Using n1ql client
2023/09/14 04:41:12 Expected and Actual scan responses are the same
2023/09/14 04:41:12
--- Multi Scan 2 ---
2023/09/14 04:41:12 distinct = false
2023/09/14 04:41:12 Using n1ql client
2023/09/14 04:41:12 Expected and Actual scan responses are the same
2023/09/14 04:41:12
--- CompIndexHighUnbounded2 ---
2023/09/14 04:41:12
--- Multi Scan 0 ---
2023/09/14 04:41:12 distinct = false
2023/09/14 04:41:13 Using n1ql client
2023/09/14 04:41:13 Expected and Actual scan responses are the same
2023/09/14 04:41:13
--- Multi Scan 1 ---
2023/09/14 04:41:13 distinct = false
2023/09/14 04:41:13 Using n1ql client
2023/09/14 04:41:13 Expected and Actual scan responses are the same
2023/09/14 04:41:13
--- Multi Scan 2 ---
2023/09/14 04:41:13 distinct = false
2023/09/14 04:41:14 Using n1ql client
2023/09/14 04:41:14 Expected and Actual scan responses are the same
2023/09/14 04:41:14
--- CompIndexHighUnbounded3 ---
2023/09/14 04:41:14
--- Multi Scan 0 ---
2023/09/14 04:41:14 distinct = false
2023/09/14 04:41:14 Using n1ql client
2023/09/14 04:41:14 Expected and Actual scan responses are the same
2023/09/14 04:41:14
--- CompIndexHighUnbounded4 ---
2023/09/14 04:41:14
--- Multi Scan 0 ---
2023/09/14 04:41:14 distinct = false
2023/09/14 04:41:14 Using n1ql client
2023/09/14 04:41:15 Expected and Actual scan responses are the same
2023/09/14 04:41:15
--- CompIndexHighUnbounded5 ---
2023/09/14 04:41:15
--- Multi Scan 0 ---
2023/09/14 04:41:15 distinct = false
2023/09/14 04:41:15 Using n1ql client
2023/09/14 04:41:15 Expected and Actual scan responses are the same
2023/09/14 04:41:15
--- SeekBoundaries ---
2023/09/14 04:41:15
--- Multi Scan 0 ---
2023/09/14 04:41:15 distinct = false
2023/09/14 04:41:15 Using n1ql client
2023/09/14 04:41:15 Expected and Actual scan responses are the same
2023/09/14 04:41:15
--- Multi Scan 1 ---
2023/09/14 04:41:15 distinct = false
2023/09/14 04:41:16 Using n1ql client
2023/09/14 04:41:16 Expected and Actual scan responses are the same
2023/09/14 04:41:16
--- Multi Scan 2 ---
2023/09/14 04:41:16 distinct = false
2023/09/14 04:41:16 Using n1ql client
2023/09/14 04:41:16 Expected and Actual scan responses are the same
2023/09/14 04:41:16
--- Multi Scan 3 ---
2023/09/14 04:41:16 distinct = false
2023/09/14 04:41:17 Using n1ql client
2023/09/14 04:41:17 Expected and Actual scan responses are the same
2023/09/14 04:41:17
--- Multi Scan 4 ---
2023/09/14 04:41:17 distinct = false
2023/09/14 04:41:17 Using n1ql client
2023/09/14 04:41:17 Expected and Actual scan responses are the same
2023/09/14 04:41:17
--- Multi Scan 5 ---
2023/09/14 04:41:17 distinct = false
2023/09/14 04:41:17 Using n1ql client
2023/09/14 04:41:17 Expected and Actual scan responses are the same
2023/09/14 04:41:17
--- Multi Scan 6 ---
2023/09/14 04:41:17 distinct = false
2023/09/14 04:41:18 Using n1ql client
2023/09/14 04:41:18 Expected and Actual scan responses are the same
2023/09/14 04:41:18
--- Multi Scan 7 ---
2023/09/14 04:41:18 distinct = false
2023/09/14 04:41:18 Using n1ql client
2023/09/14 04:41:18 Expected and Actual scan responses are the same
2023/09/14 04:41:18
--- PrefixSortVariations ---
2023/09/14 04:41:18
--- Multi Scan 0 ---
2023/09/14 04:41:18 distinct = false
2023/09/14 04:41:19 Using n1ql client
2023/09/14 04:41:19 Expected and Actual scan responses are the same
2023/09/14 04:41:19
--- Multi Scan 1 ---
2023/09/14 04:41:19 distinct = false
2023/09/14 04:41:19 Using n1ql client
2023/09/14 04:41:19 Expected and Actual scan responses are the same
--- PASS: TestMultiScanScenarios (20.02s)
=== RUN TestMultiScanOffset
2023/09/14 04:41:19 In TestMultiScanOffset()
2023/09/14 04:41:19
--------- Composite Index with 2 fields ---------
2023/09/14 04:41:19
--- ScanAllNoFilter ---
2023/09/14 04:41:19 distinct = false
2023/09/14 04:41:20 Using n1ql client
2023/09/14 04:41:20
--- ScanAllFilterNil ---
2023/09/14 04:41:20 distinct = false
2023/09/14 04:41:20 Using n1ql client
2023/09/14 04:41:20
--- ScanAll_AllFiltersNil ---
2023/09/14 04:41:20 distinct = false
2023/09/14 04:41:21 Using n1ql client
2023/09/14 04:41:21
--- SingleSeek ---
2023/09/14 04:41:21 distinct = false
2023/09/14 04:41:21 Using n1ql client
2023/09/14 04:41:21
--- MultipleSeek ---
2023/09/14 04:41:21 distinct = false
2023/09/14 04:41:21 Using n1ql client
2023/09/14 04:41:21
--- SimpleRange ---
2023/09/14 04:41:21 distinct = false
2023/09/14 04:41:22 Using n1ql client
2023/09/14 04:41:22
--- NonOverlappingRanges ---
2023/09/14 04:41:22 distinct = false
2023/09/14 04:41:22 Using n1ql client
2023/09/14 04:41:22
--- OverlappingRanges ---
2023/09/14 04:41:22 distinct = false
2023/09/14 04:41:23 Using n1ql client
2023/09/14 04:41:23
--- NonOverlappingFilters ---
2023/09/14 04:41:23 distinct = false
2023/09/14 04:41:23 Using n1ql client
2023/09/14 04:41:23
--- OverlappingFilters ---
2023/09/14 04:41:23 distinct = false
2023/09/14 04:41:23 Using n1ql client
2023/09/14 04:41:23
--- BoundaryFilters ---
2023/09/14 04:41:23 distinct = false
2023/09/14 04:41:24 Using n1ql client
2023/09/14 04:41:24
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:41:24 distinct = false
2023/09/14 04:41:24 Using n1ql client
2023/09/14 04:41:24
--- SeekAndFilters_Overlapping ---
2023/09/14 04:41:24 distinct = false
2023/09/14 04:41:25 Using n1ql client
2023/09/14 04:41:25
--- SimpleRangeLowUnbounded ---
2023/09/14 04:41:25 distinct = false
2023/09/14 04:41:25 Using n1ql client
2023/09/14 04:41:25 Expected and Actual scan responses are the same
2023/09/14 04:41:25
--- SimpleRangeHighUnbounded ---
2023/09/14 04:41:25 distinct = false
2023/09/14 04:41:26 Using n1ql client
2023/09/14 04:41:26 Expected and Actual scan responses are the same
2023/09/14 04:41:26
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:41:26 distinct = false
2023/09/14 04:41:26 Using n1ql client
2023/09/14 04:41:26 Expected and Actual scan responses are the same
2023/09/14 04:41:26
--- FiltersWithUnbounded ---
2023/09/14 04:41:26 distinct = false
2023/09/14 04:41:27 Using n1ql client
2023/09/14 04:41:27 Expected and Actual scan responses are the same
2023/09/14 04:41:27
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:41:27 distinct = false
2023/09/14 04:41:27 Using n1ql client
2023/09/14 04:41:27 Expected and Actual scan responses are the same
2023/09/14 04:41:27
--------- Simple Index with 1 field ---------
2023/09/14 04:41:27
--- SingleIndexSimpleRange ---
2023/09/14 04:41:27 distinct = false
2023/09/14 04:41:27 Using n1ql client
2023/09/14 04:41:27
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:41:27 distinct = false
2023/09/14 04:41:28 Using n1ql client
2023/09/14 04:41:28
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:41:28 distinct = false
2023/09/14 04:41:28 Using n1ql client
2023/09/14 04:41:28
--------- Composite Index with 3 fields ---------
2023/09/14 04:41:28
--- ScanAllNoFilter ---
2023/09/14 04:41:28 distinct = false
2023/09/14 04:41:28 Using n1ql client
2023/09/14 04:41:28
--- ScanAllFilterNil ---
2023/09/14 04:41:28 distinct = false
2023/09/14 04:41:29 Using n1ql client
2023/09/14 04:41:29
--- ScanAll_AllFiltersNil ---
2023/09/14 04:41:29 distinct = false
2023/09/14 04:41:29 Using n1ql client
2023/09/14 04:41:29
--- 3FieldsSingleSeek ---
2023/09/14 04:41:29 distinct = false
2023/09/14 04:41:30 Using n1ql client
2023/09/14 04:41:30
--- 3FieldsMultipleSeeks ---
2023/09/14 04:41:30 distinct = false
2023/09/14 04:41:30 Using n1ql client
2023/09/14 04:41:30
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:41:30 distinct = false
2023/09/14 04:41:31 Using n1ql client
--- PASS: TestMultiScanOffset (11.46s)
=== RUN TestMultiScanPrimaryIndex
2023/09/14 04:41:31 In TestMultiScanPrimaryIndex()
2023/09/14 04:41:31
--- PrimaryRange ---
2023/09/14 04:41:31 Using n1ql client
2023/09/14 04:41:31 Expected and Actual scan responses are the same
2023/09/14 04:41:31
--- PrimaryScanAllNoFilter ---
2023/09/14 04:41:31 Using n1ql client
2023/09/14 04:41:31 Expected and Actual scan responses are the same
--- PASS: TestMultiScanPrimaryIndex (0.07s)
=== RUN TestMultiScanDistinct
2023/09/14 04:41:31 In TestScansDistinct()
2023/09/14 04:41:31
--------- Composite Index with 2 fields ---------
2023/09/14 04:41:31
--- ScanAllNoFilter ---
2023/09/14 04:41:31 distinct = true
2023/09/14 04:41:31 Using n1ql client
2023/09/14 04:41:31 Expected and Actual scan responses are the same
2023/09/14 04:41:31
--- ScanAllFilterNil ---
2023/09/14 04:41:31 distinct = true
2023/09/14 04:41:32 Using n1ql client
2023/09/14 04:41:32 Expected and Actual scan responses are the same
2023/09/14 04:41:32
--- ScanAll_AllFiltersNil ---
2023/09/14 04:41:32 distinct = true
2023/09/14 04:41:32 Using n1ql client
2023/09/14 04:41:32 Expected and Actual scan responses are the same
2023/09/14 04:41:32
--- SingleSeek ---
2023/09/14 04:41:32 distinct = true
2023/09/14 04:41:33 Using n1ql client
2023/09/14 04:41:33 Expected and Actual scan responses are the same
2023/09/14 04:41:33
--- MultipleSeek ---
2023/09/14 04:41:33 distinct = true
2023/09/14 04:41:33 Using n1ql client
2023/09/14 04:41:33 Expected and Actual scan responses are the same
2023/09/14 04:41:33
--- SimpleRange ---
2023/09/14 04:41:33 distinct = true
2023/09/14 04:41:33 Using n1ql client
2023/09/14 04:41:33 Expected and Actual scan responses are the same
2023/09/14 04:41:33
--- NonOverlappingRanges ---
2023/09/14 04:41:33 distinct = true
2023/09/14 04:41:34 Using n1ql client
2023/09/14 04:41:34 Expected and Actual scan responses are the same
2023/09/14 04:41:34
--- OverlappingRanges ---
2023/09/14 04:41:34 distinct = true
2023/09/14 04:41:34 Using n1ql client
2023/09/14 04:41:34 Expected and Actual scan responses are the same
2023/09/14 04:41:34
--- NonOverlappingFilters ---
2023/09/14 04:41:34 distinct = true
2023/09/14 04:41:35 Using n1ql client
2023/09/14 04:41:35 Expected and Actual scan responses are the same
2023/09/14 04:41:35
--- OverlappingFilters ---
2023/09/14 04:41:35 distinct = true
2023/09/14 04:41:35 Using n1ql client
2023/09/14 04:41:35 Expected and Actual scan responses are the same
2023/09/14 04:41:35
--- BoundaryFilters ---
2023/09/14 04:41:35 distinct = true
2023/09/14 04:41:36 Using n1ql client
2023/09/14 04:41:36 Expected and Actual scan responses are the same
2023/09/14 04:41:36
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:41:36 distinct = true
2023/09/14 04:41:36 Using n1ql client
2023/09/14 04:41:36 Expected and Actual scan responses are the same
2023/09/14 04:41:36
--- SeekAndFilters_Overlapping ---
2023/09/14 04:41:36 distinct = true
2023/09/14 04:41:36 Using n1ql client
2023/09/14 04:41:36 Expected and Actual scan responses are the same
2023/09/14 04:41:36
--- SimpleRangeLowUnbounded ---
2023/09/14 04:41:36 distinct = false
2023/09/14 04:41:37 Using n1ql client
2023/09/14 04:41:37 Expected and Actual scan responses are the same
2023/09/14 04:41:37
--- SimpleRangeHighUnbounded ---
2023/09/14 04:41:37 distinct = false
2023/09/14 04:41:37 Using n1ql client
2023/09/14 04:41:37 Expected and Actual scan responses are the same
2023/09/14 04:41:37
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:41:37 distinct = false
2023/09/14 04:41:38 Using n1ql client
2023/09/14 04:41:38 Expected and Actual scan responses are the same
2023/09/14 04:41:38
--- FiltersWithUnbounded ---
2023/09/14 04:41:38 distinct = false
2023/09/14 04:41:38 Using n1ql client
2023/09/14 04:41:38 Expected and Actual scan responses are the same
2023/09/14 04:41:38
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:41:38 distinct = false
2023/09/14 04:41:39 Using n1ql client
2023/09/14 04:41:39 Expected and Actual scan responses are the same
2023/09/14 04:41:39
--------- Simple Index with 1 field ---------
2023/09/14 04:41:39
--- SingleIndexSimpleRange ---
2023/09/14 04:41:39 distinct = true
2023/09/14 04:41:39 Using n1ql client
2023/09/14 04:41:39 Expected and Actual scan responses are the same
2023/09/14 04:41:39
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:41:39 distinct = true
2023/09/14 04:41:39 Using n1ql client
2023/09/14 04:41:39 Expected and Actual scan responses are the same
2023/09/14 04:41:39
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:41:39 distinct = true
2023/09/14 04:41:40 Using n1ql client
2023/09/14 04:41:40 Expected and Actual scan responses are the same
2023/09/14 04:41:40
--------- Composite Index with 3 fields ---------
2023/09/14 04:41:40
--- ScanAllNoFilter ---
2023/09/14 04:41:40 distinct = true
2023/09/14 04:41:40 Using n1ql client
2023/09/14 04:41:40 Expected and Actual scan responses are the same
2023/09/14 04:41:40
--- ScanAllFilterNil ---
2023/09/14 04:41:40 distinct = true
2023/09/14 04:41:41 Using n1ql client
2023/09/14 04:41:41 Expected and Actual scan responses are the same
2023/09/14 04:41:41
--- ScanAll_AllFiltersNil ---
2023/09/14 04:41:41 distinct = true
2023/09/14 04:41:41 Using n1ql client
2023/09/14 04:41:41 Expected and Actual scan responses are the same
2023/09/14 04:41:41
--- 3FieldsSingleSeek ---
2023/09/14 04:41:41 distinct = true
2023/09/14 04:41:42 Using n1ql client
2023/09/14 04:41:42 Expected and Actual scan responses are the same
2023/09/14 04:41:42
--- 3FieldsMultipleSeeks ---
2023/09/14 04:41:42 distinct = true
2023/09/14 04:41:42 Using n1ql client
2023/09/14 04:41:42 Expected and Actual scan responses are the same
2023/09/14 04:41:42
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:41:42 distinct = true
2023/09/14 04:41:43 Using n1ql client
2023/09/14 04:41:43 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDistinct (11.90s)
=== RUN TestMultiScanProjection
2023/09/14 04:41:43 In TestMultiScanProjection()
2023/09/14 04:41:43
--------- Composite Index with 2 fields ---------
2023/09/14 04:41:43
--- ScanAllNoFilter ---
2023/09/14 04:41:43 distinct = true
2023/09/14 04:41:43 Using n1ql client
2023/09/14 04:41:43 Expected and Actual scan responses are the same
2023/09/14 04:41:43
--- ScanAllFilterNil ---
2023/09/14 04:41:43 distinct = true
2023/09/14 04:41:44 Using n1ql client
2023/09/14 04:41:44 Expected and Actual scan responses are the same
2023/09/14 04:41:44
--- ScanAll_AllFiltersNil ---
2023/09/14 04:41:44 distinct = true
2023/09/14 04:41:44 Using n1ql client
2023/09/14 04:41:44 Expected and Actual scan responses are the same
2023/09/14 04:41:44
--- SingleSeek ---
2023/09/14 04:41:44 distinct = true
2023/09/14 04:41:45 Using n1ql client
2023/09/14 04:41:45 Expected and Actual scan responses are the same
2023/09/14 04:41:45
--- MultipleSeek ---
2023/09/14 04:41:45 distinct = true
2023/09/14 04:41:45 Using n1ql client
2023/09/14 04:41:45 Expected and Actual scan responses are the same
2023/09/14 04:41:45
--- SimpleRange ---
2023/09/14 04:41:45 distinct = true
2023/09/14 04:41:45 Using n1ql client
2023/09/14 04:41:45 Expected and Actual scan responses are the same
2023/09/14 04:41:45
--- NonOverlappingRanges ---
2023/09/14 04:41:45 distinct = true
2023/09/14 04:41:46 Using n1ql client
2023/09/14 04:41:46 Expected and Actual scan responses are the same
2023/09/14 04:41:46
--- OverlappingRanges ---
2023/09/14 04:41:46 distinct = true
2023/09/14 04:41:46 Using n1ql client
2023/09/14 04:41:46 Expected and Actual scan responses are the same
2023/09/14 04:41:46
--- NonOverlappingFilters ---
2023/09/14 04:41:46 distinct = true
2023/09/14 04:41:47 Using n1ql client
2023/09/14 04:41:47 Expected and Actual scan responses are the same
2023/09/14 04:41:47
--- OverlappingFilters ---
2023/09/14 04:41:47 distinct = true
2023/09/14 04:41:47 Using n1ql client
2023/09/14 04:41:47 Expected and Actual scan responses are the same
2023/09/14 04:41:47
--- BoundaryFilters ---
2023/09/14 04:41:47 distinct = true
2023/09/14 04:41:48 Using n1ql client
2023/09/14 04:41:48 Expected and Actual scan responses are the same
2023/09/14 04:41:48
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:41:48 distinct = true
2023/09/14 04:41:48 Using n1ql client
2023/09/14 04:41:48 Expected and Actual scan responses are the same
2023/09/14 04:41:48
--- SeekAndFilters_Overlapping ---
2023/09/14 04:41:48 distinct = true
2023/09/14 04:41:48 Using n1ql client
2023/09/14 04:41:48 Expected and Actual scan responses are the same
2023/09/14 04:41:48
--- SimpleRangeLowUnbounded ---
2023/09/14 04:41:48 distinct = false
2023/09/14 04:41:49 Using n1ql client
2023/09/14 04:41:49 Expected and Actual scan responses are the same
2023/09/14 04:41:49
--- SimpleRangeHighUnbounded ---
2023/09/14 04:41:49 distinct = false
2023/09/14 04:41:49 Using n1ql client
2023/09/14 04:41:49 Expected and Actual scan responses are the same
2023/09/14 04:41:49
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:41:49 distinct = false
2023/09/14 04:41:50 Using n1ql client
2023/09/14 04:41:50 Expected and Actual scan responses are the same
2023/09/14 04:41:50
--- FiltersWithUnbounded ---
2023/09/14 04:41:50 distinct = false
2023/09/14 04:41:50 Using n1ql client
2023/09/14 04:41:50 Expected and Actual scan responses are the same
2023/09/14 04:41:50
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:41:50 distinct = false
2023/09/14 04:41:51 Using n1ql client
2023/09/14 04:41:51 Expected and Actual scan responses are the same
2023/09/14 04:41:51
--------- Simple Index with 1 field ---------
2023/09/14 04:41:51
--- SingleIndexSimpleRange ---
2023/09/14 04:41:51 distinct = true
2023/09/14 04:41:51 Using n1ql client
2023/09/14 04:41:51 Expected and Actual scan responses are the same
2023/09/14 04:41:51
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:41:51 distinct = true
2023/09/14 04:41:51 Using n1ql client
2023/09/14 04:41:51 Expected and Actual scan responses are the same
2023/09/14 04:41:51
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:41:51 distinct = true
2023/09/14 04:41:52 Using n1ql client
2023/09/14 04:41:52 Expected and Actual scan responses are the same
2023/09/14 04:41:52
--------- Composite Index with 3 fields ---------
2023/09/14 04:41:52
--- ScanAllNoFilter ---
2023/09/14 04:41:52 distinct = true
2023/09/14 04:41:52 Using n1ql client
2023/09/14 04:41:52 Expected and Actual scan responses are the same
2023/09/14 04:41:52
--- ScanAllFilterNil ---
2023/09/14 04:41:52 distinct = true
2023/09/14 04:41:53 Using n1ql client
2023/09/14 04:41:53 Expected and Actual scan responses are the same
2023/09/14 04:41:53
--- ScanAll_AllFiltersNil ---
2023/09/14 04:41:53 distinct = true
2023/09/14 04:41:53 Using n1ql client
2023/09/14 04:41:53 Expected and Actual scan responses are the same
2023/09/14 04:41:53
--- 3FieldsSingleSeek ---
2023/09/14 04:41:53 distinct = true
2023/09/14 04:41:54 Using n1ql client
2023/09/14 04:41:54 Expected and Actual scan responses are the same
2023/09/14 04:41:54
--- 3FieldsMultipleSeeks ---
2023/09/14 04:41:54 distinct = true
2023/09/14 04:41:54 Using n1ql client
2023/09/14 04:41:54 Expected and Actual scan responses are the same
2023/09/14 04:41:54
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:41:54 distinct = true
2023/09/14 04:41:55 Using n1ql client
2023/09/14 04:41:55 Expected and Actual scan responses are the same
2023/09/14 04:41:55 indexes are: index_company, index_companyname, index_company_name_age, index_company_name_age_address, index_company_name_age_address_friends
2023/09/14 04:41:55 fields are: [company], [company name], [company name age], [company name age address], [company name age address friends]
2023/09/14 04:41:55
--- SingleIndexProjectFirst ---
2023/09/14 04:41:55 distinct = true
2023/09/14 04:41:55 Using n1ql client
2023/09/14 04:41:55 Expected and Actual scan responses are the same
2023/09/14 04:41:55
--- 2FieldIndexProjectSecond ---
2023/09/14 04:41:55 distinct = true
2023/09/14 04:41:56 Using n1ql client
2023/09/14 04:41:56 Expected and Actual scan responses are the same
2023/09/14 04:41:56
--- 3FieldIndexProjectThird ---
2023/09/14 04:41:56 distinct = true
2023/09/14 04:41:56 Using n1ql client
2023/09/14 04:41:56 Expected and Actual scan responses are the same
2023/09/14 04:41:56
--- 4FieldIndexProjectFourth ---
2023/09/14 04:41:56 distinct = true
2023/09/14 04:41:58 Using n1ql client
2023/09/14 04:41:58 Expected and Actual scan responses are the same
2023/09/14 04:41:58
--- 5FieldIndexProjectFifth ---
2023/09/14 04:41:58 distinct = true
2023/09/14 04:42:01 Using n1ql client
2023/09/14 04:42:01 Expected and Actual scan responses are the same
2023/09/14 04:42:01
--- 2FieldIndexProjectTwo ---
2023/09/14 04:42:01 distinct = true
2023/09/14 04:42:02 Using n1ql client
2023/09/14 04:42:02 Expected and Actual scan responses are the same
2023/09/14 04:42:02
--- 3FieldIndexProjectTwo ---
2023/09/14 04:42:02 distinct = true
2023/09/14 04:42:02 Using n1ql client
2023/09/14 04:42:02 Expected and Actual scan responses are the same
2023/09/14 04:42:02
--- 3FieldIndexProjectTwo ---
2023/09/14 04:42:02 distinct = true
2023/09/14 04:42:03 Using n1ql client
2023/09/14 04:42:03 Expected and Actual scan responses are the same
2023/09/14 04:42:03
--- 3FieldIndexProjectTwo ---
2023/09/14 04:42:03 distinct = true
2023/09/14 04:42:03 Using n1ql client
2023/09/14 04:42:03 Expected and Actual scan responses are the same
2023/09/14 04:42:03
--- 4FieldIndexProjectTwo ---
2023/09/14 04:42:03 distinct = true
2023/09/14 04:42:05 Using n1ql client
2023/09/14 04:42:05 Expected and Actual scan responses are the same
2023/09/14 04:42:05
--- 4FieldIndexProjectTwo ---
2023/09/14 04:42:05 distinct = true
2023/09/14 04:42:06 Using n1ql client
2023/09/14 04:42:07 Expected and Actual scan responses are the same
2023/09/14 04:42:07
--- 4FieldIndexProjectTwo ---
2023/09/14 04:42:07 distinct = true
2023/09/14 04:42:08 Using n1ql client
2023/09/14 04:42:08 Expected and Actual scan responses are the same
2023/09/14 04:42:08
--- 4FieldIndexProjectTwo ---
2023/09/14 04:42:08 distinct = true
2023/09/14 04:42:10 Using n1ql client
2023/09/14 04:42:10 Expected and Actual scan responses are the same
2023/09/14 04:42:10
--- 4FieldIndexProjectTwo ---
2023/09/14 04:42:10 distinct = true
2023/09/14 04:42:11 Using n1ql client
2023/09/14 04:42:11 Expected and Actual scan responses are the same
2023/09/14 04:42:11
--- 5FieldIndexProjectTwo ---
2023/09/14 04:42:11 distinct = true
2023/09/14 04:42:15 Using n1ql client
2023/09/14 04:42:15 Expected and Actual scan responses are the same
2023/09/14 04:42:15
--- 5FieldIndexProjectTwo ---
2023/09/14 04:42:15 distinct = true
2023/09/14 04:42:18 Using n1ql client
2023/09/14 04:42:18 Expected and Actual scan responses are the same
2023/09/14 04:42:18
--- 5FieldIndexProjectTwo ---
2023/09/14 04:42:18 distinct = true
2023/09/14 04:42:21 Using n1ql client
2023/09/14 04:42:22 Expected and Actual scan responses are the same
2023/09/14 04:42:22
--- 5FieldIndexProjectTwo ---
2023/09/14 04:42:22 distinct = true
2023/09/14 04:42:25 Using n1ql client
2023/09/14 04:42:25 Expected and Actual scan responses are the same
2023/09/14 04:42:25
--- 5FieldIndexProjectThree ---
2023/09/14 04:42:25 distinct = true
2023/09/14 04:42:28 Using n1ql client
2023/09/14 04:42:28 Expected and Actual scan responses are the same
2023/09/14 04:42:28
--- 5FieldIndexProjectFour ---
2023/09/14 04:42:28 distinct = true
2023/09/14 04:42:32 Using n1ql client
2023/09/14 04:42:32 Expected and Actual scan responses are the same
2023/09/14 04:42:32
--- 5FieldIndexProjectAll ---
2023/09/14 04:42:32 distinct = true
2023/09/14 04:42:35 Using n1ql client
2023/09/14 04:42:35 Expected and Actual scan responses are the same
2023/09/14 04:42:35
--- 5FieldIndexProjectAlternate ---
2023/09/14 04:42:35 distinct = true
2023/09/14 04:42:38 Using n1ql client
2023/09/14 04:42:38 Expected and Actual scan responses are the same
2023/09/14 04:42:38
--- 5FieldIndexProjectEmptyEntryKeys ---
2023/09/14 04:42:38 distinct = true
2023/09/14 04:42:42 Using n1ql client
2023/09/14 04:42:42 Expected and Actual scan responses are the same
--- PASS: TestMultiScanProjection (58.90s)
=== RUN TestMultiScanRestAPI
2023/09/14 04:42:42 In TestMultiScanRestAPI()
2023/09/14 04:42:42 In DropAllSecondaryIndexes()
2023/09/14 04:42:42 Index found: index_primary
2023/09/14 04:42:42 Dropped index index_primary
2023/09/14 04:42:42 Index found: index_company_name_age_address_friends
2023/09/14 04:42:42 Dropped index index_company_name_age_address_friends
2023/09/14 04:42:42 Index found: index_companyname
2023/09/14 04:42:42 Dropped index index_companyname
2023/09/14 04:42:42 Index found: index_company
2023/09/14 04:42:42 Dropped index index_company
2023/09/14 04:42:42 Index found: addressidx
2023/09/14 04:42:42 Dropped index addressidx
2023/09/14 04:42:42 Index found: index_company_name_age
2023/09/14 04:42:42 Dropped index index_company_name_age
2023/09/14 04:42:42 Index found: index_company_name_age_address
2023/09/14 04:42:42 Dropped index index_company_name_age_address
2023/09/14 04:42:46 Created the secondary index index_companyname. Waiting for it become active
2023/09/14 04:42:46 Index is 2161490356613072740 now active
2023/09/14 04:42:46 GET all indexes
2023/09/14 04:42:46 200 OK
2023/09/14 04:42:46 getscans status : 200 OK
2023/09/14 04:42:46 number of entries 337
2023/09/14 04:42:46 Status : 200 OK
2023/09/14 04:42:46 Result from multiscancount API = 0
--- PASS: TestMultiScanRestAPI (4.18s)
=== RUN TestMultiScanPrimaryIndexVariations
2023/09/14 04:42:46 In TestMultiScanPrimaryIndexVariations()
2023/09/14 04:42:53 Created the secondary index index_pi. Waiting for it become active
2023/09/14 04:42:53 Index is 10766878282786696486 now active
2023/09/14 04:42:53
--- No Overlap ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53
--- Proper Overlap ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53
--- Low Boundary Overlap ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53
--- Complex Overlaps ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53
--- Multiple Equal Overlaps ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53
--- Boundary and Subset Overlaps ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53
--- Point Overlaps ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53
--- Boundary and Point Overlaps ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53
--- Primary index range null ---
2023/09/14 04:42:53 Using n1ql client
2023/09/14 04:42:53 Expected and Actual scan responses are the same
2023/09/14 04:42:53 Dropping the secondary index index_pi
2023/09/14 04:42:53 Index dropped
--- PASS: TestMultiScanPrimaryIndexVariations (7.13s)
=== RUN TestMultiScanDescSetup
2023/09/14 04:42:53 In TestMultiScanDescSetup()
2023/09/14 04:42:53 In DropAllSecondaryIndexes()
2023/09/14 04:42:53 Index found: index_companyname
2023/09/14 04:42:53 Dropped index index_companyname
2023/09/14 04:43:00 Created the secondary index index_companyname_desc. Waiting for it become active
2023/09/14 04:43:00 Index is 5251073707510178440 now active
2023/09/14 04:43:07 Created the secondary index index_company_desc. Waiting for it become active
2023/09/14 04:43:07 Index is 16933829257982957231 now active
2023/09/14 04:43:13 Created the secondary index index_company_name_age_desc. Waiting for it become active
2023/09/14 04:43:13 Index is 12736220247325904544 now active
--- PASS: TestMultiScanDescSetup (20.30s)
=== RUN TestMultiScanDescScenarios
2023/09/14 04:43:13 In TestMultiScanDescScenarios()
2023/09/14 04:43:13
--------- Composite Index with 2 fields ---------
2023/09/14 04:43:13
--- ScanAllNoFilter ---
2023/09/14 04:43:13 distinct = false
2023/09/14 04:43:14 Using n1ql client
2023/09/14 04:43:14 Expected and Actual scan responses are the same
2023/09/14 04:43:14
--- ScanAllFilterNil ---
2023/09/14 04:43:14 distinct = false
2023/09/14 04:43:14 Using n1ql client
2023/09/14 04:43:14 Expected and Actual scan responses are the same
2023/09/14 04:43:14
--- ScanAll_AllFiltersNil ---
2023/09/14 04:43:14 distinct = false
2023/09/14 04:43:15 Using n1ql client
2023/09/14 04:43:15 Expected and Actual scan responses are the same
2023/09/14 04:43:15
--- SingleSeek ---
2023/09/14 04:43:15 distinct = false
2023/09/14 04:43:15 Using n1ql client
2023/09/14 04:43:15 Expected and Actual scan responses are the same
2023/09/14 04:43:15
--- MultipleSeek ---
2023/09/14 04:43:15 distinct = false
2023/09/14 04:43:16 Using n1ql client
2023/09/14 04:43:16 Expected and Actual scan responses are the same
2023/09/14 04:43:16
--- SimpleRange ---
2023/09/14 04:43:16 distinct = false
2023/09/14 04:43:16 Using n1ql client
2023/09/14 04:43:16 Expected and Actual scan responses are the same
2023/09/14 04:43:16
--- NonOverlappingRanges ---
2023/09/14 04:43:16 distinct = false
2023/09/14 04:43:16 Using n1ql client
2023/09/14 04:43:16 Expected and Actual scan responses are the same
2023/09/14 04:43:16
--- OverlappingRanges ---
2023/09/14 04:43:16 distinct = false
2023/09/14 04:43:17 Using n1ql client
2023/09/14 04:43:17 Expected and Actual scan responses are the same
2023/09/14 04:43:17
--- NonOverlappingFilters ---
2023/09/14 04:43:17 distinct = false
2023/09/14 04:43:17 Using n1ql client
2023/09/14 04:43:17 Expected and Actual scan responses are the same
2023/09/14 04:43:17
--- OverlappingFilters ---
2023/09/14 04:43:17 distinct = false
2023/09/14 04:43:18 Using n1ql client
2023/09/14 04:43:18 Expected and Actual scan responses are the same
2023/09/14 04:43:18
--- BoundaryFilters ---
2023/09/14 04:43:18 distinct = false
2023/09/14 04:43:18 Using n1ql client
2023/09/14 04:43:18 Expected and Actual scan responses are the same
2023/09/14 04:43:18
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:43:18 distinct = false
2023/09/14 04:43:19 Using n1ql client
2023/09/14 04:43:19 Expected and Actual scan responses are the same
2023/09/14 04:43:19
--- SeekAndFilters_Overlapping ---
2023/09/14 04:43:19 distinct = false
2023/09/14 04:43:19 Using n1ql client
2023/09/14 04:43:19 Expected and Actual scan responses are the same
2023/09/14 04:43:19
--- SimpleRangeLowUnbounded ---
2023/09/14 04:43:19 distinct = false
2023/09/14 04:43:19 Using n1ql client
2023/09/14 04:43:19 Expected and Actual scan responses are the same
2023/09/14 04:43:19
--- SimpleRangeHighUnbounded ---
2023/09/14 04:43:19 distinct = false
2023/09/14 04:43:20 Using n1ql client
2023/09/14 04:43:20 Expected and Actual scan responses are the same
2023/09/14 04:43:20
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:43:20 distinct = false
2023/09/14 04:43:20 Using n1ql client
2023/09/14 04:43:20 Expected and Actual scan responses are the same
2023/09/14 04:43:20
--- FiltersWithUnbounded ---
2023/09/14 04:43:20 distinct = false
2023/09/14 04:43:21 Using n1ql client
2023/09/14 04:43:21 Expected and Actual scan responses are the same
2023/09/14 04:43:21
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:43:21 distinct = false
2023/09/14 04:43:21 Using n1ql client
2023/09/14 04:43:21 Expected and Actual scan responses are the same
2023/09/14 04:43:21
--------- Simple Index with 1 field ---------
2023/09/14 04:43:21
--- SingleIndexSimpleRange ---
2023/09/14 04:43:21 distinct = false
2023/09/14 04:43:22 Using n1ql client
2023/09/14 04:43:22 Expected and Actual scan responses are the same
2023/09/14 04:43:22
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:43:22 distinct = false
2023/09/14 04:43:22 Using n1ql client
2023/09/14 04:43:22 Expected and Actual scan responses are the same
2023/09/14 04:43:22
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:43:22 distinct = false
2023/09/14 04:43:22 Using n1ql client
2023/09/14 04:43:22 Expected and Actual scan responses are the same
2023/09/14 04:43:22
--------- Composite Index with 3 fields ---------
2023/09/14 04:43:22
--- ScanAllNoFilter ---
2023/09/14 04:43:22 distinct = false
2023/09/14 04:43:23 Using n1ql client
2023/09/14 04:43:23 Expected and Actual scan responses are the same
2023/09/14 04:43:23
--- ScanAllFilterNil ---
2023/09/14 04:43:23 distinct = false
2023/09/14 04:43:23 Using n1ql client
2023/09/14 04:43:23 Expected and Actual scan responses are the same
2023/09/14 04:43:23
--- ScanAll_AllFiltersNil ---
2023/09/14 04:43:23 distinct = false
2023/09/14 04:43:24 Using n1ql client
2023/09/14 04:43:24 Expected and Actual scan responses are the same
2023/09/14 04:43:24
--- 3FieldsSingleSeek ---
2023/09/14 04:43:24 distinct = false
2023/09/14 04:43:24 Using n1ql client
2023/09/14 04:43:24 Expected and Actual scan responses are the same
2023/09/14 04:43:24
--- 3FieldsMultipleSeeks ---
2023/09/14 04:43:24 distinct = false
2023/09/14 04:43:25 Using n1ql client
2023/09/14 04:43:25 Expected and Actual scan responses are the same
2023/09/14 04:43:25
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:43:25 distinct = false
2023/09/14 04:43:25 Using n1ql client
2023/09/14 04:43:25 Expected and Actual scan responses are the same
2023/09/14 04:43:25
--------- New scenarios ---------
2023/09/14 04:43:25
--- CompIndexHighUnbounded1 ---
2023/09/14 04:43:25
--- Multi Scan 0 ---
2023/09/14 04:43:25 distinct = false
2023/09/14 04:43:26 Using n1ql client
2023/09/14 04:43:26 Expected and Actual scan responses are the same
2023/09/14 04:43:26
--- Multi Scan 1 ---
2023/09/14 04:43:26 distinct = false
2023/09/14 04:43:26 Using n1ql client
2023/09/14 04:43:26 Expected and Actual scan responses are the same
2023/09/14 04:43:26
--- Multi Scan 2 ---
2023/09/14 04:43:26 distinct = false
2023/09/14 04:43:26 Using n1ql client
2023/09/14 04:43:26 Expected and Actual scan responses are the same
2023/09/14 04:43:26
--- CompIndexHighUnbounded2 ---
2023/09/14 04:43:26
--- Multi Scan 0 ---
2023/09/14 04:43:26 distinct = false
2023/09/14 04:43:27 Using n1ql client
2023/09/14 04:43:27 Expected and Actual scan responses are the same
2023/09/14 04:43:27
--- Multi Scan 1 ---
2023/09/14 04:43:27 distinct = false
2023/09/14 04:43:27 Using n1ql client
2023/09/14 04:43:27 Expected and Actual scan responses are the same
2023/09/14 04:43:27
--- Multi Scan 2 ---
2023/09/14 04:43:27 distinct = false
2023/09/14 04:43:28 Using n1ql client
2023/09/14 04:43:28 Expected and Actual scan responses are the same
2023/09/14 04:43:28
--- CompIndexHighUnbounded3 ---
2023/09/14 04:43:28
--- Multi Scan 0 ---
2023/09/14 04:43:28 distinct = false
2023/09/14 04:43:28 Using n1ql client
2023/09/14 04:43:28 Expected and Actual scan responses are the same
2023/09/14 04:43:28
--- CompIndexHighUnbounded4 ---
2023/09/14 04:43:28
--- Multi Scan 0 ---
2023/09/14 04:43:28 distinct = false
2023/09/14 04:43:29 Using n1ql client
2023/09/14 04:43:29 Expected and Actual scan responses are the same
2023/09/14 04:43:29
--- CompIndexHighUnbounded5 ---
2023/09/14 04:43:29
--- Multi Scan 0 ---
2023/09/14 04:43:29 distinct = false
2023/09/14 04:43:29 Using n1ql client
2023/09/14 04:43:29 Expected and Actual scan responses are the same
2023/09/14 04:43:29
--- SeekBoundaries ---
2023/09/14 04:43:29
--- Multi Scan 0 ---
2023/09/14 04:43:29 distinct = false
2023/09/14 04:43:30 Using n1ql client
2023/09/14 04:43:30 Expected and Actual scan responses are the same
2023/09/14 04:43:30
--- Multi Scan 1 ---
2023/09/14 04:43:30 distinct = false
2023/09/14 04:43:30 Using n1ql client
2023/09/14 04:43:30 Expected and Actual scan responses are the same
2023/09/14 04:43:30
--- Multi Scan 2 ---
2023/09/14 04:43:30 distinct = false
2023/09/14 04:43:30 Using n1ql client
2023/09/14 04:43:30 Expected and Actual scan responses are the same
2023/09/14 04:43:30
--- Multi Scan 3 ---
2023/09/14 04:43:30 distinct = false
2023/09/14 04:43:31 Using n1ql client
2023/09/14 04:43:31 Expected and Actual scan responses are the same
2023/09/14 04:43:31
--- Multi Scan 4 ---
2023/09/14 04:43:31 distinct = false
2023/09/14 04:43:31 Using n1ql client
2023/09/14 04:43:31 Expected and Actual scan responses are the same
2023/09/14 04:43:31
--- Multi Scan 5 ---
2023/09/14 04:43:31 distinct = false
2023/09/14 04:43:32 Using n1ql client
2023/09/14 04:43:32 Expected and Actual scan responses are the same
2023/09/14 04:43:32
--- Multi Scan 6 ---
2023/09/14 04:43:32 distinct = false
2023/09/14 04:43:32 Using n1ql client
2023/09/14 04:43:32 Expected and Actual scan responses are the same
2023/09/14 04:43:32
--- Multi Scan 7 ---
2023/09/14 04:43:32 distinct = false
2023/09/14 04:43:33 Using n1ql client
2023/09/14 04:43:33 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescScenarios (19.31s)
=== RUN TestMultiScanDescCount
2023/09/14 04:43:33 In TestMultiScanDescCount()
2023/09/14 04:43:33
--------- Composite Index with 2 fields ---------
2023/09/14 04:43:33
--- ScanAllNoFilter ---
2023/09/14 04:43:33 distinct = false
2023/09/14 04:43:33 Using n1ql client
2023/09/14 04:43:33 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:43:33
--- ScanAllFilterNil ---
2023/09/14 04:43:33 distinct = false
2023/09/14 04:43:33 Using n1ql client
2023/09/14 04:43:33 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:43:33
--- ScanAll_AllFiltersNil ---
2023/09/14 04:43:33 distinct = false
2023/09/14 04:43:34 Using n1ql client
2023/09/14 04:43:34 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:43:34
--- SingleSeek ---
2023/09/14 04:43:34 distinct = false
2023/09/14 04:43:34 Using n1ql client
2023/09/14 04:43:34 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:43:34
--- MultipleSeek ---
2023/09/14 04:43:34 distinct = false
2023/09/14 04:43:35 Using n1ql client
2023/09/14 04:43:35 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/14 04:43:35
--- SimpleRange ---
2023/09/14 04:43:35 distinct = false
2023/09/14 04:43:35 Using n1ql client
2023/09/14 04:43:35 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/14 04:43:35
--- NonOverlappingRanges ---
2023/09/14 04:43:35 distinct = false
2023/09/14 04:43:35 Using n1ql client
2023/09/14 04:43:35 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2023/09/14 04:43:35
--- OverlappingRanges ---
2023/09/14 04:43:35 distinct = false
2023/09/14 04:43:36 Using n1ql client
2023/09/14 04:43:36 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2023/09/14 04:43:36
--- NonOverlappingFilters ---
2023/09/14 04:43:36 distinct = false
2023/09/14 04:43:36 Using n1ql client
2023/09/14 04:43:36 MultiScanCount = 337 ExpectedMultiScanCount = 337
2023/09/14 04:43:36
--- OverlappingFilters ---
2023/09/14 04:43:36 distinct = false
2023/09/14 04:43:37 Using n1ql client
2023/09/14 04:43:37 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2023/09/14 04:43:37
--- BoundaryFilters ---
2023/09/14 04:43:37 distinct = false
2023/09/14 04:43:37 Using n1ql client
2023/09/14 04:43:37 MultiScanCount = 499 ExpectedMultiScanCount = 499
2023/09/14 04:43:37
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:43:37 distinct = false
2023/09/14 04:43:37 Using n1ql client
2023/09/14 04:43:37 MultiScanCount = 256 ExpectedMultiScanCount = 256
2023/09/14 04:43:37
--- SeekAndFilters_Overlapping ---
2023/09/14 04:43:37 distinct = false
2023/09/14 04:43:38 Using n1ql client
2023/09/14 04:43:38 MultiScanCount = 255 ExpectedMultiScanCount = 255
2023/09/14 04:43:38
--- SimpleRangeLowUnbounded ---
2023/09/14 04:43:38 distinct = false
2023/09/14 04:43:38 Using n1ql client
2023/09/14 04:43:38 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/14 04:43:38
--- SimpleRangeHighUnbounded ---
2023/09/14 04:43:38 distinct = false
2023/09/14 04:43:39 Using n1ql client
2023/09/14 04:43:39 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/14 04:43:39
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:43:39 distinct = false
2023/09/14 04:43:39 Using n1ql client
2023/09/14 04:43:39 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:43:39
--- FiltersWithUnbounded ---
2023/09/14 04:43:39 distinct = false
2023/09/14 04:43:40 Using n1ql client
2023/09/14 04:43:40 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/14 04:43:40
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:43:40 distinct = false
2023/09/14 04:43:40 Using n1ql client
2023/09/14 04:43:40 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/14 04:43:40
--------- Simple Index with 1 field ---------
2023/09/14 04:43:40
--- SingleIndexSimpleRange ---
2023/09/14 04:43:40 distinct = false
2023/09/14 04:43:40 Using n1ql client
2023/09/14 04:43:40 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/14 04:43:40
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:43:40 distinct = false
2023/09/14 04:43:41 Using n1ql client
2023/09/14 04:43:41 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2023/09/14 04:43:41
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:43:41 distinct = false
2023/09/14 04:43:41 Using n1ql client
2023/09/14 04:43:41 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2023/09/14 04:43:41
--------- Composite Index with 3 fields ---------
2023/09/14 04:43:41
--- ScanAllNoFilter ---
2023/09/14 04:43:41 distinct = false
2023/09/14 04:43:41 Using n1ql client
2023/09/14 04:43:41 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:43:41
--- ScanAllFilterNil ---
2023/09/14 04:43:41 distinct = false
2023/09/14 04:43:42 Using n1ql client
2023/09/14 04:43:42 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:43:42
--- ScanAll_AllFiltersNil ---
2023/09/14 04:43:42 distinct = false
2023/09/14 04:43:42 Using n1ql client
2023/09/14 04:43:42 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:43:42
--- 3FieldsSingleSeek ---
2023/09/14 04:43:42 distinct = false
2023/09/14 04:43:43 Using n1ql client
2023/09/14 04:43:43 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:43:43
--- 3FieldsMultipleSeeks ---
2023/09/14 04:43:43 distinct = false
2023/09/14 04:43:43 Using n1ql client
2023/09/14 04:43:43 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/14 04:43:43
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:43:43 distinct = false
2023/09/14 04:43:44 Using n1ql client
2023/09/14 04:43:44 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/14 04:43:44
--------- New scenarios ---------
2023/09/14 04:43:44
--- CompIndexHighUnbounded1 ---
2023/09/14 04:43:44
--- Multi Scan 0 ---
2023/09/14 04:43:44 distinct = false
2023/09/14 04:43:44 Using n1ql client
2023/09/14 04:43:44 Using n1ql client
2023/09/14 04:43:44 len(scanResults) = 8 MultiScanCount = 8
2023/09/14 04:43:44 Expected and Actual scan responses are the same
2023/09/14 04:43:44
--- Multi Scan 1 ---
2023/09/14 04:43:44 distinct = false
2023/09/14 04:43:44 Using n1ql client
2023/09/14 04:43:44 Using n1ql client
2023/09/14 04:43:44 len(scanResults) = 0 MultiScanCount = 0
2023/09/14 04:43:44 Expected and Actual scan responses are the same
2023/09/14 04:43:44
--- Multi Scan 2 ---
2023/09/14 04:43:44 distinct = false
2023/09/14 04:43:45 Using n1ql client
2023/09/14 04:43:45 Using n1ql client
2023/09/14 04:43:45 len(scanResults) = 9 MultiScanCount = 9
2023/09/14 04:43:45 Expected and Actual scan responses are the same
2023/09/14 04:43:45
--- CompIndexHighUnbounded2 ---
2023/09/14 04:43:45
--- Multi Scan 0 ---
2023/09/14 04:43:45 distinct = false
2023/09/14 04:43:45 Using n1ql client
2023/09/14 04:43:45 Using n1ql client
2023/09/14 04:43:45 len(scanResults) = 4138 MultiScanCount = 4138
2023/09/14 04:43:45 Expected and Actual scan responses are the same
2023/09/14 04:43:45
--- Multi Scan 1 ---
2023/09/14 04:43:45 distinct = false
2023/09/14 04:43:46 Using n1ql client
2023/09/14 04:43:46 Using n1ql client
2023/09/14 04:43:46 len(scanResults) = 2746 MultiScanCount = 2746
2023/09/14 04:43:46 Expected and Actual scan responses are the same
2023/09/14 04:43:46
--- Multi Scan 2 ---
2023/09/14 04:43:46 distinct = false
2023/09/14 04:43:46 Using n1ql client
2023/09/14 04:43:46 Using n1ql client
2023/09/14 04:43:46 len(scanResults) = 4691 MultiScanCount = 4691
2023/09/14 04:43:46 Expected and Actual scan responses are the same
2023/09/14 04:43:46
--- CompIndexHighUnbounded3 ---
2023/09/14 04:43:46
--- Multi Scan 0 ---
2023/09/14 04:43:46 distinct = false
2023/09/14 04:43:47 Using n1ql client
2023/09/14 04:43:47 Using n1ql client
2023/09/14 04:43:47 len(scanResults) = 1329 MultiScanCount = 1329
2023/09/14 04:43:47 Expected and Actual scan responses are the same
2023/09/14 04:43:47
--- CompIndexHighUnbounded4 ---
2023/09/14 04:43:47
--- Multi Scan 0 ---
2023/09/14 04:43:47 distinct = false
2023/09/14 04:43:47 Using n1ql client
2023/09/14 04:43:47 Using n1ql client
2023/09/14 04:43:47 len(scanResults) = 5349 MultiScanCount = 5349
2023/09/14 04:43:47 Expected and Actual scan responses are the same
2023/09/14 04:43:47
--- CompIndexHighUnbounded5 ---
2023/09/14 04:43:47
--- Multi Scan 0 ---
2023/09/14 04:43:47 distinct = false
2023/09/14 04:43:47 Using n1ql client
2023/09/14 04:43:48 Using n1ql client
2023/09/14 04:43:48 len(scanResults) = 8210 MultiScanCount = 8210
2023/09/14 04:43:48 Expected and Actual scan responses are the same
2023/09/14 04:43:48
--- SeekBoundaries ---
2023/09/14 04:43:48
--- Multi Scan 0 ---
2023/09/14 04:43:48 distinct = false
2023/09/14 04:43:48 Using n1ql client
2023/09/14 04:43:48 Using n1ql client
2023/09/14 04:43:48 len(scanResults) = 175 MultiScanCount = 175
2023/09/14 04:43:48 Expected and Actual scan responses are the same
2023/09/14 04:43:48
--- Multi Scan 1 ---
2023/09/14 04:43:48 distinct = false
2023/09/14 04:43:48 Using n1ql client
2023/09/14 04:43:48 Using n1ql client
2023/09/14 04:43:48 len(scanResults) = 1 MultiScanCount = 1
2023/09/14 04:43:48 Expected and Actual scan responses are the same
2023/09/14 04:43:48
--- Multi Scan 2 ---
2023/09/14 04:43:48 distinct = false
2023/09/14 04:43:49 Using n1ql client
2023/09/14 04:43:49 Using n1ql client
2023/09/14 04:43:49 len(scanResults) = 555 MultiScanCount = 555
2023/09/14 04:43:49 Expected and Actual scan responses are the same
2023/09/14 04:43:49
--- Multi Scan 3 ---
2023/09/14 04:43:49 distinct = false
2023/09/14 04:43:49 Using n1ql client
2023/09/14 04:43:49 Using n1ql client
2023/09/14 04:43:49 len(scanResults) = 872 MultiScanCount = 872
2023/09/14 04:43:49 Expected and Actual scan responses are the same
2023/09/14 04:43:49
--- Multi Scan 4 ---
2023/09/14 04:43:49 distinct = false
2023/09/14 04:43:50 Using n1ql client
2023/09/14 04:43:50 Using n1ql client
2023/09/14 04:43:50 len(scanResults) = 287 MultiScanCount = 287
2023/09/14 04:43:50 Expected and Actual scan responses are the same
2023/09/14 04:43:50
--- Multi Scan 5 ---
2023/09/14 04:43:50 distinct = false
2023/09/14 04:43:50 Using n1ql client
2023/09/14 04:43:50 Using n1ql client
2023/09/14 04:43:50 len(scanResults) = 5254 MultiScanCount = 5254
2023/09/14 04:43:50 Expected and Actual scan responses are the same
2023/09/14 04:43:50
--- Multi Scan 6 ---
2023/09/14 04:43:50 distinct = false
2023/09/14 04:43:50 Using n1ql client
2023/09/14 04:43:50 Using n1ql client
2023/09/14 04:43:50 len(scanResults) = 5566 MultiScanCount = 5566
2023/09/14 04:43:51 Expected and Actual scan responses are the same
2023/09/14 04:43:51
--- Multi Scan 7 ---
2023/09/14 04:43:51 distinct = false
2023/09/14 04:43:51 Using n1ql client
2023/09/14 04:43:51 Using n1ql client
2023/09/14 04:43:51 len(scanResults) = 8 MultiScanCount = 8
2023/09/14 04:43:51 Expected and Actual scan responses are the same
2023/09/14 04:43:51
--------- With DISTINCT True ---------
2023/09/14 04:43:51
--- ScanAllNoFilter ---
2023/09/14 04:43:51 distinct = true
2023/09/14 04:43:51 Using n1ql client
2023/09/14 04:43:51 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:43:51
--- ScanAllFilterNil ---
2023/09/14 04:43:51 distinct = true
2023/09/14 04:43:52 Using n1ql client
2023/09/14 04:43:52 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:43:52
--- ScanAll_AllFiltersNil ---
2023/09/14 04:43:52 distinct = true
2023/09/14 04:43:52 Using n1ql client
2023/09/14 04:43:52 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:43:52
--- SingleSeek ---
2023/09/14 04:43:52 distinct = true
2023/09/14 04:43:53 Using n1ql client
2023/09/14 04:43:53 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:43:53
--- MultipleSeek ---
2023/09/14 04:43:53 distinct = true
2023/09/14 04:43:53 Using n1ql client
2023/09/14 04:43:53 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/14 04:43:53
--- SimpleRange ---
2023/09/14 04:43:53 distinct = true
2023/09/14 04:43:53 Using n1ql client
2023/09/14 04:43:53 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/14 04:43:53
--- NonOverlappingRanges ---
2023/09/14 04:43:53 distinct = true
2023/09/14 04:43:54 Using n1ql client
2023/09/14 04:43:54 MultiScanCount = 428 ExpectedMultiScanCount = 428
2023/09/14 04:43:54
--- NonOverlappingFilters2 ---
2023/09/14 04:43:54 distinct = true
2023/09/14 04:43:54 Using n1ql client
2023/09/14 04:43:54 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:43:54
--- OverlappingRanges ---
2023/09/14 04:43:54 distinct = true
2023/09/14 04:43:55 Using n1ql client
2023/09/14 04:43:55 MultiScanCount = 575 ExpectedMultiScanCount = 575
2023/09/14 04:43:55
--- NonOverlappingFilters ---
2023/09/14 04:43:55 distinct = true
2023/09/14 04:43:56 Using n1ql client
2023/09/14 04:43:56 MultiScanCount = 186 ExpectedMultiScanCount = 186
2023/09/14 04:43:56
--- OverlappingFilters ---
2023/09/14 04:43:56 distinct = true
2023/09/14 04:43:56 Using n1ql client
2023/09/14 04:43:56 MultiScanCount = 543 ExpectedMultiScanCount = 543
2023/09/14 04:43:56
--- BoundaryFilters ---
2023/09/14 04:43:56 distinct = true
2023/09/14 04:43:57 Using n1ql client
2023/09/14 04:43:57 MultiScanCount = 172 ExpectedMultiScanCount = 172
2023/09/14 04:43:57
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:43:57 distinct = true
2023/09/14 04:43:57 Using n1ql client
2023/09/14 04:43:57 MultiScanCount = 135 ExpectedMultiScanCount = 135
2023/09/14 04:43:57
--- SeekAndFilters_Overlapping ---
2023/09/14 04:43:57 distinct = true
2023/09/14 04:43:57 Using n1ql client
2023/09/14 04:43:57 MultiScanCount = 134 ExpectedMultiScanCount = 134
2023/09/14 04:43:57
--- SimpleRangeLowUnbounded ---
2023/09/14 04:43:57 distinct = false
2023/09/14 04:43:58 Using n1ql client
2023/09/14 04:43:58 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/14 04:43:58
--- SimpleRangeHighUnbounded ---
2023/09/14 04:43:58 distinct = false
2023/09/14 04:43:58 Using n1ql client
2023/09/14 04:43:58 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/14 04:43:58
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:43:58 distinct = false
2023/09/14 04:43:59 Using n1ql client
2023/09/14 04:43:59 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/14 04:43:59
--- FiltersWithUnbounded ---
2023/09/14 04:43:59 distinct = false
2023/09/14 04:43:59 Using n1ql client
2023/09/14 04:43:59 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/14 04:43:59
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:43:59 distinct = false
2023/09/14 04:43:59 Using n1ql client
2023/09/14 04:44:00 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/14 04:44:00
--------- Simple Index with 1 field ---------
2023/09/14 04:44:00
--- SingleIndexSimpleRange ---
2023/09/14 04:44:00 distinct = true
2023/09/14 04:44:00 Using n1ql client
2023/09/14 04:44:00 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/14 04:44:00
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:44:00 distinct = true
2023/09/14 04:44:00 Using n1ql client
2023/09/14 04:44:00 MultiScanCount = 713 ExpectedMultiScanCount = 713
2023/09/14 04:44:00
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:44:00 distinct = true
2023/09/14 04:44:01 Using n1ql client
2023/09/14 04:44:01 MultiScanCount = 869 ExpectedMultiScanCount = 869
2023/09/14 04:44:01
--------- Composite Index with 3 fields ---------
2023/09/14 04:44:01
--- ScanAllNoFilter ---
2023/09/14 04:44:01 distinct = true
2023/09/14 04:44:01 Using n1ql client
2023/09/14 04:44:01 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:44:01
--- ScanAllFilterNil ---
2023/09/14 04:44:01 distinct = true
2023/09/14 04:44:02 Using n1ql client
2023/09/14 04:44:02 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:44:02
--- ScanAll_AllFiltersNil ---
2023/09/14 04:44:02 distinct = true
2023/09/14 04:44:02 Using n1ql client
2023/09/14 04:44:02 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/14 04:44:02
--- 3FieldsSingleSeek ---
2023/09/14 04:44:02 distinct = true
2023/09/14 04:44:02 Using n1ql client
2023/09/14 04:44:02 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/14 04:44:02
--- 3FieldsMultipleSeeks ---
2023/09/14 04:44:02 distinct = true
2023/09/14 04:44:03 Using n1ql client
2023/09/14 04:44:03 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/14 04:44:03
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:44:03 distinct = true
2023/09/14 04:44:03 Using n1ql client
2023/09/14 04:44:03 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanDescCount (30.75s)
=== RUN TestMultiScanDescOffset
2023/09/14 04:44:03 In SkipTestMultiScanDescOffset()
2023/09/14 04:44:03
--------- Composite Index with 2 fields ---------
2023/09/14 04:44:03
--- ScanAllNoFilter ---
2023/09/14 04:44:03 distinct = false
2023/09/14 04:44:04 Using n1ql client
2023/09/14 04:44:04
--- ScanAllFilterNil ---
2023/09/14 04:44:04 distinct = false
2023/09/14 04:44:04 Using n1ql client
2023/09/14 04:44:04
--- ScanAll_AllFiltersNil ---
2023/09/14 04:44:04 distinct = false
2023/09/14 04:44:05 Using n1ql client
2023/09/14 04:44:05
--- SingleSeek ---
2023/09/14 04:44:05 distinct = false
2023/09/14 04:44:05 Using n1ql client
2023/09/14 04:44:05
--- MultipleSeek ---
2023/09/14 04:44:05 distinct = false
2023/09/14 04:44:05 Using n1ql client
2023/09/14 04:44:05
--- SimpleRange ---
2023/09/14 04:44:05 distinct = false
2023/09/14 04:44:06 Using n1ql client
2023/09/14 04:44:06
--- NonOverlappingRanges ---
2023/09/14 04:44:06 distinct = false
2023/09/14 04:44:06 Using n1ql client
2023/09/14 04:44:06
--- OverlappingRanges ---
2023/09/14 04:44:06 distinct = false
2023/09/14 04:44:07 Using n1ql client
2023/09/14 04:44:07
--- NonOverlappingFilters ---
2023/09/14 04:44:07 distinct = false
2023/09/14 04:44:07 Using n1ql client
2023/09/14 04:44:07
--- OverlappingFilters ---
2023/09/14 04:44:07 distinct = false
2023/09/14 04:44:07 Using n1ql client
2023/09/14 04:44:07
--- BoundaryFilters ---
2023/09/14 04:44:07 distinct = false
2023/09/14 04:44:08 Using n1ql client
2023/09/14 04:44:08
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:44:08 distinct = false
2023/09/14 04:44:08 Using n1ql client
2023/09/14 04:44:08
--- SeekAndFilters_Overlapping ---
2023/09/14 04:44:08 distinct = false
2023/09/14 04:44:09 Using n1ql client
2023/09/14 04:44:09
--- SimpleRangeLowUnbounded ---
2023/09/14 04:44:09 distinct = false
2023/09/14 04:44:09 Using n1ql client
2023/09/14 04:44:09 Expected and Actual scan responses are the same
2023/09/14 04:44:09
--- SimpleRangeHighUnbounded ---
2023/09/14 04:44:09 distinct = false
2023/09/14 04:44:10 Using n1ql client
2023/09/14 04:44:10 Expected and Actual scan responses are the same
2023/09/14 04:44:10
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:44:10 distinct = false
2023/09/14 04:44:10 Using n1ql client
2023/09/14 04:44:10 Expected and Actual scan responses are the same
2023/09/14 04:44:10
--- FiltersWithUnbounded ---
2023/09/14 04:44:10 distinct = false
2023/09/14 04:44:10 Using n1ql client
2023/09/14 04:44:10 Expected and Actual scan responses are the same
2023/09/14 04:44:10
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:44:10 distinct = false
2023/09/14 04:44:11 Using n1ql client
2023/09/14 04:44:11 Expected and Actual scan responses are the same
2023/09/14 04:44:11
--------- Simple Index with 1 field ---------
2023/09/14 04:44:11
--- SingleIndexSimpleRange ---
2023/09/14 04:44:11 distinct = false
2023/09/14 04:44:11 Using n1ql client
2023/09/14 04:44:11
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:44:11 distinct = false
2023/09/14 04:44:12 Using n1ql client
2023/09/14 04:44:12
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:44:12 distinct = false
2023/09/14 04:44:12 Using n1ql client
2023/09/14 04:44:12
--------- Composite Index with 3 fields ---------
2023/09/14 04:44:12
--- ScanAllNoFilter ---
2023/09/14 04:44:12 distinct = false
2023/09/14 04:44:12 Using n1ql client
2023/09/14 04:44:12
--- ScanAllFilterNil ---
2023/09/14 04:44:12 distinct = false
2023/09/14 04:44:13 Using n1ql client
2023/09/14 04:44:13
--- ScanAll_AllFiltersNil ---
2023/09/14 04:44:13 distinct = false
2023/09/14 04:44:13 Using n1ql client
2023/09/14 04:44:13
--- 3FieldsSingleSeek ---
2023/09/14 04:44:13 distinct = false
2023/09/14 04:44:14 Using n1ql client
2023/09/14 04:44:14
--- 3FieldsMultipleSeeks ---
2023/09/14 04:44:14 distinct = false
2023/09/14 04:44:14 Using n1ql client
2023/09/14 04:44:14
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:44:14 distinct = false
2023/09/14 04:44:15 Using n1ql client
--- PASS: TestMultiScanDescOffset (11.44s)
=== RUN TestMultiScanDescDistinct
2023/09/14 04:44:15 In SkipTestMultiScanDescDistinct()
2023/09/14 04:44:15
--------- Composite Index with 2 fields ---------
2023/09/14 04:44:15
--- ScanAllNoFilter ---
2023/09/14 04:44:15 distinct = true
2023/09/14 04:44:15 Using n1ql client
2023/09/14 04:44:15 Expected and Actual scan responses are the same
2023/09/14 04:44:15
--- ScanAllFilterNil ---
2023/09/14 04:44:15 distinct = true
2023/09/14 04:44:16 Using n1ql client
2023/09/14 04:44:16 Expected and Actual scan responses are the same
2023/09/14 04:44:16
--- ScanAll_AllFiltersNil ---
2023/09/14 04:44:16 distinct = true
2023/09/14 04:44:16 Using n1ql client
2023/09/14 04:44:16 Expected and Actual scan responses are the same
2023/09/14 04:44:16
--- SingleSeek ---
2023/09/14 04:44:16 distinct = true
2023/09/14 04:44:17 Using n1ql client
2023/09/14 04:44:17 Expected and Actual scan responses are the same
2023/09/14 04:44:17
--- MultipleSeek ---
2023/09/14 04:44:17 distinct = true
2023/09/14 04:44:17 Using n1ql client
2023/09/14 04:44:17 Expected and Actual scan responses are the same
2023/09/14 04:44:17
--- SimpleRange ---
2023/09/14 04:44:17 distinct = true
2023/09/14 04:44:17 Using n1ql client
2023/09/14 04:44:18 Expected and Actual scan responses are the same
2023/09/14 04:44:18
--- NonOverlappingRanges ---
2023/09/14 04:44:18 distinct = true
2023/09/14 04:44:18 Using n1ql client
2023/09/14 04:44:18 Expected and Actual scan responses are the same
2023/09/14 04:44:18
--- OverlappingRanges ---
2023/09/14 04:44:18 distinct = true
2023/09/14 04:44:18 Using n1ql client
2023/09/14 04:44:18 Expected and Actual scan responses are the same
2023/09/14 04:44:18
--- NonOverlappingFilters ---
2023/09/14 04:44:18 distinct = true
2023/09/14 04:44:19 Using n1ql client
2023/09/14 04:44:19 Expected and Actual scan responses are the same
2023/09/14 04:44:19
--- OverlappingFilters ---
2023/09/14 04:44:19 distinct = true
2023/09/14 04:44:19 Using n1ql client
2023/09/14 04:44:19 Expected and Actual scan responses are the same
2023/09/14 04:44:19
--- BoundaryFilters ---
2023/09/14 04:44:19 distinct = true
2023/09/14 04:44:20 Using n1ql client
2023/09/14 04:44:20 Expected and Actual scan responses are the same
2023/09/14 04:44:20
--- SeekAndFilters_NonOverlapping ---
2023/09/14 04:44:20 distinct = true
2023/09/14 04:44:20 Using n1ql client
2023/09/14 04:44:20 Expected and Actual scan responses are the same
2023/09/14 04:44:20
--- SeekAndFilters_Overlapping ---
2023/09/14 04:44:20 distinct = true
2023/09/14 04:44:20 Using n1ql client
2023/09/14 04:44:20 Expected and Actual scan responses are the same
2023/09/14 04:44:20
--- SimpleRangeLowUnbounded ---
2023/09/14 04:44:20 distinct = false
2023/09/14 04:44:21 Using n1ql client
2023/09/14 04:44:21 Expected and Actual scan responses are the same
2023/09/14 04:44:21
--- SimpleRangeHighUnbounded ---
2023/09/14 04:44:21 distinct = false
2023/09/14 04:44:21 Using n1ql client
2023/09/14 04:44:21 Expected and Actual scan responses are the same
2023/09/14 04:44:21
--- SimpleRangeMultipleUnbounded ---
2023/09/14 04:44:21 distinct = false
2023/09/14 04:44:22 Using n1ql client
2023/09/14 04:44:22 Expected and Actual scan responses are the same
2023/09/14 04:44:22
--- FiltersWithUnbounded ---
2023/09/14 04:44:22 distinct = false
2023/09/14 04:44:22 Using n1ql client
2023/09/14 04:44:22 Expected and Actual scan responses are the same
2023/09/14 04:44:22
--- FiltersLowGreaterThanHigh ---
2023/09/14 04:44:22 distinct = false
2023/09/14 04:44:23 Using n1ql client
2023/09/14 04:44:23 Expected and Actual scan responses are the same
2023/09/14 04:44:23
--------- Simple Index with 1 field ---------
2023/09/14 04:44:23
--- SingleIndexSimpleRange ---
2023/09/14 04:44:23 distinct = true
2023/09/14 04:44:23 Using n1ql client
2023/09/14 04:44:23 Expected and Actual scan responses are the same
2023/09/14 04:44:23
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/14 04:44:23 distinct = true
2023/09/14 04:44:23 Using n1ql client
2023/09/14 04:44:23 Expected and Actual scan responses are the same
2023/09/14 04:44:23
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/14 04:44:23 distinct = true
2023/09/14 04:44:24 Using n1ql client
2023/09/14 04:44:24 Expected and Actual scan responses are the same
2023/09/14 04:44:24
--------- Composite Index with 3 fields ---------
2023/09/14 04:44:24
--- ScanAllNoFilter ---
2023/09/14 04:44:24 distinct = true
2023/09/14 04:44:24 Using n1ql client
2023/09/14 04:44:24 Expected and Actual scan responses are the same
2023/09/14 04:44:24
--- ScanAllFilterNil ---
2023/09/14 04:44:24 distinct = true
2023/09/14 04:44:25 Using n1ql client
2023/09/14 04:44:25 Expected and Actual scan responses are the same
2023/09/14 04:44:25
--- ScanAll_AllFiltersNil ---
2023/09/14 04:44:25 distinct = true
2023/09/14 04:44:25 Using n1ql client
2023/09/14 04:44:26 Expected and Actual scan responses are the same
2023/09/14 04:44:26
--- 3FieldsSingleSeek ---
2023/09/14 04:44:26 distinct = true
2023/09/14 04:44:26 Using n1ql client
2023/09/14 04:44:26 Expected and Actual scan responses are the same
2023/09/14 04:44:26
--- 3FieldsMultipleSeeks ---
2023/09/14 04:44:26 distinct = true
2023/09/14 04:44:26 Using n1ql client
2023/09/14 04:44:26 Expected and Actual scan responses are the same
2023/09/14 04:44:26
--- 3FieldsMultipleSeeks_Identical ---
2023/09/14 04:44:26 distinct = true
2023/09/14 04:44:27 Using n1ql client
2023/09/14 04:44:27 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescDistinct (12.15s)
=== RUN TestGroupAggrSetup
2023/09/14 04:44:27 In TestGroupAggrSetup()
2023/09/14 04:44:27 Emptying the default bucket
2023/09/14 04:44:30 Flush Enabled on bucket default, responseBody:
2023/09/14 04:45:08 Flushed the bucket default, Response body:
2023/09/14 04:45:08 Dropping the secondary index index_agg
2023/09/14 04:45:08 Populating the default bucket
2023/09/14 04:45:12 Created the secondary index index_agg. Waiting for it become active
2023/09/14 04:45:12 Index is 3614291583880462032 now active
--- PASS: TestGroupAggrSetup (50.86s)
=== RUN TestGroupAggrLeading
2023/09/14 04:45:18 In TestGroupAggrLeading()
2023/09/14 04:45:18 Total Scanresults = 7
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 3
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLeading (0.01s)
=== RUN TestGroupAggrNonLeading
2023/09/14 04:45:18 In TestGroupAggrNonLeading()
2023/09/14 04:45:18 Total Scanresults = 4
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNonLeading (0.00s)
=== RUN TestGroupAggrNoGroup
2023/09/14 04:45:18 In TestGroupAggrNoGroup()
2023/09/14 04:45:18 Total Scanresults = 1
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroup (0.00s)
=== RUN TestGroupAggrMinMax
2023/09/14 04:45:18 In TestGroupAggrMinMax()
2023/09/14 04:45:18 Total Scanresults = 4
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax (0.00s)
=== RUN TestGroupAggrMinMax2
2023/09/14 04:45:18 In TestGroupAggrMinMax()
2023/09/14 04:45:18 Total Scanresults = 1
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax2 (0.00s)
=== RUN TestGroupAggrLeading_N1QLExprs
2023/09/14 04:45:18 In TestGroupAggrLeading_N1QLExprs()
2023/09/14 04:45:18 Total Scanresults = 17
2023/09/14 04:45:18 basicGroupAggrN1QLExprs1: Scan validation passed
2023/09/14 04:45:18 Total Scanresults = 9
2023/09/14 04:45:18 basicGroupAggrN1QLExprs2: Scan validation passed
--- PASS: TestGroupAggrLeading_N1QLExprs (0.38s)
=== RUN TestGroupAggrLimit
2023/09/14 04:45:18 In TestGroupAggrLimit()
2023/09/14 04:45:18 Total Scanresults = 3
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLimit (0.01s)
=== RUN TestGroupAggrOffset
2023/09/14 04:45:18 In TestGroupAggrOffset()
2023/09/14 04:45:18 Total Scanresults = 3
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrOffset (0.00s)
=== RUN TestGroupAggrCountN
2023/09/14 04:45:18 In TestGroupAggrCountN()
2023/09/14 04:45:18 Total Scanresults = 4
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 4
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrCountN (0.00s)
=== RUN TestGroupAggrNoGroupNoMatch
2023/09/14 04:45:18 In TestGroupAggrNoGroupNoMatch()
2023/09/14 04:45:18 Total Scanresults = 1
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroupNoMatch (0.00s)
=== RUN TestGroupAggrGroupNoMatch
2023/09/14 04:45:18 In TestGroupAggrGroupNoMatch()
2023/09/14 04:45:18 Total Scanresults = 0
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrGroupNoMatch (0.00s)
=== RUN TestGroupAggrMultDataTypes
2023/09/14 04:45:18 In TestGroupAggrMultDataTypes()
2023/09/14 04:45:18 Total Scanresults = 8
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMultDataTypes (0.00s)
=== RUN TestGroupAggrDistinct
2023/09/14 04:45:18 In TestGroupAggrDistinct()
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct (0.00s)
=== RUN TestGroupAggrDistinct2
2023/09/14 04:45:18 In TestGroupAggrDistinct2()
2023/09/14 04:45:18 Total Scanresults = 1
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 4
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 4
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct2 (0.00s)
=== RUN TestGroupAggrNull
2023/09/14 04:45:18 In TestGroupAggrNull()
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNull (0.00s)
=== RUN TestGroupAggrInt64
2023/09/14 04:45:18 In TestGroupAggrInt64()
2023/09/14 04:45:18 Updating the default bucket
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
2023/09/14 04:45:18 Total Scanresults = 2
2023/09/14 04:45:18 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrInt64 (0.22s)
=== RUN TestGroupAggr1
2023/09/14 04:45:18 In TestGroupAggr1()
2023/09/14 04:45:18 In DropAllSecondaryIndexes()
2023/09/14 04:45:18 Index found: index_company_desc
2023/09/14 04:45:18 Dropped index index_company_desc
2023/09/14 04:45:18 Index found: #primary
2023/09/14 04:45:19 Dropped index #primary
2023/09/14 04:45:19 Index found: index_agg
2023/09/14 04:45:19 Dropped index index_agg
2023/09/14 04:45:19 Index found: index_company_name_age_desc
2023/09/14 04:45:19 Dropped index index_company_name_age_desc
2023/09/14 04:45:19 Index found: index_companyname_desc
2023/09/14 04:45:19 Dropped index index_companyname_desc
2023/09/14 04:45:19 Index found: #primary
2023/09/14 04:45:19 Dropped index #primary
2023/09/14 04:45:57 Flushed the bucket default, Response body:
2023/09/14 04:46:08 Created the secondary index idx_aggrs. Waiting for it become active
2023/09/14 04:46:08 Index is 5722000612656618479 now active
2023/09/14 04:46:08 Total Scanresults = 633
2023/09/14 04:46:10 Total Scanresults = 743
--- PASS: TestGroupAggr1 (51.66s)
=== RUN TestGroupAggrArrayIndex
2023/09/14 04:46:10 In TestGroupAggrArrayIndex()
2023/09/14 04:46:15 Created the secondary index ga_arr1. Waiting for it become active
2023/09/14 04:46:15 Index is 4683483762395793790 now active
2023/09/14 04:46:21 Created the secondary index ga_arr2. Waiting for it become active
2023/09/14 04:46:21 Index is 3911011802056407530 now active
2023/09/14 04:46:21 Scenario 1
2023/09/14 04:46:21 Total Scanresults = 633
2023/09/14 04:46:21 Scenario 2
2023/09/14 04:46:21 Total Scanresults = 2824
2023/09/14 04:46:22 Scenario 3
2023/09/14 04:46:22 Total Scanresults = 1
2023/09/14 04:46:22 Scenario 4
2023/09/14 04:46:22 Total Scanresults = 992
2023/09/14 04:46:23 Scenario 5
2023/09/14 04:46:23 Total Scanresults = 2824
2023/09/14 04:46:24 Scenario 6
2023/09/14 04:46:24 Total Scanresults = 1
2023/09/14 04:46:24 Scenario 7
2023/09/14 04:46:24 Total Scanresults = 2929
2023/09/14 04:46:27 Scenario 8
2023/09/14 04:46:27 Total Scanresults = 1171
2023/09/14 04:46:28 Scenario 9
2023/09/14 04:46:28 Total Scanresults = 1
2023/09/14 04:46:28 Scenario 10
2023/09/14 04:46:28 Total Scanresults = 633
2023/09/14 04:46:29 Scenario 11
2023/09/14 04:46:29 Total Scanresults = 1171
2023/09/14 04:46:29 Scenario 12
2023/09/14 04:46:29 Total Scanresults = 1
2023/09/14 04:46:30 Scenario 13
2023/09/14 04:46:34 Total Scanresults = 1
2023/09/14 04:46:34 Count of scanResults is 1
2023/09/14 04:46:34 Value: [2 133]
--- PASS: TestGroupAggrArrayIndex (23.62s)
=== RUN TestGroupAggr_FirstValidAggrOnly
2023/09/14 04:46:34 In TestGroupAggr_FirstValidAggrOnly()
2023/09/14 04:46:34 In DropAllSecondaryIndexes()
2023/09/14 04:46:34 Index found: #primary
2023/09/14 04:46:34 Dropped index #primary
2023/09/14 04:46:34 Index found: #primary
2023/09/14 04:46:34 Dropped index #primary
2023/09/14 04:46:34 Index found: ga_arr1
2023/09/14 04:46:34 Dropped index ga_arr1
2023/09/14 04:46:34 Index found: ga_arr2
2023/09/14 04:46:34 Dropped index ga_arr2
2023/09/14 04:46:34 Index found: test_oneperprimarykey
2023/09/14 04:46:34 Dropped index test_oneperprimarykey
2023/09/14 04:46:34 Index found: idx_aggrs
2023/09/14 04:46:34 Dropped index idx_aggrs
2023/09/14 04:46:49 Created the secondary index idx_asc_3field. Waiting for it become active
2023/09/14 04:46:49 Index is 12279456898472626385 now active
2023/09/14 04:46:55 Created the secondary index idx_desc_3field. Waiting for it become active
2023/09/14 04:46:55 Index is 9325875550332256576 now active
2023/09/14 04:46:55 === MIN no group by ===
2023/09/14 04:46:55 Total Scanresults = 1
2023/09/14 04:46:55 Count of scanResults is 1
2023/09/14 04:46:55 Value: ["ACCEL"]
2023/09/14 04:46:55 === MIN no group by, no row match ===
2023/09/14 04:46:55 Total Scanresults = 1
2023/09/14 04:46:55 Count of scanResults is 1
2023/09/14 04:46:55 Value: [null]
2023/09/14 04:46:56 === MIN with group by ===
2023/09/14 04:46:56 Total Scanresults = 633
2023/09/14 04:46:56 === MIN with group by, no row match ===
2023/09/14 04:46:56 Total Scanresults = 0
2023/09/14 04:46:56 === One Aggr, no group by ===
2023/09/14 04:46:56 Total Scanresults = 1
2023/09/14 04:46:56 Count of scanResults is 1
2023/09/14 04:46:56 Value: ["FANFARE"]
2023/09/14 04:46:57 === One Aggr, no group by, no row match ===
2023/09/14 04:46:57 Total Scanresults = 1
2023/09/14 04:46:57 Count of scanResults is 1
2023/09/14 04:46:57 Value: [null]
2023/09/14 04:46:57 === Multiple Aggr, no group by ===
2023/09/14 04:46:57 Total Scanresults = 1
2023/09/14 04:46:57 Count of scanResults is 1
2023/09/14 04:46:57 Value: ["FANFARE" 15]
2023/09/14 04:46:57 === Multiple Aggr, no group by, no row match ===
2023/09/14 04:46:57 Total Scanresults = 1
2023/09/14 04:46:57 Count of scanResults is 1
2023/09/14 04:46:57 Value: [null null]
2023/09/14 04:46:57 === No Aggr, 1 group by ===
2023/09/14 04:46:57 Total Scanresults = 207
2023/09/14 04:46:57 === Aggr on non-leading key, previous equality filter, no group ===
2023/09/14 04:46:57 Total Scanresults = 1
2023/09/14 04:46:57 Count of scanResults is 1
2023/09/14 04:46:57 Value: [17]
2023/09/14 04:46:57 === Aggr on non-leading key, previous equality filters, no group ===
2023/09/14 04:46:57 Total Scanresults = 1
2023/09/14 04:46:57 Count of scanResults is 1
2023/09/14 04:46:57 Value: [null]
2023/09/14 04:46:58 === Aggr on non-leading key, previous non-equality filters, no group ===
2023/09/14 04:46:58 Total Scanresults = 1
2023/09/14 04:46:58 Count of scanResults is 1
2023/09/14 04:46:58 Value: ["Ahmed"]
2023/09/14 04:46:58 === MIN on desc, no group ===
2023/09/14 04:46:58 Total Scanresults = 1
2023/09/14 04:46:58 Count of scanResults is 1
2023/09/14 04:46:58 Value: ["FANFARE"]
2023/09/14 04:46:58 === MAX on asc, no group ===
2023/09/14 04:46:58 Total Scanresults = 1
2023/09/14 04:46:58 Count of scanResults is 1
2023/09/14 04:46:58 Value: ["OZEAN"]
2023/09/14 04:46:58 === MAX on desc, no group ===
2023/09/14 04:46:58 Total Scanresults = 1
2023/09/14 04:46:58 Count of scanResults is 1
2023/09/14 04:46:58 Value: ["OZEAN"]
2023/09/14 04:46:58 === COUNT(DISTINCT const_expr, no group ===
2023/09/14 04:46:58 Total Scanresults = 1
2023/09/14 04:46:58 Count of scanResults is 1
2023/09/14 04:46:58 Value: [1]
2023/09/14 04:46:58 === COUNT(DISTINCT const_expr, no group, no row match ===
2023/09/14 04:46:58 Total Scanresults = 1
2023/09/14 04:46:58 Count of scanResults is 1
2023/09/14 04:46:58 Value: [0]
2023/09/14 04:46:59 === COUNT(const_expr, no group ===
2023/09/14 04:46:59 Total Scanresults = 1
2023/09/14 04:46:59 Count of scanResults is 1
2023/09/14 04:46:59 Value: [321]
2023/09/14 04:47:03 Created the secondary index indexMinAggr. Waiting for it become active
2023/09/14 04:47:03 Index is 4132866455770265687 now active
2023/09/14 04:47:03 === Equality filter check: Equality for a, nil filter for b - inclusion 0, no filter for c ===
2023/09/14 04:47:03 Total Scanresults = 1
2023/09/14 04:47:03 Count of scanResults is 1
2023/09/14 04:47:03 Value: [5]
2023/09/14 04:47:03 === Equality filter check: Equality for a, nil filter for b - inclusion 3, no filter for c ===
2023/09/14 04:47:03 Total Scanresults = 1
2023/09/14 04:47:03 Count of scanResults is 1
2023/09/14 04:47:03 Value: [5]
2023/09/14 04:47:03 === Equality filter check: Equality for a, nil filter for b - inclusion 3, nil filter for c ===
2023/09/14 04:47:03 Total Scanresults = 1
2023/09/14 04:47:03 Count of scanResults is 1
2023/09/14 04:47:03 Value: [5]
--- PASS: TestGroupAggr_FirstValidAggrOnly (29.64s)
=== RUN TestGroupAggrPrimary
2023/09/14 04:47:03 In TestGroupAggrPrimary()
2023/09/14 04:47:03 Total Scanresults = 1
2023/09/14 04:47:03 Total Scanresults = 1
2023/09/14 04:47:03 Total Scanresults = 1
2023/09/14 04:47:04 Total Scanresults = 1002
2023/09/14 04:47:04 Total Scanresults = 1002
2023/09/14 04:47:04 Total Scanresults = 1
2023/09/14 04:47:04 Total Scanresults = 1
2023/09/14 04:47:05 Total Scanresults = 1
2023/09/14 04:47:05 Total Scanresults = 1
2023/09/14 04:47:05 Total Scanresults = 1
2023/09/14 04:47:05 Total Scanresults = 1
2023/09/14 04:47:05 --- MB-28305 Scenario 1 ---
2023/09/14 04:47:05 Total Scanresults = 1
2023/09/14 04:47:05 Count of scanResults is 1
2023/09/14 04:47:05 Value: [0]
2023/09/14 04:47:05 --- MB-28305 Scenario 2 ---
2023/09/14 04:47:05 Total Scanresults = 1
2023/09/14 04:47:05 Count of scanResults is 1
2023/09/14 04:47:05 Value: [0]
2023/09/14 04:47:05 --- MB-28305 Scenario 3 ---
2023/09/14 04:47:05 Total Scanresults = 1
2023/09/14 04:47:05 Count of scanResults is 1
2023/09/14 04:47:05 Value: [0]
--- PASS: TestGroupAggrPrimary (1.62s)
=== RUN TestGroupAggrDocumentKey
2023/09/14 04:47:05 In TestGroupAggrDocumentKey()
2023/09/14 04:47:05 Dropping the secondary index documentkey_idx1
2023/09/14 04:47:05 Dropping the secondary index documentkey_idx2
2023/09/14 04:47:05 Populating the default bucket for TestGroupAggrDocumentKey single key index
2023/09/14 04:47:09 Created the secondary index documentkey_idx1. Waiting for it become active
2023/09/14 04:47:09 Index is 335127569826772965 now active
2023/09/14 04:47:09 Using n1ql client
2023/09/14 04:47:10 Scanresult Row ["1"] :
2023/09/14 04:47:10 Scanresult Row ["2"] :
2023/09/14 04:47:10 Scanresult Row ["3"] :
2023/09/14 04:47:10 Expected and Actual scan responses are the same
2023/09/14 04:47:10 Populating the default bucket for TestGroupAggrDocumentKey composite key index
2023/09/14 04:47:15 Created the secondary index documentkey_idx2. Waiting for it become active
2023/09/14 04:47:15 Index is 18224400794244221006 now active
2023/09/14 04:47:15 Using n1ql client
2023/09/14 04:47:16 Scanresult Row ["1"] :
2023/09/14 04:47:16 Scanresult Row ["2"] :
2023/09/14 04:47:16 Scanresult Row ["3"] :
2023/09/14 04:47:16 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDocumentKey (10.79s)
=== RUN TestRebalanceSetupCluster
2023/09/14 04:47:16 set14_rebalance_test.go::TestRebalanceSetupCluster: entry: Current cluster configuration: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:47:16 set14_rebalance_test.go::TestRebalanceSetupCluster: 1. Setting up initial cluster configuration
2023/09/14 04:47:16 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/14 04:47:21 Rebalance progress: 2.734375
2023/09/14 04:47:26 Rebalance progress: 8.0078125
2023/09/14 04:47:31 Rebalance progress: 13.4765625
2023/09/14 04:47:36 Rebalance progress: 19.07552083333334
2023/09/14 04:47:41 Rebalance progress: 24.4140625
2023/09/14 04:47:46 Rebalance progress: 30.078125
2023/09/14 04:47:51 Rebalance progress: 36.29557291666666
2023/09/14 04:47:56 Rebalance progress: 41.40625
2023/09/14 04:48:01 Rebalance progress: 46.45182291666666
2023/09/14 04:48:06 Rebalance progress: 50
2023/09/14 04:48:11 Rebalance progress: 50
2023/09/14 04:48:16 Rebalance progress: 75
2023/09/14 04:48:21 Rebalance progress: 100
2023/09/14 04:48:21 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 04:48:22 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 04:48:39 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/14 04:48:54 Rebalance progress: 75
2023/09/14 04:48:59 Rebalance progress: 100
2023/09/14 04:48:59 set14_rebalance_test.go::TestRebalanceSetupCluster: 2. Changing indexer.settings.rebalance.redistribute_indexes to true
2023/09/14 04:48:59 Changing config key indexer.settings.rebalance.redistribute_indexes to value true
2023/09/14 04:48:59 set14_rebalance_test.go::TestRebalanceSetupCluster: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceSetupCluster (103.52s)
=== RUN TestCreateDocsBeforeRebalance
2023/09/14 04:48:59 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:48:59 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: 1. Creating 100 documents
2023/09/14 04:48:59 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: 100 documents created
2023/09/14 04:48:59 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateDocsBeforeRebalance (0.13s)
=== RUN TestCreateIndexesBeforeRebalance
2023/09/14 04:48:59 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:48:59 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 1. Creating 17 indexes: non-partitioned, 0-replica, non-deferred
2023/09/14 04:48:59 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN__id on `default`(_id)
2023/09/14 04:49:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN__id index is now active.
2023/09/14 04:49:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_docid on `default`(docid)
2023/09/14 04:49:09 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_docid index is now active.
2023/09/14 04:49:09 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_guid on `default`(guid)
2023/09/14 04:49:15 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_guid index is now active.
2023/09/14 04:49:15 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_isActive on `default`(isActive)
2023/09/14 04:49:21 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_isActive index is now active.
2023/09/14 04:49:21 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_balance on `default`(balance)
2023/09/14 04:49:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_balance index is now active.
2023/09/14 04:49:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_picture on `default`(picture)
2023/09/14 04:49:33 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_picture index is now active.
2023/09/14 04:49:33 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_age on `default`(age)
2023/09/14 04:49:39 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_age index is now active.
2023/09/14 04:49:39 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_eyeColor on `default`(eyeColor)
2023/09/14 04:49:45 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_eyeColor index is now active.
2023/09/14 04:49:45 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_name on `default`(name)
2023/09/14 04:49:51 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_name index is now active.
2023/09/14 04:49:51 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_gender on `default`(gender)
2023/09/14 04:49:57 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_gender index is now active.
2023/09/14 04:49:57 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_company on `default`(company)
2023/09/14 04:50:04 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_company index is now active.
2023/09/14 04:50:04 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_email on `default`(email)
2023/09/14 04:50:10 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_email index is now active.
2023/09/14 04:50:10 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_phone on `default`(phone)
2023/09/14 04:50:16 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_phone index is now active.
2023/09/14 04:50:16 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_registered on `default`(registered)
2023/09/14 04:50:22 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_registered index is now active.
2023/09/14 04:50:22 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_latitude on `default`(latitude)
2023/09/14 04:50:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_latitude index is now active.
2023/09/14 04:50:28 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_longitude on `default`(longitude)
2023/09/14 04:50:34 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_longitude index is now active.
2023/09/14 04:50:34 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_favoriteFruit on `default`(favoriteFruit)
2023/09/14 04:50:40 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_favoriteFruit index is now active.
2023/09/14 04:50:40 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 2. Creating 17 indexes: non-partitioned, 0-replica, DEFERRED
2023/09/14 04:50:40 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED__id_docid on `default`(_id, docid) with {"defer_build":true}
2023/09/14 04:50:40 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED__id_docid index is now deferred.
2023/09/14 04:50:40 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_docid_guid on `default`(docid, guid) with {"defer_build":true}
2023/09/14 04:50:40 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_docid_guid index is now deferred.
2023/09/14 04:50:40 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_guid_isActive on `default`(guid, isActive) with {"defer_build":true}
2023/09/14 04:50:40 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_guid_isActive index is now deferred.
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_isActive_balance on `default`(isActive, balance) with {"defer_build":true}
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_isActive_balance index is now deferred.
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_balance_picture on `default`(balance, picture) with {"defer_build":true}
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_balance_picture index is now deferred.
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_picture_age on `default`(picture, age) with {"defer_build":true}
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_picture_age index is now deferred.
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_age_eyeColor on `default`(age, eyeColor) with {"defer_build":true}
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_age_eyeColor index is now deferred.
2023/09/14 04:50:41 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_eyeColor_name on `default`(eyeColor, name) with {"defer_build":true}
2023/09/14 04:50:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_eyeColor_name index is now deferred.
2023/09/14 04:50:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_name_gender on `default`(name, gender) with {"defer_build":true}
2023/09/14 04:50:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_name_gender index is now deferred.
2023/09/14 04:50:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_gender_company on `default`(gender, company) with {"defer_build":true}
2023/09/14 04:50:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_gender_company index is now deferred.
2023/09/14 04:50:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_company_email on `default`(company, email) with {"defer_build":true}
2023/09/14 04:50:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_company_email index is now deferred.
2023/09/14 04:50:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_email_phone on `default`(email, phone) with {"defer_build":true}
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_email_phone index is now deferred.
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_phone_registered on `default`(phone, registered) with {"defer_build":true}
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_phone_registered index is now deferred.
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_registered_latitude on `default`(registered, latitude) with {"defer_build":true}
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_registered_latitude index is now deferred.
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_latitude_longitude on `default`(latitude, longitude) with {"defer_build":true}
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_latitude_longitude index is now deferred.
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_longitude_favoriteFruit on `default`(longitude, favoriteFruit) with {"defer_build":true}
2023/09/14 04:50:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_longitude_favoriteFruit index is now deferred.
2023/09/14 04:50:44 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_favoriteFruit__id on `default`(favoriteFruit, _id) with {"defer_build":true}
2023/09/14 04:50:44 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_favoriteFruit__id index is now deferred.
2023/09/14 04:50:44 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 3. Creating 3 indexes: 7-PARTITION, 0-replica, non-deferred
2023/09/14 04:50:44 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS__id_guid on `default`(_id, guid) partition by hash(Meta().id) with {"num_partition":7}
2023/09/14 04:50:48 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS__id_guid index is now active.
2023/09/14 04:50:48 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS_docid_isActive on `default`(docid, isActive) partition by hash(Meta().id) with {"num_partition":7}
2023/09/14 04:50:54 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS_docid_isActive index is now active.
2023/09/14 04:50:54 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS_guid_balance on `default`(guid, balance) partition by hash(Meta().id) with {"num_partition":7}
2023/09/14 04:51:00 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS_guid_balance index is now active.
2023/09/14 04:51:00 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateIndexesBeforeRebalance (120.97s)
=== RUN TestIndexNodeRebalanceIn
2023/09/14 04:51:00 TestIndexNodeRebalanceIn entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:51:00 TestIndexNodeRebalanceIn: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/14 04:51:00 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/14 04:51:12 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/14 04:51:12 TestIndexNodeRebalanceIn: 2. Adding index node 127.0.0.1:9003 to the cluster
2023/09/14 04:51:12 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/14 04:51:22 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/14 04:51:22 TestIndexNodeRebalanceIn: 3. Rebalancing
2023/09/14 04:51:28 Rebalance progress: 20
2023/09/14 04:51:33 Rebalance progress: 41.96428571428572
2023/09/14 04:51:38 Rebalance progress: 58.03571428571429
2023/09/14 04:51:43 Rebalance progress: 58.03571428571429
2023/09/14 04:51:48 Rebalance progress: 87.5
2023/09/14 04:51:53 Rebalance progress: 100
2023/09/14 04:51:53 TestIndexNodeRebalanceIn exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestIndexNodeRebalanceIn (54.32s)
=== RUN TestCreateReplicatedIndexesBeforeRebalance
2023/09/14 04:51:55 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:51:55 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: 1. Creating 5 indexes: non-partitioned, 2-REPLICA, non-deferred
2023/09/14 04:51:55 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS__id_isActive on `default`(_id, isActive) with {"num_replica":2}
2023/09/14 04:52:05 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS__id_isActive index is now active.
2023/09/14 04:52:05 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_docid_balance on `default`(docid, balance) with {"num_replica":2}
2023/09/14 04:52:14 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_docid_balance index is now active.
2023/09/14 04:52:14 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_guid_picture on `default`(guid, picture) with {"num_replica":2}
2023/09/14 04:52:24 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_guid_picture index is now active.
2023/09/14 04:52:24 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_isActive_age on `default`(isActive, age) with {"num_replica":2}
2023/09/14 04:52:39 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_isActive_age index is now active.
2023/09/14 04:52:39 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with {"num_replica":2}
2023/09/14 04:52:49 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_balance_eyeColor index is now active.
2023/09/14 04:52:49 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: 2. Creating 2 indexes: 5-PARTITION, 1-REPLICA, non-deferred
2023/09/14 04:52:49 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_5PARTITIONS_1REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "num_replica":1}
2023/09/14 04:53:04 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_5PARTITIONS_1REPLICAS__id_balance index is now active.
2023/09/14 04:53:04 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_5PARTITIONS_1REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "num_replica":1}
2023/09/14 04:53:16 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_5PARTITIONS_1REPLICAS_docid_picture index is now active.
2023/09/14 04:53:16 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateReplicatedIndexesBeforeRebalance (81.12s)
=== RUN TestIndexNodeRebalanceOut
2023/09/14 04:53:16 set14_rebalance_test.go::TestIndexNodeRebalanceOut: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:53:16 set14_rebalance_test.go::TestIndexNodeRebalanceOut: 1. Rebalancing index node 127.0.0.1:9001 out of the cluster
2023/09/14 04:53:16 Removing node(s): [127.0.0.1:9001] from the cluster
2023/09/14 04:53:21 Rebalance progress: 20
2023/09/14 04:53:26 Rebalance progress: 38.97058823529412
2023/09/14 04:53:31 Rebalance progress: 52.20588235294118
2023/09/14 04:53:37 Rebalance progress: 61.02941176470588
2023/09/14 04:53:41 Rebalance progress: 72.47377120843692
2023/09/14 04:53:46 Rebalance progress: 82.65587005819522
2023/09/14 04:53:51 Rebalance progress: 100
2023-09-14T04:53:52.401+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.440+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.480+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.626+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.634+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.635+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.655+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.658+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.677+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.690+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.705+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.711+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.718+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.730+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.730+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.749+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023/09/14 04:53:52 set14_rebalance_test.go::TestIndexNodeRebalanceOut: exit: Current cluster configuration: map[127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023-09-14T04:53:52.784+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.804+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.805+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.815+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.815+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:b57dc2a593e5943273bcee9db801550e@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc020f293b0 0xc01c8f9840 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3632896e+07 couch_docs_data_size:1.958918e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.8815544e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1406422016e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5369 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:944858 index_disk_size:1.756025e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1388428288e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5365 7.6.0-1467-rel-EE-enterprise false [index] 3f67a48a9c4db11af4d2dec63dedffc3 inet 26292718 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:871385 index_disk_size:2.263734e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1388792832e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5363 7.6.0-1467-rel-EE-enterprise false [index] 120d056d757451cd36d47ba8a23b35fa inet 115886320 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=104991996&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=69202768 /pools/default/serverGroups?v=63391191 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc020f293b0 0xc01c8f9840 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3632896e+07 couch_docs_data_size:1.958918e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.8815544e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1406422016e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5369 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:944858 index_disk_size:1.756025e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1388428288e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5365 7.6.0-1467-rel-EE-enterprise false [index] 3f67a48a9c4db11af4d2dec63dedffc3 inet 26292718 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:871385 index_disk_size:2.263734e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1388792832e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5363 7.6.0-1467-rel-EE-enterprise false [index] 120d056d757451cd36d47ba8a23b35fa inet 115886320 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[indexAdmin:9112 indexHttp:9114 indexHttps:19114 indexScan:9113 indexStreamCatchup:9116 indexStreamInit:9115 indexStreamMaint:9117 mgmt:9002 mgmtSSL:19002] 127.0.0.1 false} {map[indexAdmin:9118 indexHttp:9120 indexHttps:19120 indexScan:9119 indexStreamCatchup:9122 indexStreamInit:9121 indexStreamMaint:9123 mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9002:19002 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9112:9112 9113:9113 9114:19114 9115:9115 9116:9116 9117:9117 9118:9118 9119:9119 9120:19120 9121:9121 9122:9122 9123:9123 9499:19499 9999:9999]}
2023-09-14T04:53:52.816+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.834+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 3 != len(c.nodesvs): 4
2023-09-14T04:53:52.835+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:b57dc2a593e5943273bcee9db801550e@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc021201b90 0xc02123e180 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3632896e+07 couch_docs_data_size:1.958918e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.8815544e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1406422016e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5369 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:944858 index_disk_size:1.756025e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1388428288e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5365 7.6.0-1467-rel-EE-enterprise false [index] 3f67a48a9c4db11af4d2dec63dedffc3 inet 26292718 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:871385 index_disk_size:2.263734e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1388792832e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5363 7.6.0-1467-rel-EE-enterprise false [index] 120d056d757451cd36d47ba8a23b35fa inet 115886320 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=104991996&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=69202768 /pools/default/serverGroups?v=63391191 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc021201b90 0xc02123e180 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3632896e+07 couch_docs_data_size:1.958918e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.8815544e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1406422016e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5369 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1} {458758 active http://127.0.0.1:9502/ 127.0.0.1:9002 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:944858 index_disk_size:1.756025e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1388428288e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12004 distTCP:21400 distTLS:21450 httpsCAPI:19502 httpsMgmt:19002] healthy 5365 7.6.0-1467-rel-EE-enterprise false [index] 3f67a48a9c4db11af4d2dec63dedffc3 inet 26292718 Group 1} {458758 active http://127.0.0.1:9503/ 127.0.0.1:9003 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:871385 index_disk_size:2.263734e+06 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1388792832e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12006 distTCP:21400 distTLS:21450 httpsCAPI:19503 httpsMgmt:19003] healthy 5363 7.6.0-1467-rel-EE-enterprise false [index] 120d056d757451cd36d47ba8a23b35fa inet 115886320 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[indexAdmin:9112 indexHttp:9114 indexHttps:19114 indexScan:9113 indexStreamCatchup:9116 indexStreamInit:9115 indexStreamMaint:9117 mgmt:9002 mgmtSSL:19002] 127.0.0.1 false} {map[indexAdmin:9118 indexHttp:9120 indexHttps:19120 indexScan:9119 indexStreamCatchup:9122 indexStreamInit:9121 indexStreamMaint:9123 mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9002:19002 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9112:9112 9113:9113 9114:19114 9115:9115 9116:9116 9117:9117 9118:9118 9119:9119 9120:19120 9121:9121 9122:9122 9123:9123 9499:19499 9999:9999]}
--- PASS: TestIndexNodeRebalanceOut (38.45s)
=== RUN TestFailoverAndRebalance
2023/09/14 04:53:54 set14_rebalance_test.go::TestFailoverAndRebalance: entry: Current cluster configuration: map[127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:53:54 set14_rebalance_test.go::TestFailoverAndRebalance: 1. Failing over index node 127.0.0.1:9002
2023/09/14 04:53:54 Failing over: [127.0.0.1:9002]
2023/09/14 04:54:07 set14_rebalance_test.go::TestFailoverAndRebalance: 2. Rebalancing
2023/09/14 04:54:13 Rebalance progress: 30
2023/09/14 04:54:18 Rebalance progress: 100
2023/09/14 04:54:18 set14_rebalance_test.go::TestFailoverAndRebalance: exit: Current cluster configuration: map[127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestFailoverAndRebalance (25.33s)
=== RUN TestSwapRebalance
2023/09/14 04:54:20 set14_rebalance_test.go::TestSwapRebalance: entry: Current cluster configuration: map[127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:54:20 set14_rebalance_test.go::TestSwapRebalance: 1. Adding index node 127.0.0.1:9001 to the cluster
2023/09/14 04:54:20 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 04:54:32 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/14 04:54:32 set14_rebalance_test.go::TestSwapRebalance: 2. Swap rebalancing index node 127.0.0.1:9003 out of the cluster
2023/09/14 04:54:32 Removing node(s): [127.0.0.1:9003] from the cluster
2023/09/14 04:54:38 Rebalance progress: 23.33333333333333
2023/09/14 04:54:43 Rebalance progress: 28.16091954022988
2023/09/14 04:54:48 Rebalance progress: 35.05747126436781
2023/09/14 04:54:53 Rebalance progress: 81.03448275862068
2023/09/14 04:54:58 Rebalance progress: 83.33333333333333
2023-09-14T04:55:02.912+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:02.912+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:02.928+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:02.928+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:02.942+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:02.956+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:02.960+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:02.962+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:02.978+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.014+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.025+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.037+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.056+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.075+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.079+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.088+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.097+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.110+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.111+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.114+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.117+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.117+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:847ba20652ff9a3f80cf9b3f91507aeb@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc01904de60 0xc019052820 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3632896e+07 couch_docs_data_size:1.958918e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.6364984e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1700576256e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5441 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1} {458758 active http://127.0.0.1:9501/ 127.0.0.1:9001 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:0 index_disk_size:0 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1682889728e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12002 distTCP:21400 distTLS:21450 httpsCAPI:19501 httpsMgmt:19001] healthy 5436 7.6.0-1467-rel-EE-enterprise false [index] 32c4c17054161a6c76feabc60aa04659 inet 110558295 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=90377587&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=132480064 /pools/default/serverGroups?v=10462945 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc01904de60 0xc019052820 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3632896e+07 couch_docs_data_size:1.958918e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.6364984e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1700576256e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5441 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1} {458758 active http://127.0.0.1:9501/ 127.0.0.1:9001 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:0 index_disk_size:0 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1682889728e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12002 distTCP:21400 distTLS:21450 httpsCAPI:19501 httpsMgmt:19001] healthy 5436 7.6.0-1467-rel-EE-enterprise false [index] 32c4c17054161a6c76feabc60aa04659 inet 110558295 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[indexAdmin:9106 indexHttp:9108 indexHttps:19108 indexScan:9107 indexStreamCatchup:9110 indexStreamInit:9109 indexStreamMaint:9111 mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9106:9106 9107:9107 9108:19108 9109:9109 9110:9110 9111:9111 9499:19499 9999:9999]}
2023-09-14T04:55:03.119+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:55:03.125+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:847ba20652ff9a3f80cf9b3f91507aeb@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc01a026480 0xc019052960 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3632896e+07 couch_docs_data_size:1.958918e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.6364984e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1700576256e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5441 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1} {458758 active http://127.0.0.1:9501/ 127.0.0.1:9001 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:0 index_disk_size:0 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1682889728e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12002 distTCP:21400 distTLS:21450 httpsCAPI:19501 httpsMgmt:19001] healthy 5436 7.6.0-1467-rel-EE-enterprise false [index] 32c4c17054161a6c76feabc60aa04659 inet 110558295 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=90377587&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=132480064 /pools/default/serverGroups?v=10462945 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc01a026480 0xc019052960 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:2.3632896e+07 couch_docs_data_size:1.958918e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:1154 curr_items_tot:1154 ep_bg_fetched:0 get_hits:0 mem_used:3.6364984e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1700576256e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5441 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1} {458758 active http://127.0.0.1:9501/ 127.0.0.1:9001 map[cmd_get:0 couch_docs_actual_disk_size:0 couch_docs_data_size:0 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:0 curr_items_tot:0 ep_bg_fetched:0 get_hits:0 index_data_size:0 index_disk_size:0 mem_used:0 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1682889728e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12002 distTCP:21400 distTLS:21450 httpsCAPI:19501 httpsMgmt:19001] healthy 5436 7.6.0-1467-rel-EE-enterprise false [index] 32c4c17054161a6c76feabc60aa04659 inet 110558295 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[indexAdmin:9106 indexHttp:9108 indexHttps:19108 indexScan:9107 indexStreamCatchup:9110 indexStreamInit:9109 indexStreamMaint:9111 mgmt:9001 mgmtSSL:19001] 127.0.0.1 false} {map[mgmt:9003 mgmtSSL:19003] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9003:19003 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9106:9106 9107:9107 9108:19108 9109:9109 9110:9110 9111:9111 9499:19499 9999:9999]}
2023/09/14 04:55:03 Rebalance progress: 100
2023/09/14 04:55:03 set14_rebalance_test.go::TestSwapRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestSwapRebalance (45.47s)
=== RUN TestRebalanceReplicaRepair
2023/09/14 04:55:05 TestRebalanceReplicaRepair entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:55:05 TestRebalanceReplicaRepair: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/14 04:55:05 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/14 04:55:18 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/14 04:55:18 TestRebalanceReplicaRepair: 2. Adding index node 127.0.0.1:9003 to the cluster
2023/09/14 04:55:18 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/14 04:55:29 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/14 04:55:29 TestRebalanceReplicaRepair: 3. Rebalancing
2023/09/14 04:55:34 Rebalance progress: 20
2023/09/14 04:55:39 Rebalance progress: 24.21875
2023/09/14 04:55:44 Rebalance progress: 24.88932594054806
2023/09/14 04:55:50 Rebalance progress: 61.71875
2023/09/14 04:55:54 Rebalance progress: 68.97533964235947
2023/09/14 04:55:59 Rebalance progress: 86.75
2023/09/14 04:56:04 Rebalance progress: 87.5
2023/09/14 04:56:09 Rebalance progress: 100
2023/09/14 04:56:09 TestRebalanceReplicaRepair exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceReplicaRepair (66.41s)
=== RUN TestFailureAndRebalanceDuringInitialIndexBuild
2023/09/14 04:56:12 set14_rebalance_test.go::TestFailureAndRebalanceDuringInitialIndexBuild: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:56:16 Created the secondary index index_0. Waiting for it become active
2023/09/14 04:56:16 Index is 3211223340629500923 now active
2023/09/14 04:56:21 Created the secondary index index_1. Waiting for it become active
2023/09/14 04:56:21 Index is 15199237019612750151 now active
2023/09/14 04:56:27 Created the secondary index index_2. Waiting for it become active
2023/09/14 04:56:27 Index is 3958288331422577769 now active
2023/09/14 04:56:34 Created the secondary index index_3. Waiting for it become active
2023/09/14 04:56:34 Index is 13204940303019907794 now active
2023/09/14 04:56:44 Created the secondary index index_4. Waiting for it become active
2023/09/14 04:56:44 Index is 9962989639223364039 now active
2023/09/14 04:56:50 Created the secondary index index_5. Waiting for it become active
2023/09/14 04:56:50 Index is 8786567513161211056 now active
2023/09/14 04:56:56 Created the secondary index index_6. Waiting for it become active
2023/09/14 04:56:56 Index is 6019468157290201217 now active
2023/09/14 04:57:02 Created the secondary index index_7. Waiting for it become active
2023/09/14 04:57:02 Index is 4947275948091315034 now active
2023/09/14 04:57:08 Created the secondary index index_8. Waiting for it become active
2023/09/14 04:57:08 Index is 10947985547564579177 now active
2023/09/14 04:57:14 Created the secondary index index_9. Waiting for it become active
2023/09/14 04:57:14 Index is 9734803728825354778 now active
2023/09/14 04:57:36 Failing over: [127.0.0.1:9002]
2023/09/14 04:57:37 Build the deferred index index_11. Waiting for the index to become active
2023/09/14 04:57:37 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:38 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:39 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:40 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:41 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:41 TestFailureAndRebalanceDuringInitialIndexBuild: 1. Adding index node 127.0.0.1:9002 to the cluster
2023/09/14 04:57:41 Kicking off failover recovery, type: full
2023/09/14 04:57:42 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:43 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:44 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:45 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:46 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:47 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:48 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:49 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:49 Rebalance progress: 0
2023/09/14 04:57:50 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:51 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:52 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:53 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:54 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:54 Rebalance progress: 20
2023/09/14 04:57:55 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:56 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:57 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:58 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:59 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:57:59 Rebalance progress: 20
2023/09/14 04:58:00 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:58:01 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:58:02 Waiting for index 5571097691038876288 to go active ...
2023/09/14 04:58:03 Index is 5571097691038876288 now active
2023/09/14 04:58:04 Rebalance progress: 20
2023/09/14 04:58:09 Rebalance progress: 20
2023/09/14 04:58:14 Rebalance progress: 20
2023/09/14 04:58:19 Rebalance progress: 20
2023/09/14 04:58:24 Rebalance progress: 20
2023/09/14 04:58:29 Rebalance progress: 20
2023/09/14 04:58:34 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/14 04:58:34 set14_rebalance_test.go::TestFailureAndRebalanceDuringInitialIndexBuild: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestFailureAndRebalanceDuringInitialIndexBuild (142.47s)
=== RUN TestRedistributeWhenNodeIsAddedForFalse
2023/09/14 04:58:34 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 04:58:34 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 1. Setting up initial cluster configuration
2023/09/14 04:58:34 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/14 04:58:39 Rebalance progress: 12.5
2023/09/14 04:58:44 Rebalance progress: 87.5
2023-09-14T04:58:46.413+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:58:46.423+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:58:46.450+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:58:46.463+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:58:46.466+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 2 != len(c.nodesvs): 3
2023-09-14T04:58:47.697+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T04:58:47.699+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T04:58:47.711+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T04:58:47.727+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T04:58:47.794+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T04:58:47.872+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T04:58:47.893+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T04:58:47.898+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023/09/14 04:58:49 Rebalance progress: 100
2023/09/14 04:58:49 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 04:58:50 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 04:58:51 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 04:59:16 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/14 04:59:31 Rebalance progress: 0
2023/09/14 04:59:36 Rebalance progress: 0
2023/09/14 04:59:41 Rebalance progress: 0
2023/09/14 04:59:46 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/14 04:59:46 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/14 05:00:16 Woke-up from sleep
2023/09/14 05:00:21 Rebalance progress: 75
2023/09/14 05:00:26 Rebalance progress: 100
2023/09/14 05:00:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 2. Changing indexer.settings.rebalance.redistribute_indexes to false
2023/09/14 05:00:26 Changing config key indexer.settings.rebalance.redistribute_indexes to value false
2023/09/14 05:00:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup 3. Setup is completed
2023/09/14 05:00:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse::Setup exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 05:00:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse 1. Creating 10 indexes: non-partitioned, 0-REPLICA, non-deferred
2023/09/14 05:00:26 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS__id_isActive on `default`(_id, isActive) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:00:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS__id_isActive index is now active.
2023/09/14 05:00:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_docid_balance on `default`(docid, balance) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:00:39 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_docid_balance index is now active.
2023/09/14 05:00:39 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_guid_picture on `default`(guid, picture) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:00:47 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_guid_picture index is now active.
2023/09/14 05:00:47 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_isActive_age on `default`(isActive, age) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:00:54 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_isActive_age index is now active.
2023/09/14 05:00:54 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:01:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_balance_eyeColor index is now active.
2023/09/14 05:01:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_picture_name on `default`(picture, name) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:01:09 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_picture_name index is now active.
2023/09/14 05:01:09 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_age_gender on `default`(age, gender) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:01:16 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_age_gender index is now active.
2023/09/14 05:01:16 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_eyeColor_company on `default`(eyeColor, company) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:01:23 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_eyeColor_company index is now active.
2023/09/14 05:01:23 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_name_email on `default`(name, email) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:01:30 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_name_email index is now active.
2023/09/14 05:01:30 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_0REPLICAS_gender_phone on `default`(gender, phone) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:01:38 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_0REPLICAS_gender_phone index is now active.
2023/09/14 05:01:38 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse 2. Creating 4 indexes: 5-PARTITION, 0-REPLICA, non-deferred
2023/09/14 05:01:38 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/14 05:01:45 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS__id_balance index is now active.
2023/09/14 05:01:45 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/14 05:01:53 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_docid_picture index is now active.
2023/09/14 05:01:53 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_guid_age on `default`(guid, age) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/14 05:02:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_guid_age index is now active.
2023/09/14 05:02:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor on `default`(isActive, eyeColor) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/14 05:02:08 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor index is now active.
2023/09/14 05:02:08 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/14 05:02:08 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForFalse: Adding node 127.0.0.1:9002 with service index to the cluster
2023/09/14 05:02:08 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/14 05:02:21 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/14 05:02:26 Rebalance progress: 83.33333333333333
2023/09/14 05:02:31 Rebalance progress: 100
2023/09/14 05:02:31 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/14 05:02:31 for GetIndexLocalMetadata http://127.0.0.1:9114/getLocalIndexMetadata
--- PASS: TestRedistributeWhenNodeIsAddedForFalse (237.32s)
=== RUN TestRedistributeWhenNodeIsAddedForTrue
2023/09/14 05:02:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 05:02:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 1. Setting up initial cluster configuration
2023/09/14 05:02:31 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/14 05:02:37 Rebalance progress: 83.33333333333333
2023-09-14T05:02:41.938+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.939+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.946+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.947+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.952+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.960+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.961+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.977+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.978+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.983+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.983+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.989+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.990+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.994+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.997+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:41.999+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:42.002+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:42.004+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:42.006+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:42.010+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:42.010+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:847ba20652ff9a3f80cf9b3f91507aeb@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc00dc40090 0xc0191215a0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.429312e+07 couch_docs_data_size:1.3751033e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.940972e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1732250624e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5897 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=101349755&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc00dc40090 0xc0191215a0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.429312e+07 couch_docs_data_size:1.3751033e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.940972e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1732250624e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5897 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023-09-14T05:02:42.012+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:42.018+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:02:42.018+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:847ba20652ff9a3f80cf9b3f91507aeb@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc00da77a70 0xc016995480 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.429312e+07 couch_docs_data_size:1.3751033e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.940972e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1732250624e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5897 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=101349755&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc00da77a70 0xc016995480 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.429312e+07 couch_docs_data_size:1.3751033e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.940972e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1732250624e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 5897 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023/09/14 05:02:42 Rebalance progress: 100
2023/09/14 05:02:42 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:02:43 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:02:45 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:02:46 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:02:47 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:03:07 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/14 05:03:22 Rebalance progress: 0
2023/09/14 05:03:27 Rebalance progress: 0
2023/09/14 05:03:32 Rebalance progress: 0
2023/09/14 05:03:37 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/14 05:03:37 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/14 05:04:07 Woke-up from sleep
2023/09/14 05:04:12 Rebalance progress: 75
2023/09/14 05:04:17 Rebalance progress: 100
2023/09/14 05:04:17 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 2. Changing indexer.settings.rebalance.redistribute_indexes to true
2023/09/14 05:04:18 Changing config key indexer.settings.rebalance.redistribute_indexes to value true
2023/09/14 05:04:18 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup 3. Setup is completed
2023/09/14 05:04:18 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue::Setup exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 05:04:18 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue 1. Creating 10 indexes: non-partitioned, 0-REPLICA, non-deferred
2023/09/14 05:04:18 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS__id_isActive on `default`(_id, isActive) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:04:23 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS__id_isActive index is now active.
2023/09/14 05:04:23 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_docid_balance on `default`(docid, balance) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:04:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_docid_balance index is now active.
2023/09/14 05:04:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_guid_picture on `default`(guid, picture) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:04:38 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_guid_picture index is now active.
2023/09/14 05:04:38 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_isActive_age on `default`(isActive, age) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:04:46 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_isActive_age index is now active.
2023/09/14 05:04:46 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:04:53 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_balance_eyeColor index is now active.
2023/09/14 05:04:53 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_picture_name on `default`(picture, name) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:05:00 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_picture_name index is now active.
2023/09/14 05:05:00 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_age_gender on `default`(age, gender) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:05:08 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_age_gender index is now active.
2023/09/14 05:05:08 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_eyeColor_company on `default`(eyeColor, company) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:05:15 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_eyeColor_company index is now active.
2023/09/14 05:05:15 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_name_email on `default`(name, email) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:05:22 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_name_email index is now active.
2023/09/14 05:05:22 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_0REPLICAS_gender_phone on `default`(gender, phone) with { "nodes":["127.0.0.1:9001"]}
2023/09/14 05:05:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_0REPLICAS_gender_phone index is now active.
2023/09/14 05:05:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue 2. Creating 4 indexes: 5-PARTITION, 0-REPLICA, non-deferred
2023/09/14 05:05:31 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/14 05:05:38 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS__id_balance index is now active.
2023/09/14 05:05:38 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/14 05:05:46 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_docid_picture index is now active.
2023/09/14 05:05:46 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_guid_age on `default`(guid, age) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/14 05:05:54 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_guid_age index is now active.
2023/09/14 05:05:54 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Executing N1QL: create index set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor on `default`(isActive, eyeColor) partition by hash(Meta().id) with {"num_partition":5, "nodes":["127.0.0.1:9001"]}
2023/09/14 05:06:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue set14_idx_5PARTITIONS_0REPLICAS_isActive_eyeColor index is now active.
2023/09/14 05:06:01 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/14 05:06:01 set14_rebalance_test.go::TestRedistributeWhenNodeIsAddedForTrue: Adding node 127.0.0.1:9002 with service index to the cluster
2023/09/14 05:06:01 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/14 05:06:14 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/14 05:06:20 Rebalance progress: 23.33333333333333
2023/09/14 05:06:25 Rebalance progress: 23.33333333333333
2023/09/14 05:06:30 Rebalance progress: 83.33333333333333
2023/09/14 05:06:35 Rebalance progress: 100
2023/09/14 05:06:35 for GetIndexLocalMetadata http://127.0.0.1:9108/getLocalIndexMetadata
2023/09/14 05:06:35 for GetIndexLocalMetadata http://127.0.0.1:9114/getLocalIndexMetadata
--- PASS: TestRedistributeWhenNodeIsAddedForTrue (243.81s)
=== RUN TestRebalanceResetCluster
2023/09/14 05:06:35 set14_rebalance_test.go::TestRebalanceResetCluster: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 172.31.5.112:9000:[kv n1ql]]
2023/09/14 05:06:35 set14_rebalance_test.go::TestRebalanceResetCluster: 1. Restoring indexer.settings.rebalance.redistribute_indexes to false
2023/09/14 05:06:35 Changing config key indexer.settings.rebalance.redistribute_indexes to value false
2023/09/14 05:06:35 set14_rebalance_test.go::TestRebalanceResetCluster: 2. Resetting cluster to initial configuration
2023/09/14 05:06:35 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/14 05:06:41 Rebalance progress: 83.33333333333333
2023-09-14T05:06:45.258+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.267+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.276+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.290+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.308+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.348+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.354+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.356+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.366+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.370+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.374+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.378+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.380+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.385+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.387+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.407+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.443+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.444+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.455+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.459+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.463+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.463+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:847ba20652ff9a3f80cf9b3f91507aeb@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc029d173b0 0xc01aa347c0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.4751872e+07 couch_docs_data_size:1.3754445e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:5.1846536e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1509563392e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6141 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=101349755&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc029d173b0 0xc01aa347c0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.4751872e+07 couch_docs_data_size:1.3754445e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:5.1846536e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1509563392e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6141 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023-09-14T05:06:45.465+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:06:45.465+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:847ba20652ff9a3f80cf9b3f91507aeb@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc0263d8fc0 0xc01da5d760 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.4751872e+07 couch_docs_data_size:1.3754445e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:5.1846536e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1509563392e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6141 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=101349755&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc0263d8fc0 0xc01da5d760 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.4751872e+07 couch_docs_data_size:1.3754445e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:5.1846536e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1509563392e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6141 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023/09/14 05:06:46 Rebalance progress: 100
2023/09/14 05:06:46 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:06:48 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:06:49 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:07:10 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/14 05:07:25 Rebalance progress: 0
2023/09/14 05:07:30 Rebalance progress: 0
2023/09/14 05:07:35 Rebalance progress: 0
2023/09/14 05:07:40 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/14 05:07:40 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/14 05:08:10 Woke-up from sleep
2023/09/14 05:08:15 Rebalance progress: 75
2023/09/14 05:08:20 Rebalance progress: 100
2023/09/14 05:08:20 set14_rebalance_test.go::TestRebalanceResetCluster: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceResetCluster (107.09s)
=== RUN TestAlterIndexIncrReplica
2023/09/14 05:08:22 In TestAlterIndexIncrReplica()
2023/09/14 05:08:22 This test creates an index with one replica and then increments replica count to 2
2023/09/14 05:08:22 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/14 05:08:28 Rebalance progress: 75
2023-09-14T05:08:30.296+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.296+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.302+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.302+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.309+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.310+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.318+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.321+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.325+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.326+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.331+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.331+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.335+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.336+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.340+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.340+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.344+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.348+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.350+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.352+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.360+05:30 [Warn] ClusterInfoCache:validateCache - Failed as len(c.nodes): 1 != len(c.nodesvs): 2
2023-09-14T05:08:30.360+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:847ba20652ff9a3f80cf9b3f91507aeb@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc0045243f0 0xc00d992420 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.4751872e+07 couch_docs_data_size:1.3754445e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.6945416e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1949498368e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6248 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=101349755&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc0045243f0 0xc00d992420 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:4.4751872e+07 couch_docs_data_size:1.3754445e+07 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:11040 curr_items_tot:11040 ep_bg_fetched:0 get_hits:0 mem_used:4.6945416e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1949498368e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6248 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001] 127.0.0.1 false}] map[] [] [] 7 6 map[10000:10000 11210:11207 12000:11998 8093:18093 9000:19000 9001:19001 9100:9100 9101:9101 9102:19102 9103:9103 9104:9104 9105:9105 9499:19499 9999:9999]}
2023/09/14 05:08:33 Rebalance progress: 100
2023/09/14 05:08:33 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:08:34 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023/09/14 05:08:52 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/14 05:09:07 Rebalance progress: 0
2023/09/14 05:09:12 Rebalance progress: 0
2023/09/14 05:09:17 Rebalance progress: 0
2023/09/14 05:09:22 Rebalance failed. See logs for detailed reason. You can try again.
2023/09/14 05:09:22 AddNodeAndRebalance: Error during rebalance, err: Rebalance failed, Sleeping for 30 seconds
2023/09/14 05:09:52 Woke-up from sleep
2023/09/14 05:09:58 Rebalance progress: 75
2023/09/14 05:10:03 Rebalance progress: 100
2023/09/14 05:10:03 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2023/09/14 05:10:14 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2023/09/14 05:10:20 Rebalance progress: 83.33333333333333
2023/09/14 05:10:25 Rebalance progress: 100
2023/09/14 05:10:25 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2023/09/14 05:10:36 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2023/09/14 05:10:41 Rebalance progress: 87.5
2023/09/14 05:10:46 Rebalance progress: 100
2023/09/14 05:10:46 In DropAllSecondaryIndexes()
2023/09/14 05:11:32 Flushed the bucket default, Response body:
2023/09/14 05:11:37 Created the secondary index idx_1. Waiting for it become active
2023/09/14 05:11:37 Index is 513669335385339613 now active
2023/09/14 05:11:37 Executing alter index command: alter index `default`.idx_1 with {"action":"replica_count", "num_replica":2}
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:04 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
2023/09/14 05:12:05 Using n1ql client
--- PASS: TestAlterIndexIncrReplica (222.68s)
=== RUN TestAlterIndexDecrReplica
2023/09/14 05:12:05 In TestAlterIndexDecrReplica()
2023/09/14 05:12:05 This test creates an index with two replicas and then decrements replica count to 1
2023/09/14 05:12:05 In DropAllSecondaryIndexes()
2023/09/14 05:12:05 Index found: idx_1
2023/09/14 05:12:05 Dropped index idx_1
2023/09/14 05:12:23 Created the secondary index idx_2. Waiting for it become active
2023/09/14 05:12:23 Index is 15398707744559379308 now active
2023/09/14 05:12:23 Executing alter index command: alter index `default`.idx_2 with {"action":"replica_count", "num_replica":1}
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
2023/09/14 05:12:49 Using n1ql client
--- PASS: TestAlterIndexDecrReplica (44.36s)
=== RUN TestAlterIndexDropReplica
2023/09/14 05:12:49 In TestAlterIndexDropReplica()
2023/09/14 05:12:49 This test creates an index with two replicas and then drops one replica from cluster
2023/09/14 05:12:49 In DropAllSecondaryIndexes()
2023/09/14 05:12:49 Index found: idx_2
2023/09/14 05:12:49 Dropped index idx_2
2023/09/14 05:13:06 Created the secondary index idx_3. Waiting for it become active
2023/09/14 05:13:06 Index is 13538037601930674051 now active
2023/09/14 05:13:06 Executing alter index command: alter index `default`.idx_3 with {"action":"drop_replica", "replicaId":0}
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:31 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
2023/09/14 05:13:32 Using n1ql client
--- PASS: TestAlterIndexDropReplica (42.50s)
=== RUN TestResetCluster_1
2023/09/14 05:13:32 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2023/09/14 05:13:37 Rebalance progress: 87.5
2023/09/14 05:13:42 Rebalance progress: 100
2023/09/14 05:13:42 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2023-09-14T05:13:43.067+05:30 [Error] Validation Failed while updating nodes and nodesvs.. &{{{1 0} 0 0 {{} -1073741824} {{} 0}} http://%40query:847ba20652ff9a3f80cf9b3f91507aeb@127.0.0.1:9000 default updateIndexerList 300 2000000000 1 false map[] {0xc00cf495f0 0xc009927ea0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList} {map[] [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:8.875008e+06 couch_docs_data_size:1.2483e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:100 curr_items_tot:100 ep_bg_fetched:0 get_hits:0 mem_used:3.5022152e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1260854272e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6556 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] map[] map[terseBucketsBase:/pools/default/b/ terseStreamingBucketsBase:/pools/default/bs/ uri:/pools/default/buckets?v=101349755&uuid=ea0df9e18e60abc43c14b2de2ef9725d] /pools/default/nodeServices?v=84691856 /pools/default/serverGroups?v=21069578 [{default 1f63e5e04602451b8cd8403d9ee97cbd}] {0xc00cf495f0 0xc009927ea0 {map[ale:0.0.0 asn1:5.0.21 chronicle:0.0.1 crypto:5.1.4 esaml:4.4.0 inets:8.3.1 kernel:8.5.4 lhttpc:1.3.0 ns_server:7.6.0-1467-rel-EE-enterprise os_mon:2.8.2 public_key:1.13.3 sasl:4.2 ssl:10.9.1 stdlib:4.3.1.1 xmerl:1.3.31.1] 7.6.0-1467-rel-EE-enterprise true ea0df9e18e60abc43c14b2de2ef9725d [{default /poolsStreaming/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d /pools/default?uuid=ea0df9e18e60abc43c14b2de2ef9725d}] false} updateIndexerList}} [{458758 active http://172.31.5.112:9500/ 172.31.5.112:9000 map[cmd_get:0 couch_docs_actual_disk_size:8.875008e+06 couch_docs_data_size:1.2483e+06 couch_spatial_data_size:0 couch_spatial_disk_size:0 couch_views_actual_disk_size:0 couch_views_data_size:0 curr_items:100 curr_items_tot:100 ep_bg_fetched:0 get_hits:0 mem_used:3.5022152e+07 ops:0 vb_active_num_non_resident:0 vb_replica_curr_items:0] 11800 11800 1.1260854272e+10 1.5466930176e+10 x86_64-pc-linux-gnu map[direct:12000 distTCP:21400 distTLS:21450 httpsCAPI:19500 httpsMgmt:19000] healthy 6556 7.6.0-1467-rel-EE-enterprise true [kv n1ql] 39e2ea5e009c8bc812ce2409efbd45b9 inet 57186245 Group 1}] [{map[capi:9500 capiSSL:19500 kv:12000 kvSSL:11998 mgmt:9000 mgmtSSL:19000 n1ql:9499 n1qlSSL:19499 projector:10000] 172.31.5.112 true} {map[mgmt:9001 mgmtSSL:19001