Building
Started building at 2023/09/08 09:30:56
Using pegged server, 1467 build
Calculating base
Updating mirror
Basing run on 7.6.0-1467 8820063a7b
Updating tree for run 08.09.2023-09.30
query is at fc4ec6b, changes since last good build: none
gometa is at 96e745a, changes since last good build: none
ns_server is at 57d74a0, changes since last good build: none
couchstore is at c392c9b, changes since last good build: none
forestdb is at 7af87ef, changes since last good build: none
kv_engine is at e36344c, changes since last good build: none
Switching indexing to unstable
indexing is at a793751, changes since last good build: none
Switching plasma to unstable
plasma is at 40f4da5, changes since last good build:
fatal: Invalid revision range 7276d1b24065c3e32bd0d28a9821f6bc45936e5d..HEAD
Switching nitro to unstable
nitro is at f6a9378, changes since last good build: none
Switching gometa to master
gometa is at 96e745a, changes since last good build: none
Switching testrunner to master
Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client'
Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI'
Submodule 'magma_loader/DocLoader' (https://github.com/couchbaselabs/DocLoader.git) registered for path 'magma_loader/DocLoader'
Cloning into '/opt/build/testrunner/java_sdk_client'...
Cloning into '/opt/build/testrunner/lib/capellaAPI'...
Cloning into '/opt/build/testrunner/magma_loader/DocLoader'...
Submodule path 'java_sdk_client': checked out 'de89b059ce28567dbac18afb032271a4eaa674ff'
Submodule path 'lib/capellaAPI': checked out '7fc6f86544c143368f1f3d7be1d0192fdea4751b'
Submodule path 'magma_loader/DocLoader': checked out '0f32672eea77681939c9b26d43f60bd4b3478936'
testrunner is at e5907d1, changes since last good build: none
Pulling in uncommitted change 191342 at refs/changes/42/191342/9
Total 8 (delta 5), reused 5 (delta 5)
[unstable 01ca9595] MB-57427: disable array index tests
Author: Dhruvil Shah
Date: Mon May 22 10:24:11 2023 +0530
2 files changed, 7 insertions(+), 1 deletion(-)
Pulling in uncommitted change 193825 at refs/changes/25/193825/1
Total 6 (delta 5), reused 6 (delta 5)
[unstable e91f6c34] MB100: CIFail - Enable info level client logs after TestScheduleIndexBasic
Author: Sai Krishna Teja Kommaraju
Date: Fri Jul 14 00:58:44 2023 +0530
1 file changed, 3 insertions(+)
Pulling in uncommitted change 195232 at refs/changes/32/195232/12
Total 46 (delta 40), reused 46 (delta 40)
[unstable 2bd2d411] MB-58279 Populate alternateShardIds for indexes getting upgraded (And re-plan placement if necessary)
Author: Varun Velamuri
Date: Thu Aug 10 15:38:43 2023 -0700
4 files changed, 198 insertions(+), 17 deletions(-)
Pulling in uncommitted change 195279 at refs/changes/79/195279/2
Total 5 (delta 4), reused 5 (delta 4)
[unstable a01102bf] MB-57825: Enable LSS flush buffer tuning
Author: Saptarshi Sen
Date: Fri Aug 11 10:53:36 2023 -0700
1 file changed, 6 insertions(+), 6 deletions(-)
Pulling in uncommitted change 195955 at refs/changes/55/195955/6
Total 10 (delta 3), reused 3 (delta 3)
[unstable 2b477101] MB-57932 close active connections to failing index node during scan
Author: hari kishore
Date: Wed Aug 23 22:08:44 2023 -0700
4 files changed, 550 insertions(+), 53 deletions(-)
Pulling in uncommitted change 196409 at refs/changes/09/196409/2
Total 6 (delta 5), reused 6 (delta 5)
[unstable 6c16d142] MB-57613 GSI client Rollback logging improvement
Author: hari kishore
Date: Wed Aug 30 15:46:15 2023 -0700
1 file changed, 17 insertions(+), 9 deletions(-)
Pulling in uncommitted change 196444 at refs/changes/44/196444/9
Total 6 (delta 5), reused 6 (delta 5)
[unstable e1b6c5b7] MB-57374 - update TT gen logic to accomodate asymmetric shards
Author: Dhruvil Shah
Date: Thu Aug 31 00:20:06 2023 +0530
2 files changed, 206 insertions(+), 42 deletions(-)
Pulling in uncommitted change 196494 at refs/changes/94/196494/1
Total 53 (delta 45), reused 53 (delta 45)
[unstable 57d10d7a] Sleep for 30 seconds and retry rebalance
Author: Varun Velamuri
Date: Thu Aug 31 20:32:44 2023 -0700
1 file changed, 23 insertions(+), 4 deletions(-)
Pulling in uncommitted change 196551 at refs/changes/51/196551/2
Total 63 (delta 54), reused 63 (delta 54)
[unstable cd4d4448] MB-100 Fix CI failures due to TMPFAIL
Author: Varun Velamuri
Date: Fri Sep 1 08:43:12 2023 -0700
3 files changed, 17 insertions(+), 12 deletions(-)
Pulling in uncommitted change 196609 at refs/changes/09/196609/6
Total 18 (delta 14), reused 17 (delta 14)
[unstable a259dfa5] MB-57374 - minor fixes to rebalance and recovery
Author: Dhruvil Shah
Date: Mon Sep 4 20:22:28 2023 +0530
2 files changed, 64 insertions(+), 11 deletions(-)
Pulling in uncommitted change 196729 at refs/changes/29/196729/5
[unstable e4280b2a] MB-58379 - remove duplicate indexes during shard rebalance
Author: Dhruvil Shah
Date: Wed Sep 6 19:10:42 2023 +0530
2 files changed, 78 insertions(+), 65 deletions(-)
Pulling in uncommitted change 196039 at refs/changes/39/196039/4
Total 18 (delta 7), reused 7 (delta 7)
[unstable a86ad12] MB-58392: Add/update flush buffer unit tests
Author: Saptarshi Sen
Date: Thu Aug 24 15:55:02 2023 -0700
3 files changed, 173 insertions(+), 81 deletions(-)
Pulling in uncommitted change 196295 at refs/changes/95/196295/2
[unstable 5992778] MB-58392: Fix a timer panic on zero LSSSampleInterval
Author: Saptarshi Sen
Date: Mon Aug 28 14:16:41 2023 -0700
1 file changed, 1 insertion(+), 1 deletion(-)
Pulling in uncommitted change 196296 at refs/changes/96/196296/2
[unstable 53ec8c8] MB-57825: Do not exceed flush buffer limit on resumeIO for idleLSS
Author: Saptarshi Sen
Date: Mon Aug 28 16:12:34 2023 -0700
2 files changed, 108 insertions(+), 6 deletions(-)
Pulling in uncommitted change 196557 at refs/changes/57/196557/9
Total 11 (delta 9), reused 11 (delta 9)
[unstable 4c9db2b] MB-58423: Perform tenant quota adjustment asynchronously
Author: jliang00
Date: Fri Sep 1 09:30:02 2023 -0700
6 files changed, 321 insertions(+), 48 deletions(-)
Building community edition
Building cmakefiles and deps [CE]
Building main product [CE]
Build CE finished
BUILD_ENTERPRISE empty. Building enterprise edition
Building Enterprise Edition
Building cmakefiles and deps [EE]
Building main product [EE]
Build EE finished
Testing
Started testing at 2023/09/08 10:26:30
Testing mode: sanity,unit,functional,serverless,integration
Using storage type: memdb
Setting ulimit to 200000
Simple Test
Sep 08 10:28:11 suite_setUp (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 08 10:32:58 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 08 10:37:26 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Sep 08 10:42:01 b" 'stop_on_failure': 'True'}"
Sep 08 10:42:01 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=50000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True,doc_ops=create;update;delete'
Sep 08 10:42:01 b"{'nodes_in': '3', 'replicas': '1', 'items': '50000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 1, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-08_10-26-53/test_1'}"
Sep 08 10:42:01 b'-->result: '
Sep 08 10:42:01 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0'
Sep 08 10:42:01 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,bucket_type=ephemeral,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Sep 08 10:42:01 b"{'nodes_in': '3', 'bucket_type': 'ephemeral', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 2, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-08_10-26-53/test_2'}"
Sep 08 10:42:01 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 08 10:42:01 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t memcapable.WarmUpMemcachedTest.do_warmup_100k,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,get-logs-cluster-run=True'
Sep 08 10:42:01 b"{'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 3, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-08_10-26-53/test_3'}"
Sep 08 10:42:01 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 08 10:42:01 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 08 10:42:01 b'failures so far...'
Sep 08 10:42:01 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.createdeleteview.CreateDeleteViewTests.test_view_ops,ddoc_ops=create,test_with_view=True,num_ddocs=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,num_views_per_ddoc=10,items=1000,skip_cleanup=False,get-logs-cluster-run=True'
Sep 08 10:42:01 b"{'ddoc_ops': 'create', 'test_with_view': 'True', 'num_ddocs': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'num_views_per_ddoc': '10', 'items': '1000', 'skip_cleanup': 'False', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 4, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-08_10-26-53/test_4'}"
Sep 08 10:43:11 b'http://127.0.0.1:9003/pools/default with status False: unknown pool'ok
Sep 08 10:53:33 test_employee_dataset_startkey_endkey_queries_rebalance_in (view.viewquerytests.ViewQueryTests) ... ok
Sep 08 10:54:21 test_simple_dataset_stale_queries_data_modification (view.viewquerytests.ViewQueryTests) ... ok
Sep 08 10:58:38 load_with_ops (xdcr.uniXDCR.unidirectional) ... ok
Sep 08 11:00:51 load_with_failover (xdcr.uniXDCR.unidirectional) ...
Sep 08 11:00:51 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 08 11:00:51 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 08 11:00:51 b'failures so far...'
Sep 08 11:00:51 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 08 11:00:51 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,num_nodes_to_add=1,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,docs-per-day=1,timeout=1200,get-logs-cluster-run=True'
Sep 08 11:00:51 b"{'num_nodes_to_add': '1', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'docs-per-day': '1', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 5, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-08_10-26-53/test_5'}"
Sep 08 11:00:51 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 08 11:00:51 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 08 11:00:51 b'failures so far...'
Sep 08 11:00:51 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 08 11:00:51 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0'
Sep 08 11:00:51 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'
Sep 08 11:00:51 b"{'num-docs': '1000', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'skip_rebalance': 'true', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 6, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-08_10-26-53/test_6'}"
Sep 08 11:00:51 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 08 11:00:51 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 08 11:00:51 b'failures so far...'
Sep 08 11:00:51 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 08 11:00:51 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 08 11:00:51 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_ops,replicas=1,items=10000,value_size=128,ctopology=chain,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,rdirection=unidirection,doc-ops=update-delete,get-logs-cluster-run=True'
Sep 08 11:00:51 b"{'replicas': '1', 'items': '10000', 'value_size': '128', 'ctopology': 'chain', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 7, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-08_10-26-53/test_7'}"
Sep 08 11:00:51 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 08 11:00:51 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 08 11:00:51 b'failures so far...'
Sep 08 11:00:51 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 08 11:00:51 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 08 11:00:51 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0'
Sep 08 11:00:51 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,bucket_storage=couchstore,bucket_size=100,eviction_policy=valueOnly,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Sep 08 11:00:51 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'bucket_storage': 'couchstore', 'bucket_size': '100', 'eviction_policy': 'valueOnly', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Sep-08_10-26-53/test_8'}"
Sep 08 11:02:57 b'http://127.0.0.1:9001/pools/default with status False: unknown pool'ok
Sep 08 11:05:51 suite_tearDown (xdcr.uniXDCR.unidirectional) ... ok
Sep 08 11:05:52 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Sep 08 11:05:52 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Sep 08 11:05:52 b'failures so far...'
Sep 08 11:05:52 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Sep 08 11:05:52 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Sep 08 11:05:52 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0'
Sep 08 11:05:52 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Sep 08 11:05:52 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Sep 08 11:05:52 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Sep 08 11:05:52 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' fail ')"
Sep 08 11:05:52 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' pass')"
Sep 08 11:05:52 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' pass')"
Sep 08 11:05:52 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' pass')"
Sep 08 11:05:52 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' pass')"
Sep 08 11:05:52 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' pass')"
Sep 08 11:05:52 Makefile:30: recipe for target 'simple-test' failed
Unit tests
=== RUN TestMerger
--- PASS: TestMerger (0.01s)
=== RUN TestInsert
--- PASS: TestInsert (0.00s)
=== RUN TestInsertPerf
16000000 items took 31.828248407s -> 502698.09998344467 items/s conflicts 40
--- PASS: TestInsertPerf (31.83s)
=== RUN TestGetPerf
16000000 items took 5.975832587s -> 2.6774511780679505e+06 items/s
--- PASS: TestGetPerf (6.58s)
=== RUN TestGetRangeSplitItems
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3333,
"memory_used": 37333408,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749841,
"level1": 187603,
"level2": 47062,
"level3": 11639,
"level4": 2904,
"level5": 713,
"level6": 173,
"level7": 47,
"level8": 16,
"level9": 2,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Split range keys [155889 255772 370326 443370 754708 920305]
No of items in each range [155889 99883 114554 73044 311338 165597 79695]
--- PASS: TestGetRangeSplitItems (0.60s)
=== RUN TestBuilder
{
"node_count": 50000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3332,
"memory_used": 1866579344,
"node_allocs": 50000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 37502051,
"level1": 9373881,
"level2": 2344604,
"level3": 584696,
"level4": 146187,
"level5": 36302,
"level6": 9217,
"level7": 2288,
"level8": 580,
"level9": 142,
"level10": 38,
"level11": 10,
"level12": 4,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 7.601720407s to build 50000000 items, 6.5774585e+06 items/sec
Took 403.586192ms to iterate 50000000 items
--- PASS: TestBuilder (8.01s)
=== RUN TestNodeDCAS
--- PASS: TestNodeDCAS (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/memdb/skiplist 47.269s
=== RUN TestInsert
Set IO Concurrency: 716
--- PASS: TestInsert (0.01s)
=== RUN TestInsertPerf
20000000 items took 55.509792765s -> 360296.78735551663 items/s snapshots_created 210 live_snapshots 1
--- PASS: TestInsertPerf (70.03s)
=== RUN TestInsertDuplicates
--- PASS: TestInsertDuplicates (0.01s)
=== RUN TestGetPerf
16000000 items took 12.505999135s -> 1.2793859832615445e+06 items/s
--- PASS: TestGetPerf (14.25s)
=== RUN TestLoadStoreDisk
Inserting 1000000 items took 1.782637794s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 15,
"next_pointers_per_node": 1.3335,
"memory_used": 57336044,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749529,
"level1": 188303,
"level2": 46635,
"level3": 11520,
"level4": 3022,
"level5": 732,
"level6": 202,
"level7": 44,
"level8": 12,
"level9": 1,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
2023-09-08T11:08:24.367+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[67459 10263 77975 38810 44888 32394 48837 18544 83605 6372 63092 82384 31003 66147 91239 236988]] total count [1000000] snap count [1000031] size per shard [[539672 82104 623800 310480 359104 259152 390696 148352 668840 50976 504736 659072 248024 529176 729912 1895904]] total size [8000000] memoryInUse [57336044]
Storing to disk took 331.575814ms
Loading from disk took 316.481538ms
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3338,
"memory_used": 57341584,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749543,
"level1": 187861,
"level2": 46938,
"level3": 11838,
"level4": 2851,
"level5": 710,
"level6": 188,
"level7": 54,
"level8": 15,
"level9": 2,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestLoadStoreDisk (3.91s)
=== RUN TestConcurrentLoadCloseFragmentation
Done Inserting 2000000 items
frag = NaN%
2023-09-08T11:08:30.412+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[49417 125457 69983 232178 92343 91740 270201 95557 136547 5917 307860 179491 11435 35493 75135 221246]] total count [2000000] snap count [2000000] size per shard [[395336 1003656 559864 1857424 738744 733920 2161608 764456 1092376 47336 2462880 1435928 91480 283944 601080 1769968]] total size [16000000] memoryInUse [114648188]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentation (6.34s)
=== RUN TestConcurrentLoadCloseFragmentationSmall
Done Inserting 10 items
frag = NaN%
2023-09-08T11:08:32.331+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationSmall (0.13s)
=== RUN TestConcurrentLoadCloseFragmentationEmpty
Done Inserting 0 items
frag = NaN%
2023-09-08T11:08:32.460+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationEmpty (0.06s)
=== RUN TestConcurrentCloseSingleNode
A
--- PASS: TestConcurrentCloseSingleNode (0.00s)
=== RUN TestStoreDiskShutdown
Inserting 1000000 items took 1.749760906s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 27,
"next_pointers_per_node": 1.3332,
"memory_used": 57331568,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 750046,
"level1": 187501,
"level2": 46783,
"level3": 11807,
"level4": 2891,
"level5": 740,
"level6": 173,
"level7": 44,
"level8": 11,
"level9": 3,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
Prepare returns error: MemDB instance has been shutdown
--- PASS: TestStoreDiskShutdown (2.63s)
=== RUN TestDelete
{
"node_count": 10,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.0000,
"memory_used": 540,
"node_allocs": 10,
"node_frees": 0,
"level_node_distribution":{
"level0": 10,
"level1": 0,
"level2": 0,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
{
"node_count": 10,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.5000,
"memory_used": 620,
"node_allocs": 20,
"node_frees": 10,
"level_node_distribution":{
"level0": 6,
"level1": 3,
"level2": 1,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestDelete (1.00s)
=== RUN TestGCPerf
final_node_count = 16000, average_live_node_count = 73831, wait_time_for_collection = 22ms
--- PASS: TestGCPerf (40.55s)
=== RUN TestMemoryInUse
ItemsCount: 5000, MemoryInUse: 296896, NodesCount: 5000
ItemsCount: 0, MemoryInUse: 64, NodesCount: 0
--- PASS: TestMemoryInUse (1.50s)
=== RUN TestFullScan
Inserting 1600000 items took 3.133028658s
{
"node_count": 1600000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 11,
"next_pointers_per_node": 1.3329,
"memory_used": 91721708,
"node_allocs": 1600000,
"node_frees": 0,
"level_node_distribution":{
"level0": 1200223,
"level1": 299939,
"level2": 75034,
"level3": 18716,
"level4": 4508,
"level5": 1165,
"level6": 333,
"level7": 64,
"level8": 12,
"level9": 4,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Full iteration of 1600000 items took 309.334228ms
--- PASS: TestFullScan (4.65s)
=== RUN TestVisitor
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3339,
"memory_used": 57342400,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749451,
"level1": 187957,
"level2": 46977,
"level3": 11764,
"level4": 2905,
"level5": 688,
"level6": 195,
"level7": 42,
"level8": 17,
"level9": 3,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 58.930704ms to iterate 1000000 items, 1.6969084e+07 items/s
shard - 0 count = 20188, range: 0-20187
shard - 1 count = 13784, range: 20188-33971
shard - 2 count = 14875, range: 33972-48846
shard - 3 count = 63303, range: 48847-112149
shard - 4 count = 33754, range: 112150-145903
shard - 5 count = 24539, range: 145904-170442
shard - 6 count = 24659, range: 170443-195101
shard - 7 count = 23365, range: 195102-218466
shard - 8 count = 98698, range: 218467-317164
shard - 9 count = 45546, range: 317165-362710
shard - 10 count = 54956, range: 362711-417666
shard - 11 count = 33095, range: 417667-450761
shard - 12 count = 13478, range: 450762-464239
shard - 13 count = 12071, range: 464240-476310
shard - 14 count = 24572, range: 476311-500882
shard - 15 count = 7882, range: 500883-508764
shard - 16 count = 17570, range: 508765-526334
shard - 17 count = 41824, range: 526335-568158
shard - 18 count = 12354, range: 568159-580512
shard - 19 count = 45204, range: 580513-625716
shard - 20 count = 52310, range: 625717-678026
shard - 21 count = 55937, range: 678027-733963
shard - 22 count = 26223, range: 733964-760186
shard - 23 count = 19525, range: 760187-779711
shard - 24 count = 10247, range: 779712-789958
shard - 25 count = 13022, range: 789959-802980
shard - 26 count = 20445, range: 802981-823425
shard - 27 count = 29231, range: 823426-852656
shard - 28 count = 9791, range: 852657-862447
shard - 29 count = 38560, range: 862448-901007
shard - 30 count = 39873, range: 901008-940880
shard - 31 count = 59119, range: 940881-999999
--- PASS: TestVisitor (1.56s)
=== RUN TestVisitorError
--- PASS: TestVisitorError (0.55s)
=== RUN TestLoadDeltaStoreDisk
snap count = 1000000
2023-09-08T11:09:29.154+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 92430 55505 34477 53747 121637 153178 29781 394596 25938 0]] total count [961289] snap count [1000000] size per shard [[0 0 0 0 0 0 739440 444040 275816 429976 973096 1225424 238248 3156768 207504 0]] total size [7690312] memoryInUse [124614292]
Storing to disk took 15.935760725s
Loading from disk took 1.067366128s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3337,
"memory_used": 57339856,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749529,
"level1": 187825,
"level2": 47212,
"level3": 11597,
"level4": 2845,
"level5": 726,
"level6": 196,
"level7": 49,
"level8": 17,
"level9": 4,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Restored 38711
RestoredFailed 353433
--- PASS: TestLoadDeltaStoreDisk (18.95s)
=== RUN TestExecuteConcurrGCWorkers
--- PASS: TestExecuteConcurrGCWorkers (0.69s)
=== RUN TestCloseWithActiveIterators
--- PASS: TestCloseWithActiveIterators (51.84s)
=== RUN TestDiskCorruption
Inserting 100000 items took 110.034847ms
{
"node_count": 100000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 5,
"next_pointers_per_node": 1.3332,
"memory_used": 5734840,
"node_allocs": 99999,
"node_frees": 0,
"level_node_distribution":{
"level0": 75025,
"level1": 18738,
"level2": 4657,
"level3": 1183,
"level4": 297,
"level5": 76,
"level6": 19,
"level7": 2,
"level8": 3,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
2023-09-08T11:10:36.585+05:30 [Info] MemDB::StoreToDisk: Unexpected amount of data being persisted dir [db.dump] count per shard [[113 3406 4336 12968 1179 2556 1457 36224 1224 8489 599 15358 12091 0 0 0]] total count [100000] snap count [99999] size per shard [[904 27248 34688 103744 9432 20448 11656 289792 9792 67912 4792 122864 96728 0 0 0]] total size [800000] memoryInUse [5734840]
2023-09-08T11:10:36.590+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[113 3406 4336 12968 1179 2556 1457 36224 1224 8489 599 15358 12091 0 0 0]] total count [100000] snap count [99999] size per shard [[904 27248 34688 103744 9432 20448 11656 289792 9792 67912 4792 122864 96728 0 0 0]] total size [800000] memoryInUse [5734840]
Storing to disk took 157.921514ms
Loading from disk took 487.695932ms
--- PASS: TestDiskCorruption (0.82s)
=== RUN TestSnapshotStats
--- PASS: TestSnapshotStats (0.02s)
=== RUN TestInsertDeleteConcurrent
total items in snapshot: 8124581 items deleted: 1875419
{
"node_count": 8124581,
"soft_deletes": 0,
"read_conflicts": 5889,
"insert_conflicts": 173,
"next_pointers_per_node": 1.3331,
"memory_used": 465778148,
"node_allocs": 10000000,
"node_frees": 10000002,
"level_node_distribution":{
"level0": 6094191,
"level1": 1523351,
"level2": 380365,
"level3": 95022,
"level4": 23774,
"level5": 5917,
"level6": 1461,
"level7": 383,
"level8": 88,
"level9": 25,
"level10": 2,
"level11": 2,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
allocs: 20000002 frees: 20000002
--- PASS: TestInsertDeleteConcurrent (19.11s)
=== RUN TestNodeList
--- PASS: TestNodeList (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/memdb 238.931s
=== RUN TestInteger
--- PASS: TestInteger (0.00s)
=== RUN TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN TestFloat
--- PASS: TestFloat (0.00s)
=== RUN TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN TestReference
--- PASS: TestReference (0.00s)
=== RUN TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618]
PASS
TESTING [0]
PASS
TESTING [0.0]
PASS
TESTING [0.0000]
PASS
TESTING [0.0000000]
PASS
TESTING [-0]
PASS
TESTING [-0.0]
PASS
TESTING [-0.0000]
PASS
TESTING [-0.0000000]
PASS
TESTING [1]
PASS
TESTING [20]
PASS
TESTING [3456]
PASS
TESTING [7645000]
PASS
TESTING [9223372036854775807]
PASS
TESTING [9223372036854775806]
PASS
TESTING [9223372036854775808]
PASS
TESTING [92233720368547758071234000]
PASS
TESTING [92233720368547758071234987437653]
PASS
TESTING [12300000000000000000000000000000056]
PASS
TESTING [12300000000000000000000000000000000]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [210690]
PASS
TESTING [90000]
PASS
TESTING [123000000]
PASS
TESTING [3.60e2]
PASS
TESTING [36e2]
PASS
TESTING [1.9999999999e10]
PASS
TESTING [1.99999e10]
PASS
TESTING [1.99999e5]
PASS
TESTING [0.00000000000012e15]
PASS
TESTING [7.64507352e8]
PASS
TESTING [9.2233720368547758071234987437653e31]
PASS
TESTING [2650e-1]
PASS
TESTING [26500e-1]
PASS
TESTING [-1]
PASS
TESTING [-20]
PASS
TESTING [-3456]
PASS
TESTING [-7645000]
PASS
TESTING [-9223372036854775808]
PASS
TESTING [-9223372036854775807]
PASS
TESTING [-9223372036854775806]
PASS
TESTING [-9223372036854775809]
PASS
TESTING [-92233720368547758071234000]
PASS
TESTING [-92233720368547758071234987437653]
PASS
TESTING [-12300000000000000000000000000000056]
PASS
TESTING [-12300000000000000000000000000000000]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [-210690]
PASS
TESTING [-90000]
PASS
TESTING [-123000000]
PASS
TESTING [-3.60e2]
PASS
TESTING [-36e2]
PASS
TESTING [-1.9999999999e10]
PASS
TESTING [-1.99999e10]
PASS
TESTING [-1.99999e5]
PASS
TESTING [-0.00000000000012e15]
PASS
TESTING [-2650e-1]
PASS
TESTING [-26500e-1]
PASS
TESTING [0.03]
PASS
TESTING [198.60]
PASS
TESTING [2000045.178]
PASS
TESTING [1.7976931348623157e+308]
PASS
TESTING [0.000000000000000000890]
PASS
TESTING [257953786.9864236576]
PASS
TESTING [257953786.9864236576e8]
PASS
TESTING [36.912e3]
PASS
TESTING [2761.67e0]
PASS
TESTING [2761.67e00]
PASS
TESTING [2761.67e000]
PASS
TESTING [7676546.67e-3]
PASS
TESTING [-0.03]
PASS
TESTING [-198.60]
PASS
TESTING [-2000045.178]
PASS
TESTING [-1.7976931348623157e+308]
PASS
TESTING [-0.000000000000000000890]
PASS
TESTING [-257953786.9864236576]
PASS
TESTING [-257953786.9864236576e8]
PASS
TESTING [-36.912e3]
PASS
TESTING [-2761.67e0]
PASS
TESTING [-2761.67e00]
PASS
TESTING [-2761.67e000]
PASS
TESTING [-7676546.67e-3]
PASS
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/collatejson 0.037s
=== RUN TestForestDBIterator
2023-09-08T11:11:02.676+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 5850 us
2023-09-08T11:11:02.677+05:30 [INFO][FDB] Forestdb opened database file test
2023-09-08T11:11:02.686+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.02s)
=== RUN TestForestDBIteratorSeek
2023-09-08T11:11:02.687+05:30 [INFO][FDB] Forestdb opened database file test
2023-09-08T11:11:02.689+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.00s)
=== RUN TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN TestMemDBInsertionPerf
Maximum number of file descriptors = 200000
Set IO Concurrency: 7200
2023-09-08T11:11:03.703+05:30 DEBU REGU.impl.init.0.func1() at aggrecorder.go:57 [id 29] will report aggregate recorder stats every 5m0s
Initial build: 10000000 items took 41.881978114s -> 238766.18178780036 items/s
Incr build: 10000000 items took 3m15.502523561s -> 51150.23488113613 items/s
Main Index: {
"node_count": 18000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 6,
"next_pointers_per_node": 1.3331,
"memory_used": 1695823756,
"node_allocs": 18000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 13501908,
"level1": 3374286,
"level2": 843532,
"level3": 210586,
"level4": 52261,
"level5": 13085,
"level6": 3262,
"level7": 814,
"level8": 202,
"level9": 48,
"level10": 12,
"level11": 2,
"level12": 2,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (237.39s)
=== RUN TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN TestDequeueA
--- PASS: TestDequeueA (1.21s)
=== RUN TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.01s)
=== RUN TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.00s)
PASS
ok github.com/couchbase/indexing/secondary/indexer 261.454s
=== RUN TestConnPoolBasicSanity
2023-09-08T11:15:27.537+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-08T11:15:27.537+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-08T11:15:27.767+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:15:27.767+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:15:28.539+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN TestCloseActiveConnectionsUnsetFlag
2023-09-08T11:15:32.541+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-08T11:15:32.541+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-08T11:15:32.756+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:15:32.757+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:15:33.542+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestCloseActiveConnectionsUnsetFlag (9.22s)
=== RUN TestCloseActiveConnectionsSetFlag
2023-09-08T11:15:41.761+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-08T11:15:41.761+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-08T11:15:41.981+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:15:41.981+05:30 [Info] Closing active connection from 127.0.0.1:40530 to 127.0.0.1:15151
2023-09-08T11:15:41.981+05:30 [Info] Closing active connection from 127.0.0.1:40532 to 127.0.0.1:15151
2023-09-08T11:15:41.981+05:30 [Info] Closing active connection from 127.0.0.1:40534 to 127.0.0.1:15151
2023-09-08T11:15:41.981+05:30 [Info] Closing active connection from 127.0.0.1:40536 to 127.0.0.1:15151
2023-09-08T11:15:41.981+05:30 [Info] Closing active connection from 127.0.0.1:40538 to 127.0.0.1:15151
2023-09-08T11:15:41.982+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:15:42.761+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestCloseActiveConnectionsSetFlag (4.22s)
=== RUN TestMaintainActiveConnections
2023-09-08T11:15:45.984+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-08T11:15:45.984+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-08T11:15:46.324+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:15:46.324+05:30 [Info] Closing active connection from 127.0.0.1:40550 to 127.0.0.1:15151
2023-09-08T11:15:46.324+05:30 [Info] Closing active connection from 127.0.0.1:40552 to 127.0.0.1:15151
2023-09-08T11:15:46.324+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:15:46.984+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestMaintainActiveConnections (4.34s)
=== RUN TestConnectionPoolRenew
2023-09-08T11:15:50.327+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-09-08T11:15:50.327+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-08T11:15:50.540+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:40562"
2023-09-08T11:15:50.540+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:40558"
2023-09-08T11:15:50.541+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:40560"
2023-09-08T11:15:50.541+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:40564"
2023-09-08T11:15:50.542+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:40556"
2023-09-08T11:15:50.543+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:15:50.543+05:30 [Info] Closing active connection from 127.0.0.1:40574 to 127.0.0.1:15151
2023-09-08T11:15:50.543+05:30 [Info] Closing active connection from 127.0.0.1:40568 to 127.0.0.1:15151
2023-09-08T11:15:50.544+05:30 [Info] Closing active connection from 127.0.0.1:40570 to 127.0.0.1:15151
2023-09-08T11:15:50.544+05:30 [Info] Closing active connection from 127.0.0.1:40572 to 127.0.0.1:15151
2023-09-08T11:15:50.544+05:30 [Info] Closing active connection from 127.0.0.1:40566 to 127.0.0.1:15151
2023-09-08T11:15:50.544+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:15:51.327+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
2023-09-08T11:15:52.545+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing unhealthy connection "127.0.0.1:40566"
2023-09-08T11:15:52.546+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] closing connection "127.0.0.1:40576" -> "127.0.0.1:15151" as the pool is closed
--- PASS: TestConnectionPoolRenew (4.22s)
=== RUN TestConnRelease
2023-09-08T11:15:54.547+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-08T11:15:54.547+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2023-09-08T11:16:34.390+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:16:34.390+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:16:34.565+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.85s)
=== RUN TestLongevity
2023-09-08T11:16:38.392+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-08T11:16:38.392+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Releasing 1 conns.
Getting 3 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 2 conns.
Getting 3 conns.
Releasing 3 conns.
Getting 4 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 2 conns.
Getting 1 conns.
Releasing 4 conns.
Getting 0 conns.
Releasing 4 conns.
Getting 2 conns.
Releasing 4 conns.
Getting 4 conns.
Releasing 0 conns.
Getting 3 conns.
Releasing 1 conns.
Getting 1 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 3 conns.
Getting 2 conns.
Releasing 4 conns.
Getting 2 conns.
Releasing 1 conns.
Getting 0 conns.
2023-09-08T11:17:16.925+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:17:16.925+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:17:17.414+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.53s)
=== RUN TestSustainedHighConns
2023-09-08T11:17:20.927+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
2023-09-08T11:17:20.927+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
Allocating 16 Connections
Returning 3 Connections
cp.curActConns = 0
cp.curActConns = 11
Returning 1 Connections
cp.curActConns = 12
Returning 2 Connections
Allocating 23 Connections
cp.curActConns = 22
Returning 2 Connections
cp.curActConns = 31
Returning 3 Connections
Allocating 5 Connections
cp.curActConns = 33
Returning 1 Connections
Allocating 7 Connections
cp.curActConns = 34
Returning 4 Connections
cp.curActConns = 35
Allocating 1 Connections
Returning 1 Connections
cp.curActConns = 35
Allocating 13 Connections
Returning 1 Connections
cp.curActConns = 46
Returning 1 Connections
cp.curActConns = 46
Allocating 11 Connections
Returning 2 Connections
cp.curActConns = 55
Returning 0 Connections
Allocating 13 Connections
cp.curActConns = 57
Returning 3 Connections
cp.curActConns = 65
Returning 2 Connections
Allocating 7 Connections
cp.curActConns = 68
Returning 1 Connections
cp.curActConns = 69
Allocating 20 Connections
Returning 0 Connections
cp.curActConns = 79
Returning 3 Connections
cp.curActConns = 86
Returning 0 Connections
Allocating 15 Connections
cp.curActConns = 90
Returning 3 Connections
cp.curActConns = 98
Returning 4 Connections
Allocating 14 Connections
cp.curActConns = 101
Returning 3 Connections
cp.curActConns = 105
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 103
Returning 2 Connections
Allocating 17 Connections
cp.curActConns = 112
Returning 2 Connections
cp.curActConns = 116
Returning 4 Connections
Allocating 10 Connections
cp.curActConns = 122
Returning 1 Connections
Allocating 14 Connections
cp.curActConns = 123
Returning 0 Connections
cp.curActConns = 135
Returning 0 Connections
Allocating 5 Connections
cp.curActConns = 135
Returning 4 Connections
cp.curActConns = 136
Allocating 13 Connections
Returning 1 Connections
cp.curActConns = 146
Returning 1 Connections
cp.curActConns = 147
Allocating 17 Connections
Returning 4 Connections
cp.curActConns = 157
Returning 0 Connections
cp.curActConns = 160
Returning 2 Connections
Allocating 13 Connections
cp.curActConns = 169
Returning 4 Connections
cp.curActConns = 167
Allocating 23 Connections
Returning 1 Connections
cp.curActConns = 180
Returning 4 Connections
cp.curActConns = 185
Returning 3 Connections
Allocating 7 Connections
cp.curActConns = 189
Returning 2 Connections
Allocating 17 Connections
cp.curActConns = 191
Returning 4 Connections
cp.curActConns = 200
Returning 3 Connections
Allocating 9 Connections
cp.curActConns = 202
Returning 1 Connections
cp.curActConns = 205
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 206
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 201
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 201
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 204
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 207
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 210
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 209
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 212
Returning 4 Connections
Allocating 0 Connections
cp.curActConns = 208
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 205
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 206
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 207
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 206
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 206
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 204
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 204
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 207
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 208
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 211
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 213
Returning 0 Connections
cp.curActConns = 214
Allocating 4 Connections
Returning 4 Connections
cp.curActConns = 214
Allocating 2 Connections
Returning 0 Connections
cp.curActConns = 216
Returning 4 Connections
Allocating 0 Connections
cp.curActConns = 212
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 213
Returning 0 Connections
Allocating 2 Connections
cp.curActConns = 215
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 218
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 215
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 216
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 214
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 215
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 214
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 214
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 213
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 213
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 215
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 215
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 214
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 217
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 215
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 214
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 213
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 214
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 214
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 214
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 212
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 216
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 214
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 218
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 221
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 219
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 217
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 215
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 215
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 212
Retuning from startDeallocatorRoutine
Retuning from startAllocatorRoutine
2023-09-08T11:18:15.996+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:18:15.996+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:18:16.961+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.07s)
=== RUN TestLowWM
2023-09-08T11:18:19.997+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2023-09-08T11:18:19.997+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-08T11:19:20.016+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-09-08T11:20:20.035+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-09-08T11:20:25.520+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:20:25.521+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:20:26.037+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.52s)
=== RUN TestTotalConns
2023-09-08T11:20:29.522+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2023-09-08T11:20:29.522+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-08T11:20:43.774+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:20:43.774+05:30 [Info] Closing active connection from 127.0.0.1:41942 to 127.0.0.1:15151
2023-09-08T11:20:43.774+05:30 [Info] Closing active connection from 127.0.0.1:42030 to 127.0.0.1:15151
2023-09-08T11:20:43.774+05:30 [Info] Closing active connection from 127.0.0.1:42064 to 127.0.0.1:15151
2023-09-08T11:20:43.774+05:30 [Info] Closing active connection from 127.0.0.1:42106 to 127.0.0.1:15151
2023-09-08T11:20:43.774+05:30 [Info] Closing active connection from 127.0.0.1:42006 to 127.0.0.1:15151
2023-09-08T11:20:43.774+05:30 [Info] Closing active connection from 127.0.0.1:42046 to 127.0.0.1:15151
2023-09-08T11:20:43.774+05:30 [Info] Closing active connection from 127.0.0.1:42128 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42036 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42056 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42066 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42024 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42100 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42132 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42126 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:41978 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42088 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:41954 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:41996 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42094 to 127.0.0.1:15151
2023-09-08T11:20:43.775+05:30 [Info] Closing active connection from 127.0.0.1:42008 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42014 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42070 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42010 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42034 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:41986 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42048 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42052 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:41940 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42012 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42038 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42084 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:41958 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:41974 to 127.0.0.1:15151
2023-09-08T11:20:43.776+05:30 [Info] Closing active connection from 127.0.0.1:42120 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:41952 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:42026 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:42072 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:42082 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:42090 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:41948 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:42028 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:41956 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:42018 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:42020 to 127.0.0.1:15151
2023-09-08T11:20:43.777+05:30 [Info] Closing active connection from 127.0.0.1:42068 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41944 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:42054 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41936 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41980 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41976 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41992 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:42096 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41998 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:42074 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41984 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41950 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:41966 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:42000 to 127.0.0.1:15151
2023-09-08T11:20:43.778+05:30 [Info] Closing active connection from 127.0.0.1:42122 to 127.0.0.1:15151
2023-09-08T11:20:43.779+05:30 [Info] Closing active connection from 127.0.0.1:42060 to 127.0.0.1:15151
2023-09-08T11:20:43.779+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:20:44.529+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.26s)
=== RUN TestUpdateTickRate
2023-09-08T11:20:47.781+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2023-09-08T11:20:47.781+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Started active connections updates consumer ...
2023-09-08T11:21:08.643+05:30 [Info] activeConnectionsUpdateChannel channel closed
2023-09-08T11:21:08.643+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-09-08T11:21:08.798+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.86s)
PASS
ok github.com/couchbase/indexing/secondary/queryport/client 345.159s
Starting server: attempt 1
Functional tests
2023/09/08 11:23:37 In TestMain()
2023/09/08 11:23:37 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2023/09/08 11:23:37 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2023/09/08 11:23:38 Initialising web UI on node: 127.0.0.1:9000
2023/09/08 11:23:39 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2023/09/08 11:23:40 Setting data quota of 1500M and Index quota of 1500M
2023/09/08 11:23:41 Adding node: https://127.0.0.1:19001 with role: kv,index to the cluster
2023/09/08 11:23:50 AddNode: Successfully added node: 127.0.0.1:9001 (role kv,index), response: {"otpNode":"n_1@127.0.0.1"}
2023/09/08 11:23:56 Rebalance progress: 0
2023/09/08 11:24:01 Rebalance progress: 0
2023/09/08 11:24:06 Rebalance progress: 75
2023/09/08 11:24:11 Rebalance progress: 100
2023/09/08 11:24:16 Created bucket default, responseBody:
2023/09/08 11:24:21 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/08 11:24:21 Successfully initialised cluster
2023/09/08 11:24:21 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/09/08 11:24:21 Changing config key queryport.client.settings.backfillLimit to value 0
2023/09/08 11:24:21 Changing config key queryport.client.log_level to value Info
2023/09/08 11:24:21 Changing config key indexer.api.enableTestServer to value true
2023/09/08 11:24:21 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2023/09/08 11:24:21 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2023/09/08 11:24:22 Changing config key indexer.settings.log_level to value info
2023/09/08 11:24:22 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2023/09/08 11:24:22 Using memory_optimized for creating indexes
2023/09/08 11:24:22 Changing config key indexer.settings.storage_mode to value memory_optimized
2023/09/08 11:24:27 Data file exists. Skipping download
2023/09/08 11:24:27 Data file exists. Skipping download
2023/09/08 11:24:28 In DropAllSecondaryIndexes()
2023/09/08 11:24:28 Emptying the default bucket
2023/09/08 11:24:31 Flush Enabled on bucket default, responseBody:
2023/09/08 11:25:09 Flushed the bucket default, Response body:
2023/09/08 11:25:09 Create Index On the empty default Bucket()
2023/09/08 11:25:13 Created the secondary index index_eyeColor. Waiting for it become active
2023/09/08 11:25:13 Index is 11680318068140538270 now active
2023/09/08 11:25:13 Populating the default bucket
=== RUN TestScanAfterBucketPopulate
2023/09/08 11:25:22 In TestScanAfterBucketPopulate()
2023/09/08 11:25:22 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/09/08 11:25:22 Using n1ql client
2023-09-08T11:25:22.829+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2023-09-08T11:25:22.834+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":2,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":120000,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T11:25:22.847+05:30 [Info] MetadataProvider.SetClusterStatus(): healthy nodes 1 failed node 0 unhealthy node 0 add node 0
2023-09-08T11:25:22.847+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T11:25:22.847+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T11:25:22.847+05:30 [Info] MetadataProvider.WatchMetadata(): indexer 127.0.0.1:9106
2023-09-08T11:25:22.851+05:30 [Info] watcher:ClientAuth successful for 127.0.0.1:9106
2023-09-08T11:25:22.867+05:30 [Info] WatchMetadata(): successfully reach indexer at 127.0.0.1:9106.
2023-09-08T11:25:22.868+05:30 [Info] MetadataProvider: Updating indexer version to 9
2023-09-08T11:25:22.868+05:30 [Info] initialized currmeta 3 force true
2023-09-08T11:25:22.873+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] started poolsize 5000 overflow 30 low WM 1000 relConn batch size 100 ...
2023-09-08T11:25:22.873+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] Started active connections updates consumer ...
2023-09-08T11:25:22.873+05:30 [Info] [GsiScanClient:"127.0.0.1:9107"] started ...
2023-09-08T11:25:22.874+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] open new connection ...
2023-09-08T11:25:22.876+05:30 [Info] GSIC[default/default-_default-_default-1694152522826994276] started ...
2023/09/08 11:25:22 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.10s)
=== RUN TestRestartNilSnapshot
2023/09/08 11:25:22 In TestRestartNilSnapshot()
2023/09/08 11:25:27 Created the secondary index idx_age. Waiting for it become active
2023/09/08 11:25:27 Index is 50295539279487764 now active
2023/09/08 11:25:27 Restarting indexer process ...
2023/09/08 11:25:27 []
2023-09-08T11:25:27.347+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-08T11:25:27.353+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/08 11:28:47 Using n1ql client
2023-09-08T11:28:47.326+05:30 [Error] transport error between 127.0.0.1:56768->127.0.0.1:9107: write tcp 127.0.0.1:56768->127.0.0.1:9107: write: broken pipe
2023-09-08T11:28:47.326+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 1212210602601751390 request transport failed `write tcp 127.0.0.1:56768->127.0.0.1:9107: write: broken pipe`
2023-09-08T11:28:47.326+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-08T11:28:47.326+05:30 [Error] metadataClient:PickRandom: Replicas - [18188144374970133036], PrunedReplica - map[], FilteredReplica map[]
2023/09/08 11:28:47 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.46s)
=== RUN TestThreeIndexCreates
2023/09/08 11:28:47 In TestThreeIndexCreates()
2023/09/08 11:28:51 Created the secondary index index_balance. Waiting for it become active
2023/09/08 11:28:51 Index is 14058274300314483392 now active
2023/09/08 11:28:51 Create docs mutations
2023/09/08 11:28:51 Using n1ql client
2023/09/08 11:28:51 Expected and Actual scan responses are the same
2023/09/08 11:28:58 Created the secondary index index_email. Waiting for it become active
2023/09/08 11:28:58 Index is 7946133599838242694 now active
2023/09/08 11:28:58 Create docs mutations
2023/09/08 11:28:58 Using n1ql client
2023/09/08 11:28:58 Expected and Actual scan responses are the same
2023/09/08 11:29:04 Created the secondary index index_pin. Waiting for it become active
2023/09/08 11:29:04 Index is 258831081586391968 now active
2023/09/08 11:29:04 Delete docs mutations
2023/09/08 11:29:05 Using n1ql client
2023/09/08 11:29:05 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (17.83s)
=== RUN TestMultipleIndexCreatesDropsWithMutations
2023/09/08 11:29:05 In TestThreeIndexCreates()
2023/09/08 11:29:11 Created the secondary index index_state. Waiting for it become active
2023/09/08 11:29:11 Index is 3514295254857254619 now active
2023/09/08 11:29:11 Create docs mutations
2023/09/08 11:29:11 Using n1ql client
2023/09/08 11:29:11 Expected and Actual scan responses are the same
2023/09/08 11:29:18 Created the secondary index index_registered. Waiting for it become active
2023/09/08 11:29:18 Index is 4284006586443221023 now active
2023/09/08 11:29:18 Create docs mutations
2023/09/08 11:29:18 Using n1ql client
2023/09/08 11:29:18 Expected and Actual scan responses are the same
2023/09/08 11:29:24 Created the secondary index index_gender. Waiting for it become active
2023/09/08 11:29:24 Index is 2251628604888308069 now active
2023/09/08 11:29:24 Create docs mutations
2023/09/08 11:29:25 Using n1ql client
2023/09/08 11:29:25 Expected and Actual scan responses are the same
2023/09/08 11:29:25 Dropping the secondary index index_registered
2023/09/08 11:29:25 Index dropped
2023/09/08 11:29:25 Create docs mutations
2023/09/08 11:29:25 Delete docs mutations
2023/09/08 11:29:25 Using n1ql client
2023/09/08 11:29:25 Expected and Actual scan responses are the same
2023/09/08 11:29:31 Created the secondary index index_longitude. Waiting for it become active
2023/09/08 11:29:31 Index is 8929580820428596334 now active
2023/09/08 11:29:31 Create docs mutations
2023/09/08 11:29:32 Using n1ql client
2023/09/08 11:29:32 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (27.04s)
=== RUN TestCreateDropScan
2023/09/08 11:29:32 In TestCreateDropScan()
2023/09/08 11:29:38 Created the secondary index index_cd. Waiting for it become active
2023/09/08 11:29:38 Index is 8053018366404509591 now active
2023/09/08 11:29:38 Using n1ql client
2023/09/08 11:29:38 Expected and Actual scan responses are the same
2023/09/08 11:29:38 Dropping the secondary index index_cd
2023/09/08 11:29:38 Index dropped
2023/09/08 11:29:38 Using n1ql client
2023/09/08 11:29:38 Scan failed as expected with error: Index Not Found - cause: GSI index index_cd not found.
--- PASS: TestCreateDropScan (6.51s)
=== RUN TestCreateDropCreate
2023/09/08 11:29:38 In TestCreateDropCreate()
2023/09/08 11:29:45 Created the secondary index index_cdc. Waiting for it become active
2023/09/08 11:29:45 Index is 3562929672096337225 now active
2023/09/08 11:29:45 Using n1ql client
2023/09/08 11:29:45 Expected and Actual scan responses are the same
2023/09/08 11:29:45 Dropping the secondary index index_cdc
2023/09/08 11:29:45 Index dropped
2023/09/08 11:29:45 Using n1ql client
2023/09/08 11:29:45 Scan 2 failed as expected with error: Index Not Found - cause: GSI index index_cdc not found.
2023/09/08 11:29:51 Created the secondary index index_cdc. Waiting for it become active
2023/09/08 11:29:51 Index is 16757813573936651409 now active
2023/09/08 11:29:51 Using n1ql client
2023/09/08 11:29:51 Expected and Actual scan responses are the same
2023/09/08 11:29:51 (Inclusion 1) Lengths of expected and actual scan results are 5066 and 5066. Num of docs in bucket = 10402
2023/09/08 11:29:51 Using n1ql client
2023/09/08 11:29:51 Expected and Actual scan responses are the same
2023/09/08 11:29:51 (Inclusion 3) Lengths of expected and actual scan results are 5066 and 5066. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (12.99s)
=== RUN TestCreate2Drop1Scan2
2023/09/08 11:29:51 In TestCreate2Drop1Scan2()
2023/09/08 11:29:58 Created the secondary index index_i1. Waiting for it become active
2023/09/08 11:29:58 Index is 4991828873092516979 now active
2023/09/08 11:30:04 Created the secondary index index_i2. Waiting for it become active
2023/09/08 11:30:04 Index is 16544878715255534848 now active
2023/09/08 11:30:04 Using n1ql client
2023/09/08 11:30:04 Expected and Actual scan responses are the same
2023/09/08 11:30:04 Using n1ql client
2023/09/08 11:30:04 Expected and Actual scan responses are the same
2023/09/08 11:30:04 Dropping the secondary index index_i1
2023/09/08 11:30:04 Index dropped
2023/09/08 11:30:04 Using n1ql client
2023/09/08 11:30:04 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (12.89s)
=== RUN TestIndexNameCaseSensitivity
2023/09/08 11:30:04 In TestIndexNameCaseSensitivity()
2023/09/08 11:30:10 Created the secondary index index_age. Waiting for it become active
2023/09/08 11:30:10 Index is 10890702899837936129 now active
2023/09/08 11:30:10 Using n1ql client
2023/09/08 11:30:10 Expected and Actual scan responses are the same
2023/09/08 11:30:10 Using n1ql client
2023/09/08 11:30:10 Scan failed as expected with error: Index Not Found - cause: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (6.26s)
=== RUN TestCreateDuplicateIndex
2023/09/08 11:30:10 In TestCreateDuplicateIndex()
2023/09/08 11:30:17 Created the secondary index index_di1. Waiting for it become active
2023/09/08 11:30:17 Index is 16558562141030455 now active
2023/09/08 11:30:17 Index found: index_di1
2023/09/08 11:30:17 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (6.34s)
=== RUN TestDropNonExistingIndex
2023/09/08 11:30:17 In TestDropNonExistingIndex()
2023/09/08 11:30:17 Dropping the secondary index 123456
2023/09/08 11:30:17 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.05s)
=== RUN TestCreateIndexNonExistentBucket
2023/09/08 11:30:17 In TestCreateIndexNonExistentBucket()
2023-09-08T11:30:17.792+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-09-08T11:30:28.795+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023/09/08 11:30:28 Index create failed as expected with error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- PASS: TestCreateIndexNonExistentBucket (11.51s)
=== RUN TestScanWithNoTimeout
2023/09/08 11:30:28 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/09/08 11:30:28 Changing config key indexer.settings.scan_timeout to value 0
2023/09/08 11:30:29 Using n1ql client
2023/09/08 11:30:29 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.38s)
=== RUN TestIndexingOnBinaryBucketMeta
2023/09/08 11:30:29 In TestIndexingOnBinaryBucketMeta()
2023/09/08 11:30:29 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2023/09/08 11:30:29 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2023/09/08 11:30:32 Modified parameters of bucket default, responseBody:
2023/09/08 11:30:32 Created bucket binaryBucket, responseBody:
2023/09/08 11:31:05 Created the secondary index index_binary_meta_id. Waiting for it become active
2023/09/08 11:31:05 Index is 9099967381933902776 now active
2023/09/08 11:31:10 items_count stat is 10 for index index_binary_meta_id
2023/09/08 11:31:10 Dropping the secondary index index_binary_meta_id
2023/09/08 11:31:10 Index dropped
2023/09/08 11:31:13 Created the secondary index index_binary_meta_cas. Waiting for it become active
2023/09/08 11:31:13 Index is 8634743425024143013 now active
2023/09/08 11:31:18 items_count stat is 10 for index index_binary_meta_cas
2023/09/08 11:31:18 Dropping the secondary index index_binary_meta_cas
2023/09/08 11:31:18 Index dropped
2023/09/08 11:31:21 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2023/09/08 11:31:21 Index is 10795701429922214862 now active
2023/09/08 11:31:26 items_count stat is 10 for index index_binary_meta_expiration
2023/09/08 11:31:26 Dropping the secondary index index_binary_meta_expiration
2023/09/08 11:31:27 Index dropped
2023/09/08 11:31:29 Deleted bucket binaryBucket, responseBody:
2023/09/08 11:31:32 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnBinaryBucketMeta (93.14s)
=== RUN TestRetainDeleteXATTRBinaryDocs
2023/09/08 11:32:02 In TestRetainDeleteXATTRBinaryDocs()
2023/09/08 11:32:02 1. Populate a bucket with binary docs having system XATTRS
2023/09/08 11:32:02 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2023/09/08 11:32:02 3. Delete the documents in the bucket
2023/09/08 11:32:02 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2023/09/08 11:32:05 Modified parameters of bucket default, responseBody:
2023/09/08 11:32:05 Created bucket binaryBucket, responseBody:
2023/09/08 11:32:38 Created the secondary index index_system_xattr. Waiting for it become active
2023/09/08 11:32:38 Index is 5582589362967472545 now active
2023/09/08 11:32:43 Deleted all the documents in the bucket: binaryBucket successfully
2023/09/08 11:32:46 Deleted bucket binaryBucket, responseBody:
2023/09/08 11:32:49 Modified parameters of bucket default, responseBody:
--- PASS: TestRetainDeleteXATTRBinaryDocs (77.59s)
=== RUN TestIndexingOnXATTRs
2023/09/08 11:33:19 In TestIndexingOnXATTRs()
2023/09/08 11:33:22 Modified parameters of bucket default, responseBody:
2023/09/08 11:33:23 Created bucket bucket_xattrs, responseBody:
2023/09/08 11:33:57 Created the secondary index index_sync_rev. Waiting for it become active
2023/09/08 11:33:57 Index is 1431202578782738782 now active
2023/09/08 11:34:04 Created the secondary index index_sync_channels. Waiting for it become active
2023/09/08 11:34:04 Index is 2928918481358507840 now active
2023/09/08 11:34:10 Created the secondary index index_sync_test. Waiting for it become active
2023/09/08 11:34:10 Index is 5560208196348464546 now active
2023/09/08 11:34:15 items_count stat is 100 for index index_sync_rev
2023/09/08 11:34:15 items_count stat is 100 for index index_sync_channels
2023/09/08 11:34:15 items_count stat is 100 for index index_sync_test
2023/09/08 11:34:15 Using n1ql client
2023-09-08T11:34:15.646+05:30 [Info] GSIC[default/bucket_xattrs-_default-_default-1694153055641488792] started ...
2023/09/08 11:34:15 Dropping the secondary index index_sync_rev
2023/09/08 11:34:15 Index dropped
2023/09/08 11:34:15 Using n1ql client
2023/09/08 11:34:15 Dropping the secondary index index_sync_channels
2023/09/08 11:34:15 Index dropped
2023/09/08 11:34:15 Using n1ql client
2023/09/08 11:34:15 Dropping the secondary index index_sync_test
2023/09/08 11:34:15 Index dropped
2023/09/08 11:34:18 Deleted bucket bucket_xattrs, responseBody:
2023/09/08 11:34:21 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnXATTRs (91.20s)
=== RUN TestSimpleIndex_FloatDataType
2023/09/08 11:34:51 In TestSimpleIndex_FloatDataType()
2023/09/08 11:34:51 Index found: index_age
2023/09/08 11:34:51 Using n1ql client
2023/09/08 11:34:51 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.02s)
=== RUN TestSimpleIndex_StringDataType
2023/09/08 11:34:51 In TestSimpleIndex_StringDataType()
2023/09/08 11:34:55 Created the secondary index index_company. Waiting for it become active
2023/09/08 11:34:55 Index is 11582806584910549681 now active
2023/09/08 11:34:55 Using n1ql client
2023/09/08 11:34:55 Expected and Actual scan responses are the same
2023/09/08 11:34:55 Using n1ql client
2023/09/08 11:34:55 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.86s)
=== RUN TestSimpleIndex_FieldValueCaseSensitivity
2023/09/08 11:34:55 In TestSimpleIndex_StringCaseSensitivity()
2023/09/08 11:34:55 Index found: index_company
2023/09/08 11:34:56 Using n1ql client
2023/09/08 11:34:56 Expected and Actual scan responses are the same
2023/09/08 11:34:56 Using n1ql client
2023/09/08 11:34:56 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.08s)
=== RUN TestSimpleIndex_BoolDataType
2023/09/08 11:34:56 In TestSimpleIndex_BoolDataType()
2023/09/08 11:35:02 Created the secondary index index_isActive. Waiting for it become active
2023/09/08 11:35:02 Index is 1616434913467833043 now active
2023/09/08 11:35:02 Using n1ql client
2023/09/08 11:35:02 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (6.67s)
=== RUN TestBasicLookup
2023/09/08 11:35:02 In TestBasicLookup()
2023/09/08 11:35:02 Index found: index_company
2023/09/08 11:35:02 Using n1ql client
2023/09/08 11:35:02 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.01s)
=== RUN TestIndexOnNonExistentField
2023/09/08 11:35:02 In TestIndexOnNonExistentField()
2023/09/08 11:35:09 Created the secondary index index_height. Waiting for it become active
2023/09/08 11:35:09 Index is 11502885828487266083 now active
2023/09/08 11:35:09 Using n1ql client
2023/09/08 11:35:09 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (6.67s)
=== RUN TestIndexPartiallyMissingField
2023/09/08 11:35:09 In TestIndexPartiallyMissingField()
2023/09/08 11:35:15 Created the secondary index index_nationality. Waiting for it become active
2023/09/08 11:35:15 Index is 14602718825966686555 now active
2023/09/08 11:35:16 Using n1ql client
2023/09/08 11:35:16 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (6.61s)
=== RUN TestScanNonMatchingDatatype
2023/09/08 11:35:16 In TestScanNonMatchingDatatype()
2023/09/08 11:35:16 Index found: index_age
2023/09/08 11:35:16 Using n1ql client
2023/09/08 11:35:16 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.01s)
=== RUN TestInclusionNeither
2023/09/08 11:35:16 In TestInclusionNeither()
2023/09/08 11:35:16 Index found: index_age
2023/09/08 11:35:16 Using n1ql client
2023/09/08 11:35:16 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.03s)
=== RUN TestInclusionLow
2023/09/08 11:35:16 In TestInclusionLow()
2023/09/08 11:35:16 Index found: index_age
2023/09/08 11:35:16 Using n1ql client
2023/09/08 11:35:16 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.05s)
=== RUN TestInclusionHigh
2023/09/08 11:35:16 In TestInclusionHigh()
2023/09/08 11:35:16 Index found: index_age
2023/09/08 11:35:16 Using n1ql client
2023/09/08 11:35:16 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.02s)
=== RUN TestInclusionBoth
2023/09/08 11:35:16 In TestInclusionBoth()
2023/09/08 11:35:16 Index found: index_age
2023/09/08 11:35:16 Using n1ql client
2023/09/08 11:35:16 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.02s)
=== RUN TestNestedIndex_String
2023/09/08 11:35:16 In TestNestedIndex_String()
2023/09/08 11:35:22 Created the secondary index index_streetname. Waiting for it become active
2023/09/08 11:35:22 Index is 14223769531997519154 now active
2023/09/08 11:35:22 Using n1ql client
2023/09/08 11:35:22 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (6.56s)
=== RUN TestNestedIndex_Float
2023/09/08 11:35:22 In TestNestedIndex_Float()
2023/09/08 11:35:29 Created the secondary index index_floor. Waiting for it become active
2023/09/08 11:35:29 Index is 10262039895915323005 now active
2023/09/08 11:35:29 Using n1ql client
2023/09/08 11:35:29 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (6.77s)
=== RUN TestNestedIndex_Bool
2023/09/08 11:35:29 In TestNestedIndex_Bool()
2023/09/08 11:35:36 Created the secondary index index_isresidential. Waiting for it become active
2023/09/08 11:35:36 Index is 14996939357039750384 now active
2023/09/08 11:35:36 Using n1ql client
2023/09/08 11:35:36 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (6.82s)
=== RUN TestLookupJsonObject
2023/09/08 11:35:36 In TestLookupJsonObject()
2023/09/08 11:35:42 Created the secondary index index_streetaddress. Waiting for it become active
2023/09/08 11:35:42 Index is 3563756087314031348 now active
2023/09/08 11:35:42 Using n1ql client
2023/09/08 11:35:42 Count of docScanResults is 1
2023/09/08 11:35:42 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/08 11:35:42 Count of scanResults is 1
2023/09/08 11:35:42 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/08 11:35:42 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.68s)
=== RUN TestLookupObjDifferentOrdering
2023/09/08 11:35:42 In TestLookupObjDifferentOrdering()
2023/09/08 11:35:42 Index found: index_streetaddress
2023/09/08 11:35:42 Using n1ql client
2023/09/08 11:35:43 Count of docScanResults is 1
2023/09/08 11:35:43 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/08 11:35:43 Count of scanResults is 1
2023/09/08 11:35:43 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/08 11:35:43 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.02s)
=== RUN TestRangeJsonObject
2023/09/08 11:35:43 In TestRangeJsonObject()
2023/09/08 11:35:43 Index found: index_streetaddress
2023/09/08 11:35:43 Using n1ql client
2023/09/08 11:35:43 Count of scanResults is 2
2023/09/08 11:35:43 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2023/09/08 11:35:43 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/09/08 11:35:43 Count of docScanResults is 2
2023/09/08 11:35:43 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/09/08 11:35:43 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2023/09/08 11:35:43 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.00s)
=== RUN TestLookupFloatDiffForms
2023/09/08 11:35:43 In TestLookupFloatDiffForms()
2023/09/08 11:35:49 Created the secondary index index_latitude. Waiting for it become active
2023/09/08 11:35:49 Index is 14344315242752109102 now active
2023/09/08 11:35:49 Scan 1
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 2
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 3
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 4
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 5
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 6
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (6.69s)
=== RUN TestRangeFloatInclVariations
2023/09/08 11:35:49 In TestRangeFloatInclVariations()
2023/09/08 11:35:49 Index found: index_latitude
2023/09/08 11:35:49 Scan 1
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 2
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 3
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 4
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 5
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
2023/09/08 11:35:49 Scan 6
2023/09/08 11:35:49 Using n1ql client
2023/09/08 11:35:49 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.02s)
=== RUN TestScanAll
2023/09/08 11:35:49 In TestScanAll()
2023/09/08 11:35:56 Created the secondary index index_name. Waiting for it become active
2023/09/08 11:35:56 Index is 12547597114788001133 now active
2023/09/08 11:35:56 Length of docScanResults = 10502
2023/09/08 11:35:56 Using n1ql client
2023/09/08 11:35:56 Length of scanResults = 10502
2023/09/08 11:35:56 Expected and Actual scan responses are the same
--- PASS: TestScanAll (6.72s)
=== RUN TestScanAllNestedField
2023/09/08 11:35:56 In TestScanAllNestedField()
2023/09/08 11:35:56 Index found: index_streetname
2023/09/08 11:35:56 Length of docScanResults = 2
2023/09/08 11:35:56 Using n1ql client
2023/09/08 11:35:56 Length of scanResults = 2
2023/09/08 11:35:56 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN TestBasicPrimaryIndex
2023/09/08 11:35:56 In TestBasicPrimaryIndex()
2023/09/08 11:36:03 Created the secondary index index_p1. Waiting for it become active
2023/09/08 11:36:03 Index is 6590827365106936023 now active
2023-09-08T11:36:03.371+05:30 [Error] transport error between 127.0.0.1:56446->127.0.0.1:9107: write tcp 127.0.0.1:56446->127.0.0.1:9107: write: broken pipe
2023-09-08T11:36:03.371+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:56446->127.0.0.1:9107: write: broken pipe`
2023-09-08T11:36:03.371+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-08T11:36:03.371+05:30 [Error] metadataClient:PickRandom: Replicas - [18016722823662374276], PrunedReplica - map[], FilteredReplica map[]
2023/09/08 11:36:03 Expected and Actual scan responses are the same
2023/09/08 11:36:03 CountRange() expected and actual is: 1885 and 1885
2023/09/08 11:36:03 lookupkey for CountLookup() = Usera303a163-e67a-4380-b17f-0dc1a1a90ac7
2023/09/08 11:36:03 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (7.02s)
=== RUN TestBasicNullDataType
2023/09/08 11:36:03 In TestBasicNullDataType()
2023/09/08 11:36:03 Index found: index_email
2023/09/08 11:36:03 Using n1ql client
2023/09/08 11:36:03 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.02s)
=== RUN TestBasicArrayDataType_ScanAll
2023/09/08 11:36:03 In TestBasicArrayDataType_ScanAll()
2023/09/08 11:36:10 Created the secondary index index_tags. Waiting for it become active
2023/09/08 11:36:10 Index is 16610977106325075413 now active
2023/09/08 11:36:10 Using n1ql client
2023/09/08 11:36:10 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (6.84s)
=== RUN TestBasicArrayDataType_Lookup
2023/09/08 11:36:10 In TestBasicArrayDataType_Lookup()
2023/09/08 11:36:12 Index found: index_tags
2023/09/08 11:36:12 Count of scanResults is 1
2023/09/08 11:36:12 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75 Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN TestArrayDataType_LookupMissingArrayValue
2023/09/08 11:36:12 In TestArrayDataType_LookupMissingArrayValue()
2023/09/08 11:36:12 Index found: index_tags
2023/09/08 11:36:12 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.00s)
=== RUN TestArrayDataType_LookupWrongOrder
2023/09/08 11:36:12 In TestArrayDataType_LookupWrongOrder()
2023/09/08 11:36:12 Index found: index_tags
2023/09/08 11:36:12 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN TestArrayDataType_LookupSubset
2023/09/08 11:36:12 In TestArrayDataType_LookupSubset()
2023/09/08 11:36:12 Index found: index_tags
2023/09/08 11:36:12 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN TestScanLimitParameter
2023/09/08 11:36:12 In TestScanLimitParameter()
2023/09/08 11:36:12 Index found: index_age
2023/09/08 11:36:12 Using n1ql client
2023/09/08 11:36:12 Using n1ql client
--- PASS: TestScanLimitParameter (0.01s)
=== RUN TestCountRange
2023/09/08 11:36:12 In TestRangeCount()
2023/09/08 11:36:12 Index found: index_age
2023/09/08 11:36:12 Count of expected and actual Range is: 2439 and 2439
2023/09/08 11:36:12 Count of expected and actual Range is: 10002 and 10002
2023/09/08 11:36:12 Count of expected and actual Range are: 0 and 0
2023/09/08 11:36:12 Count of expected and actual Range are: 475 and 475
2023/09/08 11:36:12 Testing CountRange() for key <= val
2023/09/08 11:36:12 Count of expected and actual CountRange for key <= 30 are: 5202 and 5202
2023/09/08 11:36:12 Testing CountRange() for key >= val
2023/09/08 11:36:12 Count of expected and actual CountRange for key >= 25 are: 7703 and 7703
2023/09/08 11:36:12 Testing CountRange() for null < key <= val
2023/09/08 11:36:12 Count of expected and actual CountRange for key > null && key <= 30 are: 5202 and 5202
2023/09/08 11:36:12 Testing CountRange() for val <= key < null
2023/09/08 11:36:12 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2023/09/08 11:36:12 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.08s)
=== RUN TestCountLookup
2023/09/08 11:36:12 In TestCountLookup()
2023/09/08 11:36:12 Index found: index_age
2023/09/08 11:36:12 Count of expected and actual Range are: 504 and 504
2023/09/08 11:36:12 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.01s)
=== RUN TestRangeStatistics
2023/09/08 11:36:12 In TestRangeCount()
2023/09/08 11:36:12 Index found: index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN TestIndexCreateWithWhere
2023/09/08 11:36:12 In TestIndexCreateWithWhere()
2023/09/08 11:36:17 Created the secondary index index_ageabove30. Waiting for it become active
2023/09/08 11:36:17 Index is 8219873890811213306 now active
2023/09/08 11:36:17 Using n1ql client
2023/09/08 11:36:17 Expected and Actual scan responses are the same
2023/09/08 11:36:17 Lengths of expected and actual scanReuslts are: 4325 and 4325
2023/09/08 11:36:23 Created the secondary index index_ageteens. Waiting for it become active
2023/09/08 11:36:23 Index is 4659722958448000468 now active
2023/09/08 11:36:23 Using n1ql client
2023/09/08 11:36:23 Expected and Actual scan responses are the same
2023/09/08 11:36:23 Lengths of expected and actual scanReuslts are: 0 and 0
2023/09/08 11:36:30 Created the secondary index index_age35to45. Waiting for it become active
2023/09/08 11:36:30 Index is 15404538002617355768 now active
2023/09/08 11:36:30 Using n1ql client
2023/09/08 11:36:30 Expected and Actual scan responses are the same
2023/09/08 11:36:30 Lengths of expected and actual scanReuslts are: 2914 and 2914
--- PASS: TestIndexCreateWithWhere (18.18s)
=== RUN TestDeferredIndexCreate
2023/09/08 11:36:30 In TestDeferredIndexCreate()
2023/09/08 11:36:30 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2023/09/08 11:36:32 Build the deferred index index_deferred. Waiting for the index to become active
2023/09/08 11:36:32 Waiting for index 7199383204240906490 to go active ...
2023/09/08 11:36:33 Waiting for index 7199383204240906490 to go active ...
2023/09/08 11:36:34 Waiting for index 7199383204240906490 to go active ...
2023/09/08 11:36:35 Waiting for index 7199383204240906490 to go active ...
2023/09/08 11:36:36 Waiting for index 7199383204240906490 to go active ...
2023/09/08 11:36:37 Index is 7199383204240906490 now active
2023/09/08 11:36:37 Using n1ql client
2023/09/08 11:36:37 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (7.21s)
=== RUN TestCompositeIndex_NumAndString
2023/09/08 11:36:37 In TestCompositeIndex()
2023/09/08 11:36:44 Created the secondary index index_composite1. Waiting for it become active
2023/09/08 11:36:44 Index is 4449937297865702895 now active
2023/09/08 11:36:44 Using n1ql client
2023/09/08 11:36:44 Using n1ql client
2023/09/08 11:36:44 Using n1ql client
2023/09/08 11:36:44 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (6.77s)
=== RUN TestCompositeIndex_TwoNumberFields
2023/09/08 11:36:44 In TestCompositeIndex()
2023/09/08 11:36:51 Created the secondary index index_composite2. Waiting for it become active
2023/09/08 11:36:51 Index is 8248915988038827238 now active
2023/09/08 11:36:51 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (6.81s)
=== RUN TestNumbers_Int64_Float64
2023/09/08 11:36:51 In TestNumbers_Int64_Float64()
2023/09/08 11:36:58 Created the secondary index idx_numbertest. Waiting for it become active
2023/09/08 11:36:58 Index is 9610086594676297899 now active
2023/09/08 11:36:58
==== Int64 test #0
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Int64 test #1
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Int64 test #2
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Int64 test #3
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Int64 test #4
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Int64 test #5
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Int64 test #6
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Int64 test #7
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Int64 test #8
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Float64 test #0
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Float64 test #1
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Float64 test #2
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
2023/09/08 11:36:58
==== Float64 test #3
2023/09/08 11:36:58 Using n1ql client
2023/09/08 11:36:58 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (7.28s)
=== RUN TestRestartIndexer
2023/09/08 11:36:58 In TestRestartIndexer()
2023/09/08 11:36:58 []
2023-09-08T11:36:58.751+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-08T11:36:58.752+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/08 11:37:18 Using n1ql client
2023-09-08T11:37:18.740+05:30 [Error] transport error between 127.0.0.1:57316->127.0.0.1:9107: write tcp 127.0.0.1:57316->127.0.0.1:9107: write: broken pipe
2023-09-08T11:37:18.740+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 7050299643879137000 request transport failed `write tcp 127.0.0.1:57316->127.0.0.1:9107: write: broken pipe`
2023-09-08T11:37:18.740+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-08T11:37:18.740+05:30 [Error] metadataClient:PickRandom: Replicas - [9618914349986636283], PrunedReplica - map[], FilteredReplica map[]
2023/09/08 11:37:18 Len of expected and actual scan results are : 10002 and 10002
2023/09/08 11:37:18 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.10s)
=== RUN TestCreateDocsMutation
2023/09/08 11:37:18 In TestCreateDocsMutation()
2023/09/08 11:37:18 Index found: index_age
2023/09/08 11:37:18 Using n1ql client
2023/09/08 11:37:18 Len of expected and actual scan results are : 10002 and 10002
2023/09/08 11:37:18 Expected and Actual scan responses are the same
2023/09/08 11:37:19 Using n1ql client
2023/09/08 11:37:19 Index Scan after mutations took 48.01594ms
2023/09/08 11:37:19 Len of expected and actual scan results are : 10102 and 10102
2023/09/08 11:37:19 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.38s)
=== RUN TestRestartProjector
2023/09/08 11:37:19 In TestRestartProjector()
2023/09/08 11:37:19 []
2023/09/08 11:37:39 Using n1ql client
2023/09/08 11:37:39 Len of expected and actual scan results are : 10102 and 10102
2023/09/08 11:37:39 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.08s)
=== RUN TestDeleteDocsMutation
2023/09/08 11:37:39 In TestDeleteDocsMutation()
2023/09/08 11:37:39 Index found: index_age
2023/09/08 11:37:39 Using n1ql client
2023/09/08 11:37:39 Len of expected and actual scan results are : 10102 and 10102
2023/09/08 11:37:39 Expected and Actual scan responses are the same
2023/09/08 11:37:39 Using n1ql client
2023/09/08 11:37:39 Index Scan after mutations took 33.883991ms
2023/09/08 11:37:39 Len of expected and actual scan results are : 9902 and 9902
2023/09/08 11:37:39 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (0.46s)
=== RUN TestUpdateDocsMutation
2023/09/08 11:37:39 In TestUpdateDocsMutation()
2023/09/08 11:37:39 Index found: index_age
2023/09/08 11:37:39 Using n1ql client
2023/09/08 11:37:39 Len of expected and actual scan results are : 9427 and 9427
2023/09/08 11:37:39 Expected and Actual scan responses are the same
2023/09/08 11:37:39 Num of keysFromMutDocs: 100
2023/09/08 11:37:39 Updating number of documents: 100
2023/09/08 11:37:40 Using n1ql client
2023/09/08 11:37:40 Index Scan after mutations took 35.234699ms
2023/09/08 11:37:40 Len of expected and actual scan results are : 9429 and 9429
2023/09/08 11:37:40 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.39s)
=== RUN TestLargeMutations
2023/09/08 11:37:40 In TestLargeMutations()
2023/09/08 11:37:40 In DropAllSecondaryIndexes()
2023/09/08 11:37:40 Index found: index_i2
2023/09/08 11:37:40 Dropped index index_i2
2023/09/08 11:37:40 Index found: index_pin
2023/09/08 11:37:40 Dropped index index_pin
2023/09/08 11:37:40 Index found: index_age35to45
2023/09/08 11:37:40 Dropped index index_age35to45
2023/09/08 11:37:40 Index found: index_composite1
2023/09/08 11:37:40 Dropped index index_composite1
2023/09/08 11:37:40 Index found: index_email
2023/09/08 11:37:40 Dropped index index_email
2023/09/08 11:37:40 Index found: index_state
2023/09/08 11:37:40 Dropped index index_state
2023/09/08 11:37:40 Index found: index_di1
2023/09/08 11:37:40 Dropped index index_di1
2023/09/08 11:37:40 Index found: index_streetaddress
2023/09/08 11:37:40 Dropped index index_streetaddress
2023/09/08 11:37:40 Index found: index_ageabove30
2023/09/08 11:37:40 Dropped index index_ageabove30
2023/09/08 11:37:40 Index found: index_cdc
2023/09/08 11:37:40 Dropped index index_cdc
2023/09/08 11:37:40 Index found: index_nationality
2023/09/08 11:37:41 Dropped index index_nationality
2023/09/08 11:37:41 Index found: index_balance
2023/09/08 11:37:41 Dropped index index_balance
2023/09/08 11:37:41 Index found: index_eyeColor
2023/09/08 11:37:41 Dropped index index_eyeColor
2023/09/08 11:37:41 Index found: index_company
2023/09/08 11:37:41 Dropped index index_company
2023/09/08 11:37:41 Index found: index_height
2023/09/08 11:37:41 Dropped index index_height
2023/09/08 11:37:41 Index found: idx_numbertest
2023/09/08 11:37:41 Dropped index idx_numbertest
2023/09/08 11:37:41 Index found: index_ageteens
2023/09/08 11:37:41 Dropped index index_ageteens
2023/09/08 11:37:41 Index found: index_isActive
2023/09/08 11:37:41 Dropped index index_isActive
2023/09/08 11:37:41 Index found: index_composite2
2023/09/08 11:37:41 Dropped index index_composite2
2023/09/08 11:37:41 Index found: index_name
2023/09/08 11:37:41 Dropped index index_name
2023/09/08 11:37:41 Index found: index_gender
2023/09/08 11:37:41 Dropped index index_gender
2023/09/08 11:37:41 Index found: index_isresidential
2023/09/08 11:37:41 Dropped index index_isresidential
2023/09/08 11:37:41 Index found: index_tags
2023/09/08 11:37:41 Dropped index index_tags
2023/09/08 11:37:41 Index found: idx_age
2023/09/08 11:37:41 Dropped index idx_age
2023/09/08 11:37:41 Index found: index_p1
2023/09/08 11:37:41 Dropped index index_p1
2023/09/08 11:37:41 Index found: index_floor
2023/09/08 11:37:41 Dropped index index_floor
2023/09/08 11:37:41 Index found: index_streetname
2023/09/08 11:37:42 Dropped index index_streetname
2023/09/08 11:37:42 Index found: index_age
2023/09/08 11:37:42 Dropped index index_age
2023/09/08 11:37:42 Index found: index_latitude
2023/09/08 11:37:42 Dropped index index_latitude
2023/09/08 11:37:42 Index found: index_deferred
2023/09/08 11:37:42 Dropped index index_deferred
2023/09/08 11:37:42 Index found: index_longitude
2023/09/08 11:37:42 Dropped index index_longitude
2023/09/08 11:38:00 Created the secondary index indexmut_1. Waiting for it become active
2023/09/08 11:38:00 Index is 17403972259763470884 now active
2023/09/08 11:38:01 Using n1ql client
2023/09/08 11:38:01 Expected and Actual scan responses are the same
2023/09/08 11:38:01 Len of expected and actual scan results are : 29902 and 29902
2023/09/08 11:38:01 ITERATION 0
2023/09/08 11:38:18 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:38:18 Index is 1161276721205772458 now active
2023/09/08 11:38:18 Using n1ql client
2023/09/08 11:38:18 Expected and Actual scan responses are the same
2023/09/08 11:38:18 Len of expected and actual scan results are : 39902 and 39902
2023/09/08 11:38:18 Using n1ql client
2023/09/08 11:38:19 Expected and Actual scan responses are the same
2023/09/08 11:38:19 Len of expected and actual scan results are : 39902 and 39902
2023/09/08 11:38:19 Dropping the secondary index indexmut_2
2023/09/08 11:38:19 Index dropped
2023/09/08 11:38:19 ITERATION 1
2023/09/08 11:38:35 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:38:35 Index is 2719884485975260092 now active
2023/09/08 11:38:35 Using n1ql client
2023/09/08 11:38:35 Expected and Actual scan responses are the same
2023/09/08 11:38:35 Len of expected and actual scan results are : 49902 and 49902
2023/09/08 11:38:35 Using n1ql client
2023/09/08 11:38:36 Expected and Actual scan responses are the same
2023/09/08 11:38:36 Len of expected and actual scan results are : 49902 and 49902
2023/09/08 11:38:36 Dropping the secondary index indexmut_2
2023/09/08 11:38:36 Index dropped
2023/09/08 11:38:36 ITERATION 2
2023/09/08 11:38:52 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:38:52 Index is 14575871499001811721 now active
2023/09/08 11:38:52 Using n1ql client
2023/09/08 11:38:53 Expected and Actual scan responses are the same
2023/09/08 11:38:53 Len of expected and actual scan results are : 59902 and 59902
2023/09/08 11:38:53 Using n1ql client
2023/09/08 11:38:53 Expected and Actual scan responses are the same
2023/09/08 11:38:53 Len of expected and actual scan results are : 59902 and 59902
2023/09/08 11:38:53 Dropping the secondary index indexmut_2
2023/09/08 11:38:54 Index dropped
2023/09/08 11:38:54 ITERATION 3
2023/09/08 11:39:11 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:39:11 Index is 3326420952433314242 now active
2023/09/08 11:39:11 Using n1ql client
2023/09/08 11:39:12 Expected and Actual scan responses are the same
2023/09/08 11:39:12 Len of expected and actual scan results are : 69902 and 69902
2023/09/08 11:39:12 Using n1ql client
2023/09/08 11:39:12 Expected and Actual scan responses are the same
2023/09/08 11:39:12 Len of expected and actual scan results are : 69902 and 69902
2023/09/08 11:39:12 Dropping the secondary index indexmut_2
2023/09/08 11:39:13 Index dropped
2023/09/08 11:39:13 ITERATION 4
2023/09/08 11:39:33 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:39:33 Index is 6106235912199366064 now active
2023/09/08 11:39:33 Using n1ql client
2023/09/08 11:39:34 Expected and Actual scan responses are the same
2023/09/08 11:39:34 Len of expected and actual scan results are : 79902 and 79902
2023/09/08 11:39:34 Using n1ql client
2023/09/08 11:39:35 Expected and Actual scan responses are the same
2023/09/08 11:39:35 Len of expected and actual scan results are : 79902 and 79902
2023/09/08 11:39:35 Dropping the secondary index indexmut_2
2023/09/08 11:39:35 Index dropped
2023/09/08 11:39:35 ITERATION 5
2023/09/08 11:39:54 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:39:54 Index is 5705483427923754577 now active
2023/09/08 11:39:54 Using n1ql client
2023/09/08 11:39:55 Expected and Actual scan responses are the same
2023/09/08 11:39:55 Len of expected and actual scan results are : 89902 and 89902
2023/09/08 11:39:55 Using n1ql client
2023/09/08 11:39:55 Expected and Actual scan responses are the same
2023/09/08 11:39:55 Len of expected and actual scan results are : 89902 and 89902
2023/09/08 11:39:55 Dropping the secondary index indexmut_2
2023/09/08 11:39:55 Index dropped
2023/09/08 11:39:55 ITERATION 6
2023/09/08 11:40:14 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:40:14 Index is 8405940934073000144 now active
2023/09/08 11:40:14 Using n1ql client
2023/09/08 11:40:15 Expected and Actual scan responses are the same
2023/09/08 11:40:15 Len of expected and actual scan results are : 99902 and 99902
2023/09/08 11:40:15 Using n1ql client
2023/09/08 11:40:16 Expected and Actual scan responses are the same
2023/09/08 11:40:16 Len of expected and actual scan results are : 99902 and 99902
2023/09/08 11:40:16 Dropping the secondary index indexmut_2
2023/09/08 11:40:16 Index dropped
2023/09/08 11:40:16 ITERATION 7
2023/09/08 11:40:35 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:40:35 Index is 15252272081970871760 now active
2023/09/08 11:40:35 Using n1ql client
2023/09/08 11:40:36 Expected and Actual scan responses are the same
2023/09/08 11:40:36 Len of expected and actual scan results are : 109902 and 109902
2023/09/08 11:40:37 Using n1ql client
2023/09/08 11:40:38 Expected and Actual scan responses are the same
2023/09/08 11:40:38 Len of expected and actual scan results are : 109902 and 109902
2023/09/08 11:40:38 Dropping the secondary index indexmut_2
2023/09/08 11:40:38 Index dropped
2023/09/08 11:40:38 ITERATION 8
2023/09/08 11:40:59 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:40:59 Index is 12465551781535402107 now active
2023/09/08 11:41:00 Using n1ql client
2023/09/08 11:41:01 Expected and Actual scan responses are the same
2023/09/08 11:41:01 Len of expected and actual scan results are : 119902 and 119902
2023/09/08 11:41:01 Using n1ql client
2023/09/08 11:41:03 Expected and Actual scan responses are the same
2023/09/08 11:41:03 Len of expected and actual scan results are : 119902 and 119902
2023/09/08 11:41:03 Dropping the secondary index indexmut_2
2023/09/08 11:41:03 Index dropped
2023/09/08 11:41:03 ITERATION 9
2023/09/08 11:41:24 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:41:24 Index is 3663500033789050359 now active
2023/09/08 11:41:24 Using n1ql client
2023/09/08 11:41:25 Expected and Actual scan responses are the same
2023/09/08 11:41:25 Len of expected and actual scan results are : 129902 and 129902
2023/09/08 11:41:25 Using n1ql client
2023/09/08 11:41:26 Expected and Actual scan responses are the same
2023/09/08 11:41:26 Len of expected and actual scan results are : 129902 and 129902
2023/09/08 11:41:26 Dropping the secondary index indexmut_2
2023/09/08 11:41:26 Index dropped
2023/09/08 11:41:26 ITERATION 10
2023/09/08 11:41:46 Created the secondary index indexmut_2. Waiting for it become active
2023/09/08 11:41:46 Index is 6212021858456346471 now active
2023/09/08 11:41:46 Using n1ql client
2023/09/08 11:41:47 Expected and Actual scan responses are the same
2023/09/08 11:41:47 Len of expected and actual scan results are : 139902 and 139902
2023/09/08 11:41:48 Using n1ql client
2023/09/08 11:41:49 Expected and Actual scan responses are the same
2023/09/08 11:41:49 Len of expected and actual scan results are : 139902 and 139902
2023/09/08 11:41:49 Dropping the secondary index indexmut_2
2023/09/08 11:41:49 Index dropped
--- PASS: TestLargeMutations (248.99s)
=== RUN TestPlanner
2023/09/08 11:41:49 In TestPlanner()
2023/09/08 11:41:49 -------------------------------------------
2023/09/08 11:41:49 initial placement - 20-50M, 10 index, 3 replica, 2x
2023-09-08T11:41:49.103+05:30 [Info] switched currmeta from 485 -> 486 force true
2023-09-08T11:41:49.106+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:49.109+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-08T11:41:49.125+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T11:41:49.125+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T11:41:49.128+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-08T11:41:49.129+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T11:41:49.129+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T11:41:49.131+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-08T11:41:49.168+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:49.168+05:30 [Info] Score: 0.03931704857454544
2023-09-08T11:41:49.168+05:30 [Info] Memory Quota: 64921238282 (60.4626G)
2023-09-08T11:41:49.168+05:30 [Info] CPU Quota: 12
2023-09-08T11:41:49.168+05:30 [Info] Indexer Memory Mean 39631287391 (36.9095G)
2023-09-08T11:41:49.168+05:30 [Info] Indexer Memory Deviation 3116370502 (2.90235G) (7.86%)
2023-09-08T11:41:49.168+05:30 [Info] Indexer Memory Utilization 0.6105
2023-09-08T11:41:49.168+05:30 [Info] Indexer CPU Mean 11.3144
2023-09-08T11:41:49.168+05:30 [Info] Indexer CPU Deviation 2.48 (21.89%)
2023-09-08T11:41:49.168+05:30 [Info] Indexer CPU Utilization 0.9429
2023-09-08T11:41:49.168+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:49.168+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:49.168+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:49.168+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:49.168+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:49.168+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:49.168+05:30 [Info] Indexer Data Size Mean 39631287391 (36.9095G)
2023-09-08T11:41:49.168+05:30 [Info] Indexer Data Size Deviation 3116370502 (2.90235G) (7.86%)
2023-09-08T11:41:49.168+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:49.168+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:49.168+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:49.168+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:49 -------------------------------------------
2023/09/08 11:41:49 initial placement - 20-50M, 30 index, 3 replica, 2x
2023-09-08T11:41:49.169+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:49.449+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T11:41:49.454+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T11:41:49.454+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T11:41:49.456+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T11:41:49.456+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T11:41:49.456+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-08T11:41:49.458+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-08T11:41:50.031+05:30 [Info] Score: 0.02886974168496064
2023-09-08T11:41:50.031+05:30 [Info] Memory Quota: 64599101032 (60.1626G)
2023-09-08T11:41:50.031+05:30 [Info] CPU Quota: 12
2023-09-08T11:41:50.031+05:30 [Info] Indexer Memory Mean 41436378674 (38.5906G)
2023-09-08T11:41:50.031+05:30 [Info] Indexer Memory Deviation 2392515097 (2.2282G) (5.77%)
2023-09-08T11:41:50.031+05:30 [Info] Indexer Memory Utilization 0.6414
2023-09-08T11:41:50.031+05:30 [Info] Indexer CPU Mean 10.8940
2023-09-08T11:41:50.031+05:30 [Info] Indexer CPU Deviation 2.61 (23.92%)
2023-09-08T11:41:50.031+05:30 [Info] Indexer CPU Utilization 0.9078
2023-09-08T11:41:50.031+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:50.031+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:50.031+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:50.031+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:50.031+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:50.031+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:50.031+05:30 [Info] Indexer Data Size Mean 41436378674 (38.5906G)
2023-09-08T11:41:50.031+05:30 [Info] Indexer Data Size Deviation 2392515097 (2.2282G) (5.77%)
2023-09-08T11:41:50.031+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:50.031+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:50.031+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:50.031+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:50 -------------------------------------------
2023/09/08 11:41:50 initial placement - 20-50M, 30 index, 3 replica, 4x
2023-09-08T11:41:50.031+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:50.290+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:50.291+05:30 [Info] Score: 0.01879147042860454
2023-09-08T11:41:50.291+05:30 [Info] Memory Quota: 124597755300 (116.041G)
2023-09-08T11:41:50.291+05:30 [Info] CPU Quota: 24
2023-09-08T11:41:50.291+05:30 [Info] Indexer Memory Mean 81107787669 (75.5375G)
2023-09-08T11:41:50.291+05:30 [Info] Indexer Memory Deviation 3048269187 (2.83892G) (3.76%)
2023-09-08T11:41:50.291+05:30 [Info] Indexer Memory Utilization 0.6510
2023-09-08T11:41:50.291+05:30 [Info] Indexer CPU Mean 22.7422
2023-09-08T11:41:50.291+05:30 [Info] Indexer CPU Deviation 3.86 (16.96%)
2023-09-08T11:41:50.291+05:30 [Info] Indexer CPU Utilization 0.9476
2023-09-08T11:41:50.291+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:50.291+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:50.291+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:50.291+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:50.291+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:50.291+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:50.291+05:30 [Info] Indexer Data Size Mean 81107787669 (75.5375G)
2023-09-08T11:41:50.291+05:30 [Info] Indexer Data Size Deviation 3048269187 (2.83892G) (3.76%)
2023-09-08T11:41:50.291+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:50.291+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:50.291+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:50.291+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:50 -------------------------------------------
2023/09/08 11:41:50 initial placement - 200-500M, 10 index, 3 replica, 2x
2023-09-08T11:41:50.291+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:50.335+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:50.335+05:30 [Info] Score: 0.0312965560503572
2023-09-08T11:41:50.335+05:30 [Info] Memory Quota: 510810476624 (475.729G)
2023-09-08T11:41:50.335+05:30 [Info] CPU Quota: 12
2023-09-08T11:41:50.335+05:30 [Info] Indexer Memory Mean 375219193786 (349.45G)
2023-09-08T11:41:50.335+05:30 [Info] Indexer Memory Deviation 23486137059 (21.8732G) (6.26%)
2023-09-08T11:41:50.335+05:30 [Info] Indexer Memory Utilization 0.7346
2023-09-08T11:41:50.335+05:30 [Info] Indexer CPU Mean 11.0900
2023-09-08T11:41:50.335+05:30 [Info] Indexer CPU Deviation 2.39 (21.53%)
2023-09-08T11:41:50.335+05:30 [Info] Indexer CPU Utilization 0.9242
2023-09-08T11:41:50.335+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:50.335+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:50.335+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:50.335+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:50.335+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:50.335+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:50.335+05:30 [Info] Indexer Data Size Mean 375219193786 (349.45G)
2023-09-08T11:41:50.335+05:30 [Info] Indexer Data Size Deviation 23486137059 (21.8732G) (6.26%)
2023-09-08T11:41:50.335+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:50.335+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:50.335+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:50.335+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:50 -------------------------------------------
2023/09/08 11:41:50 initial placement - 200-500M, 30 index, 3 replica, 2x
2023-09-08T11:41:50.336+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:51.151+05:30 [Info] Score: 0.02598288946972148
2023-09-08T11:41:51.151+05:30 [Info] Memory Quota: 545908534070 (508.417G)
2023-09-08T11:41:51.151+05:30 [Info] CPU Quota: 12
2023-09-08T11:41:51.151+05:30 [Info] Indexer Memory Mean 421018155160 (392.104G)
2023-09-08T11:41:51.151+05:30 [Info] Indexer Memory Deviation 21878536380 (20.376G) (5.20%)
2023-09-08T11:41:51.151+05:30 [Info] Indexer Memory Utilization 0.7712
2023-09-08T11:41:51.151+05:30 [Info] Indexer CPU Mean 12.7758
2023-09-08T11:41:51.151+05:30 [Info] Indexer CPU Deviation 3.47 (27.14%)
2023-09-08T11:41:51.151+05:30 [Info] Indexer CPU Utilization 1.0646
2023-09-08T11:41:51.151+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:51.151+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:51.151+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:51.151+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:51.151+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:51.151+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:51.151+05:30 [Info] Indexer Data Size Mean 421018155160 (392.104G)
2023-09-08T11:41:51.151+05:30 [Info] Indexer Data Size Deviation 21878536380 (20.376G) (5.20%)
2023-09-08T11:41:51.151+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:51.151+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:51.151+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:51.152+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:51 -------------------------------------------
2023/09/08 11:41:51 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2023-09-08T11:41:51.152+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:51.560+05:30 [Info] Score: 0.012040051780380383
2023-09-08T11:41:51.560+05:30 [Info] Memory Quota: 366210006576 (341.06G)
2023-09-08T11:41:51.560+05:30 [Info] CPU Quota: 16
2023-09-08T11:41:51.560+05:30 [Info] Indexer Memory Mean 294590401864 (274.359G)
2023-09-08T11:41:51.560+05:30 [Info] Indexer Memory Deviation 7093767384 (6.60659G) (2.41%)
2023-09-08T11:41:51.560+05:30 [Info] Indexer Memory Utilization 0.8044
2023-09-08T11:41:51.560+05:30 [Info] Indexer CPU Mean 10.2343
2023-09-08T11:41:51.560+05:30 [Info] Indexer CPU Deviation 5.09 (49.71%)
2023-09-08T11:41:51.560+05:30 [Info] Indexer CPU Utilization 0.6396
2023-09-08T11:41:51.560+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:51.560+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:51.560+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:51.561+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:51.561+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:51.561+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:51.561+05:30 [Info] Indexer Data Size Mean 294590401864 (274.359G)
2023-09-08T11:41:51.561+05:30 [Info] Indexer Data Size Deviation 7093767384 (6.60659G) (2.41%)
2023-09-08T11:41:51.561+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:51.561+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:51.561+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:51.561+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:51 -------------------------------------------
2023/09/08 11:41:51 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2023-09-08T11:41:51.561+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:52.215+05:30 [Info] Score: 0.05610977853424668
2023-09-08T11:41:52.215+05:30 [Info] Memory Quota: 337068329797 (313.919G)
2023-09-08T11:41:52.215+05:30 [Info] CPU Quota: 20
2023-09-08T11:41:52.215+05:30 [Info] Indexer Memory Mean 241983849447 (225.365G)
2023-09-08T11:41:52.215+05:30 [Info] Indexer Memory Deviation 27155320402 (25.2904G) (11.22%)
2023-09-08T11:41:52.215+05:30 [Info] Indexer Memory Utilization 0.7179
2023-09-08T11:41:52.215+05:30 [Info] Indexer CPU Mean 8.2620
2023-09-08T11:41:52.215+05:30 [Info] Indexer CPU Deviation 3.32 (40.16%)
2023-09-08T11:41:52.215+05:30 [Info] Indexer CPU Utilization 0.4131
2023-09-08T11:41:52.215+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.215+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.215+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.215+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.215+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.215+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.215+05:30 [Info] Indexer Data Size Mean 241983849447 (225.365G)
2023-09-08T11:41:52.215+05:30 [Info] Indexer Data Size Deviation 27155320402 (25.2904G) (11.22%)
2023-09-08T11:41:52.215+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.215+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.215+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.215+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 initial placement - 6 2M index, 1 replica, 2x
2023-09-08T11:41:52.226+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:52.242+05:30 [Info] Score: 0
2023-09-08T11:41:52.242+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2023-09-08T11:41:52.242+05:30 [Info] CPU Quota: 2
2023-09-08T11:41:52.242+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2023-09-08T11:41:52.242+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.242+05:30 [Info] Indexer Memory Utilization 0.4290
2023-09-08T11:41:52.242+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-08T11:41:52.242+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:52.242+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-08T11:41:52.242+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.242+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.242+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.242+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.242+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.242+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.242+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2023-09-08T11:41:52.242+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.242+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.242+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.242+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.242+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 initial placement - 5 20M primary index, 2 replica, 2x
2023-09-08T11:41:52.253+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:52.293+05:30 [Info] Score: 0
2023-09-08T11:41:52.293+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2023-09-08T11:41:52.293+05:30 [Info] CPU Quota: 2
2023-09-08T11:41:52.293+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2023-09-08T11:41:52.293+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.293+05:30 [Info] Indexer Memory Utilization 0.7659
2023-09-08T11:41:52.293+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-08T11:41:52.293+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:52.293+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-08T11:41:52.293+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.293+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.293+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.293+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.293+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.293+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.293+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2023-09-08T11:41:52.293+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.293+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.293+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.293+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.293+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 initial placement - 5 20M array index, 2 replica, 2x
2023-09-08T11:41:52.303+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:52.343+05:30 [Info] Score: 0
2023-09-08T11:41:52.343+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2023-09-08T11:41:52.343+05:30 [Info] CPU Quota: 2
2023-09-08T11:41:52.343+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2023-09-08T11:41:52.343+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.343+05:30 [Info] Indexer Memory Utilization 0.8063
2023-09-08T11:41:52.343+05:30 [Info] Indexer CPU Mean 1.2000
2023-09-08T11:41:52.343+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:52.343+05:30 [Info] Indexer CPU Utilization 0.6000
2023-09-08T11:41:52.343+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.343+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.343+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.343+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.343+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.343+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.343+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2023-09-08T11:41:52.343+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.343+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.343+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.343+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.343+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 initial placement - 3 replica constraint, 2 index, 2x
2023-09-08T11:41:52.347+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:52.383+05:30 [Info] Score: 0
2023-09-08T11:41:52.384+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-08T11:41:52.384+05:30 [Info] CPU Quota: 2
2023-09-08T11:41:52.384+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-08T11:41:52.384+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.384+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-08T11:41:52.384+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:52.384+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:52.384+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:52.384+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.384+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.384+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.384+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.384+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.384+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.384+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-08T11:41:52.384+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.384+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.384+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.384+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.384+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2023-09-08T11:41:52.395+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.03177677223869018
2023-09-08T11:41:52.523+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:52.523+05:30 [Info] Score: 0.007189938568471697
2023-09-08T11:41:52.523+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2023-09-08T11:41:52.523+05:30 [Info] CPU Quota: 27
2023-09-08T11:41:52.523+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2023-09-08T11:41:52.523+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2023-09-08T11:41:52.523+05:30 [Info] Indexer Memory Utilization 0.5679
2023-09-08T11:41:52.523+05:30 [Info] Indexer CPU Mean 20.1734
2023-09-08T11:41:52.523+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2023-09-08T11:41:52.523+05:30 [Info] Indexer CPU Utilization 0.7472
2023-09-08T11:41:52.523+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.523+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.523+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.523+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.523+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.523+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.523+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2023-09-08T11:41:52.523+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2023-09-08T11:41:52.523+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.523+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.523+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.523+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2023-09-08T11:41:52.536+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0029623828364263066
2023-09-08T11:41:52.783+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:52.783+05:30 [Info] Score: 0.00043718596495524715
2023-09-08T11:41:52.783+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-08T11:41:52.783+05:30 [Info] CPU Quota: 20
2023-09-08T11:41:52.783+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2023-09-08T11:41:52.783+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2023-09-08T11:41:52.783+05:30 [Info] Indexer Memory Utilization 0.7321
2023-09-08T11:41:52.783+05:30 [Info] Indexer CPU Mean 14.2305
2023-09-08T11:41:52.783+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2023-09-08T11:41:52.783+05:30 [Info] Indexer CPU Utilization 0.7115
2023-09-08T11:41:52.783+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.783+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.783+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.783+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.783+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.783+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.784+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2023-09-08T11:41:52.784+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2023-09-08T11:41:52.784+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.784+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.784+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.784+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 incr placement - 3 server group, 3 replica, 1x
2023-09-08T11:41:52.786+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.816496580927726
2023-09-08T11:41:52.812+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:52.812+05:30 [Info] Score: 0
2023-09-08T11:41:52.812+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-08T11:41:52.812+05:30 [Info] CPU Quota: 16
2023-09-08T11:41:52.812+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-08T11:41:52.812+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.812+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-08T11:41:52.812+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:52.812+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:52.812+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:52.812+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.812+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.812+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.812+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.812+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.812+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.812+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-08T11:41:52.812+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.812+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.812+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.812+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.812+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 incr placement - 2 server group, 3 replica, 1x
2023-09-08T11:41:52.814+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2023-09-08T11:41:52.814+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2023-09-08T11:41:52.814+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2023-09-08T11:41:52.814+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.816496580927726
2023-09-08T11:41:52.840+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:52.840+05:30 [Info] Score: 0
2023-09-08T11:41:52.840+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-09-08T11:41:52.840+05:30 [Info] CPU Quota: 16
2023-09-08T11:41:52.840+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-09-08T11:41:52.840+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.840+05:30 [Info] Indexer Memory Utilization 0.0049
2023-09-08T11:41:52.840+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:52.840+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:52.840+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:52.840+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:52.840+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:52.840+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:52.840+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.840+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:52.840+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:52.840+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-09-08T11:41:52.840+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:52.840+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:52.840+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:52.840+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:52.841+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:52 -------------------------------------------
2023/09/08 11:41:52 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2023-09-08T11:41:52.843+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.170798088299117
2023-09-08T11:41:52.843+05:30 [Info] Planner::initial temperature: initial resource variation 0.170798088299117 temp 0.0170798088299117
2023-09-08T11:41:53.031+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:53.031+05:30 [Info] Score: 0.15820535689718657
2023-09-08T11:41:53.031+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-09-08T11:41:53.031+05:30 [Info] CPU Quota: 30
2023-09-08T11:41:53.031+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-09-08T11:41:53.031+05:30 [Info] Indexer Memory Deviation 2331987559 (2.17183G) (2.62%)
2023-09-08T11:41:53.031+05:30 [Info] Indexer Memory Utilization 0.6367
2023-09-08T11:41:53.031+05:30 [Info] Indexer CPU Mean 24.0538
2023-09-08T11:41:53.031+05:30 [Info] Indexer CPU Deviation 3.63 (15.09%)
2023-09-08T11:41:53.031+05:30 [Info] Indexer CPU Utilization 0.8018
2023-09-08T11:41:53.031+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:53.031+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:53.031+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:53.031+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:53.031+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:53.031+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:53.031+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-09-08T11:41:53.031+05:30 [Info] Indexer Data Size Deviation 2331987559 (2.17183G) (2.62%)
2023-09-08T11:41:53.031+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2023-09-08T11:41:53.031+05:30 [Info] Index Data Moved (exclude new node) 293.991G (29.60%)
2023-09-08T11:41:53.031+05:30 [Info] No. Index (from non-deleted node) 90
2023-09-08T11:41:53.031+05:30 [Info] No. Index Moved (exclude new node) 27 (30.00%)
2023/09/08 11:41:53 -------------------------------------------
2023/09/08 11:41:53 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2023-09-08T11:41:53.034+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.44740101059067555
2023-09-08T11:41:53.034+05:30 [Info] Planner::initial temperature: initial resource variation 0.44740101059067555 temp 0.04474010105906756
2023-09-08T11:41:53.770+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:53.770+05:30 [Info] Score: 0.22780076867412374
2023-09-08T11:41:53.770+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-08T11:41:53.770+05:30 [Info] CPU Quota: 20
2023-09-08T11:41:53.770+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-09-08T11:41:53.770+05:30 [Info] Indexer Memory Deviation 25092726562 (23.3694G) (6.39%)
2023-09-08T11:41:53.770+05:30 [Info] Indexer Memory Utilization 0.7311
2023-09-08T11:41:53.770+05:30 [Info] Indexer CPU Mean 13.9305
2023-09-08T11:41:53.770+05:30 [Info] Indexer CPU Deviation 3.18 (22.85%)
2023-09-08T11:41:53.770+05:30 [Info] Indexer CPU Utilization 0.6965
2023-09-08T11:41:53.770+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:53.770+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:53.770+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:53.770+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:53.770+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:53.770+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:53.770+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-09-08T11:41:53.770+05:30 [Info] Indexer Data Size Deviation 25092726562 (23.3694G) (6.39%)
2023-09-08T11:41:53.770+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2023-09-08T11:41:53.770+05:30 [Info] Index Data Moved (exclude new node) 2.39491T (55.91%)
2023-09-08T11:41:53.770+05:30 [Info] No. Index (from non-deleted node) 90
2023-09-08T11:41:53.770+05:30 [Info] No. Index Moved (exclude new node) 25 (27.78%)
2023/09/08 11:41:53 -------------------------------------------
2023/09/08 11:41:53 rebalance - travel sample, 10% shuffle, 1x
2023-09-08T11:41:53.771+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.26630044091806737
2023-09-08T11:41:53.771+05:30 [Info] Planner::initial temperature: initial resource variation 0.26630044091806737 temp 0.026630044091806738
2023-09-08T11:41:53.796+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:53.796+05:30 [Info] Score: 0.04715225965046212
2023-09-08T11:41:53.796+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-08T11:41:53.796+05:30 [Info] CPU Quota: 8
2023-09-08T11:41:53.796+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-09-08T11:41:53.796+05:30 [Info] Indexer Memory Deviation 1632564 (1.55693M) (9.33%)
2023-09-08T11:41:53.796+05:30 [Info] Indexer Memory Utilization 0.0326
2023-09-08T11:41:53.796+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:53.796+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:53.796+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:53.796+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:53.796+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:53.796+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:53.796+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:53.796+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:53.796+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:53.796+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-08T11:41:53.796+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:53.796+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:53.796+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:53.796+05:30 [Info] No. Index (from non-deleted node) 10
2023-09-08T11:41:53.796+05:30 [Info] No. Index Moved (exclude new node) 1 (10.00%)
2023/09/08 11:41:53 -------------------------------------------
2023/09/08 11:41:53 rebalance - 20-50M, 90 index, swap 2, 1x
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-09-08T11:41:53.798+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-09-08T11:41:53.798+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4095843409677649
2023-09-08T11:41:53.798+05:30 [Info] Planner::initial temperature: initial resource variation 0.4095843409677649 temp 0.04095843409677649
2023-09-08T11:41:53.989+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:53.989+05:30 [Info] Score: 0.015217194774278258
2023-09-08T11:41:53.989+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-09-08T11:41:53.989+05:30 [Info] CPU Quota: 30
2023-09-08T11:41:53.989+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-09-08T11:41:53.989+05:30 [Info] Indexer Memory Deviation 2704904114 (2.51914G) (3.04%)
2023-09-08T11:41:53.989+05:30 [Info] Indexer Memory Utilization 0.6367
2023-09-08T11:41:53.989+05:30 [Info] Indexer CPU Mean 24.0538
2023-09-08T11:41:53.989+05:30 [Info] Indexer CPU Deviation 0.82 (3.40%)
2023-09-08T11:41:53.989+05:30 [Info] Indexer CPU Utilization 0.8018
2023-09-08T11:41:53.989+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:53.989+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:53.989+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:53.989+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:53.989+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:53.989+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:53.989+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-09-08T11:41:53.990+05:30 [Info] Indexer Data Size Deviation 2704904114 (2.51914G) (3.04%)
2023-09-08T11:41:53.990+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:53.990+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:53.990+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:53.990+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:53 -------------------------------------------
2023/09/08 11:41:53 rebalance - mixed small/medium, 90 index, swap 2, 1x
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1823804162
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2949882636
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 281908850
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 672245080
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 416480912
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1292406600
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2212821389
2023-09-08T11:41:53.991+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 3494557023
2023-09-08T11:41:53.991+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4082556623939647
2023-09-08T11:41:53.992+05:30 [Info] Planner::initial temperature: initial resource variation 0.4082556623939647 temp 0.040825566239396475
2023-09-08T11:41:54.132+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:54.132+05:30 [Info] Score: 0.0010523284974571707
2023-09-08T11:41:54.132+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-09-08T11:41:54.132+05:30 [Info] CPU Quota: 20
2023-09-08T11:41:54.132+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-09-08T11:41:54.132+05:30 [Info] Indexer Memory Deviation 826089661 (787.82M) (0.21%)
2023-09-08T11:41:54.132+05:30 [Info] Indexer Memory Utilization 0.7311
2023-09-08T11:41:54.132+05:30 [Info] Indexer CPU Mean 13.9305
2023-09-08T11:41:54.132+05:30 [Info] Indexer CPU Deviation 1.69 (12.12%)
2023-09-08T11:41:54.132+05:30 [Info] Indexer CPU Utilization 0.6965
2023-09-08T11:41:54.132+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:54.132+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:54.132+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:54.132+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:54.132+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:54.132+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:54.132+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-09-08T11:41:54.132+05:30 [Info] Indexer Data Size Deviation 826089661 (787.82M) (0.21%)
2023-09-08T11:41:54.132+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:54.132+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:54.132+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:54.132+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:54 -------------------------------------------
2023/09/08 11:41:54 rebalance - travel sample, swap 2, 1x
2023-09-08T11:41:54.133+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 192.168.1.8:9000
2023-09-08T11:41:54.133+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-08T11:41:54.133+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0086622738872069
2023-09-08T11:41:54.133+05:30 [Info] Planner::initial temperature: initial resource variation 1.0086622738872069 temp 0.1008662273887207
2023-09-08T11:41:54.267+05:30 [Info] Score: 0.00031929273712825843
2023-09-08T11:41:54.267+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-08T11:41:54.267+05:30 [Info] CPU Quota: 8
2023-09-08T11:41:54.267+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-09-08T11:41:54.267+05:30 [Info] Indexer Memory Deviation 22354 (21.8301K) (0.13%)
2023-09-08T11:41:54.267+05:30 [Info] Indexer Memory Utilization 0.0326
2023-09-08T11:41:54.267+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:54.267+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:54.267+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:54.267+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:54.267+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:54.267+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:54.267+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:54.267+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:54.267+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:54.267+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-08T11:41:54.267+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:54.267+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:54.267+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:54.267+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:54.267+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:54 -------------------------------------------
2023/09/08 11:41:54 rebalance - 8 identical index, add 4, 1x
2023-09-08T11:41:54.268+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2596996162
2023-09-08T11:41:54.268+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 4039455774
2023-09-08T11:41:54.268+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 2854263694
2023-09-08T11:41:54.268+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 1879968118
2023-09-08T11:41:54.268+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1
2023-09-08T11:41:54.268+05:30 [Info] Planner::initial temperature: initial resource variation 1 temp 0.1
2023-09-08T11:41:54.449+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T11:41:54.456+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T11:41:54.456+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T11:41:54.456+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T11:41:54.456+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T11:41:54.457+05:30 [Info] switched currmeta from 486 -> 486 force true
2023-09-08T11:41:54.457+05:30 [Info] switched currmeta from 490 -> 490 force true
2023-09-08T11:41:58.126+05:30 [Info] Score: 0
2023-09-08T11:41:58.126+05:30 [Info] Memory Quota: 930294000 (887.197M)
2023-09-08T11:41:58.126+05:30 [Info] CPU Quota: 2
2023-09-08T11:41:58.126+05:30 [Info] Indexer Memory Mean 260000000 (247.955M)
2023-09-08T11:41:58.126+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:58.126+05:30 [Info] Indexer Memory Utilization 0.2795
2023-09-08T11:41:58.126+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:58.126+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:58.126+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:58.126+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:58.126+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:58.126+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:58.126+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:58.126+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:58.126+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:58.126+05:30 [Info] Indexer Data Size Mean 260000000 (247.955M)
2023-09-08T11:41:58.126+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:58.126+05:30 [Info] Total Index Data (from non-deleted node) 1.93715G
2023-09-08T11:41:58.126+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:58.126+05:30 [Info] No. Index (from non-deleted node) 8
2023-09-08T11:41:58.126+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:58 -------------------------------------------
2023/09/08 11:41:58 rebalance - 8 identical index, delete 2, 2x
2023-09-08T11:41:58.126+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:41:58.127+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023-09-08T11:41:58.172+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:41:58.172+05:30 [Info] Score: 0
2023-09-08T11:41:58.172+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2023-09-08T11:41:58.172+05:30 [Info] CPU Quota: 4
2023-09-08T11:41:58.172+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2023-09-08T11:41:58.172+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:58.172+05:30 [Info] Indexer Memory Utilization 0.0098
2023-09-08T11:41:58.172+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:58.172+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:58.172+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:58.172+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:58.172+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:58.172+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:58.172+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:58.172+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:58.172+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:58.172+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2023-09-08T11:41:58.172+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:58.172+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:58.172+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:58.172+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:58.172+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:58 -------------------------------------------
2023/09/08 11:41:58 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2023-09-08T11:41:58.173+05:30 [Warn] There is more replica than available nodes. Will not move index replica (default,,,country) from ejected node 127.0.0.1:9003
2023-09-08T11:41:58.173+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-08T11:41:58.173+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-08T11:41:58.173+05:30 [Info] Score: 0
2023-09-08T11:41:58.173+05:30 [Info] Memory Quota: 536870912 (512M)
2023-09-08T11:41:58.173+05:30 [Info] CPU Quota: 16
2023-09-08T11:41:58.173+05:30 [Info] Indexer Memory Mean 0 (0)
2023-09-08T11:41:58.173+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:58.173+05:30 [Info] Indexer Memory Utilization 0.0000
2023-09-08T11:41:58.173+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:58.173+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:58.173+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:58.173+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:58.173+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:58.173+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:58.173+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:58.173+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:58.173+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:58.173+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-08T11:41:58.173+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:58.173+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:58.173+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:58.173+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:58.173+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:58 -------------------------------------------
2023/09/08 11:41:58 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2023-09-08T11:41:58.174+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-08T11:41:58.174+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-08T11:41:58.174+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9003
2023-09-08T11:41:58.174+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-08T11:41:58.174+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-08T11:41:58.174+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-08T11:41:58.174+05:30 [Info] Score: 0
2023-09-08T11:41:58.174+05:30 [Info] Memory Quota: 268435456 (256M)
2023-09-08T11:41:58.174+05:30 [Info] CPU Quota: 8
2023-09-08T11:41:58.174+05:30 [Info] Indexer Memory Mean 0 (0)
2023-09-08T11:41:58.174+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-09-08T11:41:58.174+05:30 [Info] Indexer Memory Utilization 0.0000
2023-09-08T11:41:58.174+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:41:58.174+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:41:58.174+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:41:58.174+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:41:58.174+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:41:58.174+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:41:58.174+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:58.174+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:41:58.174+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:41:58.174+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-08T11:41:58.174+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:41:58.174+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:41:58.174+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:41:58.174+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:41:58.174+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/09/08 11:41:58 -------------------------------------------
2023/09/08 11:41:58 Minimum memory test 1: min memory = 0
2023-09-08T11:41:58.175+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-08T11:41:58.175+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-08T11:41:58.177+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/08 11:41:58 -------------------------------------------
2023/09/08 11:41:58 Minimum memory test 2: min memory > quota
2023-09-08T11:41:58.178+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-08T11:41:58.178+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-09-08T11:41:58.178+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=4us
2023-09-08T11:41:58.178+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-08T11:41:58.178+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/09/08 11:41:59 -------------------------------------------
2023/09/08 11:41:59 Minimum memory test 3: min memory < quota
2023-09-08T11:41:59.202+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-08T11:41:59.202+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Minimum memory test 4: replica repair with min memory > quota
2023-09-08T11:42:01.530+05:30 [Info] Rebuilding lost replica for (default,,,country,0,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.530+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=7us
2023-09-08T11:42:01.531+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=9us
2023-09-08T11:42:01.531+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-08T11:42:01.531+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-08T11:42:01.531+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-08T11:42:01.531+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-08T11:42:01.531+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:01.531+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=309us
2023-09-08T11:42:01.531+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-08T11:42:01.531+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-08T11:42:01.531+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-08T11:42:01.531+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:01.531+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=325us
2023-09-08T11:42:01.531+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster. Will not rebuild lost replica.
2023-09-08T11:42:01.531+05:30 [Warn]
MemoryQuota: 200
CpuQuota: 8
--- Violations for index (mem 130, cpu 0) at node 127.0.0.1:9003
Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2023-09-08T11:42:01.531+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-09-08T11:42:01.532+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0 is less than threshold: 0. No nodes have been added or deleted and there are no violations observed
2023-09-08T11:42:01.532+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Minimum memory test 5: replica repair with min memory < quota
2023-09-08T11:42:01.532+05:30 [Info] Rebuilding lost replica for (default,,,country,0,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.532+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-09-08T11:42:01.532+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-09-08T11:42:01.544+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Minimum memory test 6: rebalance with min memory > quota
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=6us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=7us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=5us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=7us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=6us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=5us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=5us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=7us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=7us
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=8us
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Minimum memory test 7: rebalance-out with min memory > quota
2023-09-08T11:42:01.545+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-08T11:42:01.546+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-09-08T11:42:01.546+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-09-08T11:42:01.546+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-08T11:42:01.546+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=5us
2023-09-08T11:42:01.546+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=5us
2023-09-08T11:42:01.546+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-08T11:42:01.546+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-09-08T11:42:01.546+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-09-08T11:42:01.546+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Minimum memory test 8: plan with min memory > quota
2023-09-08T11:42:01.549+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-09-08T11:42:01.550+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-08T11:42:01.550+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:01.550+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=951us
2023-09-08T11:42:01.550+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-09-08T11:42:01.550+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-08T11:42:01.550+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=4us
2023-09-08T11:42:01.550+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=4us
2023-09-08T11:42:01.550+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=3us
2023-09-08T11:42:01.550+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-08T11:42:01.550+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2023-09-08T11:42:01.550+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Minimum memory test 9: single node rebalance with min memory > quota
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=7us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=4us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=3us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=3us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=3us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=4us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=5us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=3us
2023-09-08T11:42:01.551+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=4us
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Minimum memory test 10: plan with partitioned index on empty cluster
2023-09-08T11:42:01.553+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.7071067811865476
2023-09-08T11:42:01.596+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 iterationTest :: Remove one node - failure
2023-09-08T11:42:01.597+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3069885437599087
2023-09-08T11:42:01.676+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:01.676+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.676+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.677+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.677+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.677+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13585171478142072).
2023-09-08T11:42:01.677+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=380us
2023-09-08T11:42:01.677+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.677+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.677+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.677+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.677+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.22294437073754986).
2023-09-08T11:42:01.677+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=465us
2023-09-08T11:42:01.677+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.677+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.678+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.678+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.678+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.15265180025980649).
2023-09-08T11:42:01.678+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=483us
2023-09-08T11:42:01.678+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.678+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.678+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.678+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.678+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1503564324412705).
2023-09-08T11:42:01.678+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=456us
2023-09-08T11:42:01.678+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.678+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.679+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.679+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.679+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12439979642987718).
2023-09-08T11:42:01.679+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=474us
2023-09-08T11:42:01.679+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.679+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.679+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.679+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.679+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.15265180025980649).
2023-09-08T11:42:01.679+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=453us
2023-09-08T11:42:01.679+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-08T11:42:01.679+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.679+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.680+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.680+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.680+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12439979642987718).
2023-09-08T11:42:01.680+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=505us
2023-09-08T11:42:01.680+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.680+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.680+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.680+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.680+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.16540237520564927).
2023-09-08T11:42:01.680+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=477us
2023-09-08T11:42:01.680+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.681+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.681+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.681+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.681+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.08594774085529973).
2023-09-08T11:42:01.681+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=448us
2023-09-08T11:42:01.681+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.681+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.681+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.681+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.681+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13326078913539552).
2023-09-08T11:42:01.681+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=477us
2023-09-08T11:42:01.681+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.682+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.682+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.682+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.682+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.14651553441908924).
2023-09-08T11:42:01.682+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=462us
2023-09-08T11:42:01.682+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002297436197351408
2023-09-08T11:42:01.682+05:30 [Info] Planner::initial temperature: initial resource variation 0.002297436197351408 temp 0.03477025638026486
2023-09-08T11:42:01.682+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.682+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-09-08T11:42:01.682+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.17560521416957955).
2023-09-08T11:42:01.682+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=452us
2023-09-08T11:42:01.682+05:30 [Error]
MemoryQuota: 5302940000000
CpuQuota: 5
--- Violations for index <6371458849773606569, bucket1, , > (mem 23.0209G, cpu 2.9241200000000003) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64158T, free cpu -35.7628)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64459T, free cpu -28.7498)
--- Violations for index <6733478100293306612, bucket1, , > (mem 20.1883G, cpu 4.88116) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64158T, free cpu -35.7628)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64459T, free cpu -28.7498)
--- Violations for index <5639814619761131734, bucket1, , > (mem 22.1385G, cpu 4.9375599999999995) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64158T, free cpu -35.7628)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64459T, free cpu -28.7498)
--- Violations for index <655221451365265143, bucket1, , > (mem 12.6636G, cpu 4.7815199999999995) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64158T, free cpu -35.7628)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64459T, free cpu -28.7498)
--- Violations for index <3841478892841291281, bucket1, , > (mem 17.1726G, cpu 3.34776) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64158T, free cpu -35.7628)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64459T, free cpu -28.7498)
--- Violations for index <3570784542879315724, bucket1, , > (mem 9.53582G, cpu 1.8980000000000001) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64158T, free cpu -35.7628)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64459T, free cpu -28.7498)
--- Violations for index <16935389501211625965, bucket1, , > (mem 8.64077G, cpu 4.6738800000000005) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64158T, free cpu -35.7628)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64459T, free cpu -28.7498)
--- Violations for index <17349611492963252346, bucket1, , > (mem 11.9336G, cpu 3.28916) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64158T, free cpu -35.7628)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.64459T, free cpu -28.7498)
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 iterationTest :: Remove one node - success
2023-09-08T11:42:01.683+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2338046561754819
2023-09-08T11:42:01.773+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:01.773+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.018274379066301246
2023-09-08T11:42:01.773+05:30 [Info] Planner::initial temperature: initial resource variation 0.018274379066301246 temp 0.023172562093369875
2023-09-08T11:42:01.773+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-09-08T11:42:01.773+05:30 [Info] Planner::Finished planner run after 10 iterations.
2023-09-08T11:42:01.773+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.15419776828829296).
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 iterationTest :: Index rebuild - success
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i0,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i5,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i10,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i13,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i15,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i18,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i22,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i4,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i8,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i11,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i24,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i26,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.776+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i28,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i23,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i27,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i6,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i12,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i14,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i20,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i17,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i19,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i21,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i25,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i29,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i7,1,0) with initial placement on node: 172.16.30.75:9000
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i9,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-08T11:42:01.777+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i16,1,0) with initial placement on node: 127.0.0.1:9001
2023-09-08T11:42:01.778+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.590668171555645
2023-09-08T11:42:01.778+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0.590668171555645 is less than threshold: 0.8. No nodes have been added or deleted and there are no violations observed
2023-09-08T11:42:01.778+05:30 [Info] Planner::initial temperature: initial resource variation 0.590668171555645 temp 0.020933182844435506
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 iterationTest :: Index rebuild - initial placement - success
2023-09-08T11:42:01.779+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-09-08T11:42:01.779+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-08T11:42:01.779+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-08T11:42:01.779+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.779+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.779+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.779+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6236095644623236
2023-09-08T11:42:01.779+05:30 [Info] Planner::initial temperature: initial resource variation 0.6236095644623236 temp 0.03663904355376764
2023-09-08T11:42:01.779+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:01.779+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:01.779+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.6236095644623236).
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 iterationTest :: Index rebuild - initial placement - numReplica > numSG - success
2023-09-08T11:42:01.780+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9000
2023-09-08T11:42:01.780+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9001
2023-09-08T11:42:01.780+05:30 [Info] Planner::setExcludeInForNonEmptyNodes Set Exclude=in for 127.0.0.1:9002
2023-09-08T11:42:01.780+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.780+05:30 [Info] Rebuilding lost replica for (default,,,idx1,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-08T11:42:01.780+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.780+05:30 [Info] Rebuilding lost replica for (default,,,idx2,2,0) with initial placement on node: 127.0.0.1:9002
2023-09-08T11:42:01.780+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:01.780+05:30 [Info] Rebuilding lost replica for (default,,,idx3,2,0) with initial placement on node: 127.0.0.1:9000
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-09-08T11:42:01.780+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-09-08T11:42:01.781+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-09-08T11:42:01.781+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-09-08T11:42:01.781+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-09-08T11:42:01.781+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-09-08T11:42:01.781+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.24845199749997662
2023-09-08T11:42:01.781+05:30 [Info] Planner::initial temperature: initial resource variation 0.24845199749997662 temp 0.07415480025000235
2023-09-08T11:42:01.781+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:01.781+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:01.781+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.24845199749997662).
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 scaling with excludeIn - 8 identical index, add 1, 1x
2023-09-08T11:42:01.781+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-09-08T11:42:01.781+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 swap with excludeIn - 8 identical index, add 1, 1x
2023-09-08T11:42:01.932+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5
2023-09-08T11:42:01.932+05:30 [Info] Planner::initial temperature: initial resource variation 0.5 temp 0.05
2023-09-08T11:42:01.932+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 replica repair with excludeIn - 3 replica, 4 zone, delete 1, 1x
2023-09-08T11:42:01.933+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-09-08T11:42:01.933+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-09-08T11:42:01.933+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 heterogenous rebalance - keep vertically scaled Node, swap 1, 1x
2023-09-08T11:42:01.934+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.1237823254333867
2023-09-08T11:42:01.934+05:30 [Info] Planner::initial temperature: initial resource variation 1.1237823254333867 temp 0.11237823254333867
2023-09-08T11:42:01.934+05:30 [Info] Planner::finalizing the solution as final solution is found.
--- PASS: TestPlanner (12.83s)
=== RUN TestGreedyPlanner
2023/09/08 11:42:01 In TestGreedyPlanner()
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Single Index Instance - 3 empty nodes - 1 SG
2023-09-08T11:42:01.937+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Single Index Instance - 2 empty nodes, 1 non-empty node - 1 SG
2023-09-08T11:42:01.939+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Single Index Instance - 1 empty node, 2 non-empty nodes - 1 SG
2023-09-08T11:42:01.941+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Single Index Instance - 3 non-empty nodes - 1 SG
2023-09-08T11:42:01.943+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 1 Replica - 3 empty nodes - 1 SG
2023-09-08T11:42:01.945+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 1 SG
2023-09-08T11:42:01.946+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 1 SG
2023-09-08T11:42:01.948+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 1 Replica - 3 non-empty nodes - 1 SG
2023-09-08T11:42:01.950+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 2 Replica - 3 empty nodes - 1 SG
2023-09-08T11:42:01.952+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 2 Replica - 3 non-empty nodes - 1 SG
2023-09-08T11:42:01.954+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 2 SG
2023-09-08T11:42:01.956+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 2 SG
2023-09-08T11:42:01.958+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Index With 1 Replica - 3 non-empty nodes - 2 SG
2023-09-08T11:42:01.960+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Equivalent Index Without any replica - 3 non-empty nodes - 1 SG
2023-09-08T11:42:01.963+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Skip least loaded node
2023-09-08T11:42:01.965+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Use least loaded node
2023-09-08T11:42:01.967+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:01 -------------------------------------------
2023/09/08 11:42:01 Place 60 index instaces on 3 empty nodes - 1 SG
2023-09-08T11:42:01.969+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-08T11:42:01.971+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-08T11:42:01.973+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-08T11:42:01.974+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-08T11:42:01.976+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-08T11:42:01.978+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-08T11:42:01.980+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-08T11:42:01.981+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-08T11:42:01.983+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-08T11:42:01.984+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-08T11:42:01.986+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-08T11:42:01.988+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-08T11:42:01.990+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-08T11:42:01.991+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-08T11:42:01.993+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-08T11:42:01.995+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-08T11:42:01.996+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-08T11:42:01.999+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-08T11:42:02.000+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-08T11:42:02.002+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-08T11:42:02.004+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-08T11:42:02.005+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-08T11:42:02.007+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-08T11:42:02.009+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-08T11:42:02.011+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-08T11:42:02.013+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-08T11:42:02.015+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-08T11:42:02.016+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-08T11:42:02.018+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-08T11:42:02.020+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-08T11:42:02.022+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-08T11:42:02.023+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-08T11:42:02.025+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-08T11:42:02.027+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-08T11:42:02.028+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-08T11:42:02.030+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-08T11:42:02.032+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-08T11:42:02.034+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-08T11:42:02.036+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-08T11:42:02.037+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-08T11:42:02.039+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-08T11:42:02.041+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-08T11:42:02.042+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-08T11:42:02.044+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-08T11:42:02.046+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-08T11:42:02.047+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-08T11:42:02.049+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-08T11:42:02.051+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-08T11:42:02.052+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-08T11:42:02.054+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-08T11:42:02.056+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-08T11:42:02.057+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-08T11:42:02.059+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-08T11:42:02.061+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-08T11:42:02.063+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-08T11:42:02.064+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-08T11:42:02.066+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-08T11:42:02.068+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-08T11:42:02.069+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-08T11:42:02.071+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-08T11:42:02.071+05:30 [Info] Actual variance of deferred index count across nodes is 0
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place 60 index instaces on 1 empty and 1 10 percent filled node - 1 SG
2023-09-08T11:42:02.073+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-08T11:42:02.075+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-08T11:42:02.077+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-08T11:42:02.078+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-08T11:42:02.080+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-08T11:42:02.082+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-08T11:42:02.083+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-08T11:42:02.085+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-08T11:42:02.087+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-08T11:42:02.088+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-08T11:42:02.090+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-08T11:42:02.091+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-08T11:42:02.093+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-08T11:42:02.094+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-08T11:42:02.096+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-08T11:42:02.098+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-08T11:42:02.099+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-08T11:42:02.101+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-08T11:42:02.103+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-08T11:42:02.104+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-08T11:42:02.106+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-08T11:42:02.108+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-08T11:42:02.109+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-08T11:42:02.111+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-08T11:42:02.113+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-08T11:42:02.115+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-08T11:42:02.116+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-08T11:42:02.118+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-08T11:42:02.120+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-08T11:42:02.121+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-08T11:42:02.123+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-08T11:42:02.125+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-08T11:42:02.126+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-08T11:42:02.128+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-08T11:42:02.130+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-08T11:42:02.131+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-08T11:42:02.133+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-08T11:42:02.135+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-08T11:42:02.136+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-08T11:42:02.138+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-08T11:42:02.140+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-08T11:42:02.141+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-08T11:42:02.143+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-08T11:42:02.145+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-08T11:42:02.147+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-08T11:42:02.149+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-08T11:42:02.151+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-08T11:42:02.153+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-08T11:42:02.155+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-08T11:42:02.156+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-08T11:42:02.158+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-08T11:42:02.160+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-08T11:42:02.162+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-08T11:42:02.163+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-08T11:42:02.165+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-08T11:42:02.167+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-08T11:42:02.169+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-08T11:42:02.171+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-08T11:42:02.172+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-08T11:42:02.174+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-08T11:42:02.174+05:30 [Info] Actual variance of deferred index count across nodes is 8
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place 60 index instaces on 1 empty and 1 30 percent filled node - 1 SG
2023-09-08T11:42:02.176+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-08T11:42:02.178+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-08T11:42:02.180+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-08T11:42:02.181+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-08T11:42:02.183+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-08T11:42:02.185+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-08T11:42:02.186+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-08T11:42:02.188+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-08T11:42:02.190+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-08T11:42:02.191+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-08T11:42:02.193+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-08T11:42:02.195+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-08T11:42:02.196+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-08T11:42:02.198+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-08T11:42:02.200+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-08T11:42:02.202+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-08T11:42:02.204+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-08T11:42:02.206+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-08T11:42:02.208+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-08T11:42:02.210+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-08T11:42:02.211+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-08T11:42:02.213+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-08T11:42:02.215+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-08T11:42:02.216+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-08T11:42:02.218+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-08T11:42:02.220+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-08T11:42:02.222+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-08T11:42:02.224+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-08T11:42:02.226+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-08T11:42:02.227+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-08T11:42:02.229+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-08T11:42:02.231+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-08T11:42:02.232+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-08T11:42:02.234+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-08T11:42:02.236+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-08T11:42:02.238+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-08T11:42:02.239+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-08T11:42:02.241+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-08T11:42:02.242+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-08T11:42:02.244+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-08T11:42:02.246+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-08T11:42:02.248+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-08T11:42:02.250+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-08T11:42:02.251+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-08T11:42:02.253+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-08T11:42:02.255+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-08T11:42:02.257+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-08T11:42:02.259+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-08T11:42:02.260+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-08T11:42:02.262+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-08T11:42:02.264+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-08T11:42:02.266+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-08T11:42:02.267+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-08T11:42:02.269+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-08T11:42:02.271+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-08T11:42:02.272+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-08T11:42:02.274+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-08T11:42:02.276+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-08T11:42:02.278+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-08T11:42:02.279+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-08T11:42:02.279+05:30 [Info] Actual variance of deferred index count across nodes is 98
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place 5 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-09-08T11:42:02.281+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-08T11:42:02.283+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-08T11:42:02.285+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-08T11:42:02.287+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-08T11:42:02.288+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-08T11:42:02.288+05:30 [Info] Actual variance of deferred index count across nodes is 4.5
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place 60 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-09-08T11:42:02.290+05:30 [Info] Using greedy index placement for index 1000987654
2023-09-08T11:42:02.292+05:30 [Info] Using greedy index placement for index 1001987654
2023-09-08T11:42:02.293+05:30 [Info] Using greedy index placement for index 1002987654
2023-09-08T11:42:02.295+05:30 [Info] Using greedy index placement for index 1003987654
2023-09-08T11:42:02.297+05:30 [Info] Using greedy index placement for index 1004987654
2023-09-08T11:42:02.298+05:30 [Info] Using greedy index placement for index 1005987654
2023-09-08T11:42:02.300+05:30 [Info] Using greedy index placement for index 1006987654
2023-09-08T11:42:02.302+05:30 [Info] Using greedy index placement for index 1007987654
2023-09-08T11:42:02.304+05:30 [Info] Using greedy index placement for index 1008987654
2023-09-08T11:42:02.305+05:30 [Info] Using greedy index placement for index 1009987654
2023-09-08T11:42:02.307+05:30 [Info] Using greedy index placement for index 1010987654
2023-09-08T11:42:02.309+05:30 [Info] Using greedy index placement for index 1011987654
2023-09-08T11:42:02.311+05:30 [Info] Using greedy index placement for index 1012987654
2023-09-08T11:42:02.312+05:30 [Info] Using greedy index placement for index 1013987654
2023-09-08T11:42:02.314+05:30 [Info] Using greedy index placement for index 1014987654
2023-09-08T11:42:02.316+05:30 [Info] Using greedy index placement for index 1015987654
2023-09-08T11:42:02.318+05:30 [Info] Using greedy index placement for index 1016987654
2023-09-08T11:42:02.320+05:30 [Info] Using greedy index placement for index 1017987654
2023-09-08T11:42:02.322+05:30 [Info] Using greedy index placement for index 1018987654
2023-09-08T11:42:02.323+05:30 [Info] Using greedy index placement for index 1019987654
2023-09-08T11:42:02.326+05:30 [Info] Using greedy index placement for index 1020987654
2023-09-08T11:42:02.328+05:30 [Info] Using greedy index placement for index 1021987654
2023-09-08T11:42:02.329+05:30 [Info] Using greedy index placement for index 1022987654
2023-09-08T11:42:02.331+05:30 [Info] Using greedy index placement for index 1023987654
2023-09-08T11:42:02.333+05:30 [Info] Using greedy index placement for index 1024987654
2023-09-08T11:42:02.335+05:30 [Info] Using greedy index placement for index 1025987654
2023-09-08T11:42:02.336+05:30 [Info] Using greedy index placement for index 1026987654
2023-09-08T11:42:02.338+05:30 [Info] Using greedy index placement for index 1027987654
2023-09-08T11:42:02.340+05:30 [Info] Using greedy index placement for index 1028987654
2023-09-08T11:42:02.342+05:30 [Info] Using greedy index placement for index 1029987654
2023-09-08T11:42:02.343+05:30 [Info] Using greedy index placement for index 1030987654
2023-09-08T11:42:02.345+05:30 [Info] Using greedy index placement for index 1031987654
2023-09-08T11:42:02.347+05:30 [Info] Using greedy index placement for index 1032987654
2023-09-08T11:42:02.348+05:30 [Info] Using greedy index placement for index 1033987654
2023-09-08T11:42:02.350+05:30 [Info] Using greedy index placement for index 1034987654
2023-09-08T11:42:02.352+05:30 [Info] Using greedy index placement for index 1035987654
2023-09-08T11:42:02.354+05:30 [Info] Using greedy index placement for index 1036987654
2023-09-08T11:42:02.356+05:30 [Info] Using greedy index placement for index 1037987654
2023-09-08T11:42:02.357+05:30 [Info] Using greedy index placement for index 1038987654
2023-09-08T11:42:02.359+05:30 [Info] Using greedy index placement for index 1039987654
2023-09-08T11:42:02.361+05:30 [Info] Using greedy index placement for index 1040987654
2023-09-08T11:42:02.363+05:30 [Info] Using greedy index placement for index 1041987654
2023-09-08T11:42:02.364+05:30 [Info] Using greedy index placement for index 1042987654
2023-09-08T11:42:02.366+05:30 [Info] Using greedy index placement for index 1043987654
2023-09-08T11:42:02.368+05:30 [Info] Using greedy index placement for index 1044987654
2023-09-08T11:42:02.369+05:30 [Info] Using greedy index placement for index 1045987654
2023-09-08T11:42:02.371+05:30 [Info] Using greedy index placement for index 1046987654
2023-09-08T11:42:02.373+05:30 [Info] Using greedy index placement for index 1047987654
2023-09-08T11:42:02.374+05:30 [Info] Using greedy index placement for index 1048987654
2023-09-08T11:42:02.376+05:30 [Info] Using greedy index placement for index 1049987654
2023-09-08T11:42:02.378+05:30 [Info] Using greedy index placement for index 1050987654
2023-09-08T11:42:02.379+05:30 [Info] Using greedy index placement for index 1051987654
2023-09-08T11:42:02.381+05:30 [Info] Using greedy index placement for index 1052987654
2023-09-08T11:42:02.383+05:30 [Info] Using greedy index placement for index 1053987654
2023-09-08T11:42:02.385+05:30 [Info] Using greedy index placement for index 1054987654
2023-09-08T11:42:02.386+05:30 [Info] Using greedy index placement for index 1055987654
2023-09-08T11:42:02.388+05:30 [Info] Using greedy index placement for index 1056987654
2023-09-08T11:42:02.390+05:30 [Info] Using greedy index placement for index 1057987654
2023-09-08T11:42:02.391+05:30 [Info] Using greedy index placement for index 1058987654
2023-09-08T11:42:02.393+05:30 [Info] Using greedy index placement for index 1059987654
2023-09-08T11:42:02.393+05:30 [Info] Actual variance of deferred index count across nodes is 648
--- PASS: TestGreedyPlanner (0.46s)
=== RUN TestTenantAwarePlanner
2023/09/08 11:42:02 In TestTenantAwarePlanner()
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 1 empty node - 1 SG
2023-09-08T11:42:02.395+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-09-08T11:42:02.395+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.395+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 empty nodes - 2 SG
2023-09-08T11:42:02.397+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9003 127.0.0.1:9002]]
2023-09-08T11:42:02.397+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.397+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9002]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 1 node - 1 SG
2023-09-08T11:42:02.399+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.399+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-09-08T11:42:02.399+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-09-08T11:42:02.399+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 2 nodes - 1 SG
2023-09-08T11:42:02.401+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.401+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.401+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-09-08T11:42:02.401+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-09-08T11:42:02.401+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(a)
2023-09-08T11:42:02.403+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.403+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.403+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9004 127.0.0.1:9003]]
2023-09-08T11:42:02.403+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9002]
2023-09-08T11:42:02.403+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(b)
2023-09-08T11:42:02.405+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.405+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.405+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9002]]
2023-09-08T11:42:02.405+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.405+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(c)
2023-09-08T11:42:02.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.407+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.407+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-08T11:42:02.407+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.407+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Memory Above LWM
2023-09-08T11:42:02.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-08T11:42:02.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.409+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-08T11:42:02.409+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.409+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.409+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Units Above LWM
2023-09-08T11:42:02.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.411+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-08T11:42:02.412+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.412+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5000 Tenants 0
2023-09-08T11:42:02.412+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.412+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.412+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(a)
2023-09-08T11:42:02.414+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.414+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-08T11:42:02.414+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.414+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-08T11:42:02.414+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.414+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.414+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(b)
2023-09-08T11:42:02.416+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.416+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-08T11:42:02.416+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.416+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-08T11:42:02.416+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.417+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.417+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Units HWM
2023-09-08T11:42:02.419+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 8000 Tenants 0
2023-09-08T11:42:02.419+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.419+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.419+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 8000 Tenants 0
2023-09-08T11:42:02.419+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-08T11:42:02.419+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.419+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-09-08T11:42:02.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-08T11:42:02.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-09-08T11:42:02.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-08T11:42:02.421+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-09-08T11:42:02.421+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.421+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.421+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-09-08T11:42:02.423+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.423+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.423+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.423+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-08T11:42:02.423+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.423+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-08T11:42:02.423+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.423+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-09-08T11:42:02.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.425+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.425+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-08T11:42:02.426+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.426+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-09-08T11:42:02.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-08T11:42:02.428+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.428+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-08T11:42:02.428+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.428+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-09-08T11:42:02.430+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.430+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.430+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.430+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.430+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9004]]
2023-09-08T11:42:02.430+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.430+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9004]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 2 empty nodes - 1 SG
2023-09-08T11:42:02.432+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-09-08T11:42:02.432+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.432+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9002]
2023-09-08T11:42:02.432+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9001]
2023-09-08T11:42:02.432+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Unable to find any valid SubCluster
2023/09/08 11:42:02 Expected error Planner not able to find any node for placement - Unable to find any valid SubCluster
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Memory HWM
2023-09-08T11:42:02.432+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-09-08T11:42:02.432+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.432+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.432+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-09-08T11:42:02.433+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-09-08T11:42:02.433+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.433+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2023/09/08 11:42:02 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Memory Above LWM
2023-09-08T11:42:02.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 680000000 Units 1000 Tenants 0
2023-09-08T11:42:02.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000 Tenants 0
2023-09-08T11:42:02.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 680000000 Units 1000 Tenants 0
2023-09-08T11:42:02.433+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000 Tenants 0
2023-09-08T11:42:02.433+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.433+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-09-08T11:42:02.433+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2023/09/08 11:42:02 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-09-08T11:42:02.434+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-08T11:42:02.434+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500 Tenants 0
2023-09-08T11:42:02.434+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 0 Units 4500 Tenants 0
2023-09-08T11:42:02.434+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-08T11:42:02.434+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500 Tenants 0
2023-09-08T11:42:02.434+05:30 [Error] Planner::validateSubClusterGrouping Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/09/08 11:42:02 Expected error Planner Constraint Violation. Node 127.0.0.1:9001 belongs to multiple subclusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9001 127.0.0.1:9003 127.0.0.1:9004]].
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes, rebalance in progress(inst version)
2023-09-08T11:42:02.434+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.434+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-08T11:42:02.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/08 11:42:02 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes, rebalance in progress(rstate)
2023-09-08T11:42:02.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.435+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/08 11:42:02 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes, rebalance in progress(rstate+inst version)
2023-09-08T11:42:02.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 50000000 Units 500 Tenants 0
2023-09-08T11:42:02.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip index 1111:1212:0 node 127.0.0.1:9003 from subCluster grouping. Rebalance in progress.
2023-09-08T11:42:02.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group node 127.0.0.1:9003 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/08 11:42:02 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 4 nodes, rebalance pending cleanup
2023-09-08T11:42:02.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.436+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Cannot group empty node 127.0.0.1:9004 due to in progress rebalance for all buckets on the node. map[bucket1:true]
2023/09/08 11:42:02 Expected error Rebalance in progress or cleanup pending from previous rebalance.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 3 SG, 1 empty, 1 Memory Above HWM
2023-09-08T11:42:02.437+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.437+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-09-08T11:42:02.437+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.437+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 1000 Tenants 0
2023-09-08T11:42:02.437+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.437+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.437+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.437+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500
2023-09-08T11:42:02.437+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.437+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 3 SG, 1 empty, 1 Units Above HWM
2023-09-08T11:42:02.438+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 8000 Tenants 0
2023-09-08T11:42:02.438+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 400000000 Units 1000 Tenants 0
2023-09-08T11:42:02.438+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 8000 Tenants 0
2023-09-08T11:42:02.438+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 400000000 Units 1000 Tenants 0
2023-09-08T11:42:02.438+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.438+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.438+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.438+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000
2023-09-08T11:42:02.438+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.438+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 3 SG, 1 empty, Both Memory/Units Above HWM
2023-09-08T11:42:02.439+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.439+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.439+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.439+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.439+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.439+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.439+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.439+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.439+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-08T11:42:02.439+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.439+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.439+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 3 SG, Multiple tenants to move, single source, multiple destination
2023-09-08T11:42:02.440+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.440+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.440+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.440+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.440+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.440+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.440+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.440+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000
2023-09-08T11:42:02.440+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000
2023-09-08T11:42:02.440+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.440+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.440+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 3 SG, Multiple tenants to move, no nodes below LWM
2023-09-08T11:42:02.441+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000 Tenants 0
2023-09-08T11:42:02.441+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-09-08T11:42:02.441+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 700000000 Units 3000 Tenants 0
2023-09-08T11:42:02.441+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000 Tenants 0
2023-09-08T11:42:02.441+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-09-08T11:42:02.441+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 700000000 Units 3000 Tenants 0
2023-09-08T11:42:02.441+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.441+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.441+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.441+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-09-08T11:42:02.441+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-09-08T11:42:02.441+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-09-08T11:42:02.442+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.442+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.443+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.443+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.443+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.443+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000
2023-09-08T11:42:02.443+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.443+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.443+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.443+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.443+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.443+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.443+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.443+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.443+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-09-08T11:42:02.444+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.444+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.444+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.444+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.444+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.444+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.444+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.444+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.444+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-08T11:42:02.445+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.445+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.445+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.445+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.445+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.445+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.445+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.445+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.445+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 3 SG, Single Large Tenant, Nothing to move
2023-09-08T11:42:02.446+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000 Tenants 0
2023-09-08T11:42:02.446+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 2000 Tenants 0
2023-09-08T11:42:02.446+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 1000 Tenants 0
2023-09-08T11:42:02.446+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 2000 Tenants 0
2023-09-08T11:42:02.446+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.446+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.446+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.446+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000
2023-09-08T11:42:02.446+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.446+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(zero usage tenants)
2023-09-08T11:42:02.448+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.448+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.448+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.449+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.449+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.449+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 3 SG, 1 Partial Subcluster
2023-09-08T11:42:02.450+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.450+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000 Tenants 0
2023-09-08T11:42:02.450+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.450+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000 Tenants 0
2023-09-08T11:42:02.450+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003]]
2023-09-08T11:42:02.450+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.450+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.450+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.450+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-09-08T11:42:02.450+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-09-08T11:42:02.450+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9003]
2023-09-08T11:42:02.450+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.450+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.450+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Replica Repair - 4 SG, Missing Replicas for multiple tenants in SG
2023-09-08T11:42:02.451+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.451+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.451+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.451+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.451+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.451+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.451+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.451+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-08T11:42:02.451+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-09-08T11:42:02.451+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-08T11:42:02.451+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-08T11:42:02.451+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over
2023-09-08T11:42:02.452+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.452+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.452+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.452+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.452+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.452+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-09-08T11:42:02.452+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9004
2023-09-08T11:42:02.452+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-08T11:42:02.452+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9004
2023-09-08T11:42:02.452+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-08T11:42:02.452+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-09-08T11:42:02.452+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.452+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over, No replacement
2023-09-08T11:42:02.453+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.453+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.453+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.453+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.453+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.453+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.453+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9001] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.453+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Replica Repair - 4 SG, Missing Replicas, one replica missing with pendingDelete true
2023-09-08T11:42:02.454+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.454+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.454+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.454+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.454+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.454+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.454+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.454+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-09-08T11:42:02.454+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-09-08T11:42:02.454+05:30 [Info] Planner::findMissingReplicaForIndexerNode Skipping Replica Repair for 88883:81813:0. PendingDelete true
2023-09-08T11:42:02.454+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx2,1) on 127.0.0.1:9005
2023-09-08T11:42:02.454+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Replica Repair - 2 SG, Missing Replicas with Nodes over HWM
2023-09-08T11:42:02.455+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 7000 Tenants 0
2023-09-08T11:42:02.455+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.455+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 7000 Tenants 0
2023-09-08T11:42:02.455+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.455+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket9,,,idx2,1) on 127.0.0.1:9005
2023-09-08T11:42:02.455+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.456+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.456+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-09-08T11:42:02.456+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700
2023-09-08T11:42:02.456+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-09-08T11:42:02.456+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000
2023-09-08T11:42:02.456+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.456+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.456+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.456+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.456+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes
2023-09-08T11:42:02.457+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9004]
2023-09-08T11:42:02.457+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9004]
2023-09-08T11:42:02.457+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9001]
2023-09-08T11:42:02.457+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006 127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.457+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9008 127.0.0.1:9006 127.0.0.1:9007]
2023-09-08T11:42:02.457+05:30 [Info] Moving index 7777:7171:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-08T11:42:02.457+05:30 [Info] Moving index 8888:8181:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-08T11:42:02.457+05:30 [Info] Moving index 9999:9191:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-08T11:42:02.457+05:30 [Info] Moving index 101010:101101:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-08T11:42:02.457+05:30 [Info] Moving index 111111:112112:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-08T11:42:02.457+05:30 [Info] Moving index 121212:121121:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-09-08T11:42:02.457+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.457+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.457+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.457+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.457+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.457+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.457+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-09-08T11:42:02.457+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-08T11:42:02.457+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.457+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.457+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.457+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 1100000000 Units 8100 Tenants 0
2023-09-08T11:42:02.457+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008] [127.0.0.1:9003 127.0.0.1:9005] [127.0.0.1:9006] [127.0.0.1:9007]]
2023-09-08T11:42:02.457+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9006] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.457+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.457+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes(different SG)
2023-09-08T11:42:02.459+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004 127.0.0.1:9005]
2023-09-08T11:42:02.459+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004 127.0.0.1:9005]
2023-09-08T11:42:02.459+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-08T11:42:02.459+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.459+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.459+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.459+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.459+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.459+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.459+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.459+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.459+05:30 [Info] Moving index 7777:17171:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-08T11:42:02.459+05:30 [Info] Moving index 8888:18181:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-08T11:42:02.459+05:30 [Info] Moving index 9999:19191:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-08T11:42:02.459+05:30 [Info] Moving index 101010:1101101:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-08T11:42:02.459+05:30 [Info] Moving index 111111:1112112:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-08T11:42:02.459+05:30 [Info] Moving index 121212:1121121:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-09-08T11:42:02.459+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-08T11:42:02.459+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-09-08T11:42:02.459+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.459+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.459+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.459+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.459+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.459+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.459+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9003] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.459+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Swap Rebalance - 4 SG, Swap 1 SG with 2 new nodes
2023-09-08T11:42:02.460+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.460+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.460+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-08T11:42:02.460+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.460+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.460+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-08T11:42:02.460+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-08T11:42:02.460+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-08T11:42:02.460+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-08T11:42:02.460+05:30 [Info] Moving index 5555:5151:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-08T11:42:02.460+05:30 [Info] Moving index 6666:6161:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-09-08T11:42:02.460+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.460+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.460+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.460+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.460+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.460+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.460+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-09-08T11:42:02.460+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-08T11:42:02.460+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.460+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.461+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.461+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.461+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.461+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.461+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.461+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Swap Rebalance - 4 SG, Swap 1 node with 2 new nodes
2023-09-08T11:42:02.462+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-08T11:42:02.462+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-08T11:42:02.462+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-08T11:42:02.462+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008 127.0.0.1:9006]
2023-09-08T11:42:02.462+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.462+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.462+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.462+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.462+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.462+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.462+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-09-08T11:42:02.462+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-08T11:42:02.462+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.462+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.462+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.462+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.462+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003] [127.0.0.1:9008] [127.0.0.1:9007]]
2023-09-08T11:42:02.462+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.462+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9008] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.462+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.462+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Swap Rebalance - 4 SG, Swap 1 empty node with 2 new nodes
2023-09-08T11:42:02.463+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-08T11:42:02.463+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-09-08T11:42:02.463+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-08T11:42:02.463+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.463+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.463+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.463+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.463+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.463+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-09-08T11:42:02.463+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9006
2023-09-08T11:42:02.463+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9006
2023-09-08T11:42:02.463+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9006
2023-09-08T11:42:02.463+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9006
2023-09-08T11:42:02.463+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9006
2023-09-08T11:42:02.463+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket6,,,idx2,1) on 127.0.0.1:9006
2023-09-08T11:42:02.463+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.463+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Swap Rebalance - 1 SG, Swap 1 node - Failed swap rebalance
2023-09-08T11:42:02.464+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-08T11:42:02.464+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-08T11:42:02.464+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-08T11:42:02.464+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.464+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-08T11:42:02.464+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.464+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-08T11:42:02.464+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.465+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9008 as replacement node for deleted node 127.0.0.1:9004.
2023-09-08T11:42:02.465+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.465+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.465+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.465+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.465+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 600000000 Units 4000
2023-09-08T11:42:02.465+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.465+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 500000000 Units 4100 Tenants 0
2023-09-08T11:42:02.465+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008]]
2023-09-08T11:42:02.465+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Swap Rebalance - 1 SG, Swap 2 node - server group mismatch
2023-09-08T11:42:02.465+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-08T11:42:02.465+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-09-08T11:42:02.465+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9002 127.0.0.1:9001]
2023-09-08T11:42:02.465+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9004]
2023/09/08 11:42:02 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 subcluster, Enough Capacity
2023-09-08T11:42:02.467+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.467+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 600000000 Units 4500 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 600000000 Units 4500 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 600000000 Units 4100 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 600000000 Units 4100 Tenants 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.467+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity
2023-09-08T11:42:02.468+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.468+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.468+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-08T11:42:02.469+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.469+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.469+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-08T11:42:02.469+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.469+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.469+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.469+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.469+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.469+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.469+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.469+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 on any target
2023-09-08T11:42:02.469+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.469+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 on any target
2023-09-08T11:42:02.469+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 on any target
2023-09-08T11:42:02.469+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.469+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.469+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/08 11:42:02 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 node, Pair node not deleted(Failed swap rebalance of 1 node)
2023-09-08T11:42:02.470+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001]
2023-09-08T11:42:02.470+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001]
2023-09-08T11:42:02.470+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004]
2023-09-08T11:42:02.470+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.470+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9009 as replacement node for deleted node 127.0.0.1:9001.
2023-09-08T11:42:02.470+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-08T11:42:02.470+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-08T11:42:02.470+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-08T11:42:02.470+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-09-08T11:42:02.470+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 600000000 Units 4000
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 500000000 Units 4100 Tenants 0
2023-09-08T11:42:02.470+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9004 127.0.0.1:9009] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9004 127.0.0.1:9009]]
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9009]
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.471+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.471+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 node, Pair node already deleted
2023-09-08T11:42:02.471+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002]
2023-09-08T11:42:02.472+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002]
2023-09-08T11:42:02.472+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes []
2023-09-08T11:42:02.472+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.472+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-08T11:42:02.472+05:30 [Info] Planner::moveTenantsFromDeletedNodes Pair node not found for deleted node 127.0.0.1:9002.
2023-09-08T11:42:02.472+05:30 [Error] Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/09/08 11:42:02 Expected error Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 subcluster, empty nodes
2023-09-08T11:42:02.473+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9005 127.0.0.1:9007 127.0.0.1:9008]
2023-09-08T11:42:02.473+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-09-08T11:42:02.473+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-09-08T11:42:02.473+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-09-08T11:42:02.473+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-09-08T11:42:02.473+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-08T11:42:02.473+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 800000000 Units 7000 Tenants 0
2023-09-08T11:42:02.473+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.473+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-08T11:42:02.473+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.473+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.473+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9002] with len 1. Skipping replica repair attempt.
2023-09-08T11:42:02.473+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 subcluster, Deleted Nodes more than added nodes
2023-09-08T11:42:02.473+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.473+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.473+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-08T11:42:02.473+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-09-08T11:42:02.473+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 1
2023-09-08T11:42:02.473+05:30 [Error] Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/09/08 11:42:02 Expected error Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 node, Add 1 node in, server group mismatch
2023-09-08T11:42:02.474+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9006]
2023-09-08T11:42:02.474+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9006]
2023-09-08T11:42:02.474+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9003]
2023-09-08T11:42:02.474+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9007]
2023/09/08 11:42:02 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 node, Pair node exists
2023-09-08T11:42:02.475+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-09-08T11:42:02.475+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-08T11:42:02.475+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-08T11:42:02.475+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.475+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-09-08T11:42:02.475+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.475+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.475+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.475+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-08T11:42:02.475+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.475+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.475+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.475+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.475+05:30 [Info] Planner::moveTenantsFromDeletedNodes No replacement node found for deleted node 127.0.0.1:9004.
2023-09-08T11:42:02.475+05:30 [Error] Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/09/08 11:42:02 Expected error Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 subcluster, No nodes under LWM
2023-09-08T11:42:02.476+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-09-08T11:42:02.476+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-09-08T11:42:02.476+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.476+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-09-08T11:42:02.476+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-08T11:42:02.476+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/08 11:42:02 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity, Partial Subcluster
2023-09-08T11:42:02.476+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-08T11:42:02.476+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.477+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 100000000 UnitsUsage 500
2023-09-08T11:42:02.477+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 500
2023-09-08T11:42:02.477+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 200000000 Units 1000
2023-09-08T11:42:02.477+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.477+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 200000000 Units 1000
2023-09-08T11:42:02.477+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.477+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500 Tenants 0
2023-09-08T11:42:02.477+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9006]
2023-09-08T11:42:02.477+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-08T11:42:02.477+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/08 11:42:02 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 2 SG, Move out 1 non-empty and 1 empty node
2023-09-08T11:42:02.478+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9007 127.0.0.1:9004]
2023-09-08T11:42:02.478+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-09-08T11:42:02.478+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-09-08T11:42:02.478+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-09-08T11:42:02.478+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9008]
2023-09-08T11:42:02.478+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.478+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.478+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.478+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.478+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.478+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.478+05:30 [Info] Moving index 171717:1171171:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.478+05:30 [Info] Moving index 141414:1141141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-09-08T11:42:02.478+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 0 Units 0
2023-09-08T11:42:02.478+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-09-08T11:42:02.478+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-08T11:42:02.478+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-08T11:42:02.478+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9008 127.0.0.1:9001]]
2023-09-08T11:42:02.478+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM
2023-09-08T11:42:02.479+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.479+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.479+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.479+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.479+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.479+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.479+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-08T11:42:02.479+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.479+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.479+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-08T11:42:02.479+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-08T11:42:02.479+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-08T11:42:02.479+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-08T11:42:02.479+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-08T11:42:02.479+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.479+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 2 Subclusters, 1 below LWM, 1 above HWM
2023-09-08T11:42:02.480+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.480+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.480+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.480+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.480+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.480+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.480+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.480+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.480+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-08T11:42:02.480+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.480+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.480+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-08T11:42:02.480+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-08T11:42:02.480+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 600000000 Units 4000 Tenants 0
2023-09-08T11:42:02.480+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-08T11:42:02.480+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 600000000 Units 4000 Tenants 0
2023-09-08T11:42:02.480+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.480+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 3 Subclusters, 1 empty, 1 Above HWM, 1 below LWM
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.481+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.481+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.481+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.481+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-08T11:42:02.481+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.481+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.481+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.481+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.481+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.481+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.481+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.481+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.481+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.481+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000 Tenants 0
2023-09-08T11:42:02.481+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-09-08T11:42:02.481+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-08T11:42:02.481+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 2 Subclusters, 1 above LWM/below HWM, 1 empty
2023-09-08T11:42:02.482+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-08T11:42:02.482+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-08T11:42:02.482+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.482+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 2 Subclusters, Both above LWM/below HWM
2023-09-08T11:42:02.483+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-08T11:42:02.483+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-09-08T11:42:02.483+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-08T11:42:02.483+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-09-08T11:42:02.483+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.483+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-08T11:42:02.483+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000 Tenants 0
2023-09-08T11:42:02.483+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500 Tenants 0
2023-09-08T11:42:02.483+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000 Tenants 0
2023-09-08T11:42:02.483+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500 Tenants 0
2023-09-08T11:42:02.483+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.483+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM (partial replica repair)
2023-09-08T11:42:02.484+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.484+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 550000000 Units 5500 Tenants 0
2023-09-08T11:42:02.484+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.484+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-09-08T11:42:02.484+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-09-08T11:42:02.484+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.484+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.484+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.484+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-08T11:42:02.484+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.484+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.484+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-08T11:42:02.484+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-08T11:42:02.484+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-08T11:42:02.484+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-08T11:42:02.484+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-08T11:42:02.484+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.484+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM(full replica repair)
2023-09-08T11:42:02.485+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000 Tenants 0
2023-09-08T11:42:02.485+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.485+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx1,1) on 127.0.0.1:9001
2023-09-08T11:42:02.485+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9001
2023-09-08T11:42:02.485+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx1,1) on 127.0.0.1:9001
2023-09-08T11:42:02.485+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9001
2023-09-08T11:42:02.485+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9001
2023-09-08T11:42:02.485+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,1) on 127.0.0.1:9001
2023-09-08T11:42:02.485+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9004 127.0.0.1:9001]]
2023-09-08T11:42:02.485+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9001]
2023-09-08T11:42:02.485+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.485+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-09-08T11:42:02.485+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.485+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.485+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-09-08T11:42:02.485+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000 Tenants 0
2023-09-08T11:42:02.485+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000 Tenants 0
2023-09-08T11:42:02.485+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000 Tenants 0
2023-09-08T11:42:02.485+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000 Tenants 0
2023-09-08T11:42:02.485+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.485+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 ScaleIn- 2 Subclusters, Both below LWM, Positive Case
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.486+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.486+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.486+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.486+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.486+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.486+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.486+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-09-08T11:42:02.486+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2023-09-08T11:42:02.486+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-09-08T11:42:02.486+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.486+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9003 SG sg1 Memory 0 Units 0
2023-09-08T11:42:02.486+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9006 SG sg3 Memory 0 Units 0
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 ScaleIn- 2 Subclusters, One below LWM/ 1 Empty
2023-09-08T11:42:02.487+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.487+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000 Tenants 0
2023-09-08T11:42:02.487+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.487+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. No ScaleIn.
2023-09-08T11:42:02.487+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-08T11:42:02.487+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.487+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-08T11:42:02.487+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.487+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.487+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.487+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.487+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.488+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-09-08T11:42:02.488+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.488+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.488+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.488+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.488+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.488+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.488+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-09-08T11:42:02.488+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.488+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.488+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.488+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-09-08T11:42:02.488+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. ScaleIn.
2023-09-08T11:42:02.488+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.489+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.489+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.489+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-09-08T11:42:02.489+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-09-08T11:42:02.489+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.489+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.489+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.489+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.489+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.489+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.489+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-09-08T11:42:02.489+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-09-08T11:42:02.489+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-09-08T11:42:02.489+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-09-08T11:42:02.489+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000 Tenants 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-09-08T11:42:02.489+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-09-08T11:42:02.489+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-09-08T11:42:02.489+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Rebalance - 1 Subcluster, Below HWM (partial replica repair)
2023-09-08T11:42:02.490+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-09-08T11:42:02.490+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 350000000 Units 500 Tenants 0
2023-09-08T11:42:02.490+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.490+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-09-08T11:42:02.490+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-09-08T11:42:02.490+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-09-08T11:42:02.490+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800 Tenants 0
2023-09-08T11:42:02.490+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 500000000 Units 800 Tenants 0
2023-09-08T11:42:02.490+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-09-08T11:42:02.490+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Resume - 1 tenant, Empty node in cluster.
2023-09-08T11:42:02.491+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-08T11:42:02.491+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.491+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.491+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.491+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.491+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.491+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.491+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.491+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-08T11:42:02.491+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-09-08T11:42:02.491+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Resume - 1 tenant, No empty node in cluster.
2023-09-08T11:42:02.493+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-08T11:42:02.493+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.493+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.493+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.493+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.493+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.493+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.493+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.493+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-08T11:42:02.493+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.493+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Resume - 1 tenant, No node below LWM in the cluster.
2023-09-08T11:42:02.495+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-08T11:42:02.495+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.495+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.495+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.495+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.495+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 5000 Tenants 0
2023-09-08T11:42:02.495+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 5000 Tenants 0
2023-09-08T11:42:02.495+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.495+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-09-08T11:42:02.495+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM []
2023/09/08 11:42:02 Expected error No SubCluster Below Low Usage Threshold
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Resume - 1 tenant, Not enough capacity in the cluster.
2023-09-08T11:42:02.496+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-09-08T11:42:02.496+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.496+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.496+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000 Tenants 0
2023-09-08T11:42:02.496+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000 Tenants 0
2023-09-08T11:42:02.496+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.496+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100 Tenants 0
2023-09-08T11:42:02.496+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.496+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250
2023-09-08T11:42:02.496+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-09-08T11:42:02.497+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250 on any target
2023/09/08 11:42:02 Expected error Not Enough Capacity To Place Tenant
--- PASS: TestTenantAwarePlanner (0.10s)
=== RUN TestPlanDuringHeterogenousScaleup
2023/09/08 11:42:02 In TestPlanDuringHeterogenousScaleup()
=== RUN TestPlanDuringHeterogenousScaleup/GreedyPlanner
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-08T11:42:02.499+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-08T11:42:02.501+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-08T11:42:02.503+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-09-08T11:42:02.506+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-09-08T11:42:02.508+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-08T11:42:02.510+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-09-08T11:42:02.512+05:30 [Info] Using greedy index placement for index 987654
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-09-08T11:42:02.514+05:30 [Info] Using greedy index placement for index 987654
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Single Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-08T11:42:02.517+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.9737654786475068
2023-09-08T11:42:02.619+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:02.619+05:30 [Info] Score: 0.5118702120133598
2023-09-08T11:42:02.619+05:30 [Info] variation: 1.0237404240267196
2023-09-08T11:42:02.619+05:30 [Info] ElapsedTime: 102ms
2023-09-08T11:42:02.619+05:30 [Info] ConvergenceTime: 100ms
2023-09-08T11:42:02.619+05:30 [Info] Iteration: 7000
2023-09-08T11:42:02.619+05:30 [Info] Move: 3882
2023-09-08T11:42:02.619+05:30 [Info] ----------------------------------------
2023-09-08T11:42:02.619+05:30 [Info] Using SAPlanner
2023-09-08T11:42:02.619+05:30 [Info] Indexer Memory Mean 126888575449 (118.174G)
2023-09-08T11:42:02.619+05:30 [Info] Indexer Memory Deviation 80354383758 (74.8359G) (63.33%)
2023-09-08T11:42:02.619+05:30 [Info] Indexer Memory Utilization 2.3004
2023-09-08T11:42:02.619+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:02.619+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:02.619+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:02.619+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:02.619+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:02.619+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:02.619+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:02.619+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:02.619+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:02.619+05:30 [Info] Indexer Data Size Mean 18082106963 (16.8403G)
2023-09-08T11:42:02.619+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (141.42%)
2023-09-08T11:42:02.619+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:02.619+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:02.619+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:02.619+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:02.619+05:30 [Info] ----------------------------------------
2023-09-08T11:42:02.619+05:30 [Info] Number of indexes: 13
2023-09-08T11:42:02.619+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:02.619+05:30 [Info] Avg Index Size: 29281978949 (27.271G)
2023-09-08T11:42:02.619+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:02.619+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-08T11:42:02.619+05:30 [Info] Avg Index Cpu: 3.5385
2023-09-08T11:42:02.619+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:02.619+05:30 [Info] Num Estimation Run: 11
2023-09-08T11:42:02.619+05:30 [Info] ----------------------------------------
2023-09-08T11:42:02.619+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:02.619+05:30 [Info] CPU Quota 27
2023-09-08T11:42:02.619+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:02.619+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:02.619+05:30 [Info] ----------------------------------------
2023-09-08T11:42:02.619+05:30 [Info] Total iteration: 7010
2023-09-08T11:42:02.619+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:02.619+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:02.619+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:02.619+05:30 [Info] RandomMove time: 0ns
2023-09-08T11:42:02.619+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-08T11:42:02.619+05:30 [Info] ExhaustMove time: 43ms
2023-09-08T11:42:02.619+05:30 [Info] ExhaustMove call: 7010
2023-09-08T11:42:02.619+05:30 [Info] ExhaustMove average time: 6us
2023-09-08T11:42:02.619+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:02.619+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:02.619+05:30 [Info] ----------------------------------------
2023-09-08T11:42:02.619+05:30 [Info]
2023-09-08T11:42:02.619+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:02.620+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-08T11:42:02.620+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.37390490588193165 allowDDLDuringScaleup:true
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info]
2023-09-08T11:42:02.620+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:02.620+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:02.620+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7501886306380632 allowDDLDuringScaleup:true
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:14116053487878296172, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info]
2023-09-08T11:42:02.620+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:02.620+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:0 (0), data:0 (0) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-08T11:42:02.620+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.07590646348000514 allowDDLDuringScaleup:true
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:02.620+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:02.620+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:02.620+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:02.620+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:02 -------------------------------------------
2023/09/08 11:42:02 Place Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-08T11:42:02.623+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6856271841119315
2023-09-08T11:42:03.097+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.097+05:30 [Info] Score: 0.28937833136341934
2023-09-08T11:42:03.097+05:30 [Info] variation: 0.5787566627268387
2023-09-08T11:42:03.097+05:30 [Info] ElapsedTime: 473ms
2023-09-08T11:42:03.097+05:30 [Info] ConvergenceTime: 471ms
2023-09-08T11:42:03.097+05:30 [Info] Iteration: 4100
2023-09-08T11:42:03.097+05:30 [Info] Move: 2652
2023-09-08T11:42:03.097+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.097+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.097+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-08T11:42:03.098+05:30 [Info] Indexer Memory Deviation 65295744085 (60.8114G) (45.04%)
2023-09-08T11:42:03.098+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-08T11:42:03.098+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:03.098+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:03.098+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:03.098+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.098+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.098+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.098+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.098+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.098+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.098+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-08T11:42:03.098+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-08T11:42:03.098+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.098+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.099+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.099+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.099+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.099+05:30 [Info] Number of indexes: 14
2023-09-08T11:42:03.099+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.099+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-09-08T11:42:03.099+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:03.099+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-08T11:42:03.099+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-08T11:42:03.099+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:03.099+05:30 [Info] Num Estimation Run: 11
2023-09-08T11:42:03.099+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.099+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:03.099+05:30 [Info] CPU Quota 27
2023-09-08T11:42:03.099+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.100+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.100+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.100+05:30 [Info] Total iteration: 4400
2023-09-08T11:42:03.100+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.100+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.100+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.100+05:30 [Info] RandomMove time: 78ms
2023-09-08T11:42:03.100+05:30 [Info] RandomMove call: 4099 (empty index 0)
2023-09-08T11:42:03.100+05:30 [Info] RandomMove average time: 19us
2023-09-08T11:42:03.100+05:30 [Info] ExhaustMove time: 7us
2023-09-08T11:42:03.100+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:03.100+05:30 [Info] ExhaustMove average time: 7us
2023-09-08T11:42:03.100+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.100+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.100+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.100+05:30 [Info]
2023-09-08T11:42:03.100+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:03.100+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:0 (0), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-08T11:42:03.100+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32726796943638176 allowDDLDuringScaleup:true
2023-09-08T11:42:03.100+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.100+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.100+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.100+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.100+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.100+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.100+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.100+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.100+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.100+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info]
2023-09-08T11:42:03.101+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:03.101+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.101+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:14574305234410919907, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info]
2023-09-08T11:42:03.101+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:03.101+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.101+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.44127633846614567 allowDDLDuringScaleup:true
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.101+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.101+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:14574305234410919907, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.101+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.101+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Index with 2 replicas - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-08T11:42:03.104+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5284872008906434
2023-09-08T11:42:03.111+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-08T11:42:03.111+05:30 [Info] Score: 0.13929460298637122
2023-09-08T11:42:03.111+05:30 [Info] variation: 0.27858920597274245
2023-09-08T11:42:03.111+05:30 [Info] ElapsedTime: 6ms
2023-09-08T11:42:03.111+05:30 [Info] ConvergenceTime: 2ms
2023-09-08T11:42:03.111+05:30 [Info] Iteration: 1
2023-09-08T11:42:03.111+05:30 [Info] Move: 1
2023-09-08T11:42:03.111+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.111+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.111+05:30 [Info] Indexer Memory Mean 163052789375 (151.855G)
2023-09-08T11:42:03.111+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (55.72%)
2023-09-08T11:42:03.111+05:30 [Info] Indexer Memory Utilization 2.9561
2023-09-08T11:42:03.111+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:03.111+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:03.111+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:03.111+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.111+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.111+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.111+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.111+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.111+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.111+05:30 [Info] Indexer Data Size Mean 54246320889 (50.5208G)
2023-09-08T11:42:03.111+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:42:03.111+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.111+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.111+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.111+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.111+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.111+05:30 [Info] Number of indexes: 15
2023-09-08T11:42:03.111+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.111+05:30 [Info] Avg Index Size: 21761293697 (20.2668G)
2023-09-08T11:42:03.111+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:03.111+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-08T11:42:03.111+05:30 [Info] Avg Index Cpu: 3.0667
2023-09-08T11:42:03.111+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:03.111+05:30 [Info] Num Estimation Run: 230
2023-09-08T11:42:03.111+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.111+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:03.111+05:30 [Info] CPU Quota 27
2023-09-08T11:42:03.111+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.111+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.111+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.111+05:30 [Info] Total iteration: 521
2023-09-08T11:42:03.111+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.111+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.111+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.111+05:30 [Info] RandomMove time: 12us
2023-09-08T11:42:03.112+05:30 [Info] RandomMove call: 1 (empty index 0)
2023-09-08T11:42:03.112+05:30 [Info] RandomMove average time: 12us
2023-09-08T11:42:03.112+05:30 [Info] ExhaustMove time: 2ms
2023-09-08T11:42:03.112+05:30 [Info] ExhaustMove call: 220
2023-09-08T11:42:03.112+05:30 [Info] ExhaustMove average time: 12us
2023-09-08T11:42:03.112+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.112+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.112+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.112+05:30 [Info]
2023-09-08T11:42:03.112+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:03.112+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.112+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5575132033129112 allowDDLDuringScaleup:true
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.112+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.112+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.112+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.112+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.112+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.112+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.112+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.112+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13069565364354619629, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.112+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.112+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.112+05:30 [Info]
2023-09-08T11:42:03.112+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:03.112+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.112+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3168776165275712 allowDDLDuringScaleup:true
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.112+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.112+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.112+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.112+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.112+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.112+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.112+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.112+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.113+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.113+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.113+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.113+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:13069565364354619629, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.113+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.113+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.113+05:30 [Info]
2023-09-08T11:42:03.113+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:03.113+05:30 [Info] Indexer total memory:125847870401 (117.205G), mem:102404635981 (95.3717G), overhead:23443234420 (21.8332G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.113+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:false usageRatio:0.3256091801595177 allowDDLDuringScaleup:true
2023-09-08T11:42:03.113+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.113+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.113+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.113+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.113+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.113+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.113+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.113+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.113+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.113+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.113+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.113+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.113+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.113+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.113+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.113+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.113+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.113+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:13069565364354619629, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.113+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.113+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on Scaled up node
2023-09-08T11:42:03.117+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3952038770958589
2023-09-08T11:42:03.374+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.374+05:30 [Info] Score: 0.358469577773188
2023-09-08T11:42:03.374+05:30 [Info] variation: 0.716939155546376
2023-09-08T11:42:03.374+05:30 [Info] ElapsedTime: 256ms
2023-09-08T11:42:03.374+05:30 [Info] ConvergenceTime: 249ms
2023-09-08T11:42:03.374+05:30 [Info] Iteration: 7400
2023-09-08T11:42:03.374+05:30 [Info] Move: 5794
2023-09-08T11:42:03.374+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.374+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.374+05:30 [Info] Indexer Memory Mean 144970682412 (135.014G)
2023-09-08T11:42:03.374+05:30 [Info] Indexer Memory Deviation 105360564648 (98.1247G) (72.68%)
2023-09-08T11:42:03.374+05:30 [Info] Indexer Memory Utilization 2.6283
2023-09-08T11:42:03.374+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:03.374+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:03.374+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:03.374+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.374+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.374+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.374+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.374+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.374+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.374+05:30 [Info] Indexer Data Size Mean 36164213926 (33.6805G)
2023-09-08T11:42:03.374+05:30 [Info] Indexer Data Size Deviation 25571960903 (23.8157G) (70.71%)
2023-09-08T11:42:03.374+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.374+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.374+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.374+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.374+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.374+05:30 [Info] Number of indexes: 14
2023-09-08T11:42:03.374+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.374+05:30 [Info] Avg Index Size: 31065146231 (28.9317G)
2023-09-08T11:42:03.374+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:03.374+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-08T11:42:03.375+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-08T11:42:03.375+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:03.375+05:30 [Info] Num Estimation Run: 11
2023-09-08T11:42:03.375+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:03.375+05:30 [Info] CPU Quota 27
2023-09-08T11:42:03.375+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.375+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.375+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Total iteration: 19841
2023-09-08T11:42:03.375+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.375+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.375+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.375+05:30 [Info] RandomMove time: 54ms
2023-09-08T11:42:03.375+05:30 [Info] RandomMove call: 7399 (empty index 0)
2023-09-08T11:42:03.375+05:30 [Info] RandomMove average time: 7us
2023-09-08T11:42:03.375+05:30 [Info] ExhaustMove time: 14us
2023-09-08T11:42:03.375+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:03.375+05:30 [Info] ExhaustMove average time: 14us
2023-09-08T11:42:03.375+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.375+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.375+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.375+05:30 [Info]
2023-09-08T11:42:03.375+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:03.375+05:30 [Info] Indexer total memory:322028009998 (299.912G), mem:291467625194 (271.45G), overhead:30560384804 (28.4616G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.375+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.7021056124497257 allowDDLDuringScaleup:true
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.375+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.375+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.375+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.375+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:12675372060942326366, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.375+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.375+05:30 [Info]
2023-09-08T11:42:03.375+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:03.375+05:30 [Info] Indexer total memory:111617261890 (103.952G), mem:95286106952 (88.7421G), overhead:16331154938 (15.2096G), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.375+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43145569209747264 allowDDLDuringScaleup:true
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.375+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.375+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.375+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.375+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.375+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.375+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.376+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.376+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.376+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:12675372060942326366, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.376+05:30 [Info] Index total memory:54246320889 (50.5208G), mem:54246320889 (50.5208G), overhead:0 (0), min:54246320889 (50.5208G), data:54246320889 (50.5208G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.376+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.376+05:30 [Info]
2023-09-08T11:42:03.376+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:03.376+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:0 (0), data:0 (0) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-08T11:42:03.376+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.06643869545280173 allowDDLDuringScaleup:true
2023-09-08T11:42:03.376+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.376+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.376+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.376+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.376+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.376+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.376+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.376+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.376+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.376+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.376+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.376+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.376+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.376+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.376+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.376+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 2 SG - Placed on older nodes
2023-09-08T11:42:03.378+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3952038770958589
2023-09-08T11:42:03.382+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-08T11:42:03.382+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=3ms
2023-09-08T11:42:03.382+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3952038770958589
2023-09-08T11:42:03.396+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.396+05:30 [Info] Score: 0.15271558887192913
2023-09-08T11:42:03.396+05:30 [Info] variation: 0.3952038770958589
2023-09-08T11:42:03.396+05:30 [Info] ElapsedTime: 13ms
2023-09-08T11:42:03.396+05:30 [Info] ConvergenceTime: 2us
2023-09-08T11:42:03.396+05:30 [Info] Iteration: 0
2023-09-08T11:42:03.396+05:30 [Info] Move: 0
2023-09-08T11:42:03.396+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.396+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.396+05:30 [Info] Indexer Memory Mean 212524421102 (197.929G)
2023-09-08T11:42:03.396+05:30 [Info] Indexer Memory Deviation 17703491065 (16.4877G) (8.33%)
2023-09-08T11:42:03.396+05:30 [Info] Indexer Memory Utilization 3.8530
2023-09-08T11:42:03.396+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:03.396+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:03.396+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:03.396+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.396+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.396+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.396+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.396+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.396+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.396+05:30 [Info] Indexer Data Size Mean 103717952615 (96.5949G)
2023-09-08T11:42:03.396+05:30 [Info] Indexer Data Size Deviation 73339667625 (68.3029G) (70.71%)
2023-09-08T11:42:03.396+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.396+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.396+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.396+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.396+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.396+05:30 [Info] Number of indexes: 14
2023-09-08T11:42:03.396+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.396+05:30 [Info] Avg Index Size: 23315671818 (21.7144G)
2023-09-08T11:42:03.396+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:03.396+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-08T11:42:03.396+05:30 [Info] Avg Index Cpu: 3.2857
2023-09-08T11:42:03.396+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:03.396+05:30 [Info] Num Estimation Run: 230
2023-09-08T11:42:03.396+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.396+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:03.396+05:30 [Info] CPU Quota 27
2023-09-08T11:42:03.396+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.396+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.396+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.396+05:30 [Info] Total iteration: 3534
2023-09-08T11:42:03.396+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.396+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.396+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.396+05:30 [Info] RandomMove time: 14us
2023-09-08T11:42:03.396+05:30 [Info] RandomMove call: 2 (empty index 0)
2023-09-08T11:42:03.396+05:30 [Info] RandomMove average time: 7us
2023-09-08T11:42:03.396+05:30 [Info] ExhaustMove time: 1ms
2023-09-08T11:42:03.396+05:30 [Info] ExhaustMove call: 230
2023-09-08T11:42:03.396+05:30 [Info] ExhaustMove average time: 5us
2023-09-08T11:42:03.396+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.396+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.396+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.396+05:30 [Info]
2023-09-08T11:42:03.396+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:03.396+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:42699834774 (39.7673G), data:0 (0) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:4
2023-09-08T11:42:03.396+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.22324145439374882 allowDDLDuringScaleup:true
2023-09-08T11:42:03.396+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.396+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.396+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:4995829886 (4.65273G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.396+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.396+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.396+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.396+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:13150749438 (12.2476G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.396+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.396+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.396+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.396+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:13051410687 (12.1551G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.396+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.396+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.396+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.396+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:11501844763 (10.7119G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.396+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.396+05:30 [Info]
2023-09-08T11:42:03.396+05:30 [Info] Indexer serverGroup:sg1, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:03.396+05:30 [Info] Indexer total memory:212947869924 (198.323G), mem:196616714986 (183.114G), overhead:16331154938 (15.2096G), min:36935807455 (34.3992G), data:155576928923 (144.892G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.396+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.48502976172478063 allowDDLDuringScaleup:true
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:4995829886 (4.65273G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:13150749438 (12.2476G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:9400037446 (8.75447G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:9389190685 (8.74437G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:6418112730470024252, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info]
2023-09-08T11:42:03.397+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:03.397+05:30 [Info] Indexer total memory:227178478435 (211.576G), mem:203735244015 (189.743G), overhead:23443234420 (21.8332G), min:43342483581 (40.3658G), data:155576928923 (144.892G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:5
2023-09-08T11:42:03.397+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.49172878388147057 allowDDLDuringScaleup:true
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:13051410687 (12.1551G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:11501844763 (10.7119G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:9400037446 (8.75447G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:9389190685 (8.74437G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.397+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.397+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:6418112730470024252, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.397+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.397+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Equivalent Index Without any replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG
2023-09-08T11:42:03.399+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.943232680780422
2023-09-08T11:42:03.401+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-08T11:42:03.401+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.401+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=1ms
2023-09-08T11:42:03.401+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.943232680780422
2023-09-08T11:42:03.401+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-09-08T11:42:03.401+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.401+05:30 [Info] Score: 0.3533478080577597
2023-09-08T11:42:03.401+05:30 [Info] variation: 0.943232680780422
2023-09-08T11:42:03.401+05:30 [Info] ElapsedTime: 81us
2023-09-08T11:42:03.401+05:30 [Info] ConvergenceTime: 2us
2023-09-08T11:42:03.401+05:30 [Info] Iteration: 0
2023-09-08T11:42:03.401+05:30 [Info] Move: 0
2023-09-08T11:42:03.401+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.401+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.401+05:30 [Info] Indexer Memory Mean 17165606520 (15.9867G)
2023-09-08T11:42:03.401+05:30 [Info] Indexer Memory Deviation 8106488563 (7.54976G) (47.23%)
2023-09-08T11:42:03.401+05:30 [Info] Indexer Memory Utilization 1.9073
2023-09-08T11:42:03.401+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-08T11:42:03.401+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-08T11:42:03.401+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-08T11:42:03.401+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.401+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.401+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.401+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.402+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.402+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.402+05:30 [Info] Indexer Data Size Mean 5165606520 (4.81085G)
2023-09-08T11:42:03.402+05:30 [Info] Indexer Data Size Deviation 7305270798 (6.80356G) (141.42%)
2023-09-08T11:42:03.402+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.402+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.402+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.402+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.402+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.402+05:30 [Info] Number of indexes: 4
2023-09-08T11:42:03.402+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.402+05:30 [Info] Avg Index Size: 9000000000 (8.3819G)
2023-09-08T11:42:03.402+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-08T11:42:03.402+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-08T11:42:03.402+05:30 [Info] Avg Index Cpu: 0.7500
2023-09-08T11:42:03.402+05:30 [Info] Max Index Cpu: 1.0000
2023-09-08T11:42:03.402+05:30 [Info] Num Estimation Run: 208
2023-09-08T11:42:03.402+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.402+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-08T11:42:03.402+05:30 [Info] CPU Quota 8
2023-09-08T11:42:03.402+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.402+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.402+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.402+05:30 [Info] Total iteration: 209
2023-09-08T11:42:03.402+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.402+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.402+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.402+05:30 [Info] RandomMove time: 0ns
2023-09-08T11:42:03.402+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-08T11:42:03.402+05:30 [Info] ExhaustMove time: 890us
2023-09-08T11:42:03.402+05:30 [Info] ExhaustMove call: 209
2023-09-08T11:42:03.402+05:30 [Info] ExhaustMove average time: 4us
2023-09-08T11:42:03.402+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.402+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.402+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.402+05:30 [Info]
2023-09-08T11:42:03.402+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-08T11:42:03.402+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:4500000000 (4.19095G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:03.402+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2912801242516189 allowDDLDuringScaleup:true
2023-09-08T11:42:03.402+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.402+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.402+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:4500000000 (4.19095G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.402+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.402+05:30 [Info]
2023-09-08T11:42:03.402+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-08T11:42:03.402+05:30 [Info] Indexer total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:5400000000 (5.02914G), data:0 (0) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:03.402+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.06990722982038854 allowDDLDuringScaleup:true
2023-09-08T11:42:03.402+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.402+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.402+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:5400000000 (5.02914G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.402+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.402+05:30 [Info]
2023-09-08T11:42:03.402+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-08T11:42:03.402+05:30 [Info] Indexer total memory:22496819560 (20.9518G), mem:20496819560 (19.0892G), overhead:2000000000 (1.86265G), min:4500000000 (4.19095G), data:15496819560 (14.4325G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:03.402+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.8388126459279925 allowDDLDuringScaleup:true
2023-09-08T11:42:03.402+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.402+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.402+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:4500000000 (4.19095G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.402+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.402+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.402+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:5905829587244312054, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.402+05:30 [Info] Index total memory:0 (0), mem:0 (0), overhead:0 (0), min:0 (0), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.402+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use least loaded node
2023-09-08T11:42:03.404+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-08T11:42:03.404+05:30 [Warn] Definition 987654 Instance 4449079192235890153 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-09-08T11:42:03.404+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-08T11:42:03.404+05:30 [Warn] Definition 987654 Instance 4449079192235890153 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-09-08T11:42:03.404+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6782899285088768
2023-09-08T11:42:03.472+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.472+05:30 [Info] Score: 0.25290029571859646
2023-09-08T11:42:03.472+05:30 [Info] variation: 0.5058005914371929
2023-09-08T11:42:03.472+05:30 [Info] ElapsedTime: 68ms
2023-09-08T11:42:03.472+05:30 [Info] ConvergenceTime: 66ms
2023-09-08T11:42:03.472+05:30 [Info] Iteration: 4000
2023-09-08T11:42:03.472+05:30 [Info] Move: 2399
2023-09-08T11:42:03.472+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.473+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-09-08T11:42:03.473+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-09-08T11:42:03.473+05:30 [Info] Indexer Memory Utilization 1.9434
2023-09-08T11:42:03.473+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-08T11:42:03.473+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-08T11:42:03.473+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-08T11:42:03.473+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.473+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.473+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.473+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.473+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.473+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.473+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-09-08T11:42:03.473+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-09-08T11:42:03.473+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.473+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.473+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.473+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.473+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Number of indexes: 5
2023-09-08T11:42:03.473+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.473+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-09-08T11:42:03.473+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-08T11:42:03.473+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-08T11:42:03.473+05:30 [Info] Avg Index Cpu: 0.6000
2023-09-08T11:42:03.473+05:30 [Info] Max Index Cpu: 1.0000
2023-09-08T11:42:03.473+05:30 [Info] Num Estimation Run: 7
2023-09-08T11:42:03.473+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-08T11:42:03.473+05:30 [Info] CPU Quota 8
2023-09-08T11:42:03.473+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.473+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.473+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Total iteration: 4180
2023-09-08T11:42:03.473+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.473+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.473+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.473+05:30 [Info] RandomMove time: 22ms
2023-09-08T11:42:03.473+05:30 [Info] RandomMove call: 3999 (empty index 0)
2023-09-08T11:42:03.473+05:30 [Info] RandomMove average time: 5us
2023-09-08T11:42:03.473+05:30 [Info] ExhaustMove time: 7us
2023-09-08T11:42:03.473+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:03.473+05:30 [Info] ExhaustMove average time: 7us
2023-09-08T11:42:03.473+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.473+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.473+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.473+05:30 [Info]
2023-09-08T11:42:03.473+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-08T11:42:03.473+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:03.473+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-09-08T11:42:03.473+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.473+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.473+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.473+05:30 [Info]
2023-09-08T11:42:03.473+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-08T11:42:03.473+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:03.473+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-09-08T11:42:03.473+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.473+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.473+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.473+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:4449079192235890153, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.473+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.473+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.473+05:30 [Info]
2023-09-08T11:42:03.473+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-08T11:42:03.473+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:03.473+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-09-08T11:42:03.473+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Index name:nonEquiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.473+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.473+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.473+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.473+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:4449079192235890153, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.473+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.473+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Equivalent Index With 1 Replica - 3 non-empty heterogenous nodes with 1 Scaled up - 1 SG - Use ScaleUp Node
2023-09-08T11:42:03.476+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-08T11:42:03.476+05:30 [Warn] Definition 987654 Instance 1658364292823496434 ReplicaId 1 partitionId 0 count 4 numLiveNode 3.
2023-09-08T11:42:03.476+05:30 [Warn] There are more equivalent index than available nodes. Allow equivalent index of (default, , , newEquivIdx) to be replaced on same node.
2023-09-08T11:42:03.476+05:30 [Warn] Definition 987654 Instance 1658364292823496434 ReplicaId 0 partitionId 0 count 4 numLiveNode 3.
2023-09-08T11:42:03.476+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6782899285088768
2023-09-08T11:42:03.542+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.542+05:30 [Info] Score: 0.25290029571859646
2023-09-08T11:42:03.542+05:30 [Info] variation: 0.5058005914371929
2023-09-08T11:42:03.543+05:30 [Info] ElapsedTime: 66ms
2023-09-08T11:42:03.543+05:30 [Info] ConvergenceTime: 64ms
2023-09-08T11:42:03.543+05:30 [Info] Iteration: 3600
2023-09-08T11:42:03.543+05:30 [Info] Move: 2403
2023-09-08T11:42:03.543+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.543+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.543+05:30 [Info] Indexer Memory Mean 17490430188 (16.2892G)
2023-09-08T11:42:03.543+05:30 [Info] Indexer Memory Deviation 5325738075 (4.95998G) (30.45%)
2023-09-08T11:42:03.543+05:30 [Info] Indexer Memory Utilization 1.9434
2023-09-08T11:42:03.543+05:30 [Info] Indexer CPU Mean 0.6667
2023-09-08T11:42:03.543+05:30 [Info] Indexer CPU Deviation 0.47 (70.71%)
2023-09-08T11:42:03.543+05:30 [Info] Indexer CPU Utilization 0.0833
2023-09-08T11:42:03.543+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.543+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.543+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.543+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.543+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.543+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.543+05:30 [Info] Indexer Data Size Mean 5490430188 (5.11336G)
2023-09-08T11:42:03.543+05:30 [Info] Indexer Data Size Deviation 3882320417 (3.61569G) (70.71%)
2023-09-08T11:42:03.543+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.543+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.543+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.543+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.543+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.543+05:30 [Info] Number of indexes: 5
2023-09-08T11:42:03.543+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.543+05:30 [Info] Avg Index Size: 10494258112 (9.77354G)
2023-09-08T11:42:03.543+05:30 [Info] Max Index Size: 25000000000 (23.2831G)
2023-09-08T11:42:03.543+05:30 [Info] Max Indexer Overhead: 3000000000 (2.79397G)
2023-09-08T11:42:03.543+05:30 [Info] Avg Index Cpu: 0.6000
2023-09-08T11:42:03.543+05:30 [Info] Max Index Cpu: 1.0000
2023-09-08T11:42:03.543+05:30 [Info] Num Estimation Run: 7
2023-09-08T11:42:03.543+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.543+05:30 [Info] Memory Quota 9000000000 (8.3819G)
2023-09-08T11:42:03.543+05:30 [Info] CPU Quota 8
2023-09-08T11:42:03.543+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.543+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.543+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.543+05:30 [Info] Total iteration: 3780
2023-09-08T11:42:03.543+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.543+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.543+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.543+05:30 [Info] RandomMove time: 21ms
2023-09-08T11:42:03.543+05:30 [Info] RandomMove call: 3599 (empty index 0)
2023-09-08T11:42:03.543+05:30 [Info] RandomMove average time: 6us
2023-09-08T11:42:03.543+05:30 [Info] ExhaustMove time: 7us
2023-09-08T11:42:03.543+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:03.543+05:30 [Info] ExhaustMove average time: 7us
2023-09-08T11:42:03.543+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.543+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.543+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.543+05:30 [Info]
2023-09-08T11:42:03.543+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9000, nodeUUID:c6fe7e12b609acc9767c7b671c908773, useLiveData:true
2023-09-08T11:42:03.543+05:30 [Info] Indexer total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:0 (0), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:03.543+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2858706130298869 allowDDLDuringScaleup:true
2023-09-08T11:42:03.543+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.543+05:30 [Info] Index name:nonEquiv 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.543+05:30 [Info] Index total memory:28000000000 (26.077G), mem:25000000000 (23.2831G), overhead:3000000000 (2.79397G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.543+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.543+05:30 [Info]
2023-09-08T11:42:03.543+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9001, nodeUUID:f18c1f3d3c1fabf2a63b51d06f536bf9, useLiveData:true
2023-09-08T11:42:03.544+05:30 [Info] Indexer total memory:16735645282 (15.5863G), mem:14235645282 (13.258G), overhead:2500000000 (2.32831G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:03.544+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.46278210574565426 allowDDLDuringScaleup:true
2023-09-08T11:42:03.544+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.544+05:30 [Info] Index name:equiv2 0, bucket:default, scope:, collection:, defnId:4650686066397790000, instId:4650686066397790000, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.544+05:30 [Info] Index total memory:8500000000 (7.91624G), mem:6000000000 (5.58794G), overhead:2500000000 (2.32831G), min:6000000000 (5.58794G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.544+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.544+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.544+05:30 [Info] Index name:newEquivIdx 0, bucket:default, scope:, collection:, defnId:987654, instId:1658364292823496434, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.544+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.544+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.544+05:30 [Info]
2023-09-08T11:42:03.544+05:30 [Info] Indexer serverGroup:index 1, nodeId:127.0.0.1:9002, nodeUUID:d70e7e12b609acd0767c7b671c908889, useLiveData:true
2023-09-08T11:42:03.544+05:30 [Info] Indexer total memory:15235645282 (14.1893G), mem:13235645282 (12.3267G), overhead:2000000000 (1.86265G), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:1.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:03.544+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.45134728122445883 allowDDLDuringScaleup:true
2023-09-08T11:42:03.544+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.544+05:30 [Info] Index name:equiv1 0, bucket:default, scope:, collection:, defnId:1062966916559205800, instId:1062966916559205800, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.544+05:30 [Info] Index total memory:7000000000 (6.51926G), mem:5000000000 (4.65661G), overhead:2000000000 (1.86265G), min:5000000000 (4.65661G), data:0 (0) cpu:1.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.544+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.544+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.544+05:30 [Info] Index name:newEquivIdx 0 (replica 1), bucket:default, scope:, collection:, defnId:987654, instId:1658364292823496434, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.544+05:30 [Info] Index total memory:8235645282 (7.67004G), mem:8235645282 (7.67004G), overhead:0 (0), min:8235645282 (7.67004G), data:8235645282 (7.67004G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.544+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:false pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-08T11:42:03.547+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.2964535944160216
2023-09-08T11:42:03.672+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.672+05:30 [Info] Score: 0.1784816836053567
2023-09-08T11:42:03.672+05:30 [Info] variation: 0.3569633672107134
2023-09-08T11:42:03.672+05:30 [Info] ElapsedTime: 125ms
2023-09-08T11:42:03.672+05:30 [Info] ConvergenceTime: 121ms
2023-09-08T11:42:03.672+05:30 [Info] Iteration: 5300
2023-09-08T11:42:03.672+05:30 [Info] Move: 3805
2023-09-08T11:42:03.672+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.672+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.672+05:30 [Info] Indexer Memory Mean 154201322596 (143.611G)
2023-09-08T11:42:03.672+05:30 [Info] Indexer Memory Deviation 82829246465 (77.1407G) (53.72%)
2023-09-08T11:42:03.672+05:30 [Info] Indexer Memory Utilization 2.7956
2023-09-08T11:42:03.672+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:03.672+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:03.672+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:03.672+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.672+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.672+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.672+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.672+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.672+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.672+05:30 [Info] Indexer Data Size Mean 45394854109 (42.2773G)
2023-09-08T11:42:03.672+05:30 [Info] Indexer Data Size Deviation 8024752292 (7.47363G) (17.68%)
2023-09-08T11:42:03.672+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.672+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.672+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.672+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.672+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.672+05:30 [Info] Number of indexes: 20
2023-09-08T11:42:03.672+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.672+05:30 [Info] Avg Index Size: 23130198389 (21.5417G)
2023-09-08T11:42:03.672+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:03.672+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-08T11:42:03.672+05:30 [Info] Avg Index Cpu: 2.3000
2023-09-08T11:42:03.672+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:03.672+05:30 [Info] Num Estimation Run: 22
2023-09-08T11:42:03.672+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.672+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:03.672+05:30 [Info] CPU Quota 27
2023-09-08T11:42:03.672+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.672+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.672+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.672+05:30 [Info] Total iteration: 8665
2023-09-08T11:42:03.672+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.672+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.672+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.672+05:30 [Info] RandomMove time: 33ms
2023-09-08T11:42:03.672+05:30 [Info] RandomMove call: 5299 (empty index 0)
2023-09-08T11:42:03.672+05:30 [Info] RandomMove average time: 6us
2023-09-08T11:42:03.672+05:30 [Info] ExhaustMove time: 9us
2023-09-08T11:42:03.672+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:03.672+05:30 [Info] ExhaustMove average time: 9us
2023-09-08T11:42:03.672+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.672+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.672+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.672+05:30 [Info]
2023-09-08T11:42:03.672+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:03.672+05:30 [Info] Indexer total memory:301827829691 (281.099G), mem:271267444887 (252.637G), overhead:30560384804 (28.4616G), min:34046140582 (31.7079G), data:34046140582 (31.7079G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:6
2023-09-08T11:42:03.672+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5018354321742201 allowDDLDuringScaleup:true
2023-09-08T11:42:03.672+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.672+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.672+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.672+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.672+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.672+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.672+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.672+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:15162293585236819170, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:15162293585236819170, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info]
2023-09-08T11:42:03.673+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:03.673+05:30 [Info] Indexer total memory:108440151874 (100.993G), mem:92108996936 (85.7832G), overhead:16331154938 (15.2096G), min:51069210873 (47.5619G), data:51069210873 (47.5619G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-08T11:42:03.673+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3444658974194678 allowDDLDuringScaleup:true
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:15162293585236819170, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:15162293585236819170, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:15162293585236819170, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.673+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.673+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.673+05:30 [Info]
2023-09-08T11:42:03.673+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:03.673+05:30 [Info] Indexer total memory:122670760385 (114.246G), mem:99227525965 (92.4128G), overhead:23443234420 (21.8332G), min:51069210873 (47.5619G), data:51069210873 (47.5619G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-08T11:42:03.673+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.35369867040631203 allowDDLDuringScaleup:true
2023-09-08T11:42:03.673+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.673+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.674+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.674+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.674+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.674+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.674+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.674+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.674+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.674+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.674+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.674+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.674+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.674+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.674+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.674+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.674+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.674+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:15162293585236819170, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.674+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.674+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.674+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.674+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:15162293585236819170, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.674+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.674+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.674+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.674+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:15162293585236819170, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.674+05:30 [Info] Index total memory:17023070291 (15.854G), mem:17023070291 (15.854G), overhead:0 (0), min:17023070291 (15.854G), data:17023070291 (15.854G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.674+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Single Partitioned Index Instance - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-08T11:42:03.677+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.1449077211373998
2023-09-08T11:42:03.852+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:03.852+05:30 [Info] Score: 0.13739736706800032
2023-09-08T11:42:03.852+05:30 [Info] variation: 0.27479473413600064
2023-09-08T11:42:03.852+05:30 [Info] ElapsedTime: 175ms
2023-09-08T11:42:03.852+05:30 [Info] ConvergenceTime: 172ms
2023-09-08T11:42:03.852+05:30 [Info] Iteration: 7300
2023-09-08T11:42:03.852+05:30 [Info] Move: 4845
2023-09-08T11:42:03.852+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.852+05:30 [Info] Using SAPlanner
2023-09-08T11:42:03.852+05:30 [Info] Indexer Memory Mean 208747525973 (194.411G)
2023-09-08T11:42:03.852+05:30 [Info] Indexer Memory Deviation 77823744009 (72.479G) (37.28%)
2023-09-08T11:42:03.852+05:30 [Info] Indexer Memory Utilization 3.7845
2023-09-08T11:42:03.852+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:03.852+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:03.852+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:03.852+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:03.852+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:03.852+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:03.852+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.852+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:03.852+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:03.852+05:30 [Info] Indexer Data Size Mean 45221342736 (42.1157G)
2023-09-08T11:42:03.852+05:30 [Info] Indexer Data Size Deviation 7994079525 (7.44507G) (17.68%)
2023-09-08T11:42:03.852+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:03.852+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.852+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:03.852+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:03.852+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Number of indexes: 20
2023-09-08T11:42:03.853+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:03.853+05:30 [Info] Avg Index Size: 31312128896 (29.1617G)
2023-09-08T11:42:03.853+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:03.853+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-08T11:42:03.853+05:30 [Info] Avg Index Cpu: 2.3000
2023-09-08T11:42:03.853+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:03.853+05:30 [Info] Num Estimation Run: 23
2023-09-08T11:42:03.853+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:03.853+05:30 [Info] CPU Quota 27
2023-09-08T11:42:03.853+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:03.853+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:03.853+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Total iteration: 11250
2023-09-08T11:42:03.853+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:03.853+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:03.853+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:03.853+05:30 [Info] RandomMove time: 47ms
2023-09-08T11:42:03.853+05:30 [Info] RandomMove call: 7299 (empty index 0)
2023-09-08T11:42:03.853+05:30 [Info] RandomMove average time: 6us
2023-09-08T11:42:03.853+05:30 [Info] ExhaustMove time: 9us
2023-09-08T11:42:03.853+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:03.853+05:30 [Info] ExhaustMove average time: 9us
2023-09-08T11:42:03.853+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:03.853+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:03.853+05:30 [Info] ----------------------------------------
2023-09-08T11:42:03.853+05:30 [Info]
2023-09-08T11:42:03.853+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:03.853+05:30 [Info] Indexer total memory:301697696161 (280.978G), mem:271137311357 (252.516G), overhead:30560384804 (28.4616G), min:33916007052 (31.5867G), data:33916007052 (31.5867G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:6
2023-09-08T11:42:03.853+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4097753531140166 allowDDLDuringScaleup:true
2023-09-08T11:42:03.853+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.853+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.853+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.853+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.853+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.853+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.853+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.853+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.853+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.853+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.853+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.853+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.853+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:4388067631463235221, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.853+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.853+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.853+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.853+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:4388067631463235221, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.853+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.853+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.853+05:30 [Info]
2023-09-08T11:42:03.853+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:03.853+05:30 [Info] Indexer total memory:337728715583 (314.534G), mem:256072940893 (238.487G), overhead:81655774690 (76.0479G), min:50874010578 (47.3801G), data:50874010578 (47.3801G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-08T11:42:03.853+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.470342252272453 allowDDLDuringScaleup:true
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:4388067631463235221, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:4388067631463235221, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:4388067631463235221, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info]
2023-09-08T11:42:03.854+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:03.854+05:30 [Info] Indexer total memory:122475560090 (114.064G), mem:99032325670 (92.231G), overhead:23443234420 (21.8332G), min:50874010578 (47.3801G), data:50874010578 (47.3801G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:7
2023-09-08T11:42:03.854+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3198823946135304 allowDDLDuringScaleup:true
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:4388067631463235221, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:4388067631463235221, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.854+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.854+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:03.854+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:03.854+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:4388067631463235221, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:03.855+05:30 [Info] Index total memory:16958003526 (15.7934G), mem:16958003526 (15.7934G), overhead:0 (0), min:16958003526 (15.7934G), data:16958003526 (15.7934G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:03.855+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:03 -------------------------------------------
2023/09/08 11:42:03 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-08T11:42:03.857+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6231361756170619
2023-09-08T11:42:04.086+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.087+05:30 [Info] Score: 0.16324776491504728
2023-09-08T11:42:04.087+05:30 [Info] variation: 0.32649552983009456
2023-09-08T11:42:04.087+05:30 [Info] ElapsedTime: 229ms
2023-09-08T11:42:04.087+05:30 [Info] ConvergenceTime: 225ms
2023-09-08T11:42:04.087+05:30 [Info] Iteration: 9200
2023-09-08T11:42:04.087+05:30 [Info] Move: 4517
2023-09-08T11:42:04.087+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.087+05:30 [Info] Using SAPlanner
2023-09-08T11:42:04.087+05:30 [Info] Indexer Memory Mean 157055841798 (146.27G)
2023-09-08T11:42:04.087+05:30 [Info] Indexer Memory Deviation 88674154216 (82.5842G) (56.46%)
2023-09-08T11:42:04.087+05:30 [Info] Indexer Memory Utilization 2.8474
2023-09-08T11:42:04.087+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:04.087+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:04.087+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:04.087+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:04.087+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:04.087+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:04.087+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.087+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:04.087+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.087+05:30 [Info] Indexer Data Size Mean 48249373312 (44.9357G)
2023-09-08T11:42:04.087+05:30 [Info] Indexer Data Size Deviation 4264682382 (3.97179G) (8.84%)
2023-09-08T11:42:04.087+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:04.087+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.087+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:04.087+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.087+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.087+05:30 [Info] Number of indexes: 28
2023-09-08T11:42:04.087+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:04.087+05:30 [Info] Avg Index Size: 16827411621 (15.6717G)
2023-09-08T11:42:04.087+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:04.087+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-08T11:42:04.087+05:30 [Info] Avg Index Cpu: 1.6429
2023-09-08T11:42:04.087+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:04.087+05:30 [Info] Num Estimation Run: 28
2023-09-08T11:42:04.087+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.087+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:04.087+05:30 [Info] CPU Quota 27
2023-09-08T11:42:04.087+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:04.087+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:04.087+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.087+05:30 [Info] Total iteration: 14675
2023-09-08T11:42:04.087+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:04.087+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:04.087+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:04.087+05:30 [Info] RandomMove time: 64ms
2023-09-08T11:42:04.087+05:30 [Info] RandomMove call: 9199 (empty index 0)
2023-09-08T11:42:04.087+05:30 [Info] RandomMove average time: 7us
2023-09-08T11:42:04.087+05:30 [Info] ExhaustMove time: 8us
2023-09-08T11:42:04.087+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:04.087+05:30 [Info] ExhaustMove average time: 8us
2023-09-08T11:42:04.087+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:04.087+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:04.087+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.087+05:30 [Info]
2023-09-08T11:42:04.087+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:04.087+05:30 [Info] Indexer total memory:313015476589 (291.518G), mem:282455091785 (263.057G), overhead:30560384804 (28.4616G), min:45233787480 (42.1272G), data:45233787480 (42.1272G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-08T11:42:04.087+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5471874698199197 allowDDLDuringScaleup:true
2023-09-08T11:42:04.087+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.087+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.087+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info]
2023-09-08T11:42:04.088+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:04.088+05:30 [Info] Indexer total memory:111651485977 (103.984G), mem:95320331039 (88.774G), overhead:16331154938 (15.2096G), min:54280544976 (50.5527G), data:54280544976 (50.5527G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-09-08T11:42:04.088+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.346383999407285 allowDDLDuringScaleup:true
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.088+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.088+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.088+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.088+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info]
2023-09-08T11:42:04.089+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:04.089+05:30 [Info] Indexer total memory:116835336992 (108.811G), mem:93392102572 (86.9782G), overhead:23443234420 (21.8332G), min:45233787480 (42.1272G), data:45233787480 (42.1272G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-08T11:42:04.089+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3064285307727953 allowDDLDuringScaleup:true
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.089+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.089+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.089+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.089+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.090+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.090+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.090+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.090+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:8341559767073138256, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.090+05:30 [Info] Index total memory:9046757496 (8.42545G), mem:9046757496 (8.42545G), overhead:0 (0), min:9046757496 (8.42545G), data:9046757496 (8.42545G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.090+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:04 -------------------------------------------
2023/09/08 11:42:04 Place Paritioned Index with 1 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-08T11:42:04.092+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.22437807863505194
2023-09-08T11:42:04.244+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.244+05:30 [Info] Score: 0.11475962811811741
2023-09-08T11:42:04.244+05:30 [Info] variation: 0.22951925623623481
2023-09-08T11:42:04.244+05:30 [Info] ElapsedTime: 151ms
2023-09-08T11:42:04.244+05:30 [Info] ConvergenceTime: 149ms
2023-09-08T11:42:04.244+05:30 [Info] Iteration: 6200
2023-09-08T11:42:04.244+05:30 [Info] Move: 4045
2023-09-08T11:42:04.244+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.244+05:30 [Info] Using SAPlanner
2023-09-08T11:42:04.244+05:30 [Info] Indexer Memory Mean 211591134437 (197.06G)
2023-09-08T11:42:04.244+05:30 [Info] Indexer Memory Deviation 78426288854 (73.0402G) (37.07%)
2023-09-08T11:42:04.244+05:30 [Info] Indexer Memory Utilization 3.8361
2023-09-08T11:42:04.244+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:04.244+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:04.244+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:04.244+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:04.244+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:04.244+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:04.244+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.244+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:04.244+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.244+05:30 [Info] Indexer Data Size Mean 48064951200 (44.764G)
2023-09-08T11:42:04.244+05:30 [Info] Indexer Data Size Deviation 4248381616 (3.95661G) (8.84%)
2023-09-08T11:42:04.244+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:04.244+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.244+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:04.244+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.244+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.244+05:30 [Info] Number of indexes: 28
2023-09-08T11:42:04.244+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:04.244+05:30 [Info] Avg Index Size: 22670478689 (21.1135G)
2023-09-08T11:42:04.244+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:04.244+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-08T11:42:04.244+05:30 [Info] Avg Index Cpu: 1.6429
2023-09-08T11:42:04.244+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:04.244+05:30 [Info] Num Estimation Run: 29
2023-09-08T11:42:04.244+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.244+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:04.244+05:30 [Info] CPU Quota 27
2023-09-08T11:42:04.244+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:04.244+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:04.244+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.244+05:30 [Info] Total iteration: 10202
2023-09-08T11:42:04.244+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:04.244+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:04.244+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:04.244+05:30 [Info] RandomMove time: 41ms
2023-09-08T11:42:04.244+05:30 [Info] RandomMove call: 6199 (empty index 0)
2023-09-08T11:42:04.244+05:30 [Info] RandomMove average time: 6us
2023-09-08T11:42:04.244+05:30 [Info] ExhaustMove time: 14us
2023-09-08T11:42:04.244+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:04.244+05:30 [Info] ExhaustMove average time: 14us
2023-09-08T11:42:04.244+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:04.244+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:04.245+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.245+05:30 [Info]
2023-09-08T11:42:04.245+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:04.245+05:30 [Info] Indexer total memory:312842580859 (291.357G), mem:282282196055 (262.896G), overhead:30560384804 (28.4616G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-08T11:42:04.245+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4543185477672772 allowDDLDuringScaleup:true
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info]
2023-09-08T11:42:04.245+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:04.245+05:30 [Info] Indexer total memory:331915596755 (309.12G), mem:250259822065 (233.073G), overhead:81655774690 (76.0479G), min:45060891750 (41.9662G), data:45060891750 (41.9662G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:9
2023-09-08T11:42:04.245+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.42405038546912194 allowDDLDuringScaleup:true
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.245+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.245+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.245+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.245+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info]
2023-09-08T11:42:04.246+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:04.246+05:30 [Info] Indexer total memory:125674619612 (117.044G), mem:102231385192 (95.2104G), overhead:23443234420 (21.8332G), min:54073070100 (50.3595G), data:54073070100 (50.3595G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:10
2023-09-08T11:42:04.246+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.32163106676360087 allowDDLDuringScaleup:true
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.246+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.246+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:13937137265094755487, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.246+05:30 [Info] Index total memory:9012178350 (8.39325G), mem:9012178350 (8.39325G), overhead:0 (0), min:9012178350 (8.39325G), data:9012178350 (8.39325G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.246+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:04 -------------------------------------------
2023/09/08 11:42:04 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-08T11:42:04.249+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.07657419497994714
2023-09-08T11:42:04.283+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.283+05:30 [Info] Score: 0.14532097559770876
2023-09-08T11:42:04.283+05:30 [Info] variation: 0.2906419511954175
2023-09-08T11:42:04.283+05:30 [Info] ElapsedTime: 34ms
2023-09-08T11:42:04.283+05:30 [Info] ConvergenceTime: 5ms
2023-09-08T11:42:04.283+05:30 [Info] Iteration: 8
2023-09-08T11:42:04.283+05:30 [Info] Move: 8
2023-09-08T11:42:04.283+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.283+05:30 [Info] Using SAPlanner
2023-09-08T11:42:04.283+05:30 [Info] Indexer Memory Mean 156291089214 (145.557G)
2023-09-08T11:42:04.283+05:30 [Info] Indexer Memory Deviation 90849494247 (84.6102G) (58.13%)
2023-09-08T11:42:04.283+05:30 [Info] Indexer Memory Utilization 2.8335
2023-09-08T11:42:04.283+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:04.283+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:04.283+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:04.283+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:04.283+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:04.283+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:04.283+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.283+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:04.283+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.283+05:30 [Info] Indexer Data Size Mean 47484620728 (44.2235G)
2023-09-08T11:42:04.283+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:42:04.283+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:04.284+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.284+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:04.284+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.284+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.284+05:30 [Info] Number of indexes: 36
2023-09-08T11:42:04.284+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:04.284+05:30 [Info] Avg Index Size: 13024257434 (12.1298G)
2023-09-08T11:42:04.284+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:04.284+05:30 [Info] Max Indexer Overhead: 30560384804 (28.4616G)
2023-09-08T11:42:04.284+05:30 [Info] Avg Index Cpu: 1.2778
2023-09-08T11:42:04.284+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:04.284+05:30 [Info] Num Estimation Run: 32
2023-09-08T11:42:04.284+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.284+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:04.284+05:30 [Info] CPU Quota 27
2023-09-08T11:42:04.284+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:04.284+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:04.284+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.284+05:30 [Info] Total iteration: 6704
2023-09-08T11:42:04.284+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:04.284+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:04.284+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:04.284+05:30 [Info] RandomMove time: 64us
2023-09-08T11:42:04.284+05:30 [Info] RandomMove call: 7 (empty index 0)
2023-09-08T11:42:04.284+05:30 [Info] RandomMove average time: 9us
2023-09-08T11:42:04.284+05:30 [Info] ExhaustMove time: 22us
2023-09-08T11:42:04.284+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:04.284+05:30 [Info] ExhaustMove average time: 22us
2023-09-08T11:42:04.284+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:04.284+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:04.284+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.284+05:30 [Info]
2023-09-08T11:42:04.284+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:04.284+05:30 [Info] Indexer total memory:315266309837 (293.615G), mem:284705925033 (265.153G), overhead:30560384804 (28.4616G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-08T11:42:04.284+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.5643277764120702 allowDDLDuringScaleup:true
2023-09-08T11:42:04.284+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.284+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.284+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.284+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.284+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.284+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.284+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.284+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.284+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.284+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.284+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.284+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.284+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.284+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info]
2023-09-08T11:42:04.285+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:04.285+05:30 [Info] Indexer total memory:104855561729 (97.6544G), mem:88524406791 (82.4448G), overhead:16331154938 (15.2096G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-08T11:42:04.285+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3132814509590003 allowDDLDuringScaleup:true
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:8339546089 (7.76681G), mem:5550922096 (5.1697G), overhead:2788623993 (2.59711G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:21554403914 (20.0741G), mem:14611943820 (13.6084G), overhead:6942460094 (6.46567G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.285+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.285+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.285+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.285+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info]
2023-09-08T11:42:04.286+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:04.286+05:30 [Info] Indexer total memory:119086170240 (110.908G), mem:95642935820 (89.0744G), overhead:23443234420 (21.8332G), min:47484620728 (44.2235G), data:47484620728 (44.2235G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-08T11:42:04.286+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.3223907726289295 allowDDLDuringScaleup:true
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.286+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.286+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.286+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.286+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.287+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.287+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.287+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.287+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.287+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.287+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.287+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.287+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.287+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.287+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.287+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.287+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.287+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.287+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.287+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.287+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.287+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.287+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.287+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.287+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.287+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.287+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.287+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:11857248126044204443, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.287+05:30 [Info] Index total memory:5935577591 (5.52794G), mem:5935577591 (5.52794G), overhead:0 (0), min:5935577591 (5.52794G), data:5935577591 (5.52794G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.287+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:04 -------------------------------------------
2023/09/08 11:42:04 Place Paritioned Index with 2 replica - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-08T11:42:04.290+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3843024078548333
2023-09-08T11:42:04.326+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.326+05:30 [Info] Score: 0.09796819540510597
2023-09-08T11:42:04.326+05:30 [Info] variation: 0.19593639081021194
2023-09-08T11:42:04.326+05:30 [Info] ElapsedTime: 36ms
2023-09-08T11:42:04.326+05:30 [Info] ConvergenceTime: 6ms
2023-09-08T11:42:04.326+05:30 [Info] Iteration: 8
2023-09-08T11:42:04.326+05:30 [Info] Move: 8
2023-09-08T11:42:04.326+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.326+05:30 [Info] Using SAPlanner
2023-09-08T11:42:04.326+05:30 [Info] Indexer Memory Mean 210829304949 (196.35G)
2023-09-08T11:42:04.326+05:30 [Info] Indexer Memory Deviation 82618266177 (76.9443G) (39.19%)
2023-09-08T11:42:04.326+05:30 [Info] Indexer Memory Utilization 3.8223
2023-09-08T11:42:04.326+05:30 [Info] Indexer CPU Mean 15.3333
2023-09-08T11:42:04.326+05:30 [Info] Indexer CPU Deviation 1.70 (11.08%)
2023-09-08T11:42:04.326+05:30 [Info] Indexer CPU Utilization 0.5679
2023-09-08T11:42:04.326+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:04.326+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:04.326+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:04.326+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.326+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:04.326+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.326+05:30 [Info] Indexer Data Size Mean 47303121712 (44.0545G)
2023-09-08T11:42:04.326+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:42:04.326+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:04.326+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.326+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:04.326+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.326+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.326+05:30 [Info] Number of indexes: 36
2023-09-08T11:42:04.326+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:04.326+05:30 [Info] Avg Index Size: 17569108745 (16.3625G)
2023-09-08T11:42:04.326+05:30 [Info] Max Index Size: 73059719100 (68.0422G)
2023-09-08T11:42:04.326+05:30 [Info] Max Indexer Overhead: 81655774690 (76.0479G)
2023-09-08T11:42:04.326+05:30 [Info] Avg Index Cpu: 1.2778
2023-09-08T11:42:04.326+05:30 [Info] Max Index Cpu: 5.0000
2023-09-08T11:42:04.326+05:30 [Info] Num Estimation Run: 33
2023-09-08T11:42:04.326+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.326+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:04.326+05:30 [Info] CPU Quota 27
2023-09-08T11:42:04.326+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:04.326+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:04.327+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Total iteration: 6730
2023-09-08T11:42:04.327+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:04.327+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:04.327+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:04.327+05:30 [Info] RandomMove time: 71us
2023-09-08T11:42:04.327+05:30 [Info] RandomMove call: 7 (empty index 0)
2023-09-08T11:42:04.327+05:30 [Info] RandomMove average time: 10us
2023-09-08T11:42:04.327+05:30 [Info] ExhaustMove time: 11us
2023-09-08T11:42:04.327+05:30 [Info] ExhaustMove call: 1
2023-09-08T11:42:04.327+05:30 [Info] ExhaustMove average time: 11us
2023-09-08T11:42:04.327+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:04.327+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:04.327+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.327+05:30 [Info]
2023-09-08T11:42:04.327+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9000, nodeUUID:tempNodeUUID_2596996162, useLiveData:true
2023-09-08T11:42:04.327+05:30 [Info] Indexer total memory:315084810821 (293.446G), mem:284524426017 (264.984G), overhead:30560384804 (28.4616G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:17.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-08T11:42:04.327+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.4699097510048492 allowDDLDuringScaleup:true
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:82702164802 (77.0224G), mem:72507837150 (67.5282G), overhead:10194327652 (9.49421G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:0, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:73074448027 (68.0559G), mem:63899137575 (59.5107G), overhead:9175310452 (8.54517G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:idx1 3, bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:idx1 0 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:idx1 6 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:idx1 7 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:idx1 1 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:idx1 5 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:idx1 4, bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.327+05:30 [Info] Index name:idx1 2 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.327+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.327+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.327+05:30 [Info]
2023-09-08T11:42:04.328+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9001, nodeUUID:tempNodeUUID_4039455774, useLiveData:true
2023-09-08T11:42:04.328+05:30 [Info] Indexer total memory:334157826717 (311.209G), mem:252502052027 (235.161G), overhead:81655774690 (76.0479G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:13.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-08T11:42:04.328+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.43953221501885753 allowDDLDuringScaleup:true
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:1, bucket:bucket1, scope:, collection:, defnId:1, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:30961528072 (28.8352G), mem:27754610480 (25.8485G), overhead:3206917592 (2.98667G), min:5550922096 (5.1697G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:2, bucket:bucket1, scope:, collection:, defnId:2, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:81043548208 (75.4777G), mem:73059719100 (68.0422G), overhead:7983829108 (7.43552G), min:14611943820 (13.6084G), data:0 (0) cpu:4.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:55876178105 (52.0387G), mem:52222430260 (48.6359G), overhead:3653747845 (3.40282G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:56098504109 (52.2458G), mem:52162170475 (48.5798G), overhead:3936333634 (3.666G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 1, bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 2, bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 7, bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 0 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 3 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 4 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 5 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 6, bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info]
2023-09-08T11:42:04.328+05:30 [Info] Indexer serverGroup:, nodeId:127.0.0.1:9002, nodeUUID:tempNodeUUID_2854263694, useLiveData:true
2023-09-08T11:42:04.328+05:30 [Info] Indexer total memory:118904671224 (110.739G), mem:95461436804 (88.9054G), overhead:23443234420 (21.8332G), min:47303121712 (44.0545G), data:47303121712 (44.0545G) cpu:16.0000, io:0 (0), scan:0 drain:0 numIndexes:12
2023-09-08T11:42:04.328+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.29055803397629315 allowDDLDuringScaleup:true
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:3, bucket:bucket1, scope:, collection:, defnId:3, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:23366200171 (21.7615G), mem:14501567430 (13.5056G), overhead:8864632741 (8.25583G), min:14501567430 (13.5056G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:4, bucket:bucket1, scope:, collection:, defnId:4, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:20758358343 (19.3327G), mem:12779827515 (11.9021G), overhead:7978530828 (7.43059G), min:12779827515 (11.9021G), data:0 (0) cpu:5.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:5, bucket:bucket1, scope:, collection:, defnId:5, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:13621658091 (12.6862G), mem:10444486052 (9.72719G), overhead:3177172039 (2.95897G), min:10444486052 (9.72719G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:6, bucket:bucket1, scope:, collection:, defnId:6, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:13855332907 (12.9038G), mem:10432434095 (9.71596G), overhead:3422898812 (3.18782G), min:10432434095 (9.71596G), data:0 (0) cpu:3.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 0, bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.328+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.328+05:30 [Info] Index name:idx1 5, bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 5, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.328+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.328+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.329+05:30 [Info] Index name:idx1 1 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 1, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.329+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.329+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.329+05:30 [Info] Index name:idx1 2 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 2, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.329+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.329+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.329+05:30 [Info] Index name:idx1 4 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 4, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.329+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.329+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.329+05:30 [Info] Index name:idx1 6 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 6, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.329+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.329+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.329+05:30 [Info] Index name:idx1 7 (replica 2), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 7, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.329+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.329+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.329+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.329+05:30 [Info] Index name:idx1 3 (replica 1), bucket:bucket2, scope:, collection:, defnId:987654, instId:10735326552420539730, Partition: 3, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.329+05:30 [Info] Index total memory:5912890214 (5.50681G), mem:5912890214 (5.50681G), overhead:0 (0), min:5912890214 (5.50681G), data:5912890214 (5.50681G) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.329+05:30 [Info] Index resident:0% build:0% estimated:true equivCheck:true pendingCreate:false pendingDelete:false
=== RUN TestPlanDuringHeterogenousScaleup/CommandRepair
2023/09/08 11:42:04 -------------------------------------------
2023/09/08 11:42:04 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-08T11:42:04.329+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-08T11:42:04.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=6us
2023-09-08T11:42:04.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-08T11:42:04.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-09-08T11:42:04.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-08T11:42:04.330+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-09-08T11:42:04.330+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-09-08T11:42:04.330+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:04.330+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.330+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=135us
2023-09-08T11:42:04.330+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.8995910950151497
2023-09-08T11:42:04.330+05:30 [Info] Planner::initial temperature: initial resource variation 0.8995910950151497 temp 0.08995910950151498
2023-09-08T11:42:04.330+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:04.330+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.330+05:30 [Info] Score: 0.22489777375378742
2023-09-08T11:42:04.330+05:30 [Info] variation: 0.8995910950151497
2023-09-08T11:42:04.330+05:30 [Info] ElapsedTime: 75us
2023-09-08T11:42:04.330+05:30 [Info] ConvergenceTime: 2us
2023-09-08T11:42:04.330+05:30 [Info] Iteration: 0
2023-09-08T11:42:04.330+05:30 [Info] Move: 0
2023-09-08T11:42:04.330+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.330+05:30 [Info] Using SAPlanner
2023-09-08T11:42:04.330+05:30 [Info] Indexer Memory Mean 122486397174 (114.074G)
2023-09-08T11:42:04.330+05:30 [Info] Indexer Memory Deviation 110187672158 (102.62G) (89.96%)
2023-09-08T11:42:04.330+05:30 [Info] Indexer Memory Utilization 2.2206
2023-09-08T11:42:04.330+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:42:04.330+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:42:04.330+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:42:04.330+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:04.330+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:04.330+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:04.330+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.330+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:04.330+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.330+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-08T11:42:04.330+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:42:04.330+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:04.330+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.330+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:04.330+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.330+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.330+05:30 [Info] Number of indexes: 4
2023-09-08T11:42:04.330+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:04.330+05:30 [Info] Avg Index Size: 91864797880 (85.5558G)
2023-09-08T11:42:04.330+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-08T11:42:04.330+05:30 [Info] Max Indexer Overhead: 46891539742 (43.6711G)
2023-09-08T11:42:04.330+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-08T11:42:04.330+05:30 [Info] Max Index Cpu: 0.0000
2023-09-08T11:42:04.330+05:30 [Info] Num Estimation Run: 0
2023-09-08T11:42:04.330+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.330+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:04.330+05:30 [Info] CPU Quota 27
2023-09-08T11:42:04.330+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:04.330+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:04.330+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.330+05:30 [Info] Total iteration: 0
2023-09-08T11:42:04.330+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:04.330+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:04.330+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:04.330+05:30 [Info] RandomMove time: 0ns
2023-09-08T11:42:04.330+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-08T11:42:04.330+05:30 [Info] ExhaustMove time: 0ns
2023-09-08T11:42:04.330+05:30 [Info] ExhaustMove call: 0
2023-09-08T11:42:04.330+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:04.330+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:04.330+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.330+05:30 [Info]
2023-09-08T11:42:04.330+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-08T11:42:04.330+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:04.331+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.45435427408637796 allowDDLDuringScaleup:true
2023-09-08T11:42:04.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.331+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.331+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.331+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.331+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:9577803219774698770, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.331+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.331+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.331+05:30 [Info]
2023-09-08T11:42:04.331+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-08T11:42:04.331+05:30 [Info] Indexer total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:04.331+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.06701117350131312 allowDDLDuringScaleup:true
2023-09-08T11:42:04.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.331+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.331+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.331+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.331+05:30 [Info]
2023-09-08T11:42:04.331+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-08T11:42:04.331+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:04.331+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0786345524123089 allowDDLDuringScaleup:true
2023-09-08T11:42:04.331+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.331+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.331+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.331+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:04 -------------------------------------------
2023/09/08 11:42:04 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 1 Scaled up
2023-09-08T11:42:04.331+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1,0) with initial placement on node: 127.0.0.1:9002
2023-09-08T11:42:04.331+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:04.331+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-09-08T11:42:04.331+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=4us
2023-09-08T11:42:04.331+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-08T11:42:04.331+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-09-08T11:42:04.331+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=7us
2023-09-08T11:42:04.331+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-09-08T11:42:04.331+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-09-08T11:42:04.331+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:04.331+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.331+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=125us
2023-09-08T11:42:04.331+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-08T11:42:04.332+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0795046976786775
2023-09-08T11:42:04.332+05:30 [Info] Planner::initial temperature: initial resource variation 0.0795046976786775 temp 0.00795046976786775
2023-09-08T11:42:04.332+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:04.332+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.332+05:30 [Info] Score: 0.019876174419669376
2023-09-08T11:42:04.332+05:30 [Info] variation: 0.0795046976786775
2023-09-08T11:42:04.332+05:30 [Info] ElapsedTime: 74us
2023-09-08T11:42:04.332+05:30 [Info] ConvergenceTime: 2us
2023-09-08T11:42:04.332+05:30 [Info] Iteration: 0
2023-09-08T11:42:04.332+05:30 [Info] Move: 0
2023-09-08T11:42:04.332+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Using SAPlanner
2023-09-08T11:42:04.332+05:30 [Info] Indexer Memory Mean 266954004690 (248.62G)
2023-09-08T11:42:04.332+05:30 [Info] Indexer Memory Deviation 21224097436 (19.7665G) (7.95%)
2023-09-08T11:42:04.332+05:30 [Info] Indexer Memory Utilization 4.8398
2023-09-08T11:42:04.332+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:42:04.332+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:42:04.332+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:42:04.332+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:04.332+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:04.332+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:04.332+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.332+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:04.332+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.332+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-08T11:42:04.332+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:42:04.332+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:04.332+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.332+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:04.332+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.332+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Number of indexes: 5
2023-09-08T11:42:04.332+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:04.332+05:30 [Info] Avg Index Size: 160172402814 (149.172G)
2023-09-08T11:42:04.332+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-08T11:42:04.332+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-09-08T11:42:04.332+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-08T11:42:04.332+05:30 [Info] Max Index Cpu: 0.0000
2023-09-08T11:42:04.332+05:30 [Info] Num Estimation Run: 0
2023-09-08T11:42:04.332+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:04.332+05:30 [Info] CPU Quota 27
2023-09-08T11:42:04.332+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:04.332+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:04.332+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Total iteration: 0
2023-09-08T11:42:04.332+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:04.332+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:04.332+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:04.332+05:30 [Info] RandomMove time: 0ns
2023-09-08T11:42:04.332+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-08T11:42:04.332+05:30 [Info] ExhaustMove time: 0ns
2023-09-08T11:42:04.332+05:30 [Info] ExhaustMove call: 0
2023-09-08T11:42:04.332+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:04.332+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:04.332+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.332+05:30 [Info]
2023-09-08T11:42:04.332+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-08T11:42:04.332+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:04.332+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1777244769790758 allowDDLDuringScaleup:true
2023-09-08T11:42:04.332+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.332+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.332+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.332+05:30 [Info]
2023-09-08T11:42:04.332+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-08T11:42:04.332+05:30 [Info] Indexer total memory:325152630110 (302.822G), mem:278261090368 (259.151G), overhead:46891539742 (43.6711G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:04.332+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.20847118640616036 allowDDLDuringScaleup:true
2023-09-08T11:42:04.332+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.332+05:30 [Info] Index total memory:57370941001 (53.4309G), mem:41039786063 (38.2213G), overhead:16331154938 (15.2096G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.332+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.332+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:12142910874253593669, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.332+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.332+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.332+05:30 [Info]
2023-09-08T11:42:04.332+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-08T11:42:04.332+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:04.332+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.2138043366147638 allowDDLDuringScaleup:true
2023-09-08T11:42:04.332+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.332+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.332+05:30 [Info] Index resident:0% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.332+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.332+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:16691336698111079560, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.332+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.332+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:04 -------------------------------------------
2023/09/08 11:42:04 Increment Replica count by 1 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-08T11:42:04.333+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx2,2,0) with initial placement on node: 127.0.0.1:9001
2023-09-08T11:42:04.333+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-08T11:42:04.333+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-09-08T11:42:04.333+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=7us
2023-09-08T11:42:04.333+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=6us
2023-09-08T11:42:04.333+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-09-08T11:42:04.333+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-09-08T11:42:04.333+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:04.333+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.333+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=199us
2023-09-08T11:42:04.333+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6987684835628951
2023-09-08T11:42:04.333+05:30 [Info] Planner::initial temperature: initial resource variation 0.6987684835628951 temp 0.06987684835628952
2023-09-08T11:42:04.333+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:04.333+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.333+05:30 [Info] Score: 0.17469212089072378
2023-09-08T11:42:04.333+05:30 [Info] variation: 0.6987684835628951
2023-09-08T11:42:04.333+05:30 [Info] ElapsedTime: 71us
2023-09-08T11:42:04.333+05:30 [Info] ConvergenceTime: 2us
2023-09-08T11:42:04.333+05:30 [Info] Iteration: 0
2023-09-08T11:42:04.333+05:30 [Info] Move: 0
2023-09-08T11:42:04.333+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.333+05:30 [Info] Using SAPlanner
2023-09-08T11:42:04.333+05:30 [Info] Indexer Memory Mean 231925826675 (215.998G)
2023-09-08T11:42:04.333+05:30 [Info] Indexer Memory Deviation 162062458205 (150.932G) (69.88%)
2023-09-08T11:42:04.333+05:30 [Info] Indexer Memory Utilization 4.2047
2023-09-08T11:42:04.333+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:42:04.333+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:42:04.333+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:42:04.333+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:04.333+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:04.333+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:04.333+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.333+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:04.333+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.333+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-08T11:42:04.333+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:42:04.334+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:04.334+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.334+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:04.334+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.334+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.334+05:30 [Info] Number of indexes: 4
2023-09-08T11:42:04.334+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:04.334+05:30 [Info] Avg Index Size: 173944370006 (161.998G)
2023-09-08T11:42:04.334+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-08T11:42:04.334+05:30 [Info] Max Indexer Overhead: 49341212983 (45.9526G)
2023-09-08T11:42:04.334+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-08T11:42:04.334+05:30 [Info] Max Index Cpu: 0.0000
2023-09-08T11:42:04.334+05:30 [Info] Num Estimation Run: 0
2023-09-08T11:42:04.334+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.334+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:04.334+05:30 [Info] CPU Quota 27
2023-09-08T11:42:04.334+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:04.334+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:04.334+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.334+05:30 [Info] Total iteration: 0
2023-09-08T11:42:04.334+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:04.334+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:04.334+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:04.334+05:30 [Info] RandomMove time: 0ns
2023-09-08T11:42:04.334+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-08T11:42:04.334+05:30 [Info] ExhaustMove time: 0ns
2023-09-08T11:42:04.334+05:30 [Info] ExhaustMove call: 0
2023-09-08T11:42:04.334+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:04.334+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:04.334+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.334+05:30 [Info]
2023-09-08T11:42:04.334+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-08T11:42:04.334+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:52248944865 (48.6606G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:04.334+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.38151873032984485 allowDDLDuringScaleup:true
2023-09-08T11:42:04.334+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.334+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.334+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:28015361594 (26.0913G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.334+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.334+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.334+05:30 [Info] Index name:replicaIdx2 0 (replica 2), bucket:default, scope:, collection:, defnId:4242, instId:17375582012406519133, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.334+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.334+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.334+05:30 [Info]
2023-09-08T11:42:04.334+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-08T11:42:04.334+05:30 [Info] Indexer total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:04.334+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.1769522034317959 allowDDLDuringScaleup:true
2023-09-08T11:42:04.334+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.334+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.334+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:24233583271 (22.5693G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.334+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.334+05:30 [Info]
2023-09-08T11:42:04.334+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-08T11:42:04.334+05:30 [Info] Indexer total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:04.334+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.0415290662383593 allowDDLDuringScaleup:true
2023-09-08T11:42:04.334+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.334+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.334+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:28437003477 (26.484G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.334+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023/09/08 11:42:04 -------------------------------------------
2023/09/08 11:42:04 Increment Replica count by 2 - 3 non-empty heterogenous nodes with 2 Scaled up
2023-09-08T11:42:04.335+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,1,0) with initial placement on node: 127.0.0.1:9003
2023-09-08T11:42:04.335+05:30 [Info] Rebuilding lost replica for (default,,,replicaIdx1,2,0) with initial placement on node: 127.0.0.1:9002
2023-09-08T11:42:04.335+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-09-08T11:42:04.335+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-09-08T11:42:04.335+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-09-08T11:42:04.335+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-09-08T11:42:04.335+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=7us
2023-09-08T11:42:04.335+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-09-08T11:42:04.335+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-09-08T11:42:04.335+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:04.335+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.335+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=127us
2023-09-08T11:42:04.335+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-09-08T11:42:04.335+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27237243417194856
2023-09-08T11:42:04.335+05:30 [Info] Planner::initial temperature: initial resource variation 0.27237243417194856 temp 0.027237243417194856
2023-09-08T11:42:04.335+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-09-08T11:42:04.335+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-09-08T11:42:04.335+05:30 [Info] Score: 0.06809310854298714
2023-09-08T11:42:04.335+05:30 [Info] variation: 0.27237243417194856
2023-09-08T11:42:04.335+05:30 [Info] ElapsedTime: 121us
2023-09-08T11:42:04.335+05:30 [Info] ConvergenceTime: 2us
2023-09-08T11:42:04.335+05:30 [Info] Iteration: 0
2023-09-08T11:42:04.335+05:30 [Info] Move: 0
2023-09-08T11:42:04.335+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.335+05:30 [Info] Using SAPlanner
2023-09-08T11:42:04.335+05:30 [Info] Indexer Memory Mean 321673719440 (299.582G)
2023-09-08T11:42:04.335+05:30 [Info] Indexer Memory Deviation 87615053973 (81.5979G) (27.24%)
2023-09-08T11:42:04.335+05:30 [Info] Indexer Memory Utilization 5.8318
2023-09-08T11:42:04.335+05:30 [Info] Indexer CPU Mean 0.0000
2023-09-08T11:42:04.335+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-09-08T11:42:04.335+05:30 [Info] Indexer CPU Utilization 0.0000
2023-09-08T11:42:04.335+05:30 [Info] Indexer IO Mean 0.0000
2023-09-08T11:42:04.335+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-09-08T11:42:04.335+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-09-08T11:42:04.335+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.335+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-09-08T11:42:04.335+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-09-08T11:42:04.335+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-09-08T11:42:04.335+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-09-08T11:42:04.335+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-09-08T11:42:04.335+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.335+05:30 [Info] No. Index (from non-deleted node) 0
2023-09-08T11:42:04.335+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023-09-08T11:42:04.335+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.335+05:30 [Info] Number of indexes: 5
2023-09-08T11:42:04.335+05:30 [Info] Number of indexers: 3
2023-09-08T11:42:04.335+05:30 [Info] Avg Index Size: 193004231664 (179.749G)
2023-09-08T11:42:04.335+05:30 [Info] Max Index Size: 237221304305 (220.93G)
2023-09-08T11:42:04.335+05:30 [Info] Max Indexer Overhead: 54003619224 (50.2948G)
2023-09-08T11:42:04.335+05:30 [Info] Avg Index Cpu: 0.0000
2023-09-08T11:42:04.335+05:30 [Info] Max Index Cpu: 0.0000
2023-09-08T11:42:04.335+05:30 [Info] Num Estimation Run: 0
2023-09-08T11:42:04.335+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.336+05:30 [Info] Memory Quota 55158315092 (51.3702G)
2023-09-08T11:42:04.336+05:30 [Info] CPU Quota 27
2023-09-08T11:42:04.336+05:30 [Info] Max Cpu Utilization -1
2023-09-08T11:42:04.336+05:30 [Info] Max Memory Utilization -1
2023-09-08T11:42:04.336+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.336+05:30 [Info] Total iteration: 0
2023-09-08T11:42:04.336+05:30 [Info] RandomSwap time: 0ns
2023-09-08T11:42:04.336+05:30 [Info] RandomSwap call: 0
2023-09-08T11:42:04.336+05:30 [Info] RandomSwap iteration: 0
2023-09-08T11:42:04.336+05:30 [Info] RandomMove time: 0ns
2023-09-08T11:42:04.336+05:30 [Info] RandomMove call: 0 (empty index 0)
2023-09-08T11:42:04.336+05:30 [Info] ExhaustMove time: 0ns
2023-09-08T11:42:04.336+05:30 [Info] ExhaustMove call: 0
2023-09-08T11:42:04.336+05:30 [Info] ExhaustSwap time: 0ns
2023-09-08T11:42:04.336+05:30 [Info] ExhaustSwap call: 0
2023-09-08T11:42:04.336+05:30 [Info] ----------------------------------------
2023-09-08T11:42:04.336+05:30 [Info]
2023-09-08T11:42:04.336+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9001, nodeUUID:af33bb1cf058349f6fafffa6a843a979, useLiveData:true
2023-09-08T11:42:04.336+05:30 [Info] Indexer total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:1
2023-09-08T11:42:04.336+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.14749187761902688 allowDDLDuringScaleup:true
2023-09-08T11:42:04.336+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.336+05:30 [Info] Index name:replicaIdx1 0, bucket:default, scope:, collection:, defnId:1337, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.336+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.336+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.336+05:30 [Info]
2023-09-08T11:42:04.336+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9002, nodeUUID:929bb73f8aaeb55422bdc071cf2dfbfc, useLiveData:true
2023-09-08T11:42:04.336+05:30 [Info] Indexer total memory:491761447603 (457.989G), mem:442420234620 (412.036G), overhead:49341212983 (45.9526G), min:47024050377 (43.7946G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:04.336+05:30 [Info] Indexer isDeleted:false isNew:false exclude:inout meetConstraint:true usageRatio:0.2750739074297335 allowDDLDuringScaleup:true
2023-09-08T11:42:04.336+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.336+05:30 [Info] Index name:replicaIdx2 0 (replica 1), bucket:default, scope:, collection:, defnId:4242, instId:1, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.336+05:30 [Info] Index total memory:223979758494 (208.597G), mem:205198930315 (191.106G), overhead:18780828179 (17.491G), min:21810224943 (20.3124G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.336+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.336+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.336+05:30 [Info] Index name:replicaIdx1 0 (replica 2), bucket:default, scope:, collection:, defnId:1337, instId:2713177322294885497, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.336+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.336+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.336+05:30 [Info]
2023-09-08T11:42:04.336+05:30 [Info] Indexer serverGroup:sg0, nodeId:127.0.0.1:9003, nodeUUID:934d23a204d25a4970e0262fa63920ba, useLiveData:true
2023-09-08T11:42:04.336+05:30 [Info] Indexer total memory:339383238621 (316.075G), mem:285379619397 (265.78G), overhead:54003619224 (50.2948G), min:50807128563 (47.3178G), data:0 (0) cpu:0.0000, io:0 (0), scan:0 drain:0 numIndexes:2
2023-09-08T11:42:04.336+05:30 [Info] Indexer isDeleted:false isNew:false exclude: meetConstraint:true usageRatio:0.17743421495123962 allowDDLDuringScaleup:true
2023-09-08T11:42:04.336+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.336+05:30 [Info] Index name:replicaIdx2 0, bucket:default, scope:, collection:, defnId:4242, instId:2, Partition: 0, new/moved:false shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.336+05:30 [Info] Index total memory:71601549512 (66.6841G), mem:48158315092 (44.8509G), overhead:23443234420 (21.8332G), min:25593303129 (23.8356G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.336+05:30 [Info] Index resident:10% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
2023-09-08T11:42:04.336+05:30 [Info] ------------------------------------------------------------------------------------------------------------------
2023-09-08T11:42:04.336+05:30 [Info] Index name:replicaIdx1 0 (replica 1), bucket:default, scope:, collection:, defnId:1337, instId:16196316058597250630, Partition: 0, new/moved:true shardProxy: false, numInstances: 0, alternateShardIds: []
2023-09-08T11:42:04.336+05:30 [Info] Index total memory:267781689109 (249.391G), mem:237221304305 (220.93G), overhead:30560384804 (28.4616G), min:25213825434 (23.4822G), data:0 (0) cpu:0.0000 io:0 (0) scan:0 drain:0
2023-09-08T11:42:04.336+05:30 [Info] Index resident:50% build:0% estimated:false equivCheck:true pendingCreate:false pendingDelete:false
--- PASS: TestPlanDuringHeterogenousScaleup (1.84s)
--- PASS: TestPlanDuringHeterogenousScaleup/GreedyPlanner (0.02s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner (1.81s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/FunctionalDDLTests (1.03s)
--- PASS: TestPlanDuringHeterogenousScaleup/SAPlanner/CreatePartitionedIndex (0.78s)
--- PASS: TestPlanDuringHeterogenousScaleup/CommandRepair (0.01s)
=== RUN TestRestfulAPI
2023/09/08 11:42:04 In TestRestfulAPI()
2023/09/08 11:42:04 In DropAllSecondaryIndexes()
2023/09/08 11:42:04 Index found: indexmut_1
2023/09/08 11:42:04 Dropped index indexmut_1
2023/09/08 11:42:04 Setting JSON docs in KV
2023/09/08 11:42:05 GET all indexes
2023/09/08 11:42:05 200 OK
2023/09/08 11:42:05 FOUND indexes: []
2023/09/08 11:42:05 DROP index: badindexid
2023/09/08 11:42:05 status: 400 Bad Request
2023/09/08 11:42:05 DROP index: 23544142
2023/09/08 11:42:05 status: 500 Internal Server Error
2023/09/08 11:42:05 TEST: malformed body
2023/09/08 11:42:05 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"
2023/09/08 11:42:05 TEST: missing field ``name``
2023/09/08 11:42:05 400 Bad Request "missing field name"
2023/09/08 11:42:05 TEST: empty field ``name``
2023/09/08 11:42:05 400 Bad Request "empty field name"
2023/09/08 11:42:05 TEST: missing field ``bucket``
2023/09/08 11:42:05 400 Bad Request "missing field bucket"
2023/09/08 11:42:05 TEST: empty field ``bucket``
2023/09/08 11:42:05 400 Bad Request "empty field bucket"
2023/09/08 11:42:05 TEST: missing field ``secExprs``
2023/09/08 11:42:05 400 Bad Request "missing field secExprs"
2023/09/08 11:42:05 TEST: empty field ``secExprs``
2023/09/08 11:42:05 400 Bad Request "empty field secExprs"
2023/09/08 11:42:05 TEST: incomplete field ``desc``
2023/09/08 11:42:05 400 Bad Request "incomplete desc information [true]"
2023/09/08 11:42:05 TEST: invalid field ``desc``
2023/09/08 11:42:05 400 Bad Request "incomplete desc information [1]"
2023/09/08 11:42:05
2023/09/08 11:42:05 CREATE INDEX: idx1
2023/09/08 11:42:14 status : 201 Created
2023/09/08 11:42:14 {"id": "13931751779821209042"}
2023/09/08 11:42:14 CREATE INDEX: idx2 (defer)
2023/09/08 11:42:14 status : 201 Created
2023/09/08 11:42:14 {"id": "7654529815676709815"}
2023/09/08 11:42:14 CREATE INDEX: idx3 (defer)
2023/09/08 11:42:15 status : 201 Created
2023/09/08 11:42:15 {"id": "729781791476283960"}
2023/09/08 11:42:15 CREATE INDEX: idx4 (defer)
2023/09/08 11:42:15 status : 201 Created
2023/09/08 11:42:15 {"id": "11306688821086938678"}
2023/09/08 11:42:15 CREATE INDEX: idx5
2023/09/08 11:42:28 status : 201 Created
2023/09/08 11:42:28 {"id": "1298986460373295034"}
2023/09/08 11:42:28 BUILD single deferred index
2023/09/08 11:42:28 202 Accepted
2023/09/08 11:42:28 GET all indexes
2023/09/08 11:42:28 200 OK
2023/09/08 11:42:28 index idx1 in INDEX_STATE_ACTIVE
2023/09/08 11:42:28 GET all indexes
2023/09/08 11:42:28 200 OK
2023/09/08 11:42:28 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:29 GET all indexes
2023/09/08 11:42:29 200 OK
2023/09/08 11:42:29 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:30 GET all indexes
2023/09/08 11:42:30 200 OK
2023/09/08 11:42:30 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:31 GET all indexes
2023/09/08 11:42:31 200 OK
2023/09/08 11:42:31 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:32 GET all indexes
2023/09/08 11:42:32 200 OK
2023/09/08 11:42:32 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:33 GET all indexes
2023/09/08 11:42:33 200 OK
2023/09/08 11:42:33 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:34 GET all indexes
2023/09/08 11:42:34 200 OK
2023/09/08 11:42:34 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:35 GET all indexes
2023/09/08 11:42:35 200 OK
2023/09/08 11:42:35 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:36 GET all indexes
2023/09/08 11:42:36 200 OK
2023/09/08 11:42:36 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:37 GET all indexes
2023/09/08 11:42:37 200 OK
2023/09/08 11:42:37 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:38 GET all indexes
2023/09/08 11:42:38 200 OK
2023/09/08 11:42:38 index idx2 in INDEX_STATE_INITIAL
2023/09/08 11:42:39 GET all indexes
2023/09/08 11:42:39 200 OK
2023/09/08 11:42:39 index idx2 in INDEX_STATE_CATCHUP
2023/09/08 11:42:40 GET all indexes
2023/09/08 11:42:40 200 OK
2023/09/08 11:42:40 index idx2 in INDEX_STATE_ACTIVE
2023/09/08 11:42:40 BUILD many deferred index
2023/09/08 11:42:41 202 Accepted
2023/09/08 11:42:41 GET all indexes
2023/09/08 11:42:41 200 OK
2023/09/08 11:42:41 index idx1 in INDEX_STATE_ACTIVE
2023/09/08 11:42:41 GET all indexes
2023/09/08 11:42:41 200 OK
2023/09/08 11:42:41 index idx2 in INDEX_STATE_ACTIVE
2023/09/08 11:42:41 GET all indexes
2023/09/08 11:42:41 200 OK
2023/09/08 11:42:41 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:42 GET all indexes
2023/09/08 11:42:42 200 OK
2023/09/08 11:42:42 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:43 GET all indexes
2023/09/08 11:42:43 200 OK
2023/09/08 11:42:43 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:44 GET all indexes
2023/09/08 11:42:44 200 OK
2023/09/08 11:42:44 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:45 GET all indexes
2023/09/08 11:42:45 200 OK
2023/09/08 11:42:45 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:46 GET all indexes
2023/09/08 11:42:46 200 OK
2023/09/08 11:42:46 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:47 GET all indexes
2023/09/08 11:42:47 200 OK
2023/09/08 11:42:47 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:48 GET all indexes
2023/09/08 11:42:48 200 OK
2023/09/08 11:42:48 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:49 GET all indexes
2023/09/08 11:42:49 200 OK
2023/09/08 11:42:49 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:50 GET all indexes
2023/09/08 11:42:50 200 OK
2023/09/08 11:42:50 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:51 GET all indexes
2023/09/08 11:42:51 200 OK
2023/09/08 11:42:51 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:52 GET all indexes
2023/09/08 11:42:52 200 OK
2023/09/08 11:42:52 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:53 GET all indexes
2023/09/08 11:42:53 200 OK
2023/09/08 11:42:53 index idx3 in INDEX_STATE_INITIAL
2023/09/08 11:42:54 GET all indexes
2023/09/08 11:42:54 200 OK
2023/09/08 11:42:54 index idx3 in INDEX_STATE_ACTIVE
2023/09/08 11:42:54 GET all indexes
2023/09/08 11:42:54 200 OK
2023/09/08 11:42:54 index idx4 in INDEX_STATE_ACTIVE
2023/09/08 11:42:54 GET all indexes
2023/09/08 11:42:54 200 OK
2023/09/08 11:42:54 index idx5 in INDEX_STATE_ACTIVE
2023/09/08 11:42:54 GET all indexes
2023/09/08 11:42:54 200 OK
2023/09/08 11:42:54 CREATED indexes: [13931751779821209042 7654529815676709815 729781791476283960 11306688821086938678 1298986460373295034]
2023/09/08 11:42:54
2023/09/08 11:42:54 LOOKUP missing index
2023/09/08 11:42:54 status : 404 Not Found
2023/09/08 11:42:54 LOOKUP Pyongyang
2023/09/08 11:42:54 status : 200 OK
2023/09/08 11:42:54 number of entries 554
2023/09/08 11:42:54 Expected and Actual scan responses are the same
2023/09/08 11:42:54 LOOKUP with stale as false
2023/09/08 11:42:54 status : 200 OK
2023/09/08 11:42:54 number of entries 554
2023/09/08 11:42:55 Expected and Actual scan responses are the same
2023/09/08 11:42:55 LOOKUP with Rome
2023/09/08 11:42:55 status : 200 OK
2023/09/08 11:42:55 number of entries 540
2023/09/08 11:42:55 Expected and Actual scan responses are the same
2023/09/08 11:42:55 RANGE missing index
2023/09/08 11:42:55 Status : 404 Not Found
2023/09/08 11:42:55 RANGE cities - none
2023/09/08 11:42:55 Status : 200 OK
2023/09/08 11:43:00 number of entries 140902
2023/09/08 11:43:01 Expected and Actual scan responses are the same
2023/09/08 11:43:01 RANGE cities -low
2023/09/08 11:43:01 Status : 200 OK
2023/09/08 11:43:06 number of entries 140902
2023/09/08 11:43:06 Expected and Actual scan responses are the same
2023/09/08 11:43:06 RANGE cities -high
2023/09/08 11:43:06 Status : 200 OK
2023/09/08 11:43:11 number of entries 140902
2023/09/08 11:43:12 Expected and Actual scan responses are the same
2023/09/08 11:43:12 RANGE cities - both
2023/09/08 11:43:12 Status : 200 OK
2023/09/08 11:43:17 number of entries 140902
2023/09/08 11:43:18 Expected and Actual scan responses are the same
2023/09/08 11:43:18 RANGE missing cities
2023/09/08 11:43:18 Status : 200 OK
2023/09/08 11:43:18 number of entries 0
2023/09/08 11:43:18 Expected and Actual scan responses are the same
2023/09/08 11:43:18
2023/09/08 11:43:18 SCANALL missing index
2023/09/08 11:43:18 {"limit":1000000,"stale":"ok"}
2023/09/08 11:43:18 Status : 404 Not Found
2023/09/08 11:43:18 SCANALL stale ok
2023/09/08 11:43:18 {"limit":1000000,"stale":"ok"}
2023/09/08 11:43:18 Status : 200 OK
2023/09/08 11:43:23 number of entries 140902
2023/09/08 11:43:23 Expected and Actual scan responses are the same
2023/09/08 11:43:23 SCANALL stale false
2023/09/08 11:43:23 {"limit":1000000,"stale":"false"}
2023/09/08 11:43:23 Status : 200 OK
2023/09/08 11:43:29 number of entries 140902
2023/09/08 11:43:29 Expected and Actual scan responses are the same
2023/09/08 11:43:29
2023/09/08 11:43:29 COUNT missing index
2023/09/08 11:43:29 Status : 404 Not Found
2023/09/08 11:43:29 COUNT cities - none
2023/09/08 11:43:29 Status : 200 OK
2023/09/08 11:43:29 number of entries 140902
2023/09/08 11:43:30 COUNT cities -low
2023/09/08 11:43:30 Status : 200 OK
2023/09/08 11:43:30 number of entries 140902
2023/09/08 11:43:30 COUNT cities -high
2023/09/08 11:43:30 Status : 200 OK
2023/09/08 11:43:30 number of entries 140902
2023/09/08 11:43:30 COUNT cities - both
2023/09/08 11:43:30 Status : 200 OK
2023/09/08 11:43:30 number of entries 140902
2023/09/08 11:43:31 COUNT missing cities
2023/09/08 11:43:31 Status : 200 OK
2023/09/08 11:43:31 number of entries 0
2023/09/08 11:43:31
2023/09/08 11:43:32 STATS: Testing URLs with valid authentication
2023/09/08 11:43:32 STATS: Testing URLs with invalid authentication
2023/09/08 11:43:32 STATS: Testing invalid URLs
2023/09/08 11:43:32 STATS: Testing unsupported methods
2023/09/08 11:43:32
--- PASS: TestRestfulAPI (88.30s)
=== RUN TestStatIndexInstFilter
2023/09/08 11:43:32 CREATE INDEX: statIdx1
2023/09/08 11:43:42 status : 201 Created
2023/09/08 11:43:42 {"id": "14078012917923939524"}
2023/09/08 11:43:42 CREATE INDEX: statIdx2
2023/09/08 11:43:54 status : 201 Created
2023/09/08 11:43:54 {"id": "9979543654812988174"}
2023/09/08 11:43:54 Instance Id for statIdx2 is 13663977689842899368, common.IndexInstId
--- PASS: TestStatIndexInstFilter (22.36s)
=== RUN TestBucketDefaultDelete
2023-09-08T11:43:55.136+05:30 [Warn] Client:runObserveStreamingEndpoint streaming endpoint for /pools/default/bs/default returned err EOF
2023-09-08T11:43:55.137+05:30 [Warn] serviceChangeNotifier: Connection terminated for collection manifest notifier instance of http://%40query@127.0.0.1:9000-default, bucket: default, (EOF)
2023/09/08 11:43:57 Deleted bucket default, responseBody:
2023/09/08 11:44:27 Created bucket default, responseBody:
2023/09/08 11:44:58 Populating the default bucket
2023/09/08 11:45:05 Using n1ql client
2023-09-08T11:45:05.702+05:30 [Info] GSIC[default/default-_default-_default-1694153705700302775] started ...
2023/09/08 11:45:05 Scan failed as expected with error: Index Not Found - cause: GSI index index_isActive not found.
2023/09/08 11:45:05 Populating the default bucket after it was deleted
2023/09/08 11:45:15 Created the secondary index index_isActive. Waiting for it become active
2023/09/08 11:45:15 Index is 4732010384830213313 now active
2023/09/08 11:45:15 Using n1ql client
2023/09/08 11:45:15 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (80.24s)
=== RUN TestMixedDatatypesScanAll
2023/09/08 11:45:15 In TestMixedDatatypesScanAll()
2023/09/08 11:45:15 Before test begin: Length of kv docs is 10002
2023/09/08 11:45:15 In DropAllSecondaryIndexes()
2023/09/08 11:45:15 Index found: index_isActive
2023/09/08 11:45:15 Dropped index index_isActive
2023/09/08 11:45:15 Number of number fields is: 277
2023/09/08 11:45:15 Number of string fields is: 234
2023/09/08 11:45:15 Number of json fields is: 244
2023/09/08 11:45:15 Number of true bool fields is: 113
2023/09/08 11:45:15 Number of false bool fields is: 132
2023/09/08 11:45:15 After generate docs: Length of kv docs is 11002
2023/09/08 11:45:15 Setting mixed datatypes JSON docs in KV
2023/09/08 11:45:20 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/08 11:45:20 Index is 6937303771942774147 now active
2023/09/08 11:45:20 Using n1ql client
2023/09/08 11:45:20 Expected and Actual scan responses are the same
2023/09/08 11:45:20 Lengths of expected and actual scan results are: 1000 and 1000
2023/09/08 11:45:20 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (5.49s)
=== RUN TestMixedDatatypesRange_Float
2023/09/08 11:45:20 In TestMixedDatatypesRange_Float()
2023/09/08 11:45:20 In DropAllSecondaryIndexes()
2023/09/08 11:45:20 Index found: index_mixeddt
2023/09/08 11:45:20 Dropped index index_mixeddt
2023/09/08 11:45:21 Number of number fields is: 265
2023/09/08 11:45:21 Number of string fields is: 246
2023/09/08 11:45:21 Number of json fields is: 246
2023/09/08 11:45:21 Number of true bool fields is: 110
2023/09/08 11:45:21 Number of false bool fields is: 133
2023/09/08 11:45:21 Setting mixed datatypes JSON docs in KV
2023/09/08 11:45:26 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/08 11:45:26 Index is 6395853688341770062 now active
2023/09/08 11:45:26 Using n1ql client
2023/09/08 11:45:27 Expected and Actual scan responses are the same
2023/09/08 11:45:27 Lengths of expected and actual scan results are: 26 and 26
2023/09/08 11:45:27 Using n1ql client
2023/09/08 11:45:27 Expected and Actual scan responses are the same
2023/09/08 11:45:27 Lengths of expected and actual scan results are: 3 and 3
2023/09/08 11:45:27 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (6.30s)
=== RUN TestMixedDatatypesRange_String
2023/09/08 11:45:27 In TestMixedDatatypesRange_String()
2023/09/08 11:45:27 In DropAllSecondaryIndexes()
2023/09/08 11:45:27 Index found: index_mixeddt
2023/09/08 11:45:27 Dropped index index_mixeddt
2023/09/08 11:45:27 Number of number fields is: 261
2023/09/08 11:45:27 Number of string fields is: 258
2023/09/08 11:45:27 Number of json fields is: 233
2023/09/08 11:45:27 Number of true bool fields is: 140
2023/09/08 11:45:27 Number of false bool fields is: 108
2023/09/08 11:45:27 Setting mixed datatypes JSON docs in KV
2023/09/08 11:45:33 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/08 11:45:33 Index is 17622719917286735532 now active
2023/09/08 11:45:33 Using n1ql client
2023/09/08 11:45:33 Expected and Actual scan responses are the same
2023/09/08 11:45:33 Lengths of expected and actual scan results are: 199 and 199
2023/09/08 11:45:33 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (6.30s)
=== RUN TestMixedDatatypesRange_Json
2023/09/08 11:45:33 In TestMixedDatatypesRange_Json()
2023/09/08 11:45:33 In DropAllSecondaryIndexes()
2023/09/08 11:45:33 Index found: index_mixeddt
2023/09/08 11:45:33 Dropped index index_mixeddt
2023/09/08 11:45:33 Number of number fields is: 270
2023/09/08 11:45:33 Number of string fields is: 243
2023/09/08 11:45:33 Number of json fields is: 237
2023/09/08 11:45:33 Number of true bool fields is: 119
2023/09/08 11:45:33 Number of false bool fields is: 131
2023/09/08 11:45:33 Setting mixed datatypes JSON docs in KV
2023/09/08 11:45:39 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/08 11:45:39 Index is 1452685144080573186 now active
2023/09/08 11:45:39 Using n1ql client
2023/09/08 11:45:39 Expected and Actual scan responses are the same
2023/09/08 11:45:39 Lengths of expected and actual scan results are: 716 and 716
2023/09/08 11:45:39 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (5.74s)
=== RUN TestMixedDatatypesScan_Bool
2023/09/08 11:45:39 In TestMixedDatatypesScan_Bool()
2023/09/08 11:45:39 In DropAllSecondaryIndexes()
2023/09/08 11:45:39 Index found: index_mixeddt
2023/09/08 11:45:39 Dropped index index_mixeddt
2023/09/08 11:45:39 Number of number fields is: 272
2023/09/08 11:45:39 Number of string fields is: 258
2023/09/08 11:45:39 Number of json fields is: 238
2023/09/08 11:45:39 Number of true bool fields is: 114
2023/09/08 11:45:39 Number of false bool fields is: 118
2023/09/08 11:45:39 Setting mixed datatypes JSON docs in KV
2023/09/08 11:45:45 Created the secondary index index_mixeddt. Waiting for it become active
2023/09/08 11:45:45 Index is 16189310406301554219 now active
2023/09/08 11:45:45 Using n1ql client
2023/09/08 11:45:45 Expected and Actual scan responses are the same
2023/09/08 11:45:45 Lengths of expected and actual scan results are: 483 and 483
2023/09/08 11:45:45 Using n1ql client
2023/09/08 11:45:45 Expected and Actual scan responses are the same
2023/09/08 11:45:45 Lengths of expected and actual scan results are: 490 and 490
2023/09/08 11:45:45 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (6.26s)
=== RUN TestLargeSecondaryKeyLength
2023/09/08 11:45:45 In TestLargeSecondaryKeyLength()
2023/09/08 11:45:45 In DropAllSecondaryIndexes()
2023/09/08 11:45:45 Index found: index_mixeddt
2023/09/08 11:45:45 Dropped index index_mixeddt
2023/09/08 11:45:45 Setting JSON docs in KV
2023/09/08 11:45:50 Created the secondary index index_LongSecField. Waiting for it become active
2023/09/08 11:45:50 Index is 11011408082350747768 now active
2023/09/08 11:45:50 Using n1ql client
2023/09/08 11:45:51 ScanAll: Lengths of expected and actual scan results are: 1000 and 1000
2023/09/08 11:45:51 Expected and Actual scan responses are the same
2023/09/08 11:45:51 Using n1ql client
2023/09/08 11:45:51 Range: Lengths of expected and actual scan results are: 800 and 800
2023/09/08 11:45:51 Expected and Actual scan responses are the same
2023/09/08 11:45:51 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (5.75s)
=== RUN TestLargePrimaryKeyLength
2023/09/08 11:45:51 In TestLargePrimaryKeyLength()
2023/09/08 11:45:51 In DropAllSecondaryIndexes()
2023/09/08 11:45:51 Index found: index_LongSecField
2023/09/08 11:45:51 Dropped index index_LongSecField
2023/09/08 11:45:51 Setting JSON docs in KV
2023/09/08 11:45:57 Created the secondary index index_LongPrimaryField. Waiting for it become active
2023/09/08 11:45:57 Index is 14873737670949069870 now active
2023/09/08 11:45:57 Using n1ql client
2023/09/08 11:45:57 Lengths of num of docs and scanResults are: 17002 and 17002
2023/09/08 11:45:57 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (6.23s)
=== RUN TestUpdateMutations_DeleteField
2023/09/08 11:45:57 In TestUpdateMutations_DeleteField()
2023/09/08 11:45:57 Setting JSON docs in KV
2023/09/08 11:46:05 Created the secondary index index_bal. Waiting for it become active
2023/09/08 11:46:05 Index is 9285053019231520545 now active
2023/09/08 11:46:05 Using n1ql client
2023/09/08 11:46:05 Expected and Actual scan responses are the same
2023/09/08 11:46:05 Using n1ql client
2023/09/08 11:46:05 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (8.38s)
=== RUN TestUpdateMutations_AddField
2023/09/08 11:46:05 In TestUpdateMutations_AddField()
2023/09/08 11:46:05 Setting JSON docs in KV
2023/09/08 11:46:12 Created the secondary index index_newField. Waiting for it become active
2023/09/08 11:46:12 Index is 9571432796962221682 now active
2023/09/08 11:46:12 Using n1ql client
2023/09/08 11:46:12 Count of scan results before add field mutations: 0
2023/09/08 11:46:12 Expected and Actual scan responses are the same
2023/09/08 11:46:12 Using n1ql client
2023/09/08 11:46:12 Count of scan results after add field mutations: 300
2023/09/08 11:46:12 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (7.05s)
=== RUN TestUpdateMutations_DataTypeChange
2023/09/08 11:46:12 In TestUpdateMutations_DataTypeChange()
2023/09/08 11:46:12 Setting JSON docs in KV
2023/09/08 11:46:20 Created the secondary index index_isUserActive. Waiting for it become active
2023/09/08 11:46:20 Index is 1192707071741906682 now active
2023/09/08 11:46:20 Using n1ql client
2023/09/08 11:46:20 Expected and Actual scan responses are the same
2023/09/08 11:46:21 Using n1ql client
2023/09/08 11:46:21 Expected and Actual scan responses are the same
2023/09/08 11:46:21 Using n1ql client
2023/09/08 11:46:21 Expected and Actual scan responses are the same
2023/09/08 11:46:21 Using n1ql client
2023/09/08 11:46:21 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (8.38s)
=== RUN TestMultipleBuckets
2023/09/08 11:46:21 In TestMultipleBuckets()
2023/09/08 11:46:21 In DropAllSecondaryIndexes()
2023/09/08 11:46:21 Index found: index_LongPrimaryField
2023/09/08 11:46:21 Dropped index index_LongPrimaryField
2023/09/08 11:46:21 Index found: index_bal
2023/09/08 11:46:21 Dropped index index_bal
2023/09/08 11:46:21 Index found: index_isUserActive
2023/09/08 11:46:21 Dropped index index_isUserActive
2023/09/08 11:46:21 Index found: index_newField
2023/09/08 11:46:21 Dropped index index_newField
2023/09/08 11:46:59 Flushed the bucket default, Response body:
2023/09/08 11:47:02 Modified parameters of bucket default, responseBody:
2023/09/08 11:47:02 Created bucket testbucket2, responseBody:
2023/09/08 11:47:02 Created bucket testbucket3, responseBody:
2023/09/08 11:47:02 Created bucket testbucket4, responseBody:
2023/09/08 11:47:32 Generating docs and Populating all the buckets
2023/09/08 11:47:36 Created the secondary index bucket1_age. Waiting for it become active
2023/09/08 11:47:36 Index is 11537654034964141888 now active
2023/09/08 11:47:42 Created the secondary index bucket2_city. Waiting for it become active
2023/09/08 11:47:42 Index is 11343404701513656423 now active
2023/09/08 11:47:48 Created the secondary index bucket3_gender. Waiting for it become active
2023/09/08 11:47:48 Index is 6558912647058957019 now active
2023/09/08 11:47:55 Created the secondary index bucket4_balance. Waiting for it become active
2023/09/08 11:47:55 Index is 3819666227951721138 now active
2023/09/08 11:47:58 Using n1ql client
2023/09/08 11:47:58 Expected and Actual scan responses are the same
2023/09/08 11:47:58 Using n1ql client
2023-09-08T11:47:58.346+05:30 [Info] GSIC[default/testbucket2-_default-_default-1694153878340476714] started ...
2023/09/08 11:47:58 Expected and Actual scan responses are the same
2023/09/08 11:47:58 Using n1ql client
2023-09-08T11:47:58.362+05:30 [Info] GSIC[default/testbucket3-_default-_default-1694153878356282253] started ...
2023/09/08 11:47:58 Expected and Actual scan responses are the same
2023/09/08 11:47:58 Using n1ql client
2023-09-08T11:47:58.387+05:30 [Info] GSIC[default/testbucket4-_default-_default-1694153878384026699] started ...
2023/09/08 11:47:58 Expected and Actual scan responses are the same
2023/09/08 11:48:00 Deleted bucket testbucket2, responseBody:
2023/09/08 11:48:02 Deleted bucket testbucket3, responseBody:
2023/09/08 11:48:05 Deleted bucket testbucket4, responseBody:
2023/09/08 11:48:08 Modified parameters of bucket default, responseBody:
--- PASS: TestMultipleBuckets (137.45s)
=== RUN TestBucketFlush
2023/09/08 11:48:38 In TestBucketFlush()
2023/09/08 11:48:38 In DropAllSecondaryIndexes()
2023/09/08 11:48:38 Index found: bucket1_age
2023/09/08 11:48:38 Dropped index bucket1_age
2023/09/08 11:49:16 Flushed the bucket default, Response body:
2023/09/08 11:49:20 Created the secondary index index_age. Waiting for it become active
2023/09/08 11:49:20 Index is 8933973852838396841 now active
2023/09/08 11:49:20 Using n1ql client
2023/09/08 11:49:21 Expected and Actual scan responses are the same
2023/09/08 11:49:27 Created the secondary index index_gender. Waiting for it become active
2023/09/08 11:49:27 Index is 18022176396506973028 now active
2023/09/08 11:49:27 Using n1ql client
2023/09/08 11:49:28 Expected and Actual scan responses are the same
2023/09/08 11:49:33 Created the secondary index index_city. Waiting for it become active
2023/09/08 11:49:33 Index is 2578307680371256654 now active
2023/09/08 11:49:33 Using n1ql client
2023/09/08 11:49:33 Expected and Actual scan responses are the same
2023/09/08 11:50:11 Flushed the bucket default, Response body:
2023/09/08 11:50:11 TestBucketFlush:: Flushed the bucket
2023/09/08 11:50:11 Using n1ql client
2023/09/08 11:50:11 Using n1ql client
2023/09/08 11:50:11 Using n1ql client
--- PASS: TestBucketFlush (92.62s)
=== RUN TestLargeDocumentSize
2023/09/08 11:50:11 In TestLargeDocumentSize()
2023/09/08 11:50:11 Data file exists. Skipping download
2023/09/08 11:50:11 Length of docs and largeDocs = 200 and 200
2023/09/08 11:50:15 Created the secondary index index_userscreenname. Waiting for it become active
2023/09/08 11:50:15 Index is 5096701205785238208 now active
2023/09/08 11:50:15 Using n1ql client
2023/09/08 11:50:16 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (5.36s)
=== RUN TestFieldsWithSpecialCharacters
2023/09/08 11:50:16 In TestFieldsWithSpecialCharacters()
2023/09/08 11:50:21 Created the secondary index index_specialchar. Waiting for it become active
2023/09/08 11:50:21 Index is 11959306499241883220 now active
2023/09/08 11:50:21 Looking up for value €2§#z13
2023/09/08 11:50:21 Using n1ql client
2023/09/08 11:50:21 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (5.26s)
=== RUN TestLargeKeyLookup
2023/09/08 11:50:21 In TestLargeKeyLookup()
2023/09/08 11:50:28 Created the secondary index index_largeKeyLookup. Waiting for it become active
2023/09/08 11:50:28 Index is 8612307921974236640 now active
2023/09/08 11:50:28 Looking up for a large key
2023/09/08 11:50:28 Using n1ql client
2023/09/08 11:50:28 Expected and Actual scan responses are the same
--- PASS: TestLargeKeyLookup (6.47s)
=== RUN TestIndexNameValidation
2023/09/08 11:50:28 In TestIndexNameValidation()
2023/09/08 11:50:28 Setting JSON docs in KV
2023/09/08 11:50:29 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected
2023/09/08 11:50:34 Created the secondary index #primary-Index_test. Waiting for it become active
2023/09/08 11:50:34 Index is 2251517468202874471 now active
2023/09/08 11:50:34 Using n1ql client
2023/09/08 11:50:34 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (6.52s)
=== RUN TestSameFieldNameAtDifferentLevels
2023/09/08 11:50:34 In TestSameFieldNameAtDifferentLevels()
2023/09/08 11:50:35 Setting JSON docs in KV
2023/09/08 11:50:41 Created the secondary index cityindex. Waiting for it become active
2023/09/08 11:50:41 Index is 7182121331516637885 now active
2023/09/08 11:50:41 Using n1ql client
2023/09/08 11:50:41 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (6.51s)
=== RUN TestSameIndexNameInTwoBuckets
2023/09/08 11:50:41 In TestSameIndexNameInTwoBuckets()
2023/09/08 11:50:41 In DropAllSecondaryIndexes()
2023/09/08 11:50:41 Index found: index_specialchar
2023/09/08 11:50:41 Dropped index index_specialchar
2023/09/08 11:50:41 Index found: index_gender
2023/09/08 11:50:41 Dropped index index_gender
2023/09/08 11:50:41 Index found: index_age
2023/09/08 11:50:41 Dropped index index_age
2023/09/08 11:50:41 Index found: index_largeKeyLookup
2023/09/08 11:50:41 Dropped index index_largeKeyLookup
2023/09/08 11:50:41 Index found: index_city
2023/09/08 11:50:41 Dropped index index_city
2023/09/08 11:50:41 Index found: #primary-Index_test
2023/09/08 11:50:41 Dropped index #primary-Index_test
2023/09/08 11:50:41 Index found: cityindex
2023/09/08 11:50:41 Dropped index cityindex
2023/09/08 11:50:41 Index found: index_userscreenname
2023/09/08 11:50:41 Dropped index index_userscreenname
2023/09/08 11:51:20 Flushed the bucket default, Response body:
2023/09/08 11:51:23 Modified parameters of bucket default, responseBody:
2023/09/08 11:51:23 Created bucket buck2, responseBody:
2023/09/08 11:51:53 Generating docs and Populating all the buckets
2023/09/08 11:51:57 Created the secondary index b_idx. Waiting for it become active
2023/09/08 11:51:57 Index is 6718751231000813575 now active
2023/09/08 11:52:04 Created the secondary index b_idx. Waiting for it become active
2023/09/08 11:52:04 Index is 14771010281035764380 now active
2023/09/08 11:52:07 Using n1ql client
2023/09/08 11:52:07 Expected and Actual scan responses are the same
2023/09/08 11:52:07 Using n1ql client
2023-09-08T11:52:07.205+05:30 [Info] GSIC[default/buck2-_default-_default-1694154127185226096] started ...
2023/09/08 11:52:07 Expected and Actual scan responses are the same
2023/09/08 11:52:10 Modified parameters of bucket default, responseBody:
2023/09/08 11:52:12 Deleted bucket buck2, responseBody:
--- PASS: TestSameIndexNameInTwoBuckets (121.42s)
=== RUN TestLargeKeysSplChars
2023/09/08 11:52:42 In TestLargeKeysSplChars()
2023/09/08 11:52:52 Created the secondary index idspl1. Waiting for it become active
2023/09/08 11:52:52 Index is 8312281430081828475 now active
2023/09/08 11:52:59 Created the secondary index idspl2. Waiting for it become active
2023/09/08 11:52:59 Index is 15863287004660510928 now active
2023/09/08 11:53:06 Created the secondary index idspl3. Waiting for it become active
2023/09/08 11:53:06 Index is 13574373560793784712 now active
2023/09/08 11:53:06 Using n1ql client
2023/09/08 11:53:06 Expected and Actual scan responses are the same
2023-09-08T11:53:06.694+05:30 [Error] transport error between 127.0.0.1:60504->127.0.0.1:9107: write tcp 127.0.0.1:60504->127.0.0.1:9107: write: broken pipe
2023-09-08T11:53:06.694+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:60504->127.0.0.1:9107: write: broken pipe`
2023-09-08T11:53:06.695+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-08T11:53:06.695+05:30 [Error] metadataClient:PickRandom: Replicas - [18360411689982642820], PrunedReplica - map[], FilteredReplica map[]
2023/09/08 11:53:07 Expected and Actual scan responses are the same
2023/09/08 11:53:07 Using n1ql client
2023/09/08 11:53:07 Expected and Actual scan responses are the same
--- PASS: TestLargeKeysSplChars (24.35s)
=== RUN TestVeryLargeIndexKey
2023/09/08 11:53:07 In DropAllSecondaryIndexes()
2023/09/08 11:53:07 Index found: idspl2
2023/09/08 11:53:07 Dropped index idspl2
2023/09/08 11:53:07 Index found: b_idx
2023/09/08 11:53:07 Dropped index b_idx
2023/09/08 11:53:07 Index found: idspl1
2023/09/08 11:53:07 Dropped index idspl1
2023/09/08 11:53:07 Index found: idspl3
2023/09/08 11:53:07 Dropped index idspl3
2023/09/08 11:53:45 Flushed the bucket default, Response body:
2023/09/08 11:53:45 TestVeryLargeIndexKey:: Flushed the bucket
2023/09/08 11:53:46 clusterconfig.KVAddress = 127.0.0.1:9000
2023/09/08 11:53:50 Created the secondary index i1. Waiting for it become active
2023/09/08 11:53:50 Index is 4064024376853403397 now active
2023/09/08 11:53:50 Using n1ql client
2023/09/08 11:53:52 Expected and Actual scan responses are the same
2023/09/08 11:53:57 Created the secondary index i2. Waiting for it become active
2023/09/08 11:53:57 Index is 4628018107358740421 now active
2023/09/08 11:53:57 Using n1ql client
2023/09/08 11:53:58 Expected and Actual scan responses are the same
2023/09/08 11:53:58 In DropAllSecondaryIndexes()
2023/09/08 11:53:58 Index found: i1
2023/09/08 11:53:58 Dropped index i1
2023/09/08 11:53:58 Index found: i2
2023/09/08 11:53:58 Dropped index i2
2023/09/08 11:54:36 Flushed the bucket default, Response body:
--- PASS: TestVeryLargeIndexKey (89.88s)
=== RUN TestTempBufScanResult
2023/09/08 11:54:36 In DropAllSecondaryIndexes()
2023/09/08 11:55:14 Flushed the bucket default, Response body:
2023/09/08 11:55:14 TestTempBufScanResult:: Flushed the bucket
2023/09/08 11:55:18 Created the secondary index index_idxKey. Waiting for it become active
2023/09/08 11:55:18 Index is 12762190999718747153 now active
2023/09/08 11:55:18 Using n1ql client
2023/09/08 11:55:18 Expected and Actual scan responses are the same
2023/09/08 11:55:18 In DropAllSecondaryIndexes()
2023/09/08 11:55:18 Index found: index_idxKey
2023/09/08 11:55:18 Dropped index index_idxKey
2023/09/08 11:55:56 Flushed the bucket default, Response body:
--- PASS: TestTempBufScanResult (79.43s)
=== RUN TestBuildDeferredAnotherBuilding
2023/09/08 11:55:56 In TestBuildDeferredAnotherBuilding()
2023/09/08 11:55:56 In DropAllSecondaryIndexes()
2023/09/08 11:56:40 Setting JSON docs in KV
2023/09/08 11:58:34 Build the deferred index id_age1. Waiting for the index to become active
2023/09/08 11:58:34 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:35 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:36 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:37 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:38 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:39 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:40 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:41 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:42 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:43 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:44 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:45 Waiting for index 2617746500448431898 to go active ...
2023/09/08 11:58:46 Index is 2617746500448431898 now active
2023/09/08 11:58:46 Build command issued for the deferred indexes [17475581707293955864]
2023/09/08 11:58:48 Build index failed as expected: Build index failed. Encountered transient error. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2023/09/08 11:58:48 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:49 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:50 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:51 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:52 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:53 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:54 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:55 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:56 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:57 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:58 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:58:59 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:59:00 Waiting for index 17475581707293955864 to go active ...
2023/09/08 11:59:01 Index is 17475581707293955864 now active
2023/09/08 11:59:01 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:02 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:03 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:04 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:05 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:06 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:07 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:08 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:09 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:10 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:11 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:12 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:13 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:14 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:15 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:16 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:17 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:18 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:19 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:20 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:21 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:22 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:23 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:24 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:25 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:26 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:27 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:28 Waiting for index 11901251031116287271 to go active ...
2023/09/08 11:59:29 Index is 11901251031116287271 now active
2023/09/08 11:59:29 Using n1ql client
2023/09/08 11:59:30 Expected and Actual scan responses are the same
2023/09/08 11:59:30 Using n1ql client
2023/09/08 11:59:30 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (214.45s)
=== RUN TestMultipleBucketsDeferredBuild
2023/09/08 11:59:30 In TestMultipleBucketsDeferredBuild()
2023/09/08 11:59:30 In DropAllSecondaryIndexes()
2023/09/08 11:59:30 Index found: id_age1
2023/09/08 11:59:30 Dropped index id_age1
2023/09/08 11:59:30 Index found: id_age
2023/09/08 11:59:30 Dropped index id_age
2023/09/08 11:59:30 Index found: id_company
2023/09/08 11:59:31 Dropped index id_company
2023/09/08 12:00:08 Flushed the bucket default, Response body:
2023/09/08 12:00:11 Modified parameters of bucket default, responseBody:
2023/09/08 12:00:11 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2023/09/08 12:00:11 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000480d8}
2023/09/08 12:00:11 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 08 Sep 2023 06:30:10 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc010de1780 31 [] false false map[] 0xc00fe4be00 }
2023/09/08 12:00:11 DeleteBucket failed for bucket defertest_buck2
2023/09/08 12:00:11 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2023/09/08 12:00:11 Created bucket defertest_buck2, responseBody:
2023/09/08 12:00:41 Setting JSON docs in KV
2023/09/08 12:01:54 Build command issued for the deferred indexes [3428140269990857659]
2023/09/08 12:01:55 Build command issued for the deferred indexes [15525420875261433498 1211025310354176086]
2023/09/08 12:01:55 Index state of 1211025310354176086 is INDEX_STATE_READY
2023/09/08 12:01:55 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:01:56 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:01:57 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:01:58 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:01:59 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:02:00 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:02:01 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:02:02 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:02:03 Waiting for index 3428140269990857659 to go active ...
2023/09/08 12:02:04 Index is 3428140269990857659 now active
2023/09/08 12:02:04 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:05 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:06 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:07 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:08 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:09 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:10 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:11 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:12 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:13 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:14 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:15 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:16 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:17 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:18 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:19 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:20 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:21 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:22 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:23 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:24 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:25 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:26 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:27 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:28 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:29 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:30 Waiting for index 15525420875261433498 to go active ...
2023/09/08 12:02:31 Index is 15525420875261433498 now active
2023/09/08 12:02:31 Using n1ql client
2023/09/08 12:02:31 Expected and Actual scan responses are the same
2023/09/08 12:02:31 Using n1ql client
2023/09/08 12:02:31 Expected and Actual scan responses are the same
2023/09/08 12:02:31 Using n1ql client
2023-09-08T12:02:31.752+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1694154751750301215] started ...
2023/09/08 12:02:31 Expected and Actual scan responses are the same
2023/09/08 12:02:34 Modified parameters of bucket default, responseBody:
2023/09/08 12:02:37 Deleted bucket defertest_buck2, responseBody:
--- PASS: TestMultipleBucketsDeferredBuild (191.40s)
=== RUN TestCreateDropCreateDeferredIndex
2023/09/08 12:02:42 In TestCreateDropCreateDeferredIndex()
2023/09/08 12:02:42 In DropAllSecondaryIndexes()
2023/09/08 12:02:42 Index found: buck1_id2
2023/09/08 12:02:42 Dropped index buck1_id2
2023/09/08 12:02:42 Index found: buck1_id1
2023/09/08 12:02:42 Dropped index buck1_id1
2023/09/08 12:02:44 Setting JSON docs in KV
2023/09/08 12:02:56 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:02:56 Index is 8103385547706205650 now active
2023/09/08 12:02:57 Dropping the secondary index id_age
2023/09/08 12:02:57 Index dropped
2023/09/08 12:03:00 Setting JSON docs in KV
2023/09/08 12:03:09 Using n1ql client
2023/09/08 12:03:09 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (27.38s)
=== RUN TestMultipleDeferredIndexes_BuildTogether
2023/09/08 12:03:09 In TestMultipleDeferredIndexes_BuildTogether()
2023/09/08 12:03:09 In DropAllSecondaryIndexes()
2023/09/08 12:03:09 Index found: id_company
2023/09/08 12:03:09 Dropped index id_company
2023/09/08 12:03:12 Setting JSON docs in KV
2023/09/08 12:03:24 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:03:24 Index is 18138908239645060449 now active
2023/09/08 12:03:26 Build command issued for the deferred indexes [id_age id_gender id_isActive], bucket: default, scope: _default, coll: _default
2023/09/08 12:03:26 Waiting for the index id_age to become active
2023/09/08 12:03:26 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:27 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:28 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:29 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:30 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:31 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:32 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:33 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:34 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:35 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:36 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:37 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:38 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:39 Waiting for index 13272682006060753840 to go active ...
2023/09/08 12:03:40 Index is 13272682006060753840 now active
2023/09/08 12:03:40 Waiting for the index id_gender to become active
2023/09/08 12:03:40 Index is 14809979213803000596 now active
2023/09/08 12:03:40 Waiting for the index id_isActive to become active
2023/09/08 12:03:40 Index is 5702006972206583240 now active
2023/09/08 12:03:40 Using n1ql client
2023/09/08 12:03:40 Expected and Actual scan responses are the same
2023/09/08 12:03:42 Setting JSON docs in KV
2023/09/08 12:03:51 Using n1ql client
2023/09/08 12:03:51 Expected and Actual scan responses are the same
2023/09/08 12:03:51 Using n1ql client
2023/09/08 12:03:52 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (42.57s)
=== RUN TestMultipleDeferredIndexes_BuildOneByOne
2023/09/08 12:03:52 In TestMultipleDeferredIndexes_BuildOneByOne()
2023/09/08 12:03:52 In DropAllSecondaryIndexes()
2023/09/08 12:03:52 Index found: id_age
2023/09/08 12:03:52 Dropped index id_age
2023/09/08 12:03:52 Index found: id_isActive
2023/09/08 12:03:52 Dropped index id_isActive
2023/09/08 12:03:52 Index found: id_company
2023/09/08 12:03:52 Dropped index id_company
2023/09/08 12:03:52 Index found: id_gender
2023/09/08 12:03:52 Dropped index id_gender
2023/09/08 12:03:55 Setting JSON docs in KV
2023/09/08 12:04:10 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:04:10 Index is 8906913117481339780 now active
2023/09/08 12:04:11 Build command issued for the deferred indexes [id_age], bucket: default, scope: _default, coll: _default
2023/09/08 12:04:11 Waiting for the index id_age to become active
2023/09/08 12:04:11 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:12 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:13 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:14 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:15 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:16 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:17 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:18 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:19 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:20 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:21 Waiting for index 15693035760621334559 to go active ...
2023/09/08 12:04:22 Index is 15693035760621334559 now active
2023/09/08 12:04:22 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/08 12:04:22 Waiting for the index id_gender to become active
2023/09/08 12:04:22 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:23 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:24 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:25 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:26 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:27 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:28 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:29 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:30 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:31 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:32 Waiting for index 7369911578009423341 to go active ...
2023/09/08 12:04:33 Index is 7369911578009423341 now active
2023/09/08 12:04:33 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/09/08 12:04:33 Waiting for the index id_isActive to become active
2023/09/08 12:04:33 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:34 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:35 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:36 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:37 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:38 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:39 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:40 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:41 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:42 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:43 Waiting for index 16546909936077838676 to go active ...
2023/09/08 12:04:44 Index is 16546909936077838676 now active
2023/09/08 12:04:44 Using n1ql client
2023/09/08 12:04:44 Expected and Actual scan responses are the same
2023/09/08 12:04:46 Setting JSON docs in KV
2023/09/08 12:04:55 Using n1ql client
2023/09/08 12:04:55 Expected and Actual scan responses are the same
2023/09/08 12:04:55 Using n1ql client
2023/09/08 12:04:56 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (64.14s)
=== RUN TestDropDeferredIndexWhileOthersBuilding
2023/09/08 12:04:56 In TestDropDeferredIndexWhileOthersBuilding()
2023/09/08 12:04:56 In DropAllSecondaryIndexes()
2023/09/08 12:04:56 Index found: id_age
2023/09/08 12:04:56 Dropped index id_age
2023/09/08 12:04:56 Index found: id_gender
2023/09/08 12:04:56 Dropped index id_gender
2023/09/08 12:04:56 Index found: id_isActive
2023/09/08 12:04:56 Dropped index id_isActive
2023/09/08 12:04:56 Index found: id_company
2023/09/08 12:04:56 Dropped index id_company
2023/09/08 12:04:59 Setting JSON docs in KV
2023/09/08 12:05:14 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:05:14 Index is 15386273432262874409 now active
2023/09/08 12:05:16 Build command issued for the deferred indexes [13385623637776920245 7807389123484287624]
2023/09/08 12:05:18 Dropping the secondary index id_isActive
2023/09/08 12:05:18 Index dropped
2023/09/08 12:05:18 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:19 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:20 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:21 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:22 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:23 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:24 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:25 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:26 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:27 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:28 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:29 Waiting for index 13385623637776920245 to go active ...
2023/09/08 12:05:30 Index is 13385623637776920245 now active
2023/09/08 12:05:30 Index is 7807389123484287624 now active
2023/09/08 12:05:31 Using n1ql client
2023/09/08 12:05:31 Expected and Actual scan responses are the same
2023/09/08 12:05:31 Using n1ql client
2023/09/08 12:05:31 Expected and Actual scan responses are the same
2023/09/08 12:05:33 Setting JSON docs in KV
2023/09/08 12:05:42 Using n1ql client
2023/09/08 12:05:42 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (46.50s)
=== RUN TestDropBuildingDeferredIndex
2023/09/08 12:05:42 In TestDropBuildingDeferredIndex()
2023/09/08 12:05:42 In DropAllSecondaryIndexes()
2023/09/08 12:05:42 Index found: id_age
2023/09/08 12:05:42 Dropped index id_age
2023/09/08 12:05:42 Index found: id_gender
2023/09/08 12:05:43 Dropped index id_gender
2023/09/08 12:05:43 Index found: id_company
2023/09/08 12:05:43 Dropped index id_company
2023/09/08 12:05:45 Setting JSON docs in KV
2023/09/08 12:05:51 Build command issued for the deferred indexes [16678044413181367113 18390988851661416064]
2023/09/08 12:05:52 Dropping the secondary index id_age
2023/09/08 12:05:52 Index dropped
2023/09/08 12:05:52 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:05:53 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:05:54 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:05:55 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:05:56 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:05:57 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:05:58 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:05:59 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:06:00 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:06:01 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:06:02 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:06:03 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:06:04 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:06:05 Waiting for index 16678044413181367113 to go active ...
2023/09/08 12:06:06 Index is 16678044413181367113 now active
2023/09/08 12:06:06 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/08 12:06:06 Waiting for the index id_gender to become active
2023/09/08 12:06:06 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:07 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:08 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:09 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:10 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:11 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:12 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:13 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:14 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:15 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:16 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:17 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:18 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:19 Waiting for index 17943985702186533720 to go active ...
2023/09/08 12:06:20 Index is 17943985702186533720 now active
2023/09/08 12:06:22 Using n1ql client
2023/09/08 12:06:22 Expected and Actual scan responses are the same
2023/09/08 12:06:22 Using n1ql client
2023/09/08 12:06:22 Expected and Actual scan responses are the same
2023/09/08 12:06:24 Setting JSON docs in KV
2023/09/08 12:06:33 Using n1ql client
2023/09/08 12:06:34 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (52.16s)
=== RUN TestDropMultipleBuildingDeferredIndexes
2023/09/08 12:06:34 In TestDropMultipleBuildingDeferredIndexes()
2023/09/08 12:06:34 In DropAllSecondaryIndexes()
2023/09/08 12:06:34 Index found: id_gender
2023/09/08 12:06:35 Dropped index id_gender
2023/09/08 12:06:35 Index found: id_company
2023/09/08 12:06:35 Dropped index id_company
2023/09/08 12:06:41 Setting JSON docs in KV
2023/09/08 12:07:15 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:07:15 Index is 4630979856117162681 now active
2023/09/08 12:07:16 Build command issued for the deferred indexes [10626523005834385476 14378042528310357120]
2023/09/08 12:07:17 Dropping the secondary index id_age
2023/09/08 12:07:17 Index dropped
2023/09/08 12:07:17 Dropping the secondary index id_gender
2023/09/08 12:07:30 Index dropped
2023/09/08 12:07:30 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/09/08 12:07:30 Waiting for the index id_isActive to become active
2023/09/08 12:07:30 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:31 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:32 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:33 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:34 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:35 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:36 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:37 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:38 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:39 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:40 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:41 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:42 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:43 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:44 Waiting for index 9735363008158148965 to go active ...
2023/09/08 12:07:45 Index is 9735363008158148965 now active
2023/09/08 12:07:56 Using n1ql client
2023/09/08 12:07:57 Expected and Actual scan responses are the same
2023/09/08 12:07:57 Number of docScanResults and scanResults = 180000 and 180000
2023/09/08 12:07:57 Using n1ql client
2023/09/08 12:07:58 Expected and Actual scan responses are the same
2023/09/08 12:07:58 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (83.92s)
=== RUN TestDropOneIndexSecondDeferBuilding
2023/09/08 12:07:58 In TestDropOneIndexSecondDeferBuilding()
2023/09/08 12:07:58 In DropAllSecondaryIndexes()
2023/09/08 12:07:58 Index found: id_company
2023/09/08 12:07:58 Dropped index id_company
2023/09/08 12:07:58 Index found: id_isActive
2023/09/08 12:07:59 Dropped index id_isActive
2023/09/08 12:08:01 Setting JSON docs in KV
2023/09/08 12:08:07 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/09/08 12:08:07 Waiting for the index id_company to become active
2023/09/08 12:08:07 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:08 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:09 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:10 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:11 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:12 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:13 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:14 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:15 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:16 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:17 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:18 Waiting for index 1060458374333620436 to go active ...
2023/09/08 12:08:19 Index is 1060458374333620436 now active
2023/09/08 12:08:19 Build command issued for the deferred indexes [17132323133725678918]
2023/09/08 12:08:20 Dropping the secondary index id_company
2023/09/08 12:08:20 Index dropped
2023/09/08 12:08:26 Setting JSON docs in KV
2023/09/08 12:08:41 Index is 17132323133725678918 now active
2023/09/08 12:08:41 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/08 12:08:41 Waiting for the index id_gender to become active
2023/09/08 12:08:41 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:42 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:43 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:44 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:45 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:46 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:47 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:48 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:49 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:50 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:51 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:52 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:53 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:54 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:55 Waiting for index 495915618408876536 to go active ...
2023/09/08 12:08:56 Index is 495915618408876536 now active
2023/09/08 12:08:56 Using n1ql client
2023/09/08 12:08:56 Expected and Actual scan responses are the same
2023/09/08 12:08:57 Using n1ql client
2023/09/08 12:08:58 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (59.55s)
=== RUN TestDropSecondIndexSecondDeferBuilding
2023/09/08 12:08:58 In TestDropSecondIndexSecondDeferBuilding()
2023/09/08 12:08:58 In DropAllSecondaryIndexes()
2023/09/08 12:08:58 Index found: id_gender
2023/09/08 12:08:58 Dropped index id_gender
2023/09/08 12:08:58 Index found: id_age
2023/09/08 12:08:58 Dropped index id_age
2023/09/08 12:09:00 Setting JSON docs in KV
2023/09/08 12:09:06 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/09/08 12:09:06 Waiting for the index id_company to become active
2023/09/08 12:09:06 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:07 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:08 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:09 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:10 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:11 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:12 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:13 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:14 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:15 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:16 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:17 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:18 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:19 Waiting for index 16196001736394120477 to go active ...
2023/09/08 12:09:20 Index is 16196001736394120477 now active
2023/09/08 12:09:20 Build command issued for the deferred indexes [6161307543476109455]
2023/09/08 12:09:21 Dropping the secondary index id_age
2023/09/08 12:09:21 Index dropped
2023/09/08 12:09:24 Setting JSON docs in KV
2023/09/08 12:09:33 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/08 12:09:33 Waiting for the index id_gender to become active
2023/09/08 12:09:33 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:34 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:35 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:36 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:37 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:38 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:39 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:40 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:41 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:42 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:43 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:44 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:45 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:46 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:47 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:48 Waiting for index 9437999519870795222 to go active ...
2023/09/08 12:09:49 Index is 9437999519870795222 now active
2023/09/08 12:09:49 Using n1ql client
2023/09/08 12:09:50 Expected and Actual scan responses are the same
2023/09/08 12:09:50 Using n1ql client
2023/09/08 12:09:53 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (54.71s)
=== RUN TestCreateAfterDropWhileIndexBuilding
2023/09/08 12:09:53 In TestCreateAfterDropWhileIndexBuilding()
2023/09/08 12:09:53 In DropAllSecondaryIndexes()
2023/09/08 12:09:53 Index found: id_company
2023/09/08 12:09:53 Dropped index id_company
2023/09/08 12:09:53 Index found: id_gender
2023/09/08 12:09:53 Dropped index id_gender
2023/09/08 12:10:16 Setting JSON docs in KV
2023/09/08 12:11:14 Build command issued for the deferred indexes [1378180812841798226]
2023/09/08 12:11:15 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:16 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:17 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:18 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:19 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:20 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:21 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:22 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:23 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:24 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:25 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:26 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:27 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:28 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:29 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:30 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:31 Waiting for index 1378180812841798226 to go active ...
2023/09/08 12:11:32 Index is 1378180812841798226 now active
2023/09/08 12:11:32 Build command issued for the deferred indexes [1824571349076216089]
2023/09/08 12:11:33 Dropping the secondary index id_company
2023/09/08 12:11:34 Index dropped
2023/09/08 12:11:34 Dropping the secondary index id_age
2023/09/08 12:11:35 Index dropped
2023/09/08 12:11:41 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/09/08 12:11:41 Waiting for the index id_gender to become active
2023/09/08 12:11:41 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:42 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:43 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:44 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:45 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:46 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:47 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:48 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:49 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:50 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:51 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:52 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:53 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:54 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:55 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:56 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:57 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:58 Waiting for index 5049261755693807234 to go active ...
2023/09/08 12:11:59 Index is 5049261755693807234 now active
2023/09/08 12:12:00 Index is 5049261755693807234 now active
2023/09/08 12:12:02 Using n1ql client
2023/09/08 12:12:05 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (131.89s)
=== RUN TestDropBuildingIndex1
2023/09/08 12:12:05 In TestDropBuildingIndex1()
2023/09/08 12:12:05 In DropAllSecondaryIndexes()
2023/09/08 12:12:05 Index found: id_gender
2023/09/08 12:12:05 Dropped index id_gender
2023/09/08 12:12:09 Setting JSON docs in KV
2023/09/08 12:12:38 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:12:38 Index is 16238915107773929950 now active
2023/09/08 12:13:01 Dropping the secondary index id_age
2023/09/08 12:13:01 Index dropped
2023/09/08 12:13:21 Created the secondary index id_age. Waiting for it become active
2023/09/08 12:13:21 Index is 62934951871957440 now active
2023/09/08 12:13:23 Setting JSON docs in KV
2023/09/08 12:13:32 Using n1ql client
2023/09/08 12:13:32 Expected and Actual scan responses are the same
2023/09/08 12:13:34 Using n1ql client
2023/09/08 12:13:34 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex1 (89.63s)
=== RUN TestDropBuildingIndex2
2023/09/08 12:13:34 In TestDropBuildingIndex2()
2023/09/08 12:13:34 In DropAllSecondaryIndexes()
2023/09/08 12:13:34 Index found: id_age
2023/09/08 12:13:34 Dropped index id_age
2023/09/08 12:13:34 Index found: id_company
2023/09/08 12:13:35 Dropped index id_company
2023/09/08 12:13:38 Setting JSON docs in KV
2023/09/08 12:14:17 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:14:17 Index is 3493463885907187778 now active
2023/09/08 12:14:41 Dropping the secondary index id_company
2023/09/08 12:14:41 Index dropped
2023/09/08 12:14:41 Index is 7980934188560994080 now active
2023/09/08 12:15:04 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:15:04 Index is 13361541768128126788 now active
2023/09/08 12:15:06 Setting JSON docs in KV
2023/09/08 12:15:14 Using n1ql client
2023/09/08 12:15:15 Expected and Actual scan responses are the same
2023/09/08 12:15:15 Using n1ql client
2023/09/08 12:15:16 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex2 (101.61s)
=== RUN TestDropIndexWithDataLoad
2023/09/08 12:15:16 In TestDropIndexWithDataLoad()
2023/09/08 12:15:16 In DropAllSecondaryIndexes()
2023/09/08 12:15:16 Index found: id_company
2023/09/08 12:15:16 Dropped index id_company
2023/09/08 12:15:16 Index found: id_age
2023/09/08 12:15:16 Dropped index id_age
2023/09/08 12:15:18 Setting JSON docs in KV
2023/09/08 12:15:45 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:15:45 Index is 15973263103545942501 now active
2023/09/08 12:16:11 Created the secondary index id_age. Waiting for it become active
2023/09/08 12:16:11 Index is 11590110713496180496 now active
2023/09/08 12:16:34 Created the secondary index id_gender. Waiting for it become active
2023/09/08 12:16:34 Index is 16396407411226674998 now active
2023/09/08 12:16:57 Created the secondary index id_isActive. Waiting for it become active
2023/09/08 12:16:57 Index is 16348128359596735551 now active
2023/09/08 12:17:07 Setting JSON docs in KV
2023/09/08 12:17:07 In LoadKVBucket
2023/09/08 12:17:07 Bucket name = default
2023/09/08 12:17:07 In DropIndexWhileKVLoad
2023/09/08 12:17:08 Dropping the secondary index id_company
2023/09/08 12:17:08 Index dropped
2023/09/08 12:17:33 Using n1ql client
2023/09/08 12:17:34 Expected and Actual scan responses are the same
2023/09/08 12:17:34 Number of docScanResults and scanResults = 96712 and 96712
2023/09/08 12:17:34 Using n1ql client
2023/09/08 12:17:37 Expected and Actual scan responses are the same
2023/09/08 12:17:37 Number of docScanResults and scanResults = 420000 and 420000
--- PASS: TestDropIndexWithDataLoad (141.53s)
=== RUN TestDropAllIndexesWithDataLoad
2023/09/08 12:17:37 In TestDropAllIndexesWithDataLoad()
2023/09/08 12:17:37 In DropAllSecondaryIndexes()
2023/09/08 12:17:37 Index found: id_gender
2023/09/08 12:17:37 Dropped index id_gender
2023/09/08 12:17:37 Index found: id_age
2023/09/08 12:17:38 Dropped index id_age
2023/09/08 12:17:38 Index found: id_isActive
2023/09/08 12:17:38 Dropped index id_isActive
2023/09/08 12:17:40 Setting JSON docs in KV
2023/09/08 12:18:12 Created the secondary index id_company. Waiting for it become active
2023/09/08 12:18:12 Index is 17640487327656091538 now active
2023/09/08 12:18:38 Created the secondary index id_age. Waiting for it become active
2023/09/08 12:18:38 Index is 545901927835570942 now active
2023/09/08 12:19:04 Created the secondary index id_gender. Waiting for it become active
2023/09/08 12:19:04 Index is 10353138340557208964 now active
2023/09/08 12:19:29 Created the secondary index id_isActive. Waiting for it become active
2023/09/08 12:19:29 Index is 11011634848435349111 now active
2023/09/08 12:19:38 Setting JSON docs in KV
2023/09/08 12:19:38 In LoadKVBucket
2023/09/08 12:19:38 Bucket name = default
2023/09/08 12:19:38 In DropIndexWhileKVLoad
2023/09/08 12:19:38 In DropIndexWhileKVLoad
2023/09/08 12:19:38 In DropIndexWhileKVLoad
2023/09/08 12:19:38 In DropIndexWhileKVLoad
2023/09/08 12:19:39 Dropping the secondary index id_company
2023/09/08 12:19:39 Dropping the secondary index id_age
2023/09/08 12:19:39 Dropping the secondary index id_isActive
2023/09/08 12:19:39 Dropping the secondary index id_gender
2023/09/08 12:19:39 Index dropped
2023/09/08 12:19:39 Index dropped
2023/09/08 12:19:39 Index dropped
2023/09/08 12:19:39 Index dropped
2023/09/08 12:19:57 Using n1ql client
2023/09/08 12:19:57 Scan failed as expected with error: Index Not Found - cause: GSI index id_company not found.
--- PASS: TestDropAllIndexesWithDataLoad (139.74s)
=== RUN TestCreateBucket_AnotherIndexBuilding
2023/09/08 12:19:57 In TestCreateBucket_AnotherIndexBuilding()
2023/09/08 12:19:57 In DropAllSecondaryIndexes()
2023/09/08 12:20:36 Flushed the bucket default, Response body:
2023/09/08 12:20:39 Modified parameters of bucket default, responseBody:
2023/09/08 12:20:39 http://127.0.0.1:9000/pools/default/buckets/multi_buck2
2023/09/08 12:20:39 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000480d8}
2023/09/08 12:20:39 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 08 Sep 2023 06:50:38 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc03055cf40 31 [] false false map[] 0xc011faf600 }
2023/09/08 12:20:39 DeleteBucket failed for bucket multi_buck2
2023/09/08 12:20:39 Deleted bucket multi_buck2, responseBody: Requested resource not found.
2023/09/08 12:21:09 Setting JSON docs in KV
2023/09/08 12:23:10 Created bucket multi_buck2, responseBody:
2023/09/08 12:23:49 Index is 5761308028016673010 now active
2023/09/08 12:23:49 Index is 14640245578241481442 now active
2023/09/08 12:23:49 Using n1ql client
2023-09-08T12:23:49.247+05:30 [Info] GSIC[default/multi_buck2-_default-_default-1694156029243780059] started ...
2023/09/08 12:23:49 Expected and Actual scan responses are the same
2023/09/08 12:23:49 Number of docScanResults and scanResults = 10000 and 10000
2023/09/08 12:23:49 Using n1ql client
2023/09/08 12:23:53 Expected and Actual scan responses are the same
2023/09/08 12:23:53 Number of docScanResults and scanResults = 200000 and 200000
2023/09/08 12:23:56 Deleted bucket multi_buck2, responseBody:
2023/09/08 12:24:34 Flushed the bucket default, Response body:
--- PASS: TestCreateBucket_AnotherIndexBuilding (276.50s)
=== RUN TestDropBucket2Index_Bucket1IndexBuilding
2023/09/08 12:24:34 In TestDropBucket2Index_Bucket1IndexBuilding()
2023/09/08 12:24:34 In DropAllSecondaryIndexes()
2023/09/08 12:24:34 Index found: buck1_idx
2023/09/08 12:24:34 Dropped index buck1_idx
2023/09/08 12:25:12 Flushed the bucket default, Response body:
2023/09/08 12:25:15 Modified parameters of bucket default, responseBody:
2023/09/08 12:25:15 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3
2023/09/08 12:25:15 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000480d8}
2023/09/08 12:25:15 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 08 Sep 2023 06:55:14 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc004cbd380 31 [] false false map[] 0xc006ce8300 }
2023/09/08 12:25:15 DeleteBucket failed for bucket multibucket_test3
2023/09/08 12:25:15 Deleted bucket multibucket_test3, responseBody: Requested resource not found.
2023/09/08 12:25:15 Created bucket multibucket_test3, responseBody:
2023/09/08 12:25:45 Setting JSON docs in KV
2023/09/08 12:26:46 Created the secondary index buck2_idx. Waiting for it become active
2023/09/08 12:26:46 Index is 2800211869341046231 now active
2023/09/08 12:26:58 Dropping the secondary index buck2_idx
2023/09/08 12:26:58 Index dropped
2023/09/08 12:26:58 Index is 212448104995514281 now active
2023/09/08 12:26:59 Using n1ql client
2023/09/08 12:27:01 Expected and Actual scan responses are the same
2023/09/08 12:27:01 Number of docScanResults and scanResults = 100000 and 100000
2023/09/08 12:27:04 Deleted bucket multibucket_test3, responseBody:
2023/09/08 12:27:42 Flushed the bucket default, Response body:
--- PASS: TestDropBucket2Index_Bucket1IndexBuilding (188.23s)
=== RUN TestDeleteBucketWhileInitialIndexBuild
2023/09/08 12:27:42 In TestDeleteBucketWhileInitialIndexBuild()
2023/09/08 12:27:42 ============== DBG: Drop all indexes in all buckets
2023/09/08 12:27:42 In DropAllSecondaryIndexes()
2023/09/08 12:27:42 Index found: buck1_idx
2023/09/08 12:27:42 Dropped index buck1_idx
2023/09/08 12:27:42 ============== DBG: Delete bucket default
2023/09/08 12:27:44 Deleted bucket default, responseBody:
2023/09/08 12:27:44 ============== DBG: Create bucket default
2023/09/08 12:27:44 Created bucket default, responseBody:
2023/09/08 12:27:47 Flush Enabled on bucket default, responseBody:
2023/09/08 12:28:20 Flushed the bucket default, Response body:
2023/09/08 12:28:20 ============== DBG: Delete bucket testbucket2
2023/09/08 12:28:20 http://127.0.0.1:9000/pools/default/buckets/testbucket2
2023/09/08 12:28:20 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000480d8}
2023/09/08 12:28:20 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 08 Sep 2023 06:58:20 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0153ba280 31 [] false false map[] 0xc007b84200 }
2023/09/08 12:28:20 DeleteBucket failed for bucket testbucket2
2023/09/08 12:28:20 Deleted bucket testbucket2, responseBody: Requested resource not found.
2023/09/08 12:28:20 ============== DBG: Create bucket testbucket2
2023/09/08 12:28:20 Created bucket testbucket2, responseBody:
2023/09/08 12:28:24 Flush Enabled on bucket testbucket2, responseBody:
2023/09/08 12:28:57 Flushed the bucket testbucket2, Response body:
2023/09/08 12:28:57 ============== DBG: Delete bucket testbucket3
2023/09/08 12:28:57 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2023/09/08 12:28:57 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000480d8}
2023/09/08 12:28:57 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 08 Sep 2023 06:58:56 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc01525aa80 31 [] false false map[] 0xc0088d6000 }
2023/09/08 12:28:57 DeleteBucket failed for bucket testbucket3
2023/09/08 12:28:57 Deleted bucket testbucket3, responseBody: Requested resource not found.
2023/09/08 12:28:57 ============== DBG: Create bucket testbucket3
2023/09/08 12:28:57 Created bucket testbucket3, responseBody:
2023/09/08 12:29:00 Flush Enabled on bucket testbucket3, responseBody:
2023/09/08 12:29:35 Flushed the bucket testbucket3, Response body:
2023/09/08 12:29:35 ============== DBG: Delete bucket testbucket4
2023/09/08 12:29:35 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/09/08 12:29:35 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000480d8}
2023/09/08 12:29:35 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 08 Sep 2023 06:59:34 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc015c98580 31 [] false false map[] 0xc0032be200 }
2023/09/08 12:29:35 DeleteBucket failed for bucket testbucket4
2023/09/08 12:29:35 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/09/08 12:29:35 ============== DBG: Create bucket testbucket4
2023/09/08 12:29:35 Created bucket testbucket4, responseBody:
2023/09/08 12:29:38 Flush Enabled on bucket testbucket4, responseBody:
2023/09/08 12:30:11 Flushed the bucket testbucket4, Response body:
2023/09/08 12:30:41 Generating docs and Populating all the buckets
2023/09/08 12:30:42 ============== DBG: Creating docs in bucket default
2023/09/08 12:30:42 ============== DBG: Creating index bucket1_age in bucket default
2023/09/08 12:30:46 Created the secondary index bucket1_age. Waiting for it become active
2023/09/08 12:30:46 Index is 7198754216563454740 now active
2023/09/08 12:30:46 ============== DBG: Creating index bucket1_gender in bucket default
2023/09/08 12:30:53 Created the secondary index bucket1_gender. Waiting for it become active
2023/09/08 12:30:53 Index is 13351724879279780653 now active
2023/09/08 12:30:53 ============== DBG: Creating docs in bucket testbucket2
2023/09/08 12:30:54 ============== DBG: Creating index bucket2_city in bucket testbucket2
2023/09/08 12:30:58 Created the secondary index bucket2_city. Waiting for it become active
2023/09/08 12:30:58 Index is 16777520580929564000 now active
2023/09/08 12:30:58 ============== DBG: Creating index bucket2_company in bucket testbucket2
2023/09/08 12:31:06 Created the secondary index bucket2_company. Waiting for it become active
2023/09/08 12:31:06 Index is 13564080284017951460 now active
2023/09/08 12:31:07 ============== DBG: Creating docs in bucket testbucket3
2023/09/08 12:31:07 ============== DBG: Creating index bucket3_gender in bucket testbucket3
2023/09/08 12:31:12 Created the secondary index bucket3_gender. Waiting for it become active
2023/09/08 12:31:12 Index is 2377682250171968072 now active
2023/09/08 12:31:12 ============== DBG: Creating index bucket3_address in bucket testbucket3
2023/09/08 12:31:19 Created the secondary index bucket3_address. Waiting for it become active
2023/09/08 12:31:19 Index is 2874019337218372440 now active
2023/09/08 12:31:19 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2023/09/08 12:31:19 Using n1ql client
2023-09-08T12:31:19.407+05:30 [Info] metadata provider version changed 1300 -> 1301
2023-09-08T12:31:19.407+05:30 [Info] switched currmeta from 1300 -> 1301 force false
2023-09-08T12:31:19.407+05:30 [Info] GSIC[default/default-_default-_default-1694156479400344543] started ...
2023/09/08 12:31:19 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2023/09/08 12:31:19 Expected and Actual scan responses are the same
2023/09/08 12:31:30 ============== DBG: Creating 50K docs in bucket testbucket4
2023/09/08 12:31:56 ============== DBG: Creating index bucket4_balance asynchronously in bucket testbucket4
2023/09/08 12:32:07 ============== DBG: Deleting bucket testbucket4
2023/09/08 12:32:09 Deleted bucket testbucket4, responseBody:
2023/09/08 12:32:09 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2023/09/08 12:32:09 Using n1ql client
2023/09/08 12:32:09 ============== DBG: First bucket scan:: Expected results = 294 Actual results = 294
2023/09/08 12:32:09 Expected and Actual scan responses are the same
2023/09/08 12:32:09 ============== DBG: Second bucket scan:: Scanning index bucket2_city in bucket testbucket2
2023/09/08 12:32:09 Using n1ql client
2023-09-08T12:32:09.377+05:30 [Info] GSIC[default/testbucket2-_default-_default-1694156529375027671] started ...
2023/09/08 12:32:09 ============== DBG: Second bucket scan:: Expected results = 392 Actual results = 392
2023/09/08 12:32:09 Expected and Actual scan responses are the same
2023/09/08 12:32:09 ============== DBG: Third bucket scan:: Scanning index bucket3_gender in bucket testbucket3
2023/09/08 12:32:09 Using n1ql client
2023-09-08T12:32:09.385+05:30 [Info] GSIC[default/testbucket3-_default-_default-1694156529383190591] started ...
2023/09/08 12:32:09 ============== DBG: Third bucket scan:: Expected results = 492 Actual results = 492
2023/09/08 12:32:09 Expected and Actual scan responses are the same
2023/09/08 12:32:09 ============== DBG: Deleting buckets testbucket2 testbucket3 testbucket4
2023/09/08 12:32:11 Deleted bucket testbucket2, responseBody:
2023/09/08 12:32:13 Deleted bucket testbucket3, responseBody:
2023/09/08 12:32:13 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/09/08 12:32:13 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000480d8}
2023/09/08 12:32:13 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 08 Sep 2023 07:02:13 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00197e980 31 [] false false map[] 0xc007b85000 }
2023/09/08 12:32:13 DeleteBucket failed for bucket testbucket4
2023/09/08 12:32:13 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/09/08 12:32:16 Modified parameters of bucket default, responseBody:
--- PASS: TestDeleteBucketWhileInitialIndexBuild (304.47s)
=== RUN TestWherClause_UpdateDocument
2023/09/08 12:32:46 In TestWherClause_UpdateDocument()
2023/09/08 12:32:46 In DropAllSecondaryIndexes()
2023/09/08 12:32:46 Index found: bucket1_gender
2023/09/08 12:32:46 Dropped index bucket1_gender
2023/09/08 12:32:46 Index found: bucket1_age
2023/09/08 12:32:46 Dropped index bucket1_age
2023/09/08 12:33:25 Flushed the bucket default, Response body:
2023/09/08 12:33:27 Setting JSON docs in KV
2023/09/08 12:33:36 Created the secondary index id_ageGreaterThan40. Waiting for it become active
2023/09/08 12:33:36 Index is 11038300391888888276 now active
2023/09/08 12:33:36 Using n1ql client
2023/09/08 12:33:36 Expected and Actual scan responses are the same
2023/09/08 12:33:36 Number of docScanResults and scanResults = 5981 and 5981
2023/09/08 12:33:40 Using n1ql client
2023/09/08 12:33:40 Expected and Actual scan responses are the same
2023/09/08 12:33:40 Number of docScanResults and scanResults = 1981 and 1981
--- PASS: TestWherClause_UpdateDocument (54.23s)
=== RUN TestDeferFalse
2023/09/08 12:33:40 In TestDeferFalse()
2023/09/08 12:33:43 Setting JSON docs in KV
2023/09/08 12:33:56 Created the secondary index index_deferfalse1. Waiting for it become active
2023/09/08 12:33:56 Index is 1057892543275246629 now active
2023/09/08 12:33:56 Using n1ql client
2023/09/08 12:33:56 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse (15.93s)
=== RUN TestDeferFalse_CloseClientConnection
2023/09/08 12:33:56 In TestDeferFalse_CloseClientConnection()
2023/09/08 12:33:56 In CloseClientThread
2023/09/08 12:33:56 In CreateIndexThread
2023/09/08 12:33:58 Create Index call failed as expected due to error : Terminate Request due to client termination
2023/09/08 12:33:59 Waiting for index 5257021055142686509 to go active ...
2023/09/08 12:34:00 Waiting for index 5257021055142686509 to go active ...
2023/09/08 12:34:01 Waiting for index 5257021055142686509 to go active ...
2023/09/08 12:34:02 Waiting for index 5257021055142686509 to go active ...
2023/09/08 12:34:03 Waiting for index 5257021055142686509 to go active ...
2023/09/08 12:34:04 Waiting for index 5257021055142686509 to go active ...
2023/09/08 12:34:05 Waiting for index 5257021055142686509 to go active ...
2023/09/08 12:34:06 Index is 5257021055142686509 now active
2023/09/08 12:34:06 Using n1ql client
2023/09/08 12:34:06 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse_CloseClientConnection (9.12s)
=== RUN TestOrphanIndexCleanup
2023/09/08 12:34:06 In DropAllSecondaryIndexes()
2023/09/08 12:34:06 Index found: index_deferfalse2
2023/09/08 12:34:06 Dropped index index_deferfalse2
2023/09/08 12:34:06 Index found: id_ageGreaterThan40
2023/09/08 12:34:06 Dropped index id_ageGreaterThan40
2023/09/08 12:34:06 Index found: index_deferfalse1
2023/09/08 12:34:06 Dropped index index_deferfalse1
2023/09/08 12:34:20 Created the secondary index idx1_age_regular. Waiting for it become active
2023/09/08 12:34:20 Index is 16783251274019813594 now active
2023/09/08 12:34:28 Created the secondary index idx2_company_regular. Waiting for it become active
2023/09/08 12:34:28 Index is 8651429460309966907 now active
2023/09/08 12:34:38 Using n1ql client
2023/09/08 12:34:38 Query on idx1_age_regular is successful
2023/09/08 12:34:38 Using n1ql client
2023/09/08 12:34:38 Query on idx2_company_regular is successful
Restarting indexer process ...
2023/09/08 12:34:38 []
2023-09-08T12:34:38.237+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-08T12:34:38.237+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/08 12:34:58 Using n1ql client
2023-09-08T12:34:58.198+05:30 [Error] transport error between 127.0.0.1:33062->127.0.0.1:9107: write tcp 127.0.0.1:33062->127.0.0.1:9107: write: broken pipe
2023-09-08T12:34:58.198+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -7162249899538505273 request transport failed `write tcp 127.0.0.1:33062->127.0.0.1:9107: write: broken pipe`
2023-09-08T12:34:58.198+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-08T12:34:58.198+05:30 [Error] metadataClient:PickRandom: Replicas - [2923537074055375034], PrunedReplica - map[], FilteredReplica map[]
2023/09/08 12:34:58 Query on idx1_age_regular is successful - after indexer restart.
2023/09/08 12:34:58 Using n1ql client
2023/09/08 12:34:58 Query on idx2_company_regular is successful - after indexer restart.
--- PASS: TestOrphanIndexCleanup (52.18s)
=== RUN TestOrphanPartitionCleanup
2023/09/08 12:35:03 Created the secondary index idx3_age_regular. Waiting for it become active
2023/09/08 12:35:03 Index is 1728383635965048110 now active
2023/09/08 12:35:13 Using n1ql client
2023/09/08 12:35:13 Query on idx3_age_regular is successful
Restarting indexer process ...
2023/09/08 12:35:13 []
2023-09-08T12:35:13.077+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-09-08T12:35:13.077+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/09/08 12:35:33 Using n1ql client
2023-09-08T12:35:33.049+05:30 [Error] transport error between 127.0.0.1:56326->127.0.0.1:9107: write tcp 127.0.0.1:56326->127.0.0.1:9107: write: broken pipe
2023-09-08T12:35:33.049+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 5464151805238450536 request transport failed `write tcp 127.0.0.1:56326->127.0.0.1:9107: write: broken pipe`
2023-09-08T12:35:33.049+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8. Partition with instances 0
2023-09-08T12:35:33.049+05:30 [Error] metadataClient:PickRandom: Replicas - [18231574073039981255], PrunedReplica - map[], FilteredReplica map[]
2023/09/08 12:35:33 Query on idx3_age_regular is successful - after indexer restart.
--- PASS: TestOrphanPartitionCleanup (34.84s)
=== RUN TestIndexerSettings
2023/09/08 12:35:33 In TestIndexerSettings()
2023/09/08 12:35:33 Changing config key indexer.settings.max_cpu_percent to value 300
2023-09-08T12:35:33.316+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:33 Changing config key indexer.settings.inmemory_snapshot.interval to value 300
2023-09-08T12:35:33.343+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":300,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":2,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:33.432+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:33 Changing config key indexer.settings.persisted_snapshot.interval to value 20000
2023-09-08T12:35:33.469+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":300,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":2,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:33.557+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:33 Changing config key indexer.settings.recovery.max_rollbacks to value 3
2023-09-08T12:35:33.587+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":300,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:33.665+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:33 Changing config key indexer.settings.log_level to value error
--- PASS: TestIndexerSettings (0.60s)
=== RUN TestRestoreDefaultSettings
2023/09/08 12:35:33 In TestIndexerSettings_RestoreDefault()
2023-09-08T12:35:33.682+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":300,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:33.773+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:33 Changing config key indexer.settings.max_cpu_percent to value 0
2023-09-08T12:35:33.796+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":300,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:33.885+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:33 Changing config key indexer.settings.inmemory_snapshot.interval to value 200
2023-09-08T12:35:33.901+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":20000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:33.993+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:33 Changing config key indexer.settings.persisted_snapshot.interval to value 5000
2023-09-08T12:35:34.009+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":3,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:34.101+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:34 Changing config key indexer.settings.recovery.max_rollbacks to value 5
2023-09-08T12:35:34.114+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"error","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:34.208+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:35:34 Changing config key indexer.settings.log_level to value info
--- PASS: TestRestoreDefaultSettings (0.54s)
=== RUN TestStat_ItemsCount
2023/09/08 12:35:34 In TestStat_ItemsCount()
2023/09/08 12:35:34 In DropAllSecondaryIndexes()
2023/09/08 12:35:34 Index found: idx1_age_regular
2023-09-08T12:35:34.215+05:30 [Info] DropIndex 16783251274019813594 ...
2023-09-08T12:35:34.250+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023-09-08T12:35:34.285+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.285+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.286+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.286+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.289+05:30 [Info] switched currmeta from 1393 -> 1394 force true
2023-09-08T12:35:34.290+05:30 [Info] switched currmeta from 1389 -> 1390 force true
2023-09-08T12:35:34.292+05:30 [Info] metadata provider version changed 1394 -> 1395
2023-09-08T12:35:34.292+05:30 [Info] switched currmeta from 1394 -> 1395 force false
2023-09-08T12:35:34.292+05:30 [Info] DropIndex 16783251274019813594 - elapsed(76.62141ms), err()
2023/09/08 12:35:34 Dropped index idx1_age_regular
2023/09/08 12:35:34 Index found: idx2_company_regular
2023-09-08T12:35:34.292+05:30 [Info] DropIndex 8651429460309966907 ...
2023-09-08T12:35:34.297+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.297+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.300+05:30 [Info] switched currmeta from 1395 -> 1395 force true
2023-09-08T12:35:34.300+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.300+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.302+05:30 [Info] switched currmeta from 1390 -> 1391 force true
2023-09-08T12:35:34.326+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.326+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.328+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.328+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.328+05:30 [Info] switched currmeta from 1395 -> 1395 force true
2023-09-08T12:35:34.333+05:30 [Info] switched currmeta from 1391 -> 1392 force true
2023-09-08T12:35:34.351+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.351+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.354+05:30 [Info] switched currmeta from 1395 -> 1396 force true
2023-09-08T12:35:34.355+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.355+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.356+05:30 [Info] switched currmeta from 1392 -> 1392 force true
2023-09-08T12:35:34.358+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.358+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.361+05:30 [Info] switched currmeta from 1396 -> 1396 force true
2023-09-08T12:35:34.362+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.362+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.365+05:30 [Info] switched currmeta from 1392 -> 1392 force true
2023-09-08T12:35:34.373+05:30 [Info] metadata provider version changed 1396 -> 1397
2023-09-08T12:35:34.373+05:30 [Info] switched currmeta from 1396 -> 1397 force false
2023-09-08T12:35:34.373+05:30 [Info] DropIndex 8651429460309966907 - elapsed(80.702885ms), err()
2023/09/08 12:35:34 Dropped index idx2_company_regular
2023/09/08 12:35:34 Index found: idx3_age_regular
2023-09-08T12:35:34.373+05:30 [Info] DropIndex 1728383635965048110 ...
2023-09-08T12:35:34.393+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.393+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.396+05:30 [Info] switched currmeta from 1397 -> 1397 force true
2023-09-08T12:35:34.411+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.411+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.429+05:30 [Info] switched currmeta from 1392 -> 1394 force true
2023-09-08T12:35:34.460+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.460+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.461+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.461+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.462+05:30 [Info] switched currmeta from 1394 -> 1394 force true
2023-09-08T12:35:34.488+05:30 [Info] switched currmeta from 1397 -> 1398 force true
2023-09-08T12:35:34.512+05:30 [Info] metadata provider version changed 1398 -> 1399
2023-09-08T12:35:34.512+05:30 [Info] switched currmeta from 1398 -> 1399 force false
2023-09-08T12:35:34.512+05:30 [Info] DropIndex 1728383635965048110 - elapsed(139.313515ms), err()
2023/09/08 12:35:34 Dropped index idx3_age_regular
2023/09/08 12:35:34 Emptying the default bucket
2023-09-08T12:35:34.515+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.515+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.522+05:30 [Info] switched currmeta from 1394 -> 1395 force true
2023-09-08T12:35:34.529+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.529+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.532+05:30 [Info] switched currmeta from 1399 -> 1399 force true
2023-09-08T12:35:34.534+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.534+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.538+05:30 [Info] switched currmeta from 1395 -> 1395 force true
2023-09-08T12:35:34.549+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:34.549+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:34.550+05:30 [Info] switched currmeta from 1399 -> 1399 force true
2023/09/08 12:35:37 Flush Enabled on bucket default, responseBody:
2023-09-08T12:35:40.734+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:35:40.740+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:40.740+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:40.741+05:30 [Info] switched currmeta from 1399 -> 1399 force true
2023-09-08T12:35:40.745+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:40.745+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:40.746+05:30 [Info] switched currmeta from 1395 -> 1395 force true
2023-09-08T12:35:42.346+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:35:42.353+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:42.353+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:42.362+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:42.362+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:42.363+05:30 [Info] switched currmeta from 1395 -> 1395 force true
2023-09-08T12:35:42.366+05:30 [Info] switched currmeta from 1399 -> 1399 force true
2023-09-08T12:35:45.589+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:35:45.595+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:45.595+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:45.597+05:30 [Info] switched currmeta from 1399 -> 1399 force true
2023-09-08T12:35:45.601+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:35:45.601+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:35:45.602+05:30 [Info] switched currmeta from 1395 -> 1395 force true
2023/09/08 12:36:15 Flushed the bucket default, Response body:
2023/09/08 12:36:15 Generating JSON docs
2023/09/08 12:36:15 Setting initial JSON docs in KV
2023/09/08 12:36:20 Creating a 2i
2023-09-08T12:36:20.340+05:30 [Info] CreateIndex default _default _default index_test1 ...
2023-09-08T12:36:20.341+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 10447233154246209496
2023-09-08T12:36:20.342+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_test1, 10447233154246209496)
2023-09-08T12:36:20.342+05:30 [Info] Skipping planner for creation of the index default:_default:_default:index_test1
2023-09-08T12:36:20.342+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 10447233154246209496
2023-09-08T12:36:20.437+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:20.437+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:20.437+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:20.437+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:20.439+05:30 [Info] switched currmeta from 1395 -> 1397 force true
2023-09-08T12:36:20.441+05:30 [Info] switched currmeta from 1399 -> 1401 force true
2023-09-08T12:36:20.452+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:20.452+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:20.452+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:20.452+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:20.455+05:30 [Info] switched currmeta from 1401 -> 1402 force true
2023-09-08T12:36:20.455+05:30 [Info] switched currmeta from 1397 -> 1398 force true
2023-09-08T12:36:20.464+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:20.464+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:20.464+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:20.464+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:20.467+05:30 [Info] switched currmeta from 1398 -> 1399 force true
2023-09-08T12:36:20.468+05:30 [Info] switched currmeta from 1402 -> 1403 force true
2023-09-08T12:36:20.545+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:20.545+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:20.548+05:30 [Info] switched currmeta from 1399 -> 1400 force true
2023-09-08T12:36:20.548+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:20.548+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:20.552+05:30 [Info] switched currmeta from 1403 -> 1404 force true
2023-09-08T12:36:21.468+05:30 [Info] connected with 1 indexers
2023-09-08T12:36:21.468+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-08T12:36:21.481+05:30 [Info] num concurrent scans {0}
2023-09-08T12:36:21.481+05:30 [Info] average scan response {159 ms}
2023-09-08T12:36:22.870+05:30 [Info] connected with 1 indexers
2023-09-08T12:36:22.870+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-08T12:36:22.877+05:30 [Info] GSIC[default/default-_default-_default-1694156479400344543] logstats "default" {"gsi_scan_count":12,"gsi_scan_duration":192694282,"gsi_throttle_duration":9633708,"gsi_prime_duration":80898875,"gsi_blocked_duration":1704667,"gsi_total_temp_files":0,"gsi_backfill_size":0}
2023-09-08T12:36:22.877+05:30 [Info] num concurrent scans {0}
2023-09-08T12:36:22.877+05:30 [Info] average scan response {12 ms}
2023-09-08T12:36:23.624+05:30 [Info] CreateIndex 10447233154246209496 default _default _default/index_test1 using:memory_optimized exprType:N1QL whereExpr:() secExprs:([`company`]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(3.284027511s) err()
2023/09/08 12:36:23 Created the secondary index index_test1. Waiting for it become active
2023-09-08T12:36:23.624+05:30 [Info] metadata provider version changed 1404 -> 1405
2023-09-08T12:36:23.625+05:30 [Info] switched currmeta from 1404 -> 1405 force false
2023/09/08 12:36:23 Index is 10447233154246209496 now active
2023-09-08T12:36:23.642+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:23.642+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:23.643+05:30 [Info] switched currmeta from 1400 -> 1401 force true
2023-09-08T12:36:23.646+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:23.646+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:23.668+05:30 [Info] switched currmeta from 1405 -> 1405 force true
2023-09-08T12:36:24.972+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-08T12:36:25.744+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:36:25.751+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:25.751+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:25.753+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:25.753+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:25.755+05:30 [Info] switched currmeta from 1401 -> 1401 force true
2023-09-08T12:36:25.755+05:30 [Info] switched currmeta from 1405 -> 1405 force true
2023-09-08T12:36:25.974+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023/09/08 12:36:28 items_count stat is 10000
--- PASS: TestStat_ItemsCount (54.43s)
=== RUN TestRangeArrayIndex_Distinct
2023/09/08 12:36:28 In TestRangeArrayIndex_Distinct()
2023/09/08 12:36:28 In DropAllSecondaryIndexes()
2023/09/08 12:36:28 Index found: index_test1
2023-09-08T12:36:28.650+05:30 [Info] DropIndex 10447233154246209496 ...
2023-09-08T12:36:28.702+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:28.702+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:28.702+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:28.702+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:28.736+05:30 [Info] metadata provider version changed 1405 -> 1407
2023-09-08T12:36:28.736+05:30 [Info] switched currmeta from 1405 -> 1407 force false
2023-09-08T12:36:28.736+05:30 [Info] DropIndex 10447233154246209496 - elapsed(86.356319ms), err()
2023/09/08 12:36:28 Dropped index index_test1
2023-09-08T12:36:28.753+05:30 [Info] switched currmeta from 1401 -> 1403 force true
2023-09-08T12:36:28.765+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:28.765+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:28.793+05:30 [Info] switched currmeta from 1403 -> 1403 force true
2023-09-08T12:36:28.812+05:30 [Info] switched currmeta from 1407 -> 1407 force true
2023-09-08T12:36:28.827+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:28.827+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:28.830+05:30 [Info] switched currmeta from 1407 -> 1407 force true
2023-09-08T12:36:30.744+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:36:30.750+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:30.750+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:30.753+05:30 [Info] switched currmeta from 1403 -> 1403 force true
2023-09-08T12:36:30.753+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:30.753+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:30.755+05:30 [Info] switched currmeta from 1407 -> 1407 force true
2023-09-08T12:36:30.980+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:36:30.984+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:30.984+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:30.988+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:30.988+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:30.989+05:30 [Info] switched currmeta from 1403 -> 1403 force true
2023-09-08T12:36:30.989+05:30 [Info] switched currmeta from 1407 -> 1407 force true
2023-09-08T12:36:35.753+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:36:35.762+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:35.762+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:35.762+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:35.762+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:35.764+05:30 [Info] switched currmeta from 1403 -> 1403 force true
2023-09-08T12:36:35.764+05:30 [Info] switched currmeta from 1407 -> 1407 force true
2023-09-08T12:36:37.284+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:36:37.287+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:37.287+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:37.290+05:30 [Info] switched currmeta from 1407 -> 1407 force true
2023-09-08T12:36:37.290+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:36:37.290+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:36:37.294+05:30 [Info] switched currmeta from 1403 -> 1403 force true
2023/09/08 12:37:07 Flushed the bucket default, Response body:
2023-09-08T12:37:07.854+05:30 [Info] CreateIndex default _default _default arridx_friends ...
2023-09-08T12:37:07.854+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 14297575177688943954
2023-09-08T12:37:07.855+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arridx_friends, 14297575177688943954)
2023-09-08T12:37:07.855+05:30 [Info] Skipping planner for creation of the index default:_default:_default:arridx_friends
2023-09-08T12:37:07.855+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 14297575177688943954
2023-09-08T12:37:07.936+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:07.936+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:07.938+05:30 [Info] switched currmeta from 1407 -> 1409 force true
2023-09-08T12:37:07.939+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:07.939+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:07.940+05:30 [Info] switched currmeta from 1403 -> 1405 force true
2023-09-08T12:37:07.963+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:07.963+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:07.964+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:07.964+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:07.965+05:30 [Info] switched currmeta from 1409 -> 1410 force true
2023-09-08T12:37:07.965+05:30 [Info] switched currmeta from 1405 -> 1406 force true
2023-09-08T12:37:07.988+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:07.988+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:07.989+05:30 [Info] switched currmeta from 1410 -> 1411 force true
2023-09-08T12:37:07.990+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:07.990+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:07.991+05:30 [Info] switched currmeta from 1406 -> 1407 force true
2023-09-08T12:37:08.035+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:08.035+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:08.035+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:08.035+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:08.038+05:30 [Info] switched currmeta from 1411 -> 1412 force true
2023-09-08T12:37:08.038+05:30 [Info] switched currmeta from 1407 -> 1408 force true
2023-09-08T12:37:10.766+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:37:10.774+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:10.774+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:10.776+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:10.776+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:10.778+05:30 [Info] switched currmeta from 1408 -> 1408 force true
2023-09-08T12:37:10.780+05:30 [Info] switched currmeta from 1412 -> 1412 force true
2023-09-08T12:37:10.818+05:30 [Info] CreateIndex 14297575177688943954 default _default _default/arridx_friends using:memory_optimized exprType:N1QL whereExpr:() secExprs:([(distinct (`friends`))]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(2.96384834s) err()
2023/09/08 12:37:10 Created the secondary index arridx_friends. Waiting for it become active
2023-09-08T12:37:10.818+05:30 [Info] metadata provider version changed 1412 -> 1413
2023-09-08T12:37:10.818+05:30 [Info] switched currmeta from 1412 -> 1413 force false
2023/09/08 12:37:10 Index is 14297575177688943954 now active
2023-09-08T12:37:10.825+05:30 [Error] transport error between 127.0.0.1:40606->127.0.0.1:9107: write tcp 127.0.0.1:40606->127.0.0.1:9107: write: broken pipe
2023-09-08T12:37:10.825+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:40606->127.0.0.1:9107: write: broken pipe`
2023-09-08T12:37:10.825+05:30 [Warn] scan failed: requestId queryport 127.0.0.1:9107 inst 3967000451227417930 partition [0]
2023-09-08T12:37:10.825+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] closing unhealthy connection "127.0.0.1:40606" authenticated true
2023-09-08T12:37:10.825+05:30 [Warn] Scan failed with error for index 14297575177688943954. Trying scan again with replica, reqId: : write tcp 127.0.0.1:40606->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2023-09-08T12:37:10.825+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-09-08T12:37:10.825+05:30 [Error] metadataClient:PickRandom: Replicas - [3967000451227417930], PrunedReplica - map[], FilteredReplica map[]
2023-09-08T12:37:10.825+05:30 [Warn] Fail to find indexers to satisfy query request. Trying scan again for index 14297575177688943954, reqId: : write tcp 127.0.0.1:40606->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2023-09-08T12:37:10.834+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:10.834+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:10.835+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:10.835+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:10.836+05:30 [Info] switched currmeta from 1408 -> 1409 force true
2023-09-08T12:37:10.837+05:30 [Info] switched currmeta from 1413 -> 1413 force true
2023-09-08T12:37:10.838+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] open new connection ...
2023/09/08 12:37:10 Expected and Actual scan responses are the same
2023/09/08 12:37:13 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Distinct (45.11s)
=== RUN TestUpdateArrayIndex_Distinct
2023/09/08 12:37:13 In TestUpdateArrayIndex_Distinct()
2023/09/08 12:37:13 In DropAllSecondaryIndexes()
2023/09/08 12:37:13 Index found: arridx_friends
2023-09-08T12:37:13.756+05:30 [Info] DropIndex 14297575177688943954 ...
2023-09-08T12:37:13.880+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:13.880+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:13.881+05:30 [Info] switched currmeta from 1409 -> 1410 force true
2023-09-08T12:37:13.882+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:13.882+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:13.884+05:30 [Info] switched currmeta from 1413 -> 1414 force true
2023-09-08T12:37:13.888+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:13.889+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:13.889+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:13.889+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:13.890+05:30 [Info] switched currmeta from 1414 -> 1414 force true
2023-09-08T12:37:13.891+05:30 [Info] switched currmeta from 1410 -> 1410 force true
2023-09-08T12:37:13.891+05:30 [Info] metadata provider version changed 1414 -> 1415
2023-09-08T12:37:13.891+05:30 [Info] switched currmeta from 1414 -> 1415 force false
2023-09-08T12:37:13.891+05:30 [Info] DropIndex 14297575177688943954 - elapsed(135.410809ms), err()
2023/09/08 12:37:13 Dropped index arridx_friends
2023-09-08T12:37:13.911+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:13.911+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:13.914+05:30 [Info] switched currmeta from 1415 -> 1415 force true
2023-09-08T12:37:13.914+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:13.914+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:13.916+05:30 [Info] switched currmeta from 1410 -> 1411 force true
2023-09-08T12:37:15.787+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:37:15.851+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:15.851+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:15.853+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:15.853+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:15.855+05:30 [Info] switched currmeta from 1411 -> 1411 force true
2023-09-08T12:37:15.856+05:30 [Info] switched currmeta from 1415 -> 1415 force true
2023-09-08T12:37:17.546+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:37:17.568+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:17.568+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:17.568+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:17.568+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:17.570+05:30 [Info] switched currmeta from 1415 -> 1415 force true
2023-09-08T12:37:17.572+05:30 [Info] switched currmeta from 1411 -> 1411 force true
2023-09-08T12:37:20.767+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:37:20.772+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:20.772+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:20.774+05:30 [Info] switched currmeta from 1415 -> 1415 force true
2023-09-08T12:37:20.774+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:20.774+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:20.776+05:30 [Info] switched currmeta from 1411 -> 1411 force true
2023-09-08T12:37:21.468+05:30 [Info] connected with 1 indexers
2023-09-08T12:37:21.468+05:30 [Info] client stats current counts: current: 0, not current: 0
2023-09-08T12:37:21.480+05:30 [Info] num concurrent scans {0}
2023-09-08T12:37:21.480+05:30 [Info] average scan response {1381 ms}
2023-09-08T12:37:22.617+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:37:22.630+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:22.630+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:22.630+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:22.630+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:22.632+05:30 [Info] switched currmeta from 1415 -> 1415 force true
2023-09-08T12:37:22.632+05:30 [Info] switched currmeta from 1411 -> 1411 force true
2023-09-08T12:37:22.869+05:30 [Info] connected with 1 indexers
2023-09-08T12:37:22.869+05:30 [Info] client stats current counts: current: 0, not current: 0
2023-09-08T12:37:22.877+05:30 [Info] num concurrent scans {0}
2023-09-08T12:37:22.877+05:30 [Info] average scan response {12 ms}
2023-09-08T12:37:25.034+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-08T12:37:26.034+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023/09/08 12:37:52 Flushed the bucket default, Response body:
2023-09-08T12:37:53.232+05:30 [Info] CreateIndex default _default _default arridx_friends ...
2023-09-08T12:37:53.233+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 17199420478067922270
2023-09-08T12:37:53.234+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arridx_friends, 17199420478067922270)
2023-09-08T12:37:53.234+05:30 [Info] Skipping planner for creation of the index default:_default:_default:arridx_friends
2023-09-08T12:37:53.234+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 17199420478067922270
2023-09-08T12:37:53.298+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:53.298+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:53.298+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:53.298+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:53.299+05:30 [Info] switched currmeta from 1415 -> 1417 force true
2023-09-08T12:37:53.300+05:30 [Info] switched currmeta from 1411 -> 1413 force true
2023-09-08T12:37:53.313+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:53.313+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:53.314+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:53.314+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:53.316+05:30 [Info] switched currmeta from 1413 -> 1414 force true
2023-09-08T12:37:53.317+05:30 [Info] switched currmeta from 1417 -> 1418 force true
2023-09-08T12:37:53.354+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:53.355+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:53.360+05:30 [Info] switched currmeta from 1414 -> 1415 force true
2023-09-08T12:37:53.363+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:53.363+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:53.368+05:30 [Info] switched currmeta from 1418 -> 1419 force true
2023-09-08T12:37:53.391+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:53.391+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:53.400+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:53.400+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:53.400+05:30 [Info] switched currmeta from 1415 -> 1416 force true
2023-09-08T12:37:53.402+05:30 [Info] switched currmeta from 1419 -> 1420 force true
2023-09-08T12:37:55.790+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:37:55.800+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:55.800+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:55.805+05:30 [Info] switched currmeta from 1416 -> 1416 force true
2023-09-08T12:37:55.805+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:55.805+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:55.811+05:30 [Info] switched currmeta from 1420 -> 1420 force true
2023-09-08T12:37:56.162+05:30 [Info] CreateIndex 17199420478067922270 default _default _default/arridx_friends using:memory_optimized exprType:N1QL whereExpr:() secExprs:([(distinct (`friends`))]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(2.930091784s) err()
2023/09/08 12:37:56 Created the secondary index arridx_friends. Waiting for it become active
2023-09-08T12:37:56.162+05:30 [Info] metadata provider version changed 1420 -> 1421
2023-09-08T12:37:56.162+05:30 [Info] switched currmeta from 1420 -> 1421 force false
2023/09/08 12:37:56 Index is 17199420478067922270 now active
2023-09-08T12:37:56.169+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:56.169+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:56.178+05:30 [Info] switched currmeta from 1421 -> 1421 force true
2023-09-08T12:37:56.233+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:56.233+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:56.236+05:30 [Info] switched currmeta from 1416 -> 1417 force true
2023/09/08 12:37:56 Expected and Actual scan responses are the same
2023/09/08 12:37:59 Expected and Actual scan responses are the same
2023/09/08 12:37:59 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Distinct (45.66s)
=== RUN TestRangeArrayIndex_Duplicate
2023/09/08 12:37:59 In TestRangeArrayIndex_Duplicate()
2023/09/08 12:37:59 In DropAllSecondaryIndexes()
2023/09/08 12:37:59 Index found: arridx_friends
2023-09-08T12:37:59.414+05:30 [Info] DropIndex 17199420478067922270 ...
2023-09-08T12:37:59.490+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:59.490+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:59.499+05:30 [Info] switched currmeta from 1417 -> 1418 force true
2023-09-08T12:37:59.499+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:59.499+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:59.504+05:30 [Info] switched currmeta from 1421 -> 1422 force true
2023-09-08T12:37:59.512+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:59.512+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:59.514+05:30 [Info] switched currmeta from 1422 -> 1422 force true
2023-09-08T12:37:59.515+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:59.515+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:59.529+05:30 [Info] switched currmeta from 1418 -> 1418 force true
2023-09-08T12:37:59.534+05:30 [Info] metadata provider version changed 1422 -> 1423
2023-09-08T12:37:59.534+05:30 [Info] switched currmeta from 1422 -> 1423 force false
2023-09-08T12:37:59.534+05:30 [Info] DropIndex 17199420478067922270 - elapsed(120.381942ms), err()
2023/09/08 12:37:59 Dropped index arridx_friends
2023-09-08T12:37:59.555+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:59.555+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:59.555+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:37:59.555+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:37:59.561+05:30 [Info] switched currmeta from 1423 -> 1423 force true
2023-09-08T12:37:59.562+05:30 [Info] switched currmeta from 1418 -> 1419 force true
2023-09-08T12:38:00.779+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:00.795+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:00.795+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:00.796+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:00.796+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:00.797+05:30 [Info] switched currmeta from 1423 -> 1423 force true
2023-09-08T12:38:00.798+05:30 [Info] switched currmeta from 1419 -> 1419 force true
2023-09-08T12:38:02.882+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:02.888+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:02.888+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:02.890+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:02.890+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:02.892+05:30 [Info] switched currmeta from 1423 -> 1423 force true
2023-09-08T12:38:02.892+05:30 [Info] switched currmeta from 1419 -> 1419 force true
2023-09-08T12:38:03.009+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:03.023+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:03.023+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:03.039+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:03.039+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:03.041+05:30 [Info] switched currmeta from 1423 -> 1423 force true
2023-09-08T12:38:03.041+05:30 [Info] switched currmeta from 1419 -> 1419 force true
2023-09-08T12:38:05.798+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:05.853+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:05.853+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:05.859+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:05.859+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:05.866+05:30 [Info] switched currmeta from 1423 -> 1423 force true
2023-09-08T12:38:05.873+05:30 [Info] switched currmeta from 1419 -> 1419 force true
2023-09-08T12:38:07.020+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:07.023+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:07.023+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:07.023+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:07.023+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:07.026+05:30 [Info] switched currmeta from 1419 -> 1419 force true
2023-09-08T12:38:07.026+05:30 [Info] switched currmeta from 1423 -> 1423 force true
2023-09-08T12:38:21.468+05:30 [Info] connected with 1 indexers
2023-09-08T12:38:21.468+05:30 [Info] client stats current counts: current: 0, not current: 0
2023-09-08T12:38:21.480+05:30 [Info] num concurrent scans {0}
2023-09-08T12:38:21.480+05:30 [Info] average scan response {515 ms}
2023-09-08T12:38:22.869+05:30 [Info] connected with 1 indexers
2023-09-08T12:38:22.869+05:30 [Info] client stats current counts: current: 0, not current: 0
2023-09-08T12:38:22.876+05:30 [Info] num concurrent scans {0}
2023-09-08T12:38:22.876+05:30 [Info] average scan response {12 ms}
2023-09-08T12:38:25.072+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-08T12:38:26.073+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023/09/08 12:38:36 Flushed the bucket default, Response body:
2023-09-08T12:38:37.528+05:30 [Info] CreateIndex default _default _default arridx_friends ...
2023-09-08T12:38:37.528+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 1863949666642566793
2023-09-08T12:38:37.529+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arridx_friends, 1863949666642566793)
2023-09-08T12:38:37.529+05:30 [Info] Skipping planner for creation of the index default:_default:_default:arridx_friends
2023-09-08T12:38:37.529+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 1863949666642566793
2023-09-08T12:38:37.611+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:37.611+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:37.613+05:30 [Info] switched currmeta from 1419 -> 1421 force true
2023-09-08T12:38:37.614+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:37.614+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:37.615+05:30 [Info] switched currmeta from 1423 -> 1425 force true
2023-09-08T12:38:37.622+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:37.622+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:37.624+05:30 [Info] switched currmeta from 1425 -> 1426 force true
2023-09-08T12:38:37.625+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:37.625+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:37.628+05:30 [Info] switched currmeta from 1421 -> 1422 force true
2023-09-08T12:38:37.674+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:37.674+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:37.674+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:37.674+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:37.676+05:30 [Info] switched currmeta from 1422 -> 1423 force true
2023-09-08T12:38:37.676+05:30 [Info] switched currmeta from 1426 -> 1427 force true
2023-09-08T12:38:37.710+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:37.710+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:37.710+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:37.710+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:37.713+05:30 [Info] switched currmeta from 1423 -> 1424 force true
2023-09-08T12:38:37.713+05:30 [Info] switched currmeta from 1427 -> 1428 force true
2023-09-08T12:38:40.608+05:30 [Info] CreateIndex 1863949666642566793 default _default _default/arridx_friends using:memory_optimized exprType:N1QL whereExpr:() secExprs:([(all (`friends`))]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(3.080168574s) err()
2023/09/08 12:38:40 Created the secondary index arridx_friends. Waiting for it become active
2023-09-08T12:38:40.608+05:30 [Info] metadata provider version changed 1428 -> 1429
2023-09-08T12:38:40.608+05:30 [Info] switched currmeta from 1428 -> 1429 force false
2023/09/08 12:38:40 Index is 1863949666642566793 now active
2023-09-08T12:38:40.623+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:40.623+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:40.626+05:30 [Info] switched currmeta from 1429 -> 1429 force true
2023-09-08T12:38:40.636+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:40.637+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:40.638+05:30 [Info] switched currmeta from 1424 -> 1425 force true
2023/09/08 12:38:40 Expected and Actual scan responses are the same
2023-09-08T12:38:40.787+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:40.793+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:40.793+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:40.794+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:40.794+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:40.796+05:30 [Info] switched currmeta from 1425 -> 1425 force true
2023-09-08T12:38:40.796+05:30 [Info] switched currmeta from 1429 -> 1429 force true
2023/09/08 12:38:43 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Duplicate (43.97s)
=== RUN TestUpdateArrayIndex_Duplicate
2023/09/08 12:38:43 In TestUpdateArrayIndex_Duplicate()
2023/09/08 12:38:43 In DropAllSecondaryIndexes()
2023/09/08 12:38:43 Index found: arridx_friends
2023-09-08T12:38:43.385+05:30 [Info] DropIndex 1863949666642566793 ...
2023-09-08T12:38:43.468+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:43.468+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:43.471+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:43.471+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:43.477+05:30 [Info] switched currmeta from 1429 -> 1430 force true
2023-09-08T12:38:43.481+05:30 [Info] switched currmeta from 1425 -> 1426 force true
2023-09-08T12:38:43.482+05:30 [Info] metadata provider version changed 1430 -> 1431
2023-09-08T12:38:43.483+05:30 [Info] switched currmeta from 1430 -> 1431 force false
2023-09-08T12:38:43.483+05:30 [Info] DropIndex 1863949666642566793 - elapsed(97.504311ms), err()
2023/09/08 12:38:43 Dropped index arridx_friends
2023-09-08T12:38:43.488+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:43.488+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:43.494+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:43.494+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:43.496+05:30 [Info] switched currmeta from 1431 -> 1431 force true
2023-09-08T12:38:43.503+05:30 [Info] switched currmeta from 1426 -> 1427 force true
2023-09-08T12:38:43.505+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:43.505+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:43.506+05:30 [Info] switched currmeta from 1431 -> 1431 force true
2023-09-08T12:38:43.517+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:43.517+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:43.518+05:30 [Info] switched currmeta from 1427 -> 1427 force true
2023-09-08T12:38:45.789+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:45.796+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:45.796+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:45.797+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:45.797+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:45.798+05:30 [Info] switched currmeta from 1427 -> 1427 force true
2023-09-08T12:38:45.799+05:30 [Info] switched currmeta from 1431 -> 1431 force true
2023-09-08T12:38:47.309+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:47.315+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:47.315+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:47.319+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:47.319+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:47.321+05:30 [Info] switched currmeta from 1427 -> 1427 force true
2023-09-08T12:38:47.323+05:30 [Info] switched currmeta from 1431 -> 1431 force true
2023-09-08T12:38:51.880+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:38:51.887+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:51.887+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:51.888+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:38:51.888+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:38:51.889+05:30 [Info] switched currmeta from 1431 -> 1431 force true
2023-09-08T12:38:51.890+05:30 [Info] switched currmeta from 1427 -> 1427 force true
2023-09-08T12:39:21.468+05:30 [Info] connected with 1 indexers
2023-09-08T12:39:21.468+05:30 [Info] client stats current counts: current: 0, not current: 0
2023-09-08T12:39:21.481+05:30 [Info] num concurrent scans {0}
2023-09-08T12:39:21.481+05:30 [Info] average scan response {1399 ms}
2023/09/08 12:39:21 Flushed the bucket default, Response body:
2023-09-08T12:39:22.415+05:30 [Info] CreateIndex default _default _default arridx_friends ...
2023-09-08T12:39:22.415+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 9919336828330534697
2023-09-08T12:39:22.416+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, arridx_friends, 9919336828330534697)
2023-09-08T12:39:22.416+05:30 [Info] Skipping planner for creation of the index default:_default:_default:arridx_friends
2023-09-08T12:39:22.416+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 9919336828330534697
2023-09-08T12:39:22.477+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:22.478+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:22.478+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:22.479+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:22.480+05:30 [Info] switched currmeta from 1427 -> 1429 force true
2023-09-08T12:39:22.481+05:30 [Info] switched currmeta from 1431 -> 1433 force true
2023-09-08T12:39:22.517+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:22.517+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:22.518+05:30 [Info] switched currmeta from 1433 -> 1434 force true
2023-09-08T12:39:22.520+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:22.520+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:22.521+05:30 [Info] switched currmeta from 1429 -> 1430 force true
2023-09-08T12:39:22.544+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:22.544+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:22.545+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:22.545+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:22.548+05:30 [Info] switched currmeta from 1430 -> 1431 force true
2023-09-08T12:39:22.549+05:30 [Info] switched currmeta from 1434 -> 1435 force true
2023-09-08T12:39:22.574+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:22.574+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:22.575+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:22.575+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:22.578+05:30 [Info] switched currmeta from 1435 -> 1436 force true
2023-09-08T12:39:22.578+05:30 [Info] switched currmeta from 1431 -> 1432 force true
2023-09-08T12:39:22.871+05:30 [Info] connected with 1 indexers
2023-09-08T12:39:22.871+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-08T12:39:22.875+05:30 [Info] num concurrent scans {0}
2023-09-08T12:39:22.875+05:30 [Info] average scan response {12 ms}
2023-09-08T12:39:25.114+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-08T12:39:25.254+05:30 [Info] CreateIndex 9919336828330534697 default _default _default/arridx_friends using:memory_optimized exprType:N1QL whereExpr:() secExprs:([(all (`friends`))]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(2.838895671s) err()
2023/09/08 12:39:25 Created the secondary index arridx_friends. Waiting for it become active
2023-09-08T12:39:25.254+05:30 [Info] metadata provider version changed 1436 -> 1437
2023-09-08T12:39:25.254+05:30 [Info] switched currmeta from 1436 -> 1437 force false
2023/09/08 12:39:25 Index is 9919336828330534697 now active
2023-09-08T12:39:25.285+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:25.285+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:25.285+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:25.285+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:25.288+05:30 [Info] switched currmeta from 1432 -> 1433 force true
2023-09-08T12:39:25.303+05:30 [Info] switched currmeta from 1437 -> 1437 force true
2023/09/08 12:39:25 Expected and Actual scan responses are the same
2023-09-08T12:39:25.821+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:39:25.829+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:25.829+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:25.831+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:25.831+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:25.834+05:30 [Info] switched currmeta from 1437 -> 1437 force true
2023-09-08T12:39:25.836+05:30 [Info] switched currmeta from 1433 -> 1433 force true
2023-09-08T12:39:26.115+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023/09/08 12:39:28 Expected and Actual scan responses are the same
2023/09/08 12:39:28 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Duplicate (45.18s)
=== RUN TestArrayIndexCornerCases
set09_arrayindex_test.go:193: Test disbaled
--- SKIP: TestArrayIndexCornerCases (0.00s)
=== RUN TestArraySizeIncreaseDecrease1
set09_arrayindex_test.go:249: Test disbaled
--- SKIP: TestArraySizeIncreaseDecrease1 (0.00s)
=== RUN TestArraySizeIncreaseDecrease2
set09_arrayindex_test.go:369: Test disbaled
--- SKIP: TestArraySizeIncreaseDecrease2 (0.00s)
=== RUN TestBufferedScan_BackfillDisabled
2023/09/08 12:39:28 In TestBufferedScan_BackfillDisabled()
2023/09/08 12:39:28 In DropAllSecondaryIndexes()
2023/09/08 12:39:28 Index found: arridx_friends
2023-09-08T12:39:28.567+05:30 [Info] DropIndex 9919336828330534697 ...
2023-09-08T12:39:28.616+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:28.617+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:28.616+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:28.617+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:28.619+05:30 [Info] switched currmeta from 1433 -> 1434 force true
2023-09-08T12:39:28.619+05:30 [Info] switched currmeta from 1437 -> 1438 force true
2023-09-08T12:39:28.647+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:28.647+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:28.655+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:28.655+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:28.655+05:30 [Info] metadata provider version changed 1438 -> 1439
2023-09-08T12:39:28.655+05:30 [Info] switched currmeta from 1438 -> 1439 force false
2023-09-08T12:39:28.655+05:30 [Info] DropIndex 9919336828330534697 - elapsed(88.576634ms), err()
2023/09/08 12:39:28 Dropped index arridx_friends
2023-09-08T12:39:28.660+05:30 [Info] switched currmeta from 1434 -> 1435 force true
2023-09-08T12:39:28.663+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:28.664+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:28.665+05:30 [Info] switched currmeta from 1435 -> 1435 force true
2023-09-08T12:39:28.680+05:30 [Info] switched currmeta from 1439 -> 1439 force true
2023-09-08T12:39:28.708+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:28.708+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:28.711+05:30 [Info] switched currmeta from 1439 -> 1439 force true
2023-09-08T12:39:30.809+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:39:30.816+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:30.816+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:30.818+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:30.818+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:30.818+05:30 [Info] switched currmeta from 1439 -> 1439 force true
2023-09-08T12:39:30.821+05:30 [Info] switched currmeta from 1435 -> 1435 force true
2023-09-08T12:39:32.212+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:39:32.218+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:32.218+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:32.221+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:32.222+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:32.227+05:30 [Info] switched currmeta from 1435 -> 1435 force true
2023-09-08T12:39:32.228+05:30 [Info] switched currmeta from 1439 -> 1439 force true
2023-09-08T12:39:35.819+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:39:35.839+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:35.839+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:35.843+05:30 [Info] switched currmeta from 1435 -> 1435 force true
2023-09-08T12:39:35.850+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:35.850+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:35.869+05:30 [Info] switched currmeta from 1439 -> 1439 force true
2023-09-08T12:39:36.635+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:39:36.639+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:36.639+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:36.646+05:30 [Info] switched currmeta from 1439 -> 1439 force true
2023-09-08T12:39:36.647+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:39:36.647+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:39:36.649+05:30 [Info] switched currmeta from 1435 -> 1435 force true
2023/09/08 12:40:06 Flushed the bucket default, Response body:
2023-09-08T12:40:21.468+05:30 [Info] connected with 1 indexers
2023-09-08T12:40:21.468+05:30 [Info] client stats current counts: current: 0, not current: 0
2023-09-08T12:40:21.480+05:30 [Info] num concurrent scans {0}
2023-09-08T12:40:21.480+05:30 [Info] average scan response {551 ms}
2023-09-08T12:40:22.869+05:30 [Info] connected with 1 indexers
2023-09-08T12:40:22.869+05:30 [Info] client stats current counts: current: 0, not current: 0
2023-09-08T12:40:22.876+05:30 [Info] num concurrent scans {0}
2023-09-08T12:40:22.876+05:30 [Info] average scan response {12 ms}
2023-09-08T12:40:25.159+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-08T12:40:26.160+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-08T12:40:43.876+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:40:43 Changing config key queryport.client.settings.backfillLimit to value 0
2023-09-08T12:40:43.883+05:30 [Info] CreateIndex default _default _default addressidx ...
2023-09-08T12:40:43.884+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 9902948168468129657
2023-09-08T12:40:43.888+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, addressidx, 9902948168468129657)
2023-09-08T12:40:43.888+05:30 [Info] Skipping planner for creation of the index default:_default:_default:addressidx
2023-09-08T12:40:43.888+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 9902948168468129657
2023-09-08T12:40:43.954+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:43.954+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:43.954+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:43.954+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:43.956+05:30 [Info] switched currmeta from 1435 -> 1437 force true
2023-09-08T12:40:43.956+05:30 [Info] switched currmeta from 1439 -> 1441 force true
2023-09-08T12:40:43.968+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:43.968+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:43.969+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:43.969+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:43.988+05:30 [Info] switched currmeta from 1441 -> 1443 force true
2023-09-08T12:40:43.994+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:43.994+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:43.996+05:30 [Info] switched currmeta from 1443 -> 1443 force true
2023-09-08T12:40:44.003+05:30 [Info] switched currmeta from 1437 -> 1439 force true
2023-09-08T12:40:44.017+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:44.017+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:44.021+05:30 [Info] switched currmeta from 1439 -> 1439 force true
2023-09-08T12:40:44.040+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:44.040+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:44.040+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:44.040+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:44.043+05:30 [Info] switched currmeta from 1439 -> 1440 force true
2023-09-08T12:40:44.043+05:30 [Info] switched currmeta from 1443 -> 1444 force true
2023-09-08T12:40:49.505+05:30 [Info] CreateIndex 9902948168468129657 default _default _default/addressidx using:memory_optimized exprType:N1QL whereExpr:() secExprs:([`address`]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(5.62115474s) err()
2023/09/08 12:40:49 Created the secondary index addressidx. Waiting for it become active
2023-09-08T12:40:49.505+05:30 [Info] metadata provider version changed 1444 -> 1445
2023-09-08T12:40:49.505+05:30 [Info] switched currmeta from 1444 -> 1445 force false
2023/09/08 12:40:49 Index is 9902948168468129657 now active
2023-09-08T12:40:49.513+05:30 [Info] metadata provider version changed 1440 -> 1441
2023-09-08T12:40:49.513+05:30 [Info] switched currmeta from 1440 -> 1441 force false
2023-09-08T12:40:49.513+05:30 [Info] GSIC[default/default-_default-_default-1694157049505319227] started ...
2023-09-08T12:40:49.513+05:30 [Warn] MonitorIndexer: Indexer for default:_default:_default is already being monitored
2023/09/08 12:40:49 Non-backfill file found: /tmp/.ICE-unix
2023/09/08 12:40:49 Non-backfill file found: /tmp/.Test-unix
2023/09/08 12:40:49 Non-backfill file found: /tmp/.X11-unix
2023/09/08 12:40:49 Non-backfill file found: /tmp/.XIM-unix
2023/09/08 12:40:49 Non-backfill file found: /tmp/.font-unix
2023/09/08 12:40:49 Non-backfill file found: /tmp/68c1b30f-e9f2-4d68-99c7-c96152196210.sock
2023/09/08 12:40:49 Non-backfill file found: /tmp/7fe52b65-9be5-4215-a77e-749e0bdfa9cb.sock
2023/09/08 12:40:49 Non-backfill file found: /tmp/f_68c1b30f-e9f2-4d68-99c7-c96152196210.sock
2023/09/08 12:40:49 Non-backfill file found: /tmp/f_7fe52b65-9be5-4215-a77e-749e0bdfa9cb.sock
2023/09/08 12:40:49 Non-backfill file found: /tmp/go-build1897353713
2023/09/08 12:40:49 Non-backfill file found: /tmp/mdbslice
2023/09/08 12:40:49 Non-backfill file found: /tmp/systemd-private-1f89c5e0bbe24d2a8cb86aaa4e56c295-apache2.service-K8abDj
2023/09/08 12:40:49 Non-backfill file found: /tmp/systemd-private-1f89c5e0bbe24d2a8cb86aaa4e56c295-systemd-timesyncd.service-2Tvu1P
2023-09-08T12:40:49.530+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:49.530+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:49.532+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023-09-08T12:40:49.534+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:49.534+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023/09/08 12:40:49 limit=1,chsize=256; received 1 items; took 25.880169ms
2023-09-08T12:40:49.541+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-08T12:40:50.856+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:40:50.861+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:50.862+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:50.864+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-08T12:40:50.867+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:50.867+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:50.870+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023/09/08 12:40:51 limit=1000,chsize=256; received 1000 items; took 1.273643319s
2023-09-08T12:40:52.817+05:30 [Info] gsiKeyspace::Close Closing default:_default:_default
--- PASS: TestBufferedScan_BackfillDisabled (84.25s)
=== RUN TestBufferedScan_BackfillEnabled
2023/09/08 12:40:52 In TestBufferedScan_BackfillEnabled()
2023-09-08T12:40:52.918+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:40:52 Changing config key queryport.client.settings.backfillLimit to value 1
2023-09-08T12:40:52.939+05:30 [Info] GSIC[default/default-_default-_default-1694157052926231113] started ...
2023-09-08T12:40:52.942+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":1,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2023/09/08 12:40:52 limit=1,chsize=256; received 1 items; took 12.19846ms
2023/09/08 12:40:53 limit=1000,chsize=256; received 1000 items; took 14.455093ms
2023-09-08T12:40:54.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[2085149721500314359:[0]]. New rollbacktime: 1694156714177633378, Old rollbacktime: 0
2023-09-08T12:40:54.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[2085149721500314359:[0]]. New rollbacktime: 1694156714177633378, Old rollbacktime: 0
2023-09-08T12:40:54.976+05:30 [Info] GSIC[default/default-_default-_default-1694157052926231113] bufferedscan new temp file ... /tmp/scan-results9223708309780
2023-09-08T12:40:55.847+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:40:55.852+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:55.852+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:55.853+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:40:55.853+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:40:55.854+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-08T12:40:55.855+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023-09-08T12:41:01.025+05:30 [Info] GSIC[default/default-_default-_default-1694157052926231113] request(bufferedscan) removing temp file /tmp/scan-results9223708309780 ...
2023/09/08 12:41:06 limit=1000,chsize=256; received 1000 items; took 10.387150828s
2023-09-08T12:41:07.361+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] open new connection ...
2023-09-08T12:41:07.367+05:30 [Info] GSIC[default/default-_default-_default-1694157052926231113] bufferedscan new temp file ... /tmp/scan-results92234013173570
2023-09-08T12:41:07.383+05:30 [Info] GSIC[default/default-_default-_default-1694157052926231113] bufferedscan new temp file ... /tmp/scan-results92232133450559
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
2023-09-08T12:41:08.870+05:30 [Info] GSIC[default/default-_default-_default-1694157052926231113] request(bufferedscan) removing temp file /tmp/scan-results92234013173570 ...
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
2023-09-08T12:41:08.870+05:30 [Info] GSIC[default/default-_default-_default-1694157052926231113] request(bufferedscan) removing temp file /tmp/scan-results92232133450559 ...
2023/09/08 12:41:19 limit=1000,chsize=256; received 584 items; took 12.009838642s
2023/09/08 12:41:19 limit=1000,chsize=256; received 584 items; took 12.00980872s
2023-09-08T12:41:20.369+05:30 [Info] gsiKeyspace::Close Closing default:_default:_default
2023-09-08T12:41:20.470+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2023/09/08 12:41:20 Changing config key queryport.client.settings.backfillLimit to value 0
2023-09-08T12:41:20.494+05:30 [Info] New settings received:
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":true,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enableShardAffinity":false,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":true,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":30,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.percentage_memory_quota":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.provisioned.enableShardAffinity":true,"indexer.settings.rebalance.blob_storage_bucket":"","indexer.settings.rebalance.blob_storage_prefix":"","indexer.settings.rebalance.blob_storage_region":"","indexer.settings.rebalance.blob_storage_scheme":"","indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":201,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":70,"indexer.settings.thresholds.mem_low":50,"indexer.settings.thresholds.units_high":60,"indexer.settings.thresholds.units_low":40,"indexer.settings.units_quota":10000,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"info","queryport.client.settings.backfillLimit":0,"queryport.client.settings.closeActiveConnections":true,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
--- PASS: TestBufferedScan_BackfillEnabled (27.68s)
=== RUN TestMultiScanSetup
2023/09/08 12:41:20 In TestMultiScanSetup()
2023-09-08T12:41:21.468+05:30 [Info] connected with 1 indexers
2023-09-08T12:41:21.469+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-08T12:41:21.480+05:30 [Info] num concurrent scans {0}
2023-09-08T12:41:21.480+05:30 [Info] average scan response {551 ms}
2023/09/08 12:41:22 Emptying the default bucket
2023-09-08T12:41:22.870+05:30 [Info] connected with 1 indexers
2023-09-08T12:41:22.870+05:30 [Info] client stats current counts: current: 1, not current: 0
2023-09-08T12:41:22.876+05:30 [Info] num concurrent scans {0}
2023-09-08T12:41:22.876+05:30 [Info] average scan response {3070 ms}
2023/09/08 12:41:25 Flush Enabled on bucket default, responseBody:
2023-09-08T12:41:25.205+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-08T12:41:26.196+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 2
2023-09-08T12:41:27.597+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:41:27.609+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:41:27.609+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:41:27.610+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:41:27.610+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:41:27.610+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-08T12:41:27.611+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023-09-08T12:41:32.497+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:41:32.504+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:41:32.504+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:41:32.506+05:30 [Info] switched currmeta from 1441 -> 1441 force true
2023-09-08T12:41:32.511+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:41:32.511+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:41:32.514+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-08T12:41:39.775+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[2085149721500314359:[0]]. New rollbacktime: 1694157099290555053, Old rollbacktime: 1694156714177633378
2023-09-08T12:41:39.777+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[2085149721500314359:[0]]. New rollbacktime: 1694157099290555053, Old rollbacktime: 1694156714177633378
2023-09-08T12:41:44.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[2085149721500314359:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 1694157099290555053
2023-09-08T12:41:44.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[2085149721500314359:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 1694157099290555053
2023/09/08 12:42:02 Flushed the bucket default, Response body:
2023/09/08 12:42:02 Populating the default bucket
2023-09-08T12:42:10.631+05:30 [Info] CreateIndex default _default _default index_companyname ...
2023-09-08T12:42:10.632+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 10254841403573736440
2023-09-08T12:42:10.634+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_companyname, 10254841403573736440)
2023-09-08T12:42:10.634+05:30 [Info] Skipping planner for creation of the index default:_default:_default:index_companyname
2023-09-08T12:42:10.634+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 10254841403573736440
2023-09-08T12:42:10.713+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:10.714+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:10.715+05:30 [Info] switched currmeta from 1445 -> 1447 force true
2023-09-08T12:42:10.716+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:10.716+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:10.718+05:30 [Info] switched currmeta from 1441 -> 1443 force true
2023-09-08T12:42:10.737+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:10.737+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:10.737+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:10.737+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:10.738+05:30 [Info] switched currmeta from 1443 -> 1445 force true
2023-09-08T12:42:10.740+05:30 [Info] switched currmeta from 1447 -> 1449 force true
2023-09-08T12:42:10.744+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:10.744+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:10.746+05:30 [Info] switched currmeta from 1445 -> 1445 force true
2023-09-08T12:42:10.751+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:10.751+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:10.752+05:30 [Info] switched currmeta from 1449 -> 1449 force true
2023-09-08T12:42:10.776+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:10.776+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:10.780+05:30 [Info] switched currmeta from 1445 -> 1446 force true
2023-09-08T12:42:10.780+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:10.780+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:10.782+05:30 [Info] switched currmeta from 1449 -> 1450 force true
2023-09-08T12:42:14.145+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:14.145+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:14.146+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:14.146+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:14.149+05:30 [Info] switched currmeta from 1450 -> 1451 force true
2023-09-08T12:42:14.149+05:30 [Info] switched currmeta from 1446 -> 1447 force true
2023-09-08T12:42:15.138+05:30 [Info] CreateIndex 10254841403573736440 default _default _default/index_companyname using:memory_optimized exprType:N1QL whereExpr:() secExprs:([`company` `name`]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(4.507139631s) err()
2023/09/08 12:42:15 Created the secondary index index_companyname. Waiting for it become active
2023-09-08T12:42:15.138+05:30 [Info] metadata provider version changed 1451 -> 1452
2023-09-08T12:42:15.138+05:30 [Info] switched currmeta from 1451 -> 1452 force false
2023/09/08 12:42:15 Index is 10254841403573736440 now active
2023-09-08T12:42:15.139+05:30 [Info] CreateIndex default _default _default index_company ...
2023-09-08T12:42:15.139+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 14059468794536625948
2023-09-08T12:42:15.143+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_company, 14059468794536625948)
2023-09-08T12:42:15.143+05:30 [Info] Skipping planner for creation of the index default:_default:_default:index_company
2023-09-08T12:42:15.143+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 14059468794536625948
2023-09-08T12:42:15.160+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.160+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.164+05:30 [Info] switched currmeta from 1452 -> 1453 force true
2023-09-08T12:42:15.168+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.168+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.176+05:30 [Info] switched currmeta from 1447 -> 1449 force true
2023-09-08T12:42:15.192+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.192+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.199+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.199+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.203+05:30 [Info] switched currmeta from 1453 -> 1455 force true
2023-09-08T12:42:15.207+05:30 [Info] switched currmeta from 1449 -> 1451 force true
2023-09-08T12:42:15.249+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.249+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.276+05:30 [Info] switched currmeta from 1455 -> 1456 force true
2023-09-08T12:42:15.335+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.336+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.341+05:30 [Info] switched currmeta from 1451 -> 1453 force true
2023-09-08T12:42:15.350+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.350+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.353+05:30 [Info] switched currmeta from 1456 -> 1457 force true
2023-09-08T12:42:15.392+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.392+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.395+05:30 [Info] switched currmeta from 1453 -> 1453 force true
2023-09-08T12:42:15.414+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:15.414+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:15.418+05:30 [Info] switched currmeta from 1457 -> 1457 force true
2023-09-08T12:42:15.965+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:42:16.028+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:16.028+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:16.031+05:30 [Info] switched currmeta from 1457 -> 1457 force true
2023-09-08T12:42:16.037+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:16.037+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:16.040+05:30 [Info] switched currmeta from 1453 -> 1453 force true
2023-09-08T12:42:19.777+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13963666073650295165:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:19.777+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13963666073650295165:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:19.778+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13963666073650295165:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:20.466+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:20.466+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:20.468+05:30 [Info] switched currmeta from 1453 -> 1454 force true
2023-09-08T12:42:20.472+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:20.472+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:20.474+05:30 [Info] switched currmeta from 1457 -> 1458 force true
2023-09-08T12:42:20.873+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:42:20.877+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:20.877+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:20.878+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:20.878+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:20.879+05:30 [Info] switched currmeta from 1454 -> 1454 force true
2023-09-08T12:42:20.880+05:30 [Info] switched currmeta from 1458 -> 1458 force true
2023-09-08T12:42:21.470+05:30 [Info] CreateIndex 14059468794536625948 default _default _default/index_company using:memory_optimized exprType:N1QL whereExpr:() secExprs:([`company`]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(6.331079256s) err()
2023/09/08 12:42:21 Created the secondary index index_company. Waiting for it become active
2023-09-08T12:42:21.470+05:30 [Info] metadata provider version changed 1458 -> 1459
2023-09-08T12:42:21.470+05:30 [Info] switched currmeta from 1458 -> 1459 force false
2023/09/08 12:42:21 Index is 14059468794536625948 now active
2023-09-08T12:42:21.471+05:30 [Info] CreateIndex default _default _default index_company_name_age ...
2023-09-08T12:42:21.471+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 7304436902346290559
2023-09-08T12:42:21.472+05:30 [Info] connected with 1 indexers
2023-09-08T12:42:21.472+05:30 [Info] client stats current counts: current: 3, not current: 0
2023-09-08T12:42:21.480+05:30 [Info] num concurrent scans {0}
2023-09-08T12:42:21.480+05:30 [Info] average scan response {551 ms}
2023-09-08T12:42:21.486+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.486+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.487+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_company_name_age, 7304436902346290559)
2023-09-08T12:42:21.487+05:30 [Info] Skipping planner for creation of the index default:_default:_default:index_company_name_age
2023-09-08T12:42:21.487+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 7304436902346290559
2023-09-08T12:42:21.488+05:30 [Info] switched currmeta from 1454 -> 1455 force true
2023-09-08T12:42:21.494+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.494+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.497+05:30 [Info] switched currmeta from 1459 -> 1459 force true
2023-09-08T12:42:21.535+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.535+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.536+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.536+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.537+05:30 [Info] switched currmeta from 1455 -> 1458 force true
2023-09-08T12:42:21.538+05:30 [Info] switched currmeta from 1459 -> 1462 force true
2023-09-08T12:42:21.543+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.543+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.543+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.544+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.546+05:30 [Info] switched currmeta from 1458 -> 1459 force true
2023-09-08T12:42:21.547+05:30 [Info] switched currmeta from 1462 -> 1463 force true
2023-09-08T12:42:21.550+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.550+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.552+05:30 [Info] switched currmeta from 1459 -> 1459 force true
2023-09-08T12:42:21.562+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.562+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.564+05:30 [Info] switched currmeta from 1463 -> 1463 force true
2023-09-08T12:42:21.628+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.628+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.630+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:21.630+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:21.631+05:30 [Info] switched currmeta from 1463 -> 1464 force true
2023-09-08T12:42:21.636+05:30 [Info] switched currmeta from 1459 -> 1460 force true
2023-09-08T12:42:22.870+05:30 [Info] connected with 1 indexers
2023-09-08T12:42:22.870+05:30 [Info] client stats current counts: current: 4, not current: 0
2023-09-08T12:42:22.876+05:30 [Info] num concurrent scans {0}
2023-09-08T12:42:22.876+05:30 [Info] average scan response {3070 ms}
2023-09-08T12:42:24.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[2868298477849676797:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:24.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[2868298477849676797:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:25.245+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 1
2023-09-08T12:42:25.884+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:42:25.893+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:25.893+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:25.896+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:25.896+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:25.898+05:30 [Info] switched currmeta from 1460 -> 1460 force true
2023-09-08T12:42:25.899+05:30 [Info] switched currmeta from 1464 -> 1464 force true
2023-09-08T12:42:26.233+05:30 [Info] [Queryport-connpool:127.0.0.1:9107] active conns 0, free conns 2
2023-09-08T12:42:26.844+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:26.844+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:26.846+05:30 [Info] switched currmeta from 1464 -> 1465 force true
2023-09-08T12:42:26.849+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:26.849+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:26.850+05:30 [Info] switched currmeta from 1460 -> 1461 force true
2023-09-08T12:42:27.840+05:30 [Info] CreateIndex 7304436902346290559 default _default _default/index_company_name_age using:memory_optimized exprType:N1QL whereExpr:() secExprs:([`company` `name` `age`]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(6.368859948s) err()
2023/09/08 12:42:27 Created the secondary index index_company_name_age. Waiting for it become active
2023-09-08T12:42:27.840+05:30 [Info] metadata provider version changed 1465 -> 1466
2023-09-08T12:42:27.840+05:30 [Info] switched currmeta from 1465 -> 1466 force false
2023/09/08 12:42:27 Index is 7304436902346290559 now active
2023-09-08T12:42:27.840+05:30 [Info] CreateIndex default _default _default index_primary ...
2023-09-08T12:42:27.840+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 6305386791860181688
2023-09-08T12:42:27.841+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_primary, 6305386791860181688)
2023-09-08T12:42:27.841+05:30 [Info] Skipping planner for creation of the index default:_default:_default:index_primary
2023-09-08T12:42:27.841+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 6305386791860181688
2023-09-08T12:42:27.861+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:27.861+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:27.867+05:30 [Info] switched currmeta from 1461 -> 1462 force true
2023-09-08T12:42:27.873+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:27.873+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:27.889+05:30 [Info] switched currmeta from 1466 -> 1468 force true
2023-09-08T12:42:27.901+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:27.901+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:27.925+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:27.925+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:27.928+05:30 [Info] switched currmeta from 1468 -> 1470 force true
2023-09-08T12:42:27.929+05:30 [Info] switched currmeta from 1462 -> 1466 force true
2023-09-08T12:42:27.946+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:27.946+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:27.977+05:30 [Info] switched currmeta from 1466 -> 1466 force true
2023-09-08T12:42:27.979+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:27.979+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:27.987+05:30 [Info] switched currmeta from 1470 -> 1471 force true
2023-09-08T12:42:28.013+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:28.013+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:28.019+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:28.019+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:28.020+05:30 [Info] switched currmeta from 1466 -> 1467 force true
2023-09-08T12:42:28.023+05:30 [Info] switched currmeta from 1471 -> 1471 force true
2023-09-08T12:42:29.775+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[1193628724081342516:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:29.775+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[1193628724081342516:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:29.775+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[1193628724081342516:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:29.775+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[1193628724081342516:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:30.892+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:42:30.902+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:30.902+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:30.907+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:30.908+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:30.908+05:30 [Info] switched currmeta from 1471 -> 1471 force true
2023-09-08T12:42:30.912+05:30 [Info] switched currmeta from 1467 -> 1467 force true
2023-09-08T12:42:33.146+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:33.146+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:33.147+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:33.147+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:33.149+05:30 [Info] switched currmeta from 1467 -> 1468 force true
2023-09-08T12:42:33.157+05:30 [Info] switched currmeta from 1471 -> 1472 force true
2023-09-08T12:42:34.144+05:30 [Info] CreateIndex 6305386791860181688 default _default _default/index_primary using:memory_optimized exprType:N1QL whereExpr:() secExprs:([]) desc:[] indexMissingLeadingKey:false isPrimary:true scheme:SINGLE partitionKeys:([]) with: - elapsed(6.304212079s) err()
2023/09/08 12:42:34 Created the secondary index index_primary. Waiting for it become active
2023-09-08T12:42:34.144+05:30 [Info] metadata provider version changed 1472 -> 1473
2023-09-08T12:42:34.144+05:30 [Info] switched currmeta from 1472 -> 1473 force false
2023/09/08 12:42:34 Index is 6305386791860181688 now active
2023-09-08T12:42:34.145+05:30 [Info] CreateIndex default _default _default index_company_name_age_address ...
2023-09-08T12:42:34.146+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 1399597969636200714
2023-09-08T12:42:34.149+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_company_name_age_address, 1399597969636200714)
2023-09-08T12:42:34.149+05:30 [Info] Skipping planner for creation of the index default:_default:_default:index_company_name_age_address
2023-09-08T12:42:34.149+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 1399597969636200714
2023-09-08T12:42:34.175+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.175+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.175+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.175+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.177+05:30 [Info] switched currmeta from 1473 -> 1474 force true
2023-09-08T12:42:34.184+05:30 [Info] switched currmeta from 1468 -> 1470 force true
2023-09-08T12:42:34.226+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.226+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.233+05:30 [Info] switched currmeta from 1474 -> 1475 force true
2023-09-08T12:42:34.242+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.242+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.245+05:30 [Info] switched currmeta from 1470 -> 1471 force true
2023-09-08T12:42:34.258+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.258+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.263+05:30 [Info] switched currmeta from 1475 -> 1477 force true
2023-09-08T12:42:34.268+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.268+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.306+05:30 [Info] switched currmeta from 1471 -> 1473 force true
2023-09-08T12:42:34.314+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.314+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.314+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.314+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.343+05:30 [Info] switched currmeta from 1477 -> 1478 force true
2023-09-08T12:42:34.350+05:30 [Info] switched currmeta from 1473 -> 1474 force true
2023-09-08T12:42:34.351+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.352+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.354+05:30 [Info] switched currmeta from 1478 -> 1478 force true
2023-09-08T12:42:34.360+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:34.360+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:34.363+05:30 [Info] switched currmeta from 1474 -> 1474 force true
2023-09-08T12:42:39.679+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:39.679+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:39.681+05:30 [Info] switched currmeta from 1478 -> 1479 force true
2023-09-08T12:42:39.686+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:39.686+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:39.688+05:30 [Info] switched currmeta from 1474 -> 1475 force true
2023-09-08T12:42:39.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13906878070309605917:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:39.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13906878070309605917:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:39.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13906878070309605917:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:39.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13906878070309605917:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:39.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13906878070309605917:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:39.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13906878070309605917:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:39.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[13906878070309605917:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:40.701+05:30 [Info] CreateIndex 1399597969636200714 default _default _default/index_company_name_age_address using:memory_optimized exprType:N1QL whereExpr:() secExprs:([`company` `name` `age` `address`]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(6.555413908s) err()
2023/09/08 12:42:40 Created the secondary index index_company_name_age_address. Waiting for it become active
2023-09-08T12:42:40.701+05:30 [Info] metadata provider version changed 1479 -> 1480
2023-09-08T12:42:40.701+05:30 [Info] switched currmeta from 1479 -> 1480 force false
2023/09/08 12:42:40 Index is 1399597969636200714 now active
2023-09-08T12:42:40.702+05:30 [Info] CreateIndex default _default _default index_company_name_age_address_friends ...
2023-09-08T12:42:40.703+05:30 [Info] send prepare create request to watcher 127.0.0.1:9106, defnId: 7600715741275080328
2023-09-08T12:42:40.709+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.709+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.710+05:30 [Info] Indexer 127.0.0.1:9106 accept prepare request. Index (default, _default, _default, index_company_name_age_address_friends, 7600715741275080328)
2023-09-08T12:42:40.710+05:30 [Info] Skipping planner for creation of the index default:_default:_default:index_company_name_age_address_friends
2023-09-08T12:42:40.710+05:30 [Info] send commit create request to watcher 127.0.0.1:9106 defnID 7600715741275080328
2023-09-08T12:42:40.711+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.711+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.712+05:30 [Info] switched currmeta from 1480 -> 1480 force true
2023-09-08T12:42:40.713+05:30 [Info] switched currmeta from 1475 -> 1476 force true
2023-09-08T12:42:40.750+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.750+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.753+05:30 [Info] switched currmeta from 1480 -> 1482 force true
2023-09-08T12:42:40.755+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.755+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.757+05:30 [Info] switched currmeta from 1476 -> 1478 force true
2023-09-08T12:42:40.773+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.773+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.777+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.777+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.782+05:30 [Info] switched currmeta from 1478 -> 1480 force true
2023-09-08T12:42:40.796+05:30 [Info] switched currmeta from 1482 -> 1484 force true
2023-09-08T12:42:40.798+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.798+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.809+05:30 [Info] switched currmeta from 1480 -> 1481 force true
2023-09-08T12:42:40.815+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.815+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.817+05:30 [Info] switched currmeta from 1484 -> 1485 force true
2023-09-08T12:42:40.821+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.821+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.824+05:30 [Info] switched currmeta from 1481 -> 1481 force true
2023-09-08T12:42:40.825+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.825+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.828+05:30 [Info] switched currmeta from 1485 -> 1485 force true
2023-09-08T12:42:40.898+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:42:40.903+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.903+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.908+05:30 [Info] switched currmeta from 1485 -> 1485 force true
2023-09-08T12:42:40.908+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:40.908+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:40.911+05:30 [Info] switched currmeta from 1481 -> 1481 force true
2023-09-08T12:42:44.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[17787912655460457370:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:44.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[17787912655460457370:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:44.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[17787912655460457370:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:44.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[17787912655460457370:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:44.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[17787912655460457370:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:44.776+05:30 [Info] Rollback time has changed for the following indexes
{Index inst : [partitions]}: map[17787912655460457370:[0]]. New rollbacktime: 1694157103595123850, Old rollbacktime: 0
2023-09-08T12:42:45.906+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2023-09-08T12:42:45.926+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:45.926+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:45.928+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:45.928+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:45.936+05:30 [Info] switched currmeta from 1485 -> 1485 force true
2023-09-08T12:42:45.946+05:30 [Info] switched currmeta from 1481 -> 1481 force true
2023-09-08T12:42:46.354+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:46.354+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:46.354+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:46.354+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:46.357+05:30 [Info] switched currmeta from 1481 -> 1482 force true
2023-09-08T12:42:46.359+05:30 [Info] switched currmeta from 1485 -> 1486 force true
2023-09-08T12:42:47.349+05:30 [Info] CreateIndex 7600715741275080328 default _default _default/index_company_name_age_address_friends using:memory_optimized exprType:N1QL whereExpr:() secExprs:([`company` `name` `age` `address` `friends`]) desc:[] indexMissingLeadingKey:false isPrimary:false scheme:SINGLE partitionKeys:([]) with: - elapsed(6.64685893s) err()
2023/09/08 12:42:47 Created the secondary index index_company_name_age_address_friends. Waiting for it become active
2023-09-08T12:42:47.349+05:30 [Info] metadata provider version changed 1486 -> 1487
2023-09-08T12:42:47.349+05:30 [Info] switched currmeta from 1486 -> 1487 force false
2023/09/08 12:42:47 Index is 7600715741275080328 now active
--- PASS: TestMultiScanSetup (86.85s)
=== RUN TestMultiScanCount
2023/09/08 12:42:47 In TestMultiScanCount()
2023/09/08 12:42:47
--------- Composite Index with 2 fields ---------
2023/09/08 12:42:47
--- ScanAllNoFilter ---
2023/09/08 12:42:47 distinct = false
2023-09-08T12:42:47.411+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:47.411+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:47.414+05:30 [Info] switched currmeta from 1482 -> 1483 force true
2023-09-08T12:42:47.420+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-09-08T12:42:47.420+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-09-08T12:42:47.429+05:30 [Info] switched currmeta from 1487 -> 1487 force true
2023/09/08 12:42:47 Using n1ql client
2023/09/08 12:42:47 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:42:47
--- ScanAllFilterNil ---
2023/09/08 12:42:47 distinct = false
2023/09/08 12:42:48 Using n1ql client
2023/09/08 12:42:48 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:42:48
--- ScanAll_AllFiltersNil ---
2023/09/08 12:42:48 distinct = false
2023/09/08 12:42:48 Using n1ql client
2023/09/08 12:42:48 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:42:48
--- SingleSeek ---
2023/09/08 12:42:48 distinct = false
2023/09/08 12:42:49 Using n1ql client
2023/09/08 12:42:49 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:42:49
--- MultipleSeek ---
2023/09/08 12:42:49 distinct = false
2023/09/08 12:42:49 Using n1ql client
2023/09/08 12:42:49 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/08 12:42:49
--- SimpleRange ---
2023/09/08 12:42:49 distinct = false
2023/09/08 12:42:50 Using n1ql client
2023/09/08 12:42:50 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/08 12:42:50
--- NonOverlappingRanges ---
2023/09/08 12:42:50 distinct = false
2023/09/08 12:42:50 Using n1ql client
2023/09/08 12:42:50 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2023/09/08 12:42:50
--- OverlappingRanges ---
2023/09/08 12:42:50 distinct = false
2023/09/08 12:42:50 Using n1ql client
2023/09/08 12:42:50 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2023/09/08 12:42:50
--- NonOverlappingFilters ---
2023/09/08 12:42:50 distinct = false
2023/09/08 12:42:51 Using n1ql client
2023/09/08 12:42:51 MultiScanCount = 337 ExpectedMultiScanCount = 337
2023/09/08 12:42:51
--- OverlappingFilters ---
2023/09/08 12:42:51 distinct = false
2023/09/08 12:42:51 Using n1ql client
2023/09/08 12:42:51 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2023/09/08 12:42:51
--- BoundaryFilters ---
2023/09/08 12:42:51 distinct = false
2023/09/08 12:42:52 Using n1ql client
2023/09/08 12:42:52 MultiScanCount = 499 ExpectedMultiScanCount = 499
2023/09/08 12:42:52
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:42:52 distinct = false
2023/09/08 12:42:52 Using n1ql client
2023/09/08 12:42:52 MultiScanCount = 256 ExpectedMultiScanCount = 256
2023/09/08 12:42:52
--- SeekAndFilters_Overlapping ---
2023/09/08 12:42:52 distinct = false
2023/09/08 12:42:53 Using n1ql client
2023/09/08 12:42:53 MultiScanCount = 255 ExpectedMultiScanCount = 255
2023/09/08 12:42:53
--- SimpleRangeLowUnbounded ---
2023/09/08 12:42:53 distinct = false
2023/09/08 12:42:53 Using n1ql client
2023/09/08 12:42:53 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/08 12:42:53
--- SimpleRangeHighUnbounded ---
2023/09/08 12:42:53 distinct = false
2023/09/08 12:42:53 Using n1ql client
2023/09/08 12:42:53 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/08 12:42:53
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:42:53 distinct = false
2023/09/08 12:42:54 Using n1ql client
2023/09/08 12:42:54 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:42:54
--- FiltersWithUnbounded ---
2023/09/08 12:42:54 distinct = false
2023/09/08 12:42:54 Using n1ql client
2023/09/08 12:42:54 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/08 12:42:54
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:42:54 distinct = false
2023/09/08 12:42:55 Using n1ql client
2023/09/08 12:42:55 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/08 12:42:55
--------- Simple Index with 1 field ---------
2023/09/08 12:42:55
--- SingleIndexSimpleRange ---
2023/09/08 12:42:55 distinct = false
2023/09/08 12:42:55 Using n1ql client
2023/09/08 12:42:55 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/08 12:42:55
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/08 12:42:55 distinct = false
2023/09/08 12:42:55 Using n1ql client
2023/09/08 12:42:55 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2023/09/08 12:42:55
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/08 12:42:55 distinct = false
2023/09/08 12:42:56 Using n1ql client
2023/09/08 12:42:56 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2023/09/08 12:42:56
--------- Composite Index with 3 fields ---------
2023/09/08 12:42:56
--- ScanAllNoFilter ---
2023/09/08 12:42:56 distinct = false
2023/09/08 12:42:56 Using n1ql client
2023/09/08 12:42:56 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:42:56
--- ScanAllFilterNil ---
2023/09/08 12:42:56 distinct = false
2023/09/08 12:42:57 Using n1ql client
2023/09/08 12:42:57 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:42:57
--- ScanAll_AllFiltersNil ---
2023/09/08 12:42:57 distinct = false
2023/09/08 12:42:57 Using n1ql client
2023/09/08 12:42:57 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:42:57
--- 3FieldsSingleSeek ---
2023/09/08 12:42:57 distinct = false
2023/09/08 12:42:58 Using n1ql client
2023/09/08 12:42:58 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:42:58
--- 3FieldsMultipleSeeks ---
2023/09/08 12:42:58 distinct = false
2023/09/08 12:42:58 Using n1ql client
2023/09/08 12:42:58 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/08 12:42:58
--- 3FieldsMultipleSeeks_Identical ---
2023/09/08 12:42:58 distinct = false
2023/09/08 12:42:58 Using n1ql client
2023/09/08 12:42:58 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/08 12:42:58
--------- New scenarios ---------
2023/09/08 12:42:58
--- CompIndexHighUnbounded1 ---
2023/09/08 12:42:58
--- Multi Scan 0 ---
2023/09/08 12:42:58 distinct = false
2023/09/08 12:42:59 Using n1ql client
2023/09/08 12:42:59 Using n1ql client
2023/09/08 12:42:59 len(scanResults) = 8 MultiScanCount = 8
2023/09/08 12:42:59 Expected and Actual scan responses are the same
2023/09/08 12:42:59
--- Multi Scan 1 ---
2023/09/08 12:42:59 distinct = false
2023/09/08 12:42:59 Using n1ql client
2023/09/08 12:42:59 Using n1ql client
2023/09/08 12:42:59 len(scanResults) = 0 MultiScanCount = 0
2023/09/08 12:42:59 Expected and Actual scan responses are the same
2023/09/08 12:42:59
--- Multi Scan 2 ---
2023/09/08 12:42:59 distinct = false
2023/09/08 12:43:00 Using n1ql client
2023/09/08 12:43:00 Using n1ql client
2023/09/08 12:43:00 len(scanResults) = 9 MultiScanCount = 9
2023/09/08 12:43:00 Expected and Actual scan responses are the same
2023/09/08 12:43:00
--- CompIndexHighUnbounded2 ---
2023/09/08 12:43:00
--- Multi Scan 0 ---
2023/09/08 12:43:00 distinct = false
2023/09/08 12:43:00 Using n1ql client
2023/09/08 12:43:00 Using n1ql client
2023/09/08 12:43:00 len(scanResults) = 4138 MultiScanCount = 4138
2023/09/08 12:43:00 Expected and Actual scan responses are the same
2023/09/08 12:43:00
--- Multi Scan 1 ---
2023/09/08 12:43:00 distinct = false
2023/09/08 12:43:00 Using n1ql client
2023/09/08 12:43:01 Using n1ql client
2023/09/08 12:43:01 len(scanResults) = 2746 MultiScanCount = 2746
2023/09/08 12:43:01 Expected and Actual scan responses are the same
2023/09/08 12:43:01
--- Multi Scan 2 ---
2023/09/08 12:43:01 distinct = false
2023/09/08 12:43:01 Using n1ql client
2023/09/08 12:43:01 Using n1ql client
2023/09/08 12:43:01 len(scanResults) = 4691 MultiScanCount = 4691
2023/09/08 12:43:01 Expected and Actual scan responses are the same
2023/09/08 12:43:01
--- CompIndexHighUnbounded3 ---
2023/09/08 12:43:01
--- Multi Scan 0 ---
2023/09/08 12:43:01 distinct = false
2023/09/08 12:43:01 Using n1ql client
2023/09/08 12:43:01 Using n1ql client
2023/09/08 12:43:01 len(scanResults) = 1329 MultiScanCount = 1329
2023/09/08 12:43:01 Expected and Actual scan responses are the same
2023/09/08 12:43:01
--- CompIndexHighUnbounded4 ---
2023/09/08 12:43:01
--- Multi Scan 0 ---
2023/09/08 12:43:01 distinct = false
2023/09/08 12:43:02 Using n1ql client
2023/09/08 12:43:02 Using n1ql client
2023/09/08 12:43:02 len(scanResults) = 5349 MultiScanCount = 5349
2023/09/08 12:43:02 Expected and Actual scan responses are the same
2023/09/08 12:43:02
--- CompIndexHighUnbounded5 ---
2023/09/08 12:43:02
--- Multi Scan 0 ---
2023/09/08 12:43:02 distinct = false
2023/09/08 12:43:02 Using n1ql client
2023/09/08 12:43:02 Using n1ql client
2023/09/08 12:43:02 len(scanResults) = 8210 MultiScanCount = 8210
2023/09/08 12:43:02 Expected and Actual scan responses are the same
2023/09/08 12:43:02
--- SeekBoundaries ---
2023/09/08 12:43:02
--- Multi Scan 0 ---
2023/09/08 12:43:02 distinct = false
2023/09/08 12:43:03 Using n1ql client
2023/09/08 12:43:03 Using n1ql client
2023/09/08 12:43:03 len(scanResults) = 175 MultiScanCount = 175
2023/09/08 12:43:03 Expected and Actual scan responses are the same
2023/09/08 12:43:03
--- Multi Scan 1 ---
2023/09/08 12:43:03 distinct = false
2023/09/08 12:43:03 Using n1ql client
2023/09/08 12:43:03 Using n1ql client
2023/09/08 12:43:03 len(scanResults) = 1 MultiScanCount = 1
2023/09/08 12:43:03 Expected and Actual scan responses are the same
2023/09/08 12:43:03
--- Multi Scan 2 ---
2023/09/08 12:43:03 distinct = false
2023/09/08 12:43:04 Using n1ql client
2023/09/08 12:43:04 Using n1ql client
2023/09/08 12:43:04 len(scanResults) = 555 MultiScanCount = 555
2023/09/08 12:43:04 Expected and Actual scan responses are the same
2023/09/08 12:43:04
--- Multi Scan 3 ---
2023/09/08 12:43:04 distinct = false
2023/09/08 12:43:04 Using n1ql client
2023/09/08 12:43:04 Using n1ql client
2023/09/08 12:43:04 len(scanResults) = 872 MultiScanCount = 872
2023/09/08 12:43:04 Expected and Actual scan responses are the same
2023/09/08 12:43:04
--- Multi Scan 4 ---
2023/09/08 12:43:04 distinct = false
2023/09/08 12:43:05 Using n1ql client
2023/09/08 12:43:05 Using n1ql client
2023/09/08 12:43:05 len(scanResults) = 287 MultiScanCount = 287
2023/09/08 12:43:05 Expected and Actual scan responses are the same
2023/09/08 12:43:05
--- Multi Scan 5 ---
2023/09/08 12:43:05 distinct = false
2023/09/08 12:43:05 Using n1ql client
2023/09/08 12:43:05 Using n1ql client
2023/09/08 12:43:05 len(scanResults) = 5254 MultiScanCount = 5254
2023/09/08 12:43:05 Expected and Actual scan responses are the same
2023/09/08 12:43:05
--- Multi Scan 6 ---
2023/09/08 12:43:05 distinct = false
2023/09/08 12:43:05 Using n1ql client
2023/09/08 12:43:05 Using n1ql client
2023/09/08 12:43:05 len(scanResults) = 5566 MultiScanCount = 5566
2023/09/08 12:43:05 Expected and Actual scan responses are the same
2023/09/08 12:43:05
--- Multi Scan 7 ---
2023/09/08 12:43:05 distinct = false
2023/09/08 12:43:06 Using n1ql client
2023/09/08 12:43:06 Using n1ql client
2023/09/08 12:43:06 len(scanResults) = 8 MultiScanCount = 8
2023/09/08 12:43:06 Expected and Actual scan responses are the same
2023/09/08 12:43:06
--------- With DISTINCT True ---------
2023/09/08 12:43:06
--- ScanAllNoFilter ---
2023/09/08 12:43:06 distinct = true
2023/09/08 12:43:06 Using n1ql client
2023/09/08 12:43:06 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:43:06
--- ScanAllFilterNil ---
2023/09/08 12:43:06 distinct = true
2023/09/08 12:43:07 Using n1ql client
2023/09/08 12:43:07 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:43:07
--- ScanAll_AllFiltersNil ---
2023/09/08 12:43:07 distinct = true
2023/09/08 12:43:07 Using n1ql client
2023/09/08 12:43:07 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:43:07
--- SingleSeek ---
2023/09/08 12:43:07 distinct = true
2023/09/08 12:43:08 Using n1ql client
2023/09/08 12:43:08 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:43:08
--- MultipleSeek ---
2023/09/08 12:43:08 distinct = true
2023/09/08 12:43:08 Using n1ql client
2023/09/08 12:43:08 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/08 12:43:08
--- SimpleRange ---
2023/09/08 12:43:08 distinct = true
2023/09/08 12:43:08 Using n1ql client
2023/09/08 12:43:08 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/08 12:43:08
--- NonOverlappingRanges ---
2023/09/08 12:43:08 distinct = true
2023/09/08 12:43:09 Using n1ql client
2023/09/08 12:43:09 MultiScanCount = 428 ExpectedMultiScanCount = 428
2023/09/08 12:43:09
--- OverlappingRanges ---
2023/09/08 12:43:09 distinct = true
2023/09/08 12:43:09 Using n1ql client
2023/09/08 12:43:09 MultiScanCount = 575 ExpectedMultiScanCount = 575
2023/09/08 12:43:09
--- NonOverlappingFilters ---
2023/09/08 12:43:09 distinct = true
2023/09/08 12:43:10 Using n1ql client
2023/09/08 12:43:10 MultiScanCount = 186 ExpectedMultiScanCount = 186
2023/09/08 12:43:10
--- NonOverlappingFilters2 ---
2023/09/08 12:43:10 distinct = true
2023/09/08 12:43:10 Using n1ql client
2023/09/08 12:43:10 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:43:10
--- OverlappingFilters ---
2023/09/08 12:43:10 distinct = true
2023/09/08 12:43:10 Using n1ql client
2023/09/08 12:43:10 MultiScanCount = 543 ExpectedMultiScanCount = 543
2023/09/08 12:43:10
--- BoundaryFilters ---
2023/09/08 12:43:10 distinct = true
2023/09/08 12:43:11 Using n1ql client
2023/09/08 12:43:11 MultiScanCount = 172 ExpectedMultiScanCount = 172
2023/09/08 12:43:11
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:43:11 distinct = true
2023/09/08 12:43:11 Using n1ql client
2023/09/08 12:43:11 MultiScanCount = 135 ExpectedMultiScanCount = 135
2023/09/08 12:43:11
--- SeekAndFilters_Overlapping ---
2023/09/08 12:43:11 distinct = true
2023/09/08 12:43:12 Using n1ql client
2023/09/08 12:43:12 MultiScanCount = 134 ExpectedMultiScanCount = 134
2023/09/08 12:43:12
--- SimpleRangeLowUnbounded ---
2023/09/08 12:43:12 distinct = false
2023/09/08 12:43:12 Using n1ql client
2023/09/08 12:43:12 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/08 12:43:12
--- SimpleRangeHighUnbounded ---
2023/09/08 12:43:12 distinct = false
2023/09/08 12:43:13 Using n1ql client
2023/09/08 12:43:13 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/08 12:43:13
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:43:13 distinct = false
2023/09/08 12:43:13 Using n1ql client
2023/09/08 12:43:13 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:43:13
--- FiltersWithUnbounded ---
2023/09/08 12:43:13 distinct = false
2023/09/08 12:43:13 Using n1ql client
2023/09/08 12:43:13 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/08 12:43:13
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:43:13 distinct = false
2023/09/08 12:43:14 Using n1ql client
2023/09/08 12:43:14 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/08 12:43:14
--------- Simple Index with 1 field ---------
2023/09/08 12:43:14
--- SingleIndexSimpleRange ---
2023/09/08 12:43:14 distinct = true
2023/09/08 12:43:14 Using n1ql client
2023/09/08 12:43:14 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/08 12:43:14
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/08 12:43:14 distinct = true
2023/09/08 12:43:15 Using n1ql client
2023/09/08 12:43:15 MultiScanCount = 713 ExpectedMultiScanCount = 713
2023/09/08 12:43:15
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/08 12:43:15 distinct = true
2023/09/08 12:43:15 Using n1ql client
2023/09/08 12:43:15 MultiScanCount = 869 ExpectedMultiScanCount = 869
2023/09/08 12:43:15
--------- Composite Index with 3 fields ---------
2023/09/08 12:43:15
--- ScanAllNoFilter ---
2023/09/08 12:43:15 distinct = true
2023/09/08 12:43:16 Using n1ql client
2023/09/08 12:43:16 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:43:16
--- ScanAllFilterNil ---
2023/09/08 12:43:16 distinct = true
2023/09/08 12:43:16 Using n1ql client
2023/09/08 12:43:16 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:43:16
--- ScanAll_AllFiltersNil ---
2023/09/08 12:43:16 distinct = true
2023/09/08 12:43:17 Using n1ql client
2023/09/08 12:43:17 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:43:17
--- 3FieldsSingleSeek ---
2023/09/08 12:43:17 distinct = true
2023/09/08 12:43:17 Using n1ql client
2023/09/08 12:43:17 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:43:17
--- 3FieldsMultipleSeeks ---
2023/09/08 12:43:17 distinct = true
2023/09/08 12:43:18 Using n1ql client
2023/09/08 12:43:18 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/08 12:43:18
--- 3FieldsMultipleSeeks_Identical ---
2023/09/08 12:43:18 distinct = true
2023/09/08 12:43:18 Using n1ql client
2023/09/08 12:43:18 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanCount (31.44s)
=== RUN TestMultiScanScenarios
2023/09/08 12:43:18 In TestMultiScanScenarios()
2023/09/08 12:43:18
--------- Composite Index with 2 fields ---------
2023/09/08 12:43:18
--- ScanAllNoFilter ---
2023/09/08 12:43:18 distinct = false
2023/09/08 12:43:19 Using n1ql client
2023/09/08 12:43:19 Expected and Actual scan responses are the same
2023/09/08 12:43:19
--- ScanAllFilterNil ---
2023/09/08 12:43:19 distinct = false
2023/09/08 12:43:19 Using n1ql client
2023/09/08 12:43:19 Expected and Actual scan responses are the same
2023/09/08 12:43:19
--- ScanAll_AllFiltersNil ---
2023/09/08 12:43:19 distinct = false
2023/09/08 12:43:20 Using n1ql client
2023/09/08 12:43:20 Expected and Actual scan responses are the same
2023/09/08 12:43:20
--- SingleSeek ---
2023/09/08 12:43:20 distinct = false
2023/09/08 12:43:20 Using n1ql client
2023/09/08 12:43:20 Expected and Actual scan responses are the same
2023/09/08 12:43:20
--- MultipleSeek ---
2023/09/08 12:43:20 distinct = false
2023/09/08 12:43:21 Using n1ql client
2023/09/08 12:43:21 Expected and Actual scan responses are the same
2023/09/08 12:43:21
--- SimpleRange ---
2023/09/08 12:43:21 distinct = false
2023/09/08 12:43:21 Using n1ql client
2023/09/08 12:43:21 Expected and Actual scan responses are the same
2023/09/08 12:43:21
--- NonOverlappingRanges ---
2023/09/08 12:43:21 distinct = false
2023/09/08 12:43:21 Using n1ql client
2023/09/08 12:43:21 Expected and Actual scan responses are the same
2023/09/08 12:43:21
--- OverlappingRanges ---
2023/09/08 12:43:21 distinct = false
2023/09/08 12:43:22 Using n1ql client
2023/09/08 12:43:22 Expected and Actual scan responses are the same
2023/09/08 12:43:22
--- NonOverlappingFilters ---
2023/09/08 12:43:22 distinct = false
2023/09/08 12:43:22 Using n1ql client
2023/09/08 12:43:22 Expected and Actual scan responses are the same
2023/09/08 12:43:22
--- OverlappingFilters ---
2023/09/08 12:43:22 distinct = false
2023/09/08 12:43:23 Using n1ql client
2023/09/08 12:43:23 Expected and Actual scan responses are the same
2023/09/08 12:43:23
--- BoundaryFilters ---
2023/09/08 12:43:23 distinct = false
2023/09/08 12:43:23 Using n1ql client
2023/09/08 12:43:23 Expected and Actual scan responses are the same
2023/09/08 12:43:23
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:43:23 distinct = false
2023/09/08 12:43:24 Using n1ql client
2023/09/08 12:43:24 Expected and Actual scan responses are the same
2023/09/08 12:43:24
--- SeekAndFilters_Overlapping ---
2023/09/08 12:43:24 distinct = false
2023/09/08 12:43:24 Using n1ql client
2023/09/08 12:43:24 Expected and Actual scan responses are the same
2023/09/08 12:43:24
--- SimpleRangeLowUnbounded ---
2023/09/08 12:43:24 distinct = false
2023/09/08 12:43:24 Using n1ql client
2023/09/08 12:43:24 Expected and Actual scan responses are the same
2023/09/08 12:43:24
--- SimpleRangeHighUnbounded ---
2023/09/08 12:43:24 distinct = false
2023/09/08 12:43:25 Using n1ql client
2023/09/08 12:43:25 Expected and Actual scan responses are the same
2023/09/08 12:43:25
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:43:25 distinct = false
2023/09/08 12:43:25 Using n1ql client
2023/09/08 12:43:25 Expected and Actual scan responses are the same
2023/09/08 12:43:25
--- FiltersWithUnbounded ---
2023/09/08 12:43:25 distinct = false
2023/09/08 12:43:26 Using n1ql client
2023/09/08 12:43:26 Expected and Actual scan responses are the same
2023/09/08 12:43:26
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:43:26 distinct = false
2023/09/08 12:43:26 Using n1ql client
2023/09/08 12:43:26 Expected and Actual scan responses are the same
2023/09/08 12:43:26
--------- Simple Index with 1 field ---------
2023/09/08 12:43:26
--- SingleIndexSimpleRange ---
2023/09/08 12:43:26 distinct = false
2023/09/08 12:43:27 Using n1ql client
2023/09/08 12:43:27 Expected and Actual scan responses are the same
2023/09/08 12:43:27
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/08 12:43:27 distinct = false
2023/09/08 12:43:27 Using n1ql client
2023/09/08 12:43:27 Expected and Actual scan responses are the same
2023/09/08 12:43:27
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/08 12:43:27 distinct = false
2023/09/08 12:43:27 Using n1ql client
2023/09/08 12:43:27 Expected and Actual scan responses are the same
2023/09/08 12:43:27
--------- Composite Index with 3 fields ---------
2023/09/08 12:43:27
--- ScanAllNoFilter ---
2023/09/08 12:43:27 distinct = false
2023/09/08 12:43:28 Using n1ql client
2023/09/08 12:43:28 Expected and Actual scan responses are the same
2023/09/08 12:43:28
--- ScanAllFilterNil ---
2023/09/08 12:43:28 distinct = false
2023/09/08 12:43:28 Using n1ql client
2023/09/08 12:43:28 Expected and Actual scan responses are the same
2023/09/08 12:43:28
--- ScanAll_AllFiltersNil ---
2023/09/08 12:43:28 distinct = false
2023/09/08 12:43:29 Using n1ql client
2023/09/08 12:43:29 Expected and Actual scan responses are the same
2023/09/08 12:43:29
--- 3FieldsSingleSeek ---
2023/09/08 12:43:29 distinct = false
2023/09/08 12:43:29 Using n1ql client
2023/09/08 12:43:29 Expected and Actual scan responses are the same
2023/09/08 12:43:29
--- 3FieldsMultipleSeeks ---
2023/09/08 12:43:29 distinct = false
2023/09/08 12:43:30 Using n1ql client
2023/09/08 12:43:30 Expected and Actual scan responses are the same
2023/09/08 12:43:30
--- 3FieldsMultipleSeeks_Identical ---
2023/09/08 12:43:30 distinct = false
2023/09/08 12:43:30 Using n1ql client
2023/09/08 12:43:30 Expected and Actual scan responses are the same
2023/09/08 12:43:30
--------- New scenarios ---------
2023/09/08 12:43:30
--- CompIndexHighUnbounded1 ---
2023/09/08 12:43:30
--- Multi Scan 0 ---
2023/09/08 12:43:30 distinct = false
2023/09/08 12:43:31 Using n1ql client
2023/09/08 12:43:31 Expected and Actual scan responses are the same
2023/09/08 12:43:31
--- Multi Scan 1 ---
2023/09/08 12:43:31 distinct = false
2023/09/08 12:43:31 Using n1ql client
2023/09/08 12:43:31 Expected and Actual scan responses are the same
2023/09/08 12:43:31
--- Multi Scan 2 ---
2023/09/08 12:43:31 distinct = false
2023/09/08 12:43:32 Using n1ql client
2023/09/08 12:43:32 Expected and Actual scan responses are the same
2023/09/08 12:43:32
--- CompIndexHighUnbounded2 ---
2023/09/08 12:43:32
--- Multi Scan 0 ---
2023/09/08 12:43:32 distinct = false
2023/09/08 12:43:32 Using n1ql client
2023/09/08 12:43:32 Expected and Actual scan responses are the same
2023/09/08 12:43:32
--- Multi Scan 1 ---
2023/09/08 12:43:32 distinct = false
2023/09/08 12:43:32 Using n1ql client
2023/09/08 12:43:32 Expected and Actual scan responses are the same
2023/09/08 12:43:32
--- Multi Scan 2 ---
2023/09/08 12:43:32 distinct = false
2023/09/08 12:43:33 Using n1ql client
2023/09/08 12:43:33 Expected and Actual scan responses are the same
2023/09/08 12:43:33
--- CompIndexHighUnbounded3 ---
2023/09/08 12:43:33
--- Multi Scan 0 ---
2023/09/08 12:43:33 distinct = false
2023/09/08 12:43:33 Using n1ql client
2023/09/08 12:43:33 Expected and Actual scan responses are the same
2023/09/08 12:43:33
--- CompIndexHighUnbounded4 ---
2023/09/08 12:43:33
--- Multi Scan 0 ---
2023/09/08 12:43:33 distinct = false
2023/09/08 12:43:34 Using n1ql client
2023/09/08 12:43:34 Expected and Actual scan responses are the same
2023/09/08 12:43:34
--- CompIndexHighUnbounded5 ---
2023/09/08 12:43:34
--- Multi Scan 0 ---
2023/09/08 12:43:34 distinct = false
2023/09/08 12:43:34 Using n1ql client
2023/09/08 12:43:34 Expected and Actual scan responses are the same
2023/09/08 12:43:34
--- SeekBoundaries ---
2023/09/08 12:43:34
--- Multi Scan 0 ---
2023/09/08 12:43:34 distinct = false
2023/09/08 12:43:35 Using n1ql client
2023/09/08 12:43:35 Expected and Actual scan responses are the same
2023/09/08 12:43:35
--- Multi Scan 1 ---
2023/09/08 12:43:35 distinct = false
2023/09/08 12:43:35 Using n1ql client
2023/09/08 12:43:35 Expected and Actual scan responses are the same
2023/09/08 12:43:35
--- Multi Scan 2 ---
2023/09/08 12:43:35 distinct = false
2023/09/08 12:43:35 Using n1ql client
2023/09/08 12:43:35 Expected and Actual scan responses are the same
2023/09/08 12:43:35
--- Multi Scan 3 ---
2023/09/08 12:43:35 distinct = false
2023/09/08 12:43:36 Using n1ql client
2023/09/08 12:43:36 Expected and Actual scan responses are the same
2023/09/08 12:43:36
--- Multi Scan 4 ---
2023/09/08 12:43:36 distinct = false
2023/09/08 12:43:36 Using n1ql client
2023/09/08 12:43:36 Expected and Actual scan responses are the same
2023/09/08 12:43:36
--- Multi Scan 5 ---
2023/09/08 12:43:36 distinct = false
2023/09/08 12:43:37 Using n1ql client
2023/09/08 12:43:37 Expected and Actual scan responses are the same
2023/09/08 12:43:37
--- Multi Scan 6 ---
2023/09/08 12:43:37 distinct = false
2023/09/08 12:43:37 Using n1ql client
2023/09/08 12:43:37 Expected and Actual scan responses are the same
2023/09/08 12:43:37
--- Multi Scan 7 ---
2023/09/08 12:43:37 distinct = false
2023/09/08 12:43:38 Using n1ql client
2023/09/08 12:43:38 Expected and Actual scan responses are the same
2023/09/08 12:43:38
--- PrefixSortVariations ---
2023/09/08 12:43:38
--- Multi Scan 0 ---
2023/09/08 12:43:38 distinct = false
2023/09/08 12:43:38 Using n1ql client
2023/09/08 12:43:38 Expected and Actual scan responses are the same
2023/09/08 12:43:38
--- Multi Scan 1 ---
2023/09/08 12:43:38 distinct = false
2023/09/08 12:43:39 Using n1ql client
2023/09/08 12:43:39 Expected and Actual scan responses are the same
--- PASS: TestMultiScanScenarios (20.34s)
=== RUN TestMultiScanOffset
2023/09/08 12:43:39 In TestMultiScanOffset()
2023/09/08 12:43:39
--------- Composite Index with 2 fields ---------
2023/09/08 12:43:39
--- ScanAllNoFilter ---
2023/09/08 12:43:39 distinct = false
2023/09/08 12:43:39 Using n1ql client
2023/09/08 12:43:39
--- ScanAllFilterNil ---
2023/09/08 12:43:39 distinct = false
2023/09/08 12:43:39 Using n1ql client
2023/09/08 12:43:39
--- ScanAll_AllFiltersNil ---
2023/09/08 12:43:39 distinct = false
2023/09/08 12:43:40 Using n1ql client
2023/09/08 12:43:40
--- SingleSeek ---
2023/09/08 12:43:40 distinct = false
2023/09/08 12:43:40 Using n1ql client
2023/09/08 12:43:40
--- MultipleSeek ---
2023/09/08 12:43:40 distinct = false
2023/09/08 12:43:41 Using n1ql client
2023/09/08 12:43:41
--- SimpleRange ---
2023/09/08 12:43:41 distinct = false
2023/09/08 12:43:41 Using n1ql client
2023/09/08 12:43:41
--- NonOverlappingRanges ---
2023/09/08 12:43:41 distinct = false
2023/09/08 12:43:41 Using n1ql client
2023/09/08 12:43:41
--- OverlappingRanges ---
2023/09/08 12:43:41 distinct = false
2023/09/08 12:43:42 Using n1ql client
2023/09/08 12:43:42
--- NonOverlappingFilters ---
2023/09/08 12:43:42 distinct = false
2023/09/08 12:43:42 Using n1ql client
2023/09/08 12:43:42
--- OverlappingFilters ---
2023/09/08 12:43:42 distinct = false
2023/09/08 12:43:43 Using n1ql client
2023/09/08 12:43:43
--- BoundaryFilters ---
2023/09/08 12:43:43 distinct = false
2023/09/08 12:43:43 Using n1ql client
2023/09/08 12:43:43
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:43:43 distinct = false
2023/09/08 12:43:44 Using n1ql client
2023/09/08 12:43:44
--- SeekAndFilters_Overlapping ---
2023/09/08 12:43:44 distinct = false
2023/09/08 12:43:44 Using n1ql client
2023/09/08 12:43:44
--- SimpleRangeLowUnbounded ---
2023/09/08 12:43:44 distinct = false
2023/09/08 12:43:44 Using n1ql client
2023/09/08 12:43:44 Expected and Actual scan responses are the same
2023/09/08 12:43:44
--- SimpleRangeHighUnbounded ---
2023/09/08 12:43:44 distinct = false
2023/09/08 12:43:45 Using n1ql client
2023/09/08 12:43:45 Expected and Actual scan responses are the same
2023/09/08 12:43:45
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:43:45 distinct = false
2023/09/08 12:43:45 Using n1ql client
2023/09/08 12:43:45 Expected and Actual scan responses are the same
2023/09/08 12:43:45
--- FiltersWithUnbounded ---
2023/09/08 12:43:45 distinct = false
2023/09/08 12:43:46 Using n1ql client
2023/09/08 12:43:46 Expected and Actual scan responses are the same
2023/09/08 12:43:46
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:43:46 distinct = false
2023/09/08 12:43:46 Using n1ql client
2023/09/08 12:43:46 Expected and Actual scan responses are the same
2023/09/08 12:43:46
--------- Simple Index with 1 field ---------
2023/09/08 12:43:46
--- SingleIndexSimpleRange ---
2023/09/08 12:43:46 distinct = false
2023/09/08 12:43:47 Using n1ql client
2023/09/08 12:43:47
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/08 12:43:47 distinct = false
2023/09/08 12:43:47 Using n1ql client
2023/09/08 12:43:47
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/08 12:43:47 distinct = false
2023/09/08 12:43:47 Using n1ql client
2023/09/08 12:43:47
--------- Composite Index with 3 fields ---------
2023/09/08 12:43:47
--- ScanAllNoFilter ---
2023/09/08 12:43:47 distinct = false
2023/09/08 12:43:48 Using n1ql client
2023/09/08 12:43:48
--- ScanAllFilterNil ---
2023/09/08 12:43:48 distinct = false
2023/09/08 12:43:48 Using n1ql client
2023/09/08 12:43:48
--- ScanAll_AllFiltersNil ---
2023/09/08 12:43:48 distinct = false
2023/09/08 12:43:49 Using n1ql client
2023/09/08 12:43:49
--- 3FieldsSingleSeek ---
2023/09/08 12:43:49 distinct = false
2023/09/08 12:43:49 Using n1ql client
2023/09/08 12:43:49
--- 3FieldsMultipleSeeks ---
2023/09/08 12:43:49 distinct = false
2023/09/08 12:43:50 Using n1ql client
2023/09/08 12:43:50
--- 3FieldsMultipleSeeks_Identical ---
2023/09/08 12:43:50 distinct = false
2023/09/08 12:43:50 Using n1ql client
--- PASS: TestMultiScanOffset (11.58s)
=== RUN TestMultiScanPrimaryIndex
2023/09/08 12:43:50 In TestMultiScanPrimaryIndex()
2023/09/08 12:43:50
--- PrimaryRange ---
2023/09/08 12:43:50 Using n1ql client
2023/09/08 12:43:50 Expected and Actual scan responses are the same
2023/09/08 12:43:50
--- PrimaryScanAllNoFilter ---
2023/09/08 12:43:50 Using n1ql client
2023/09/08 12:43:50 Expected and Actual scan responses are the same
--- PASS: TestMultiScanPrimaryIndex (0.08s)
=== RUN TestMultiScanDistinct
2023/09/08 12:43:50 In TestScansDistinct()
2023/09/08 12:43:50
--------- Composite Index with 2 fields ---------
2023/09/08 12:43:50
--- ScanAllNoFilter ---
2023/09/08 12:43:50 distinct = true
2023/09/08 12:43:51 Using n1ql client
2023/09/08 12:43:51 Expected and Actual scan responses are the same
2023/09/08 12:43:51
--- ScanAllFilterNil ---
2023/09/08 12:43:51 distinct = true
2023/09/08 12:43:51 Using n1ql client
2023/09/08 12:43:51 Expected and Actual scan responses are the same
2023/09/08 12:43:51
--- ScanAll_AllFiltersNil ---
2023/09/08 12:43:51 distinct = true
2023/09/08 12:43:52 Using n1ql client
2023/09/08 12:43:52 Expected and Actual scan responses are the same
2023/09/08 12:43:52
--- SingleSeek ---
2023/09/08 12:43:52 distinct = true
2023/09/08 12:43:52 Using n1ql client
2023/09/08 12:43:52 Expected and Actual scan responses are the same
2023/09/08 12:43:52
--- MultipleSeek ---
2023/09/08 12:43:52 distinct = true
2023/09/08 12:43:53 Using n1ql client
2023/09/08 12:43:53 Expected and Actual scan responses are the same
2023/09/08 12:43:53
--- SimpleRange ---
2023/09/08 12:43:53 distinct = true
2023/09/08 12:43:53 Using n1ql client
2023/09/08 12:43:53 Expected and Actual scan responses are the same
2023/09/08 12:43:53
--- NonOverlappingRanges ---
2023/09/08 12:43:53 distinct = true
2023/09/08 12:43:53 Using n1ql client
2023/09/08 12:43:53 Expected and Actual scan responses are the same
2023/09/08 12:43:53
--- OverlappingRanges ---
2023/09/08 12:43:53 distinct = true
2023/09/08 12:43:54 Using n1ql client
2023/09/08 12:43:54 Expected and Actual scan responses are the same
2023/09/08 12:43:54
--- NonOverlappingFilters ---
2023/09/08 12:43:54 distinct = true
2023/09/08 12:43:54 Using n1ql client
2023/09/08 12:43:54 Expected and Actual scan responses are the same
2023/09/08 12:43:54
--- OverlappingFilters ---
2023/09/08 12:43:54 distinct = true
2023/09/08 12:43:55 Using n1ql client
2023/09/08 12:43:55 Expected and Actual scan responses are the same
2023/09/08 12:43:55
--- BoundaryFilters ---
2023/09/08 12:43:55 distinct = true
2023/09/08 12:43:55 Using n1ql client
2023/09/08 12:43:55 Expected and Actual scan responses are the same
2023/09/08 12:43:55
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:43:55 distinct = true
2023/09/08 12:43:56 Using n1ql client
2023/09/08 12:43:56 Expected and Actual scan responses are the same
2023/09/08 12:43:56
--- SeekAndFilters_Overlapping ---
2023/09/08 12:43:56 distinct = true
2023/09/08 12:43:56 Using n1ql client
2023/09/08 12:43:56 Expected and Actual scan responses are the same
2023/09/08 12:43:56
--- SimpleRangeLowUnbounded ---
2023/09/08 12:43:56 distinct = false
2023/09/08 12:43:56 Using n1ql client
2023/09/08 12:43:56 Expected and Actual scan responses are the same
2023/09/08 12:43:56
--- SimpleRangeHighUnbounded ---
2023/09/08 12:43:56 distinct = false
2023/09/08 12:43:57 Using n1ql client
2023/09/08 12:43:57 Expected and Actual scan responses are the same
2023/09/08 12:43:57
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:43:57 distinct = false
2023/09/08 12:43:57 Using n1ql client
2023/09/08 12:43:57 Expected and Actual scan responses are the same
2023/09/08 12:43:57
--- FiltersWithUnbounded ---
2023/09/08 12:43:57 distinct = false
2023/09/08 12:43:58 Using n1ql client
2023/09/08 12:43:58 Expected and Actual scan responses are the same
2023/09/08 12:43:58
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:43:58 distinct = false
2023/09/08 12:43:58 Using n1ql client
2023/09/08 12:43:58 Expected and Actual scan responses are the same
2023/09/08 12:43:58
--------- Simple Index with 1 field ---------
2023/09/08 12:43:58
--- SingleIndexSimpleRange ---
2023/09/08 12:43:58 distinct = true
2023/09/08 12:43:59 Using n1ql client
2023/09/08 12:43:59 Expected and Actual scan responses are the same
2023/09/08 12:43:59
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/08 12:43:59 distinct = true
2023/09/08 12:43:59 Using n1ql client
2023/09/08 12:43:59 Expected and Actual scan responses are the same
2023/09/08 12:43:59
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/08 12:43:59 distinct = true
2023/09/08 12:43:59 Using n1ql client
2023/09/08 12:43:59 Expected and Actual scan responses are the same
2023/09/08 12:43:59
--------- Composite Index with 3 fields ---------
2023/09/08 12:43:59
--- ScanAllNoFilter ---
2023/09/08 12:43:59 distinct = true
2023/09/08 12:44:00 Using n1ql client
2023/09/08 12:44:00 Expected and Actual scan responses are the same
2023/09/08 12:44:00
--- ScanAllFilterNil ---
2023/09/08 12:44:00 distinct = true
2023/09/08 12:44:00 Using n1ql client
2023/09/08 12:44:01 Expected and Actual scan responses are the same
2023/09/08 12:44:01
--- ScanAll_AllFiltersNil ---
2023/09/08 12:44:01 distinct = true
2023/09/08 12:44:01 Using n1ql client
2023/09/08 12:44:01 Expected and Actual scan responses are the same
2023/09/08 12:44:01
--- 3FieldsSingleSeek ---
2023/09/08 12:44:01 distinct = true
2023/09/08 12:44:01 Using n1ql client
2023/09/08 12:44:01 Expected and Actual scan responses are the same
2023/09/08 12:44:01
--- 3FieldsMultipleSeeks ---
2023/09/08 12:44:01 distinct = true
2023/09/08 12:44:02 Using n1ql client
2023/09/08 12:44:02 Expected and Actual scan responses are the same
2023/09/08 12:44:02
--- 3FieldsMultipleSeeks_Identical ---
2023/09/08 12:44:02 distinct = true
2023/09/08 12:44:02 Using n1ql client
2023/09/08 12:44:02 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDistinct (12.12s)
=== RUN TestMultiScanProjection
2023/09/08 12:44:02 In TestMultiScanProjection()
2023/09/08 12:44:02
--------- Composite Index with 2 fields ---------
2023/09/08 12:44:02
--- ScanAllNoFilter ---
2023/09/08 12:44:02 distinct = true
2023/09/08 12:44:03 Using n1ql client
2023/09/08 12:44:03 Expected and Actual scan responses are the same
2023/09/08 12:44:03
--- ScanAllFilterNil ---
2023/09/08 12:44:03 distinct = true
2023/09/08 12:44:03 Using n1ql client
2023/09/08 12:44:03 Expected and Actual scan responses are the same
2023/09/08 12:44:03
--- ScanAll_AllFiltersNil ---
2023/09/08 12:44:03 distinct = true
2023/09/08 12:44:04 Using n1ql client
2023/09/08 12:44:04 Expected and Actual scan responses are the same
2023/09/08 12:44:04
--- SingleSeek ---
2023/09/08 12:44:04 distinct = true
2023/09/08 12:44:04 Using n1ql client
2023/09/08 12:44:04 Expected and Actual scan responses are the same
2023/09/08 12:44:04
--- MultipleSeek ---
2023/09/08 12:44:04 distinct = true
2023/09/08 12:44:05 Using n1ql client
2023/09/08 12:44:05 Expected and Actual scan responses are the same
2023/09/08 12:44:05
--- SimpleRange ---
2023/09/08 12:44:05 distinct = true
2023/09/08 12:44:05 Using n1ql client
2023/09/08 12:44:05 Expected and Actual scan responses are the same
2023/09/08 12:44:05
--- NonOverlappingRanges ---
2023/09/08 12:44:05 distinct = true
2023/09/08 12:44:06 Using n1ql client
2023/09/08 12:44:06 Expected and Actual scan responses are the same
2023/09/08 12:44:06
--- OverlappingRanges ---
2023/09/08 12:44:06 distinct = true
2023/09/08 12:44:06 Using n1ql client
2023/09/08 12:44:06 Expected and Actual scan responses are the same
2023/09/08 12:44:06
--- NonOverlappingFilters ---
2023/09/08 12:44:06 distinct = true
2023/09/08 12:44:06 Using n1ql client
2023/09/08 12:44:06 Expected and Actual scan responses are the same
2023/09/08 12:44:06
--- OverlappingFilters ---
2023/09/08 12:44:06 distinct = true
2023/09/08 12:44:07 Using n1ql client
2023/09/08 12:44:07 Expected and Actual scan responses are the same
2023/09/08 12:44:07
--- BoundaryFilters ---
2023/09/08 12:44:07 distinct = true
2023/09/08 12:44:07 Using n1ql client
2023/09/08 12:44:07 Expected and Actual scan responses are the same
2023/09/08 12:44:07
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:44:07 distinct = true
2023/09/08 12:44:08 Using n1ql client
2023/09/08 12:44:08 Expected and Actual scan responses are the same
2023/09/08 12:44:08
--- SeekAndFilters_Overlapping ---
2023/09/08 12:44:08 distinct = true
2023/09/08 12:44:08 Using n1ql client
2023/09/08 12:44:08 Expected and Actual scan responses are the same
2023/09/08 12:44:08
--- SimpleRangeLowUnbounded ---
2023/09/08 12:44:08 distinct = false
2023/09/08 12:44:09 Using n1ql client
2023/09/08 12:44:09 Expected and Actual scan responses are the same
2023/09/08 12:44:09
--- SimpleRangeHighUnbounded ---
2023/09/08 12:44:09 distinct = false
2023/09/08 12:44:09 Using n1ql client
2023/09/08 12:44:09 Expected and Actual scan responses are the same
2023/09/08 12:44:09
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:44:09 distinct = false
2023/09/08 12:44:09 Using n1ql client
2023/09/08 12:44:10 Expected and Actual scan responses are the same
2023/09/08 12:44:10
--- FiltersWithUnbounded ---
2023/09/08 12:44:10 distinct = false
2023/09/08 12:44:10 Using n1ql client
2023/09/08 12:44:10 Expected and Actual scan responses are the same
2023/09/08 12:44:10
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:44:10 distinct = false
2023/09/08 12:44:10 Using n1ql client
2023/09/08 12:44:10 Expected and Actual scan responses are the same
2023/09/08 12:44:10
--------- Simple Index with 1 field ---------
2023/09/08 12:44:10
--- SingleIndexSimpleRange ---
2023/09/08 12:44:10 distinct = true
2023/09/08 12:44:11 Using n1ql client
2023/09/08 12:44:11 Expected and Actual scan responses are the same
2023/09/08 12:44:11
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/08 12:44:11 distinct = true
2023/09/08 12:44:11 Using n1ql client
2023/09/08 12:44:11 Expected and Actual scan responses are the same
2023/09/08 12:44:11
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/08 12:44:11 distinct = true
2023/09/08 12:44:11 Using n1ql client
2023/09/08 12:44:11 Expected and Actual scan responses are the same
2023/09/08 12:44:11
--------- Composite Index with 3 fields ---------
2023/09/08 12:44:11
--- ScanAllNoFilter ---
2023/09/08 12:44:11 distinct = true
2023/09/08 12:44:12 Using n1ql client
2023/09/08 12:44:12 Expected and Actual scan responses are the same
2023/09/08 12:44:12
--- ScanAllFilterNil ---
2023/09/08 12:44:12 distinct = true
2023/09/08 12:44:13 Using n1ql client
2023/09/08 12:44:13 Expected and Actual scan responses are the same
2023/09/08 12:44:13
--- ScanAll_AllFiltersNil ---
2023/09/08 12:44:13 distinct = true
2023/09/08 12:44:13 Using n1ql client
2023/09/08 12:44:13 Expected and Actual scan responses are the same
2023/09/08 12:44:13
--- 3FieldsSingleSeek ---
2023/09/08 12:44:13 distinct = true
2023/09/08 12:44:14 Using n1ql client
2023/09/08 12:44:14 Expected and Actual scan responses are the same
2023/09/08 12:44:14
--- 3FieldsMultipleSeeks ---
2023/09/08 12:44:14 distinct = true
2023/09/08 12:44:14 Using n1ql client
2023/09/08 12:44:14 Expected and Actual scan responses are the same
2023/09/08 12:44:14
--- 3FieldsMultipleSeeks_Identical ---
2023/09/08 12:44:14 distinct = true
2023/09/08 12:44:15 Using n1ql client
2023/09/08 12:44:15 Expected and Actual scan responses are the same
2023/09/08 12:44:15 indexes are: index_company, index_companyname, index_company_name_age, index_company_name_age_address, index_company_name_age_address_friends
2023/09/08 12:44:15 fields are: [company], [company name], [company name age], [company name age address], [company name age address friends]
2023/09/08 12:44:15
--- SingleIndexProjectFirst ---
2023/09/08 12:44:15 distinct = true
2023/09/08 12:44:15 Using n1ql client
2023/09/08 12:44:15 Expected and Actual scan responses are the same
2023/09/08 12:44:15
--- 2FieldIndexProjectSecond ---
2023/09/08 12:44:15 distinct = true
2023/09/08 12:44:16 Using n1ql client
2023/09/08 12:44:16 Expected and Actual scan responses are the same
2023/09/08 12:44:16
--- 3FieldIndexProjectThird ---
2023/09/08 12:44:16 distinct = true
2023/09/08 12:44:16 Using n1ql client
2023/09/08 12:44:16 Expected and Actual scan responses are the same
2023/09/08 12:44:16
--- 4FieldIndexProjectFourth ---
2023/09/08 12:44:16 distinct = true
2023/09/08 12:44:18 Using n1ql client
2023/09/08 12:44:18 Expected and Actual scan responses are the same
2023/09/08 12:44:18
--- 5FieldIndexProjectFifth ---
2023/09/08 12:44:18 distinct = true
2023/09/08 12:44:21 Using n1ql client
2023/09/08 12:44:21 Expected and Actual scan responses are the same
2023/09/08 12:44:21
--- 2FieldIndexProjectTwo ---
2023/09/08 12:44:21 distinct = true
2023/09/08 12:44:22 Using n1ql client
2023/09/08 12:44:22 Expected and Actual scan responses are the same
2023/09/08 12:44:22
--- 3FieldIndexProjectTwo ---
2023/09/08 12:44:22 distinct = true
2023/09/08 12:44:22 Using n1ql client
2023/09/08 12:44:22 Expected and Actual scan responses are the same
2023/09/08 12:44:22
--- 3FieldIndexProjectTwo ---
2023/09/08 12:44:22 distinct = true
2023/09/08 12:44:23 Using n1ql client
2023/09/08 12:44:23 Expected and Actual scan responses are the same
2023/09/08 12:44:23
--- 3FieldIndexProjectTwo ---
2023/09/08 12:44:23 distinct = true
2023/09/08 12:44:23 Using n1ql client
2023/09/08 12:44:23 Expected and Actual scan responses are the same
2023/09/08 12:44:23
--- 4FieldIndexProjectTwo ---
2023/09/08 12:44:23 distinct = true
2023/09/08 12:44:25 Using n1ql client
2023/09/08 12:44:25 Expected and Actual scan responses are the same
2023/09/08 12:44:25
--- 4FieldIndexProjectTwo ---
2023/09/08 12:44:25 distinct = true
2023/09/08 12:44:27 Using n1ql client
2023/09/08 12:44:27 Expected and Actual scan responses are the same
2023/09/08 12:44:27
--- 4FieldIndexProjectTwo ---
2023/09/08 12:44:27 distinct = true
2023/09/08 12:44:28 Using n1ql client
2023/09/08 12:44:28 Expected and Actual scan responses are the same
2023/09/08 12:44:28
--- 4FieldIndexProjectTwo ---
2023/09/08 12:44:28 distinct = true
2023/09/08 12:44:30 Using n1ql client
2023/09/08 12:44:30 Expected and Actual scan responses are the same
2023/09/08 12:44:30
--- 4FieldIndexProjectTwo ---
2023/09/08 12:44:30 distinct = true
2023/09/08 12:44:31 Using n1ql client
2023/09/08 12:44:31 Expected and Actual scan responses are the same
2023/09/08 12:44:31
--- 5FieldIndexProjectTwo ---
2023/09/08 12:44:31 distinct = true
2023/09/08 12:44:35 Using n1ql client
2023/09/08 12:44:35 Expected and Actual scan responses are the same
2023/09/08 12:44:35
--- 5FieldIndexProjectTwo ---
2023/09/08 12:44:35 distinct = true
2023/09/08 12:44:38 Using n1ql client
2023/09/08 12:44:38 Expected and Actual scan responses are the same
2023/09/08 12:44:38
--- 5FieldIndexProjectTwo ---
2023/09/08 12:44:38 distinct = true
2023/09/08 12:44:42 Using n1ql client
2023/09/08 12:44:42 Expected and Actual scan responses are the same
2023/09/08 12:44:42
--- 5FieldIndexProjectTwo ---
2023/09/08 12:44:42 distinct = true
2023/09/08 12:44:45 Using n1ql client
2023/09/08 12:44:45 Expected and Actual scan responses are the same
2023/09/08 12:44:45
--- 5FieldIndexProjectThree ---
2023/09/08 12:44:45 distinct = true
2023/09/08 12:44:49 Using n1ql client
2023/09/08 12:44:49 Expected and Actual scan responses are the same
2023/09/08 12:44:49
--- 5FieldIndexProjectFour ---
2023/09/08 12:44:49 distinct = true
2023/09/08 12:44:52 Using n1ql client
2023/09/08 12:44:52 Expected and Actual scan responses are the same
2023/09/08 12:44:52
--- 5FieldIndexProjectAll ---
2023/09/08 12:44:52 distinct = true
2023/09/08 12:44:55 Using n1ql client
2023/09/08 12:44:55 Expected and Actual scan responses are the same
2023/09/08 12:44:55
--- 5FieldIndexProjectAlternate ---
2023/09/08 12:44:55 distinct = true
2023/09/08 12:44:59 Using n1ql client
2023/09/08 12:44:59 Expected and Actual scan responses are the same
2023/09/08 12:44:59
--- 5FieldIndexProjectEmptyEntryKeys ---
2023/09/08 12:44:59 distinct = true
2023/09/08 12:45:02 Using n1ql client
2023/09/08 12:45:02 Expected and Actual scan responses are the same
--- PASS: TestMultiScanProjection (59.69s)
=== RUN TestMultiScanRestAPI
2023/09/08 12:45:02 In TestMultiScanRestAPI()
2023/09/08 12:45:02 In DropAllSecondaryIndexes()
2023/09/08 12:45:02 Index found: index_companyname
2023/09/08 12:45:02 Dropped index index_companyname
2023/09/08 12:45:02 Index found: addressidx
2023/09/08 12:45:02 Dropped index addressidx
2023/09/08 12:45:02 Index found: index_primary
2023/09/08 12:45:02 Dropped index index_primary
2023/09/08 12:45:02 Index found: index_company
2023/09/08 12:45:02 Dropped index index_company
2023/09/08 12:45:02 Index found: index_company_name_age
2023/09/08 12:45:02 Dropped index index_company_name_age
2023/09/08 12:45:02 Index found: index_company_name_age_address_friends
2023/09/08 12:45:03 Dropped index index_company_name_age_address_friends
2023/09/08 12:45:03 Index found: index_company_name_age_address
2023/09/08 12:45:03 Dropped index index_company_name_age_address
2023/09/08 12:45:06 Created the secondary index index_companyname. Waiting for it become active
2023/09/08 12:45:06 Index is 5212453234541224198 now active
2023/09/08 12:45:06 GET all indexes
2023/09/08 12:45:06 200 OK
2023/09/08 12:45:06 getscans status : 200 OK
2023/09/08 12:45:06 number of entries 337
2023/09/08 12:45:06 Status : 200 OK
2023/09/08 12:45:06 Result from multiscancount API = 0
--- PASS: TestMultiScanRestAPI (4.21s)
=== RUN TestMultiScanPrimaryIndexVariations
2023/09/08 12:45:06 In TestMultiScanPrimaryIndexVariations()
2023/09/08 12:45:13 Created the secondary index index_pi. Waiting for it become active
2023/09/08 12:45:13 Index is 2276780013835519542 now active
2023/09/08 12:45:13
--- No Overlap ---
2023/09/08 12:45:13 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14
--- Proper Overlap ---
2023/09/08 12:45:14 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14
--- Low Boundary Overlap ---
2023/09/08 12:45:14 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14
--- Complex Overlaps ---
2023/09/08 12:45:14 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14
--- Multiple Equal Overlaps ---
2023/09/08 12:45:14 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14
--- Boundary and Subset Overlaps ---
2023/09/08 12:45:14 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14
--- Point Overlaps ---
2023/09/08 12:45:14 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14
--- Boundary and Point Overlaps ---
2023/09/08 12:45:14 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14
--- Primary index range null ---
2023/09/08 12:45:14 Using n1ql client
2023/09/08 12:45:14 Expected and Actual scan responses are the same
2023/09/08 12:45:14 Dropping the secondary index index_pi
2023/09/08 12:45:15 Index dropped
--- PASS: TestMultiScanPrimaryIndexVariations (8.24s)
=== RUN TestMultiScanDescSetup
2023/09/08 12:45:15 In TestMultiScanDescSetup()
2023/09/08 12:45:15 In DropAllSecondaryIndexes()
2023/09/08 12:45:15 Index found: index_companyname
2023/09/08 12:45:15 Dropped index index_companyname
2023/09/08 12:45:19 Created the secondary index index_companyname_desc. Waiting for it become active
2023/09/08 12:45:19 Index is 7657697308204110359 now active
2023/09/08 12:45:26 Created the secondary index index_company_desc. Waiting for it become active
2023/09/08 12:45:26 Index is 8357863828459209277 now active
2023/09/08 12:45:33 Created the secondary index index_company_name_age_desc. Waiting for it become active
2023/09/08 12:45:33 Index is 17744247326017707844 now active
--- PASS: TestMultiScanDescSetup (18.24s)
=== RUN TestMultiScanDescScenarios
2023/09/08 12:45:33 In TestMultiScanDescScenarios()
2023/09/08 12:45:33
--------- Composite Index with 2 fields ---------
2023/09/08 12:45:33
--- ScanAllNoFilter ---
2023/09/08 12:45:33 distinct = false
2023/09/08 12:45:33 Using n1ql client
2023/09/08 12:45:33 Expected and Actual scan responses are the same
2023/09/08 12:45:33
--- ScanAllFilterNil ---
2023/09/08 12:45:33 distinct = false
2023/09/08 12:45:34 Using n1ql client
2023/09/08 12:45:34 Expected and Actual scan responses are the same
2023/09/08 12:45:34
--- ScanAll_AllFiltersNil ---
2023/09/08 12:45:34 distinct = false
2023/09/08 12:45:34 Using n1ql client
2023/09/08 12:45:34 Expected and Actual scan responses are the same
2023/09/08 12:45:34
--- SingleSeek ---
2023/09/08 12:45:34 distinct = false
2023/09/08 12:45:35 Using n1ql client
2023/09/08 12:45:35 Expected and Actual scan responses are the same
2023/09/08 12:45:35
--- MultipleSeek ---
2023/09/08 12:45:35 distinct = false
2023/09/08 12:45:35 Using n1ql client
2023/09/08 12:45:35 Expected and Actual scan responses are the same
2023/09/08 12:45:35
--- SimpleRange ---
2023/09/08 12:45:35 distinct = false
2023/09/08 12:45:36 Using n1ql client
2023/09/08 12:45:36 Expected and Actual scan responses are the same
2023/09/08 12:45:36
--- NonOverlappingRanges ---
2023/09/08 12:45:36 distinct = false
2023/09/08 12:45:36 Using n1ql client
2023/09/08 12:45:36 Expected and Actual scan responses are the same
2023/09/08 12:45:36
--- OverlappingRanges ---
2023/09/08 12:45:36 distinct = false
2023/09/08 12:45:36 Using n1ql client
2023/09/08 12:45:36 Expected and Actual scan responses are the same
2023/09/08 12:45:36
--- NonOverlappingFilters ---
2023/09/08 12:45:36 distinct = false
2023/09/08 12:45:37 Using n1ql client
2023/09/08 12:45:37 Expected and Actual scan responses are the same
2023/09/08 12:45:37
--- OverlappingFilters ---
2023/09/08 12:45:37 distinct = false
2023/09/08 12:45:37 Using n1ql client
2023/09/08 12:45:37 Expected and Actual scan responses are the same
2023/09/08 12:45:37
--- BoundaryFilters ---
2023/09/08 12:45:37 distinct = false
2023/09/08 12:45:38 Using n1ql client
2023/09/08 12:45:38 Expected and Actual scan responses are the same
2023/09/08 12:45:38
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:45:38 distinct = false
2023/09/08 12:45:38 Using n1ql client
2023/09/08 12:45:38 Expected and Actual scan responses are the same
2023/09/08 12:45:38
--- SeekAndFilters_Overlapping ---
2023/09/08 12:45:38 distinct = false
2023/09/08 12:45:39 Using n1ql client
2023/09/08 12:45:39 Expected and Actual scan responses are the same
2023/09/08 12:45:39
--- SimpleRangeLowUnbounded ---
2023/09/08 12:45:39 distinct = false
2023/09/08 12:45:39 Using n1ql client
2023/09/08 12:45:39 Expected and Actual scan responses are the same
2023/09/08 12:45:39
--- SimpleRangeHighUnbounded ---
2023/09/08 12:45:39 distinct = false
2023/09/08 12:45:39 Using n1ql client
2023/09/08 12:45:40 Expected and Actual scan responses are the same
2023/09/08 12:45:40
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:45:40 distinct = false
2023/09/08 12:45:40 Using n1ql client
2023/09/08 12:45:40 Expected and Actual scan responses are the same
2023/09/08 12:45:40
--- FiltersWithUnbounded ---
2023/09/08 12:45:40 distinct = false
2023/09/08 12:45:40 Using n1ql client
2023/09/08 12:45:40 Expected and Actual scan responses are the same
2023/09/08 12:45:40
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:45:40 distinct = false
2023/09/08 12:45:41 Using n1ql client
2023/09/08 12:45:41 Expected and Actual scan responses are the same
2023/09/08 12:45:41
--------- Simple Index with 1 field ---------
2023/09/08 12:45:41
--- SingleIndexSimpleRange ---
2023/09/08 12:45:41 distinct = false
2023/09/08 12:45:41 Using n1ql client
2023/09/08 12:45:41 Expected and Actual scan responses are the same
2023/09/08 12:45:41
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/08 12:45:41 distinct = false
2023/09/08 12:45:42 Using n1ql client
2023/09/08 12:45:42 Expected and Actual scan responses are the same
2023/09/08 12:45:42
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/08 12:45:42 distinct = false
2023/09/08 12:45:42 Using n1ql client
2023/09/08 12:45:42 Expected and Actual scan responses are the same
2023/09/08 12:45:42
--------- Composite Index with 3 fields ---------
2023/09/08 12:45:42
--- ScanAllNoFilter ---
2023/09/08 12:45:42 distinct = false
2023/09/08 12:45:42 Using n1ql client
2023/09/08 12:45:43 Expected and Actual scan responses are the same
2023/09/08 12:45:43
--- ScanAllFilterNil ---
2023/09/08 12:45:43 distinct = false
2023/09/08 12:45:43 Using n1ql client
2023/09/08 12:45:43 Expected and Actual scan responses are the same
2023/09/08 12:45:43
--- ScanAll_AllFiltersNil ---
2023/09/08 12:45:43 distinct = false
2023/09/08 12:45:43 Using n1ql client
2023/09/08 12:45:44 Expected and Actual scan responses are the same
2023/09/08 12:45:44
--- 3FieldsSingleSeek ---
2023/09/08 12:45:44 distinct = false
2023/09/08 12:45:44 Using n1ql client
2023/09/08 12:45:44 Expected and Actual scan responses are the same
2023/09/08 12:45:44
--- 3FieldsMultipleSeeks ---
2023/09/08 12:45:44 distinct = false
2023/09/08 12:45:45 Using n1ql client
2023/09/08 12:45:45 Expected and Actual scan responses are the same
2023/09/08 12:45:45
--- 3FieldsMultipleSeeks_Identical ---
2023/09/08 12:45:45 distinct = false
2023/09/08 12:45:45 Using n1ql client
2023/09/08 12:45:45 Expected and Actual scan responses are the same
2023/09/08 12:45:45
--------- New scenarios ---------
2023/09/08 12:45:45
--- CompIndexHighUnbounded1 ---
2023/09/08 12:45:45
--- Multi Scan 0 ---
2023/09/08 12:45:45 distinct = false
2023/09/08 12:45:45 Using n1ql client
2023/09/08 12:45:45 Expected and Actual scan responses are the same
2023/09/08 12:45:45
--- Multi Scan 1 ---
2023/09/08 12:45:45 distinct = false
2023/09/08 12:45:46 Using n1ql client
2023/09/08 12:45:46 Expected and Actual scan responses are the same
2023/09/08 12:45:46
--- Multi Scan 2 ---
2023/09/08 12:45:46 distinct = false
2023/09/08 12:45:46 Using n1ql client
2023/09/08 12:45:46 Expected and Actual scan responses are the same
2023/09/08 12:45:46
--- CompIndexHighUnbounded2 ---
2023/09/08 12:45:46
--- Multi Scan 0 ---
2023/09/08 12:45:46 distinct = false
2023/09/08 12:45:47 Using n1ql client
2023/09/08 12:45:47 Expected and Actual scan responses are the same
2023/09/08 12:45:47
--- Multi Scan 1 ---
2023/09/08 12:45:47 distinct = false
2023/09/08 12:45:47 Using n1ql client
2023/09/08 12:45:47 Expected and Actual scan responses are the same
2023/09/08 12:45:47
--- Multi Scan 2 ---
2023/09/08 12:45:47 distinct = false
2023/09/08 12:45:47 Using n1ql client
2023/09/08 12:45:48 Expected and Actual scan responses are the same
2023/09/08 12:45:48
--- CompIndexHighUnbounded3 ---
2023/09/08 12:45:48
--- Multi Scan 0 ---
2023/09/08 12:45:48 distinct = false
2023/09/08 12:45:48 Using n1ql client
2023/09/08 12:45:48 Expected and Actual scan responses are the same
2023/09/08 12:45:48
--- CompIndexHighUnbounded4 ---
2023/09/08 12:45:48
--- Multi Scan 0 ---
2023/09/08 12:45:48 distinct = false
2023/09/08 12:45:48 Using n1ql client
2023/09/08 12:45:48 Expected and Actual scan responses are the same
2023/09/08 12:45:48
--- CompIndexHighUnbounded5 ---
2023/09/08 12:45:48
--- Multi Scan 0 ---
2023/09/08 12:45:48 distinct = false
2023/09/08 12:45:49 Using n1ql client
2023/09/08 12:45:49 Expected and Actual scan responses are the same
2023/09/08 12:45:49
--- SeekBoundaries ---
2023/09/08 12:45:49
--- Multi Scan 0 ---
2023/09/08 12:45:49 distinct = false
2023/09/08 12:45:49 Using n1ql client
2023/09/08 12:45:49 Expected and Actual scan responses are the same
2023/09/08 12:45:49
--- Multi Scan 1 ---
2023/09/08 12:45:49 distinct = false
2023/09/08 12:45:50 Using n1ql client
2023/09/08 12:45:50 Expected and Actual scan responses are the same
2023/09/08 12:45:50
--- Multi Scan 2 ---
2023/09/08 12:45:50 distinct = false
2023/09/08 12:45:50 Using n1ql client
2023/09/08 12:45:50 Expected and Actual scan responses are the same
2023/09/08 12:45:50
--- Multi Scan 3 ---
2023/09/08 12:45:50 distinct = false
2023/09/08 12:45:50 Using n1ql client
2023/09/08 12:45:50 Expected and Actual scan responses are the same
2023/09/08 12:45:50
--- Multi Scan 4 ---
2023/09/08 12:45:50 distinct = false
2023/09/08 12:45:51 Using n1ql client
2023/09/08 12:45:51 Expected and Actual scan responses are the same
2023/09/08 12:45:51
--- Multi Scan 5 ---
2023/09/08 12:45:51 distinct = false
2023/09/08 12:45:51 Using n1ql client
2023/09/08 12:45:51 Expected and Actual scan responses are the same
2023/09/08 12:45:51
--- Multi Scan 6 ---
2023/09/08 12:45:51 distinct = false
2023/09/08 12:45:52 Using n1ql client
2023/09/08 12:45:52 Expected and Actual scan responses are the same
2023/09/08 12:45:52
--- Multi Scan 7 ---
2023/09/08 12:45:52 distinct = false
2023/09/08 12:45:52 Using n1ql client
2023/09/08 12:45:52 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescScenarios (19.45s)
=== RUN TestMultiScanDescCount
2023/09/08 12:45:52 In TestMultiScanDescCount()
2023/09/08 12:45:52
--------- Composite Index with 2 fields ---------
2023/09/08 12:45:52
--- ScanAllNoFilter ---
2023/09/08 12:45:52 distinct = false
2023/09/08 12:45:53 Using n1ql client
2023/09/08 12:45:53 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:45:53
--- ScanAllFilterNil ---
2023/09/08 12:45:53 distinct = false
2023/09/08 12:45:53 Using n1ql client
2023/09/08 12:45:53 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:45:53
--- ScanAll_AllFiltersNil ---
2023/09/08 12:45:53 distinct = false
2023/09/08 12:45:53 Using n1ql client
2023/09/08 12:45:53 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:45:53
--- SingleSeek ---
2023/09/08 12:45:53 distinct = false
2023/09/08 12:45:54 Using n1ql client
2023/09/08 12:45:54 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:45:54
--- MultipleSeek ---
2023/09/08 12:45:54 distinct = false
2023/09/08 12:45:54 Using n1ql client
2023/09/08 12:45:54 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/08 12:45:54
--- SimpleRange ---
2023/09/08 12:45:54 distinct = false
2023/09/08 12:45:55 Using n1ql client
2023/09/08 12:45:55 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/08 12:45:55
--- NonOverlappingRanges ---
2023/09/08 12:45:55 distinct = false
2023/09/08 12:45:55 Using n1ql client
2023/09/08 12:45:55 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2023/09/08 12:45:55
--- OverlappingRanges ---
2023/09/08 12:45:55 distinct = false
2023/09/08 12:45:56 Using n1ql client
2023/09/08 12:45:56 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2023/09/08 12:45:56
--- NonOverlappingFilters ---
2023/09/08 12:45:56 distinct = false
2023/09/08 12:45:56 Using n1ql client
2023/09/08 12:45:56 MultiScanCount = 337 ExpectedMultiScanCount = 337
2023/09/08 12:45:56
--- OverlappingFilters ---
2023/09/08 12:45:56 distinct = false
2023/09/08 12:45:56 Using n1ql client
2023/09/08 12:45:56 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2023/09/08 12:45:56
--- BoundaryFilters ---
2023/09/08 12:45:56 distinct = false
2023/09/08 12:45:57 Using n1ql client
2023/09/08 12:45:57 MultiScanCount = 499 ExpectedMultiScanCount = 499
2023/09/08 12:45:57
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:45:57 distinct = false
2023/09/08 12:45:57 Using n1ql client
2023/09/08 12:45:57 MultiScanCount = 256 ExpectedMultiScanCount = 256
2023/09/08 12:45:57
--- SeekAndFilters_Overlapping ---
2023/09/08 12:45:57 distinct = false
2023/09/08 12:45:58 Using n1ql client
2023/09/08 12:45:58 MultiScanCount = 255 ExpectedMultiScanCount = 255
2023/09/08 12:45:58
--- SimpleRangeLowUnbounded ---
2023/09/08 12:45:58 distinct = false
2023/09/08 12:45:58 Using n1ql client
2023/09/08 12:45:58 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/08 12:45:58
--- SimpleRangeHighUnbounded ---
2023/09/08 12:45:58 distinct = false
2023/09/08 12:45:58 Using n1ql client
2023/09/08 12:45:58 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/08 12:45:58
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:45:58 distinct = false
2023/09/08 12:45:59 Using n1ql client
2023/09/08 12:45:59 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:45:59
--- FiltersWithUnbounded ---
2023/09/08 12:45:59 distinct = false
2023/09/08 12:45:59 Using n1ql client
2023/09/08 12:45:59 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/08 12:45:59
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:45:59 distinct = false
2023/09/08 12:46:00 Using n1ql client
2023/09/08 12:46:00 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/08 12:46:00
--------- Simple Index with 1 field ---------
2023/09/08 12:46:00
--- SingleIndexSimpleRange ---
2023/09/08 12:46:00 distinct = false
2023/09/08 12:46:00 Using n1ql client
2023/09/08 12:46:00 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2023/09/08 12:46:00
--- SingleIndex_SimpleRanges_NonOverlapping ---
2023/09/08 12:46:00 distinct = false
2023/09/08 12:46:00 Using n1ql client
2023/09/08 12:46:00 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2023/09/08 12:46:00
--- SingleIndex_SimpleRanges_Overlapping ---
2023/09/08 12:46:00 distinct = false
2023/09/08 12:46:01 Using n1ql client
2023/09/08 12:46:01 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2023/09/08 12:46:01
--------- Composite Index with 3 fields ---------
2023/09/08 12:46:01
--- ScanAllNoFilter ---
2023/09/08 12:46:01 distinct = false
2023/09/08 12:46:01 Using n1ql client
2023/09/08 12:46:01 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:46:01
--- ScanAllFilterNil ---
2023/09/08 12:46:01 distinct = false
2023/09/08 12:46:02 Using n1ql client
2023/09/08 12:46:02 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:46:02
--- ScanAll_AllFiltersNil ---
2023/09/08 12:46:02 distinct = false
2023/09/08 12:46:02 Using n1ql client
2023/09/08 12:46:02 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:46:02
--- 3FieldsSingleSeek ---
2023/09/08 12:46:02 distinct = false
2023/09/08 12:46:03 Using n1ql client
2023/09/08 12:46:03 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:46:03
--- 3FieldsMultipleSeeks ---
2023/09/08 12:46:03 distinct = false
2023/09/08 12:46:03 Using n1ql client
2023/09/08 12:46:03 MultiScanCount = 3 ExpectedMultiScanCount = 3
2023/09/08 12:46:03
--- 3FieldsMultipleSeeks_Identical ---
2023/09/08 12:46:03 distinct = false
2023/09/08 12:46:04 Using n1ql client
2023/09/08 12:46:04 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/08 12:46:04
--------- New scenarios ---------
2023/09/08 12:46:04
--- CompIndexHighUnbounded1 ---
2023/09/08 12:46:04
--- Multi Scan 0 ---
2023/09/08 12:46:04 distinct = false
2023/09/08 12:46:04 Using n1ql client
2023/09/08 12:46:04 Using n1ql client
2023/09/08 12:46:04 len(scanResults) = 8 MultiScanCount = 8
2023/09/08 12:46:04 Expected and Actual scan responses are the same
2023/09/08 12:46:04
--- Multi Scan 1 ---
2023/09/08 12:46:04 distinct = false
2023/09/08 12:46:04 Using n1ql client
2023/09/08 12:46:04 Using n1ql client
2023/09/08 12:46:04 len(scanResults) = 0 MultiScanCount = 0
2023/09/08 12:46:04 Expected and Actual scan responses are the same
2023/09/08 12:46:04
--- Multi Scan 2 ---
2023/09/08 12:46:04 distinct = false
2023/09/08 12:46:05 Using n1ql client
2023/09/08 12:46:05 Using n1ql client
2023/09/08 12:46:05 len(scanResults) = 9 MultiScanCount = 9
2023/09/08 12:46:05 Expected and Actual scan responses are the same
2023/09/08 12:46:05
--- CompIndexHighUnbounded2 ---
2023/09/08 12:46:05
--- Multi Scan 0 ---
2023/09/08 12:46:05 distinct = false
2023/09/08 12:46:05 Using n1ql client
2023/09/08 12:46:05 Using n1ql client
2023/09/08 12:46:05 len(scanResults) = 4138 MultiScanCount = 4138
2023/09/08 12:46:05 Expected and Actual scan responses are the same
2023/09/08 12:46:05
--- Multi Scan 1 ---
2023/09/08 12:46:05 distinct = false
2023/09/08 12:46:06 Using n1ql client
2023/09/08 12:46:06 Using n1ql client
2023/09/08 12:46:06 len(scanResults) = 2746 MultiScanCount = 2746
2023/09/08 12:46:06 Expected and Actual scan responses are the same
2023/09/08 12:46:06
--- Multi Scan 2 ---
2023/09/08 12:46:06 distinct = false
2023/09/08 12:46:06 Using n1ql client
2023/09/08 12:46:06 Using n1ql client
2023/09/08 12:46:06 len(scanResults) = 4691 MultiScanCount = 4691
2023/09/08 12:46:06 Expected and Actual scan responses are the same
2023/09/08 12:46:06
--- CompIndexHighUnbounded3 ---
2023/09/08 12:46:06
--- Multi Scan 0 ---
2023/09/08 12:46:06 distinct = false
2023/09/08 12:46:07 Using n1ql client
2023/09/08 12:46:07 Using n1ql client
2023/09/08 12:46:07 len(scanResults) = 1329 MultiScanCount = 1329
2023/09/08 12:46:07 Expected and Actual scan responses are the same
2023/09/08 12:46:07
--- CompIndexHighUnbounded4 ---
2023/09/08 12:46:07
--- Multi Scan 0 ---
2023/09/08 12:46:07 distinct = false
2023/09/08 12:46:07 Using n1ql client
2023/09/08 12:46:07 Using n1ql client
2023/09/08 12:46:07 len(scanResults) = 5349 MultiScanCount = 5349
2023/09/08 12:46:07 Expected and Actual scan responses are the same
2023/09/08 12:46:07
--- CompIndexHighUnbounded5 ---
2023/09/08 12:46:07
--- Multi Scan 0 ---
2023/09/08 12:46:07 distinct = false
2023/09/08 12:46:07 Using n1ql client
2023/09/08 12:46:08 Using n1ql client
2023/09/08 12:46:08 len(scanResults) = 8210 MultiScanCount = 8210
2023/09/08 12:46:08 Expected and Actual scan responses are the same
2023/09/08 12:46:08
--- SeekBoundaries ---
2023/09/08 12:46:08
--- Multi Scan 0 ---
2023/09/08 12:46:08 distinct = false
2023/09/08 12:46:08 Using n1ql client
2023/09/08 12:46:08 Using n1ql client
2023/09/08 12:46:08 len(scanResults) = 175 MultiScanCount = 175
2023/09/08 12:46:08 Expected and Actual scan responses are the same
2023/09/08 12:46:08
--- Multi Scan 1 ---
2023/09/08 12:46:08 distinct = false
2023/09/08 12:46:08 Using n1ql client
2023/09/08 12:46:08 Using n1ql client
2023/09/08 12:46:08 len(scanResults) = 1 MultiScanCount = 1
2023/09/08 12:46:08 Expected and Actual scan responses are the same
2023/09/08 12:46:08
--- Multi Scan 2 ---
2023/09/08 12:46:08 distinct = false
2023/09/08 12:46:09 Using n1ql client
2023/09/08 12:46:09 Using n1ql client
2023/09/08 12:46:09 len(scanResults) = 555 MultiScanCount = 555
2023/09/08 12:46:09 Expected and Actual scan responses are the same
2023/09/08 12:46:09
--- Multi Scan 3 ---
2023/09/08 12:46:09 distinct = false
2023/09/08 12:46:09 Using n1ql client
2023/09/08 12:46:09 Using n1ql client
2023/09/08 12:46:09 len(scanResults) = 872 MultiScanCount = 872
2023/09/08 12:46:09 Expected and Actual scan responses are the same
2023/09/08 12:46:09
--- Multi Scan 4 ---
2023/09/08 12:46:09 distinct = false
2023/09/08 12:46:10 Using n1ql client
2023/09/08 12:46:10 Using n1ql client
2023/09/08 12:46:10 len(scanResults) = 287 MultiScanCount = 287
2023/09/08 12:46:10 Expected and Actual scan responses are the same
2023/09/08 12:46:10
--- Multi Scan 5 ---
2023/09/08 12:46:10 distinct = false
2023/09/08 12:46:10 Using n1ql client
2023/09/08 12:46:10 Using n1ql client
2023/09/08 12:46:10 len(scanResults) = 5254 MultiScanCount = 5254
2023/09/08 12:46:10 Expected and Actual scan responses are the same
2023/09/08 12:46:10
--- Multi Scan 6 ---
2023/09/08 12:46:10 distinct = false
2023/09/08 12:46:11 Using n1ql client
2023/09/08 12:46:11 Using n1ql client
2023/09/08 12:46:11 len(scanResults) = 5566 MultiScanCount = 5566
2023/09/08 12:46:11 Expected and Actual scan responses are the same
2023/09/08 12:46:11
--- Multi Scan 7 ---
2023/09/08 12:46:11 distinct = false
2023/09/08 12:46:11 Using n1ql client
2023/09/08 12:46:11 Using n1ql client
2023/09/08 12:46:11 len(scanResults) = 8 MultiScanCount = 8
2023/09/08 12:46:11 Expected and Actual scan responses are the same
2023/09/08 12:46:11
--------- With DISTINCT True ---------
2023/09/08 12:46:11
--- ScanAllNoFilter ---
2023/09/08 12:46:11 distinct = true
2023/09/08 12:46:11 Using n1ql client
2023/09/08 12:46:11 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:46:11
--- ScanAllFilterNil ---
2023/09/08 12:46:11 distinct = true
2023/09/08 12:46:12 Using n1ql client
2023/09/08 12:46:12 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:46:12
--- ScanAll_AllFiltersNil ---
2023/09/08 12:46:12 distinct = true
2023/09/08 12:46:12 Using n1ql client
2023/09/08 12:46:12 MultiScanCount = 999 ExpectedMultiScanCount = 999
2023/09/08 12:46:12
--- SingleSeek ---
2023/09/08 12:46:12 distinct = true
2023/09/08 12:46:13 Using n1ql client
2023/09/08 12:46:13 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:46:13
--- MultipleSeek ---
2023/09/08 12:46:13 distinct = true
2023/09/08 12:46:13 Using n1ql client
2023/09/08 12:46:13 MultiScanCount = 2 ExpectedMultiScanCount = 2
2023/09/08 12:46:13
--- SimpleRange ---
2023/09/08 12:46:13 distinct = true
2023/09/08 12:46:14 Using n1ql client
2023/09/08 12:46:14 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/08 12:46:14
--- NonOverlappingRanges ---
2023/09/08 12:46:14 distinct = true
2023/09/08 12:46:14 Using n1ql client
2023/09/08 12:46:14 MultiScanCount = 428 ExpectedMultiScanCount = 428
2023/09/08 12:46:14
--- NonOverlappingFilters2 ---
2023/09/08 12:46:14 distinct = true
2023/09/08 12:46:14 Using n1ql client
2023/09/08 12:46:14 MultiScanCount = 1 ExpectedMultiScanCount = 1
2023/09/08 12:46:14
--- OverlappingRanges ---
2023/09/08 12:46:14 distinct = true
2023/09/08 12:46:15 Using n1ql client
2023/09/08 12:46:15 MultiScanCount = 575 ExpectedMultiScanCount = 575
2023/09/08 12:46:15
--- NonOverlappingFilters ---
2023/09/08 12:46:15 distinct = true
2023/09/08 12:46:16 Using n1ql client
2023/09/08 12:46:16 MultiScanCount = 186 ExpectedMultiScanCount = 186
2023/09/08 12:46:16
--- OverlappingFilters ---
2023/09/08 12:46:16 distinct = true
2023/09/08 12:46:16 Using n1ql client
2023/09/08 12:46:16 MultiScanCount = 543 ExpectedMultiScanCount = 543
2023/09/08 12:46:16
--- BoundaryFilters ---
2023/09/08 12:46:16 distinct = true
2023/09/08 12:46:17 Using n1ql client
2023/09/08 12:46:17 MultiScanCount = 172 ExpectedMultiScanCount = 172
2023/09/08 12:46:17
--- SeekAndFilters_NonOverlapping ---
2023/09/08 12:46:17 distinct = true
2023/09/08 12:46:17 Using n1ql client
2023/09/08 12:46:17 MultiScanCount = 135 ExpectedMultiScanCount = 135
2023/09/08 12:46:17
--- SeekAndFilters_Overlapping ---
2023/09/08 12:46:17 distinct = true
2023/09/08 12:46:18 Using n1ql client
2023/09/08 12:46:18 MultiScanCount = 134 ExpectedMultiScanCount = 134
2023/09/08 12:46:18
--- SimpleRangeLowUnbounded ---
2023/09/08 12:46:18 distinct = false
2023/09/08 12:46:18 Using n1ql client
2023/09/08 12:46:18 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2023/09/08 12:46:18
--- SimpleRangeHighUnbounded ---
2023/09/08 12:46:18 distinct = false
2023/09/08 12:46:18 Using n1ql client
2023/09/08 12:46:18 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2023/09/08 12:46:18
--- SimpleRangeMultipleUnbounded ---
2023/09/08 12:46:18 distinct = false
2023/09/08 12:46:19 Using n1ql client
2023/09/08 12:46:19 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2023/09/08 12:46:19
--- FiltersWithUnbounded ---
2023/09/08 12:46:19 distinct = false
2023/09/08 12:46:19 Using n1ql client
2023/09/08 12:46:19 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2023/09/08 12:46:19
--- FiltersLowGreaterThanHigh ---
2023/09/08 12:46:19 distinct = false
2023/09/08 12:46:20 Using n1ql client
2023/09/08 12:46:20 MultiScanCount = 418 ExpectedMultiScanCount = 418
2023/09/08 12:46:20
--------- Simple Index with 1 field ---------
2023/09/08 12:46:20
--- SingleIndexSimpleRange ---
2023/09/08 12:46:20 distinct = true
2023/09/08 12:46:20 Using n1ql client
2023/09/08 12:46:20 MultiScanCount = 227 ExpectedMultiScanCount = 227
2023/09/08 12:46:20
--- SingleIndex