Building

Started building at 2022/08/04 22:31:57
Using pegged server, 1739 build
Calculating base
Updating mirror
Basing run on 7.2.0-1739 eddcdf9fd
Updating tree for run 04.08.2022-22.31
query is at b2ca880, changes since last good build: none
gometa is at a237ed7, changes since last good build: 

ns_server is at f2c62fe, changes since last good build: none
couchstore is at 20545dc, changes since last good build: none
forestdb is at acba458, changes since last good build: none
kv_engine is at fde39ad, changes since last good build: none
Switching indexing to unstable
indexing is at 6400782, changes since last good build: none
Switching plasma to unstable
plasma is at 0068bd9, changes since last good build: 
fatal: Invalid revision range 98b15f37e4dc23f1d1992828125f57d06e31601d..HEAD

Switching nitro to unstable
nitro is at 966c610, changes since last good build: none
Switching gometa to master
gometa is at 05cb6b2, changes since last good build: none
Switching testrunner to master
Submodule 'gauntlet' (https://github.com/pavithra-mahamani/gauntlet) registered for path 'gauntlet'
Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client'
Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI'
Cloning into '/opt/build/testrunner/gauntlet'...
Cloning into '/opt/build/testrunner/java_sdk_client'...
Cloning into '/opt/build/testrunner/lib/capellaAPI'...
fatal: Could not chdir to '../../../gauntlet': No such file or directory
Unable to fetch in submodule path 'gauntlet'
testrunner is at f196cc1, changes since last good build: none
Pulling in uncommitted change 177770 at refs/changes/70/177770/6
Total 5 (delta 4), reused 5 (delta 4)
[unstable 03281b8e] Add more logging when inserting nil value into back store
 Author: Varun Velamuri 
 Date: Wed Jul 20 14:51:23 2022 +0530
 1 file changed, 33 insertions(+), 1 deletion(-)
Pulling in uncommitted change 177779 at refs/changes/79/177779/3
Total 11 (delta 8), reused 10 (delta 8)
[unstable 92091cbc] WIP: MB-47409: Log nil values in NodeTable
 Author: akhilmd 
 Date: Wed Jul 20 16:40:09 2022 +0530
 1 file changed, 57 insertions(+), 3 deletions(-)
Pulling in uncommitted change 177823 at refs/changes/23/177823/4
Total 8 (delta 1), reused 1 (delta 1)
[unstable 6c543a9f] enable Integration tests fixing testrunner repo clone
 Author: Dhruvil Shah 
 Date: Thu Jul 21 15:07:20 2022 +0530
 2 files changed, 7 insertions(+), 9 deletions(-)
Pulling in uncommitted change 178354 at refs/changes/54/178354/4
Total 12 (delta 8), reused 12 (delta 8)
[unstable 53d1352d] MB-52308 Part 5 (7.2.0 1739) Elixir Pause-Resume feature for GSI
 Author: cherkauer-couchbase 
 Date: Tue Aug 2 14:11:35 2022 -0700
 5 files changed, 425 insertions(+), 213 deletions(-)
 create mode 100644 secondary/indexer/pause_objutil.go
Pulling in uncommitted change 177256 at refs/changes/56/177256/2
Total 3 (delta 2), reused 3 (delta 2)
[unstable b91a8a5] MB-51993: Fix Timeout in TestAutoTuneFlushBufferGetUsedMemory
 Author: saptarshi.sen 
 Date: Thu Jul 7 18:41:49 2022 -0700
 1 file changed, 22 insertions(+), 1 deletion(-)
Pulling in uncommitted change 177516 at refs/changes/16/177516/11
Total 18 (delta 10), reused 15 (delta 10)
[unstable a1d4744] MB-52020: Add LSS Snapshot & Copy
 Author: saptarshi.sen 
 Date: Wed Jul 13 12:49:15 2022 -0700
 7 files changed, 1129 insertions(+), 6 deletions(-)
Pulling in uncommitted change 177517 at refs/changes/17/177517/13
Total 23 (delta 12), reused 18 (delta 12)
[unstable db86d48] MB-52020: Add Shard Snapshot, Copy & Restore on LFS
 Author: saptarshi.sen 
 Date: Wed Jul 13 12:56:46 2022 -0700
 3 files changed, 1638 insertions(+), 3 deletions(-)
Pulling in uncommitted change 177518 at refs/changes/18/177518/12
Total 27 (delta 19), reused 26 (delta 19)
[unstable 87e8b01] MB-52020: Add Tenant Copy
 Author: saptarshi.sen 
 Date: Wed Jul 13 13:06:22 2022 -0700
 2 files changed, 75 insertions(+)
Pulling in uncommitted change 177642 at refs/changes/42/177642/1
Total 7 (delta 4), reused 6 (delta 4)
[unstable 4aa01da] MB-51993: Fix negative global flush buffer memory usage
 Author: saptarshi.sen 
 Date: Fri Jul 15 20:58:04 2022 -0700
 2 files changed, 92 insertions(+), 4 deletions(-)
Pulling in uncommitted change 177643 at refs/changes/43/177643/1
Total 10 (delta 5), reused 8 (delta 5)
[unstable fe0b399] MB-51993: Handle invalid autotuner flush buffer config
 Author: saptarshi.sen 
 Date: Fri Jul 15 21:03:34 2022 -0700
 1 file changed, 27 insertions(+), 17 deletions(-)
Pulling in uncommitted change 177644 at refs/changes/44/177644/1
Total 14 (delta 10), reused 14 (delta 10)
[unstable 2c29610] MB-51993: Add autotuner test channel to reduce CI runtime
 Author: saptarshi.sen 
 Date: Fri Jul 15 21:06:52 2022 -0700
 2 files changed, 319 insertions(+), 294 deletions(-)
Building community edition
Building cmakefiles and deps [CE]
Building main product [CE]

... A new version of repo (2.21) is available.
... You should upgrade soon:
    cp /opt/build/.repo/repo/repo /home/buildbot/bin/repo


... A new version of repo (2.21) is available.
... You should upgrade soon:
    cp /opt/build/.repo/repo/repo /home/buildbot/bin/repo

Build CE finished
BUILD_ENTERPRISE empty. Building enterprise edition
Building Enterprise Edition
Building cmakefiles and deps [EE]
Building main product [EE]

... A new version of repo (2.21) is available.
... You should upgrade soon:
    cp /opt/build/.repo/repo/repo /home/buildbot/bin/repo


... A new version of repo (2.21) is available.
... You should upgrade soon:
    cp /opt/build/.repo/repo/repo /home/buildbot/bin/repo

Build EE finished
Disabled integration tests

Testing

Started testing at 2022/08/04 23:18:09
Testing mode: sanity,unit,functional,integration
Using storage type: memdb
Setting ulimit to 200000

Simple Test

Aug 04 23:18:31 b" 'stop_on_failure': 'True'}"
Aug 04 23:18:31 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Aug 04 23:18:31 b"{'nodes_in': '3', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 1, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Aug-04_23-18-30/test_1'}"
Aug 04 23:18:31 b'-->result: '
Aug 04 23:18:31 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 1'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,bucket_type=ephemeral,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Aug 04 23:18:31 b"{'nodes_in': '3', 'bucket_type': 'ephemeral', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 2, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Aug-04_23-18-30/test_2'}"
Aug 04 23:18:31 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 2'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t memcapable.WarmUpMemcachedTest.do_warmup_100k,get-logs-cluster-run=True'
Aug 04 23:18:31 b"{'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 3, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Aug-04_23-18-30/test_3'}"
Aug 04 23:18:31 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 2'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.createdeleteview.CreateDeleteViewTests.test_view_ops,ddoc_ops=create,test_with_view=True,num_ddocs=1,num_views_per_ddoc=10,items=1000,skip_cleanup=False,get-logs-cluster-run=True'
Aug 04 23:18:31 b"{'ddoc_ops': 'create', 'test_with_view': 'True', 'num_ddocs': '1', 'num_views_per_ddoc': '10', 'items': '1000', 'skip_cleanup': 'False', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 4, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Aug-04_23-18-30/test_4'}"
Aug 04 23:18:31 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 2'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 0 , fail 1'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,num_nodes_to_add=1,skip_rebalance=true,docs-per-day=1,timeout=1200,get-logs-cluster-run=True'
Aug 04 23:18:31 b"{'num_nodes_to_add': '1', 'skip_rebalance': 'true', 'docs-per-day': '1', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 5, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Aug-04_23-18-30/test_5'}"
Aug 04 23:18:31 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 2'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 0 , fail 1'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 0 , fail 1'
Aug 04 23:18:31 b'failures so far...'
Aug 04 23:18:31 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'ERROR
Aug 04 23:18:32 b"{'num-docs': '1000', 'skip_rebalance': 'true', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 6, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Aug-04_23-18-30/test_6'}"
Aug 04 23:18:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 2'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 0 , fail 1'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 0 , fail 2'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_ops,replicas=1,items=10000,value_size=128,ctopology=chain,rdirection=unidirection,doc-ops=update-delete,get-logs-cluster-run=True'
Aug 04 23:18:32 b"{'replicas': '1', 'items': '10000', 'value_size': '128', 'ctopology': 'chain', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 7, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Aug-04_23-18-30/test_7'}"
Aug 04 23:18:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 2'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 0 , fail 1'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 0 , fail 2'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 0 , fail 1'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Aug 04 23:18:32 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'total_testcases': 8, 'last_case_fail': 'True', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-22-Aug-04_23-18-30/test_8'}"
Aug 04 23:18:32 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 0 , fail 2'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 0 , fail 1'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 0 , fail 1'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 0 , fail 2'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 0 , fail 2'
Aug 04 23:18:32 b'failures so far...'
Aug 04 23:18:32 b'xdcr.uniXDCR.unidirectional.load_with_failover'
Aug 04 23:18:32 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Aug 04 23:18:32 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' fail ')"
Aug 04 23:18:32 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' fail ')"
Aug 04 23:18:32 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' fail ')"
Aug 04 23:18:32 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' fail ')"
Aug 04 23:18:32 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' fail ')"
Aug 04 23:18:32 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' fail ')"
Aug 04 23:18:32 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' fail ')"
Aug 04 23:18:32 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' fail ')"
Aug 04 23:18:32 Makefile:28: recipe for target 'simple-test' failed

Unit tests

=== RUN   TestMerger
--- PASS: TestMerger (0.03s)
=== RUN   TestInsert
--- PASS: TestInsert (0.00s)
=== RUN   TestInsertPerf
16000000 items took 23.756890205s -> 673488.8220610858 items/s conflicts 22
--- PASS: TestInsertPerf (23.76s)
=== RUN   TestGetPerf
16000000 items took 11.613787766s -> 1.3776728421747878e+06 items/s
--- PASS: TestGetPerf (12.20s)
=== RUN   TestGetRangeSplitItems
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3351,
"memory_used":            37360992,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 749144,
"level1": 187776,
"level2": 47222,
"level3": 11903,
"level4": 2974,
"level5": 735,
"level6": 182,
"level7": 48,
"level8": 12,
"level9": 2,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Split range keys [35911 108875 357987 462344 598654 671258 781160]
No of items in each range [35911 72964 249112 104357 136310 72604 109902 218840]
--- PASS: TestGetRangeSplitItems (0.60s)
=== RUN   TestBuilder
{
"node_count":             50000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3333,
"memory_used":            1866650928,
"node_allocs":            50000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 37500395,
"level1": 9374070,
"level2": 2344403,
"level3": 586130,
"level4": 146617,
"level5": 36338,
"level6": 9033,
"level7": 2299,
"level8": 539,
"level9": 123,
"level10": 39,
"level11": 9,
"level12": 5,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 7.085635823s to build 50000000 items, 7.05653e+06 items/sec
Took 393.486639ms to iterate 50000000 items
--- PASS: TestBuilder (7.48s)
=== RUN   TestNodeDCAS
--- PASS: TestNodeDCAS (0.00s)
PASS
ok  	github.com/couchbase/indexing/secondary/memdb/skiplist	44.269s
=== RUN   TestInsert
Set IO Concurrency: 716
--- PASS: TestInsert (0.01s)
=== RUN   TestInsertPerf
20000000 items took 46.473096125s -> 430356.52167881036 items/s snapshots_created 210 live_snapshots 1
--- PASS: TestInsertPerf (58.10s)
=== RUN   TestInsertDuplicates
--- PASS: TestInsertDuplicates (0.01s)
=== RUN   TestGetPerf
16000000 items took 10.98096119s -> 1.457067348036042e+06 items/s
--- PASS: TestGetPerf (12.66s)
=== RUN   TestLoadStoreDisk
Inserting 1000000 items took 1.38456162s
{
"node_count":             1000823,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       19,
"next_pointers_per_node": 1.3321,
"memory_used":            57318416,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 751447,
"level1": 187192,
"level2": 46585,
"level3": 11638,
"level4": 3014,
"level5": 692,
"level6": 197,
"level7": 43,
"level8": 11,
"level9": 2,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
2022-08-04T23:20:43.476+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[13993 76905 10400 18356 22435 90671 72144 46968 64672 88497 35295 30306 29389 51099 20411 328459]] total count [1000000] snap count [1000000] size per shard [[111944 615240 83200 146848 179480 725368 577152 375744 517376 707976 282360 242448 235112 408792 163288 2627672]] total size [8000000] memoryInUse [57318416]
Storing to disk took 328.581256ms
Loading from disk took 561.146824ms
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3330,
"memory_used":            57328080,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 749846,
"level1": 188082,
"level2": 46516,
"level3": 11661,
"level4": 2892,
"level5": 766,
"level6": 172,
"level7": 48,
"level8": 12,
"level9": 4,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestLoadStoreDisk (3.37s)
=== RUN   TestConcurrentLoadCloseFragmentation
Done Inserting 2000000 items
frag = NaN%
2022-08-04T23:20:48.641+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[8730 43186 176871 124369 42221 184442 66384 364233 98796 74106 133496 60338 266309 228029 53656 74834]] total count [2000000] snap count [2000006] size per shard [[69840 345488 1414968 994952 337768 1475536 531072 2913864 790368 592848 1067968 482704 2130472 1824232 429248 598672]] total size [16000000] memoryInUse [114660144]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentation (5.24s)
=== RUN   TestConcurrentLoadCloseFragmentationSmall
Done Inserting 10 items
frag = NaN%
2022-08-04T23:20:50.287+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationSmall (0.09s)
=== RUN   TestConcurrentLoadCloseFragmentationEmpty
Done Inserting 0 items
frag = NaN%
2022-08-04T23:20:50.372+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationEmpty (0.14s)
=== RUN   TestConcurrentCloseSingleNode
A
--- PASS: TestConcurrentCloseSingleNode (0.28s)
=== RUN   TestStoreDiskShutdown
Inserting 1000000 items took 1.304635741s
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       15,
"next_pointers_per_node": 1.3343,
"memory_used":            57349416,
"node_allocs":            999999,
"node_frees":             0,
"level_node_distribution":{
"level0": 749311,
"level1": 188161,
"level2": 46754,
"level3": 11766,
"level4": 3030,
"level5": 721,
"level6": 205,
"level7": 39,
"level8": 8,
"level9": 4,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
Prepare returns error:  MemDB instance has been shutdown
--- PASS: TestStoreDiskShutdown (2.31s)
=== RUN   TestDelete
{
"node_count":             10,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.1000,
"memory_used":            556,
"node_allocs":            10,
"node_frees":             0,
"level_node_distribution":{
"level0": 9,
"level1": 1,
"level2": 0,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
{
"node_count":             10,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3000,
"memory_used":            588,
"node_allocs":            20,
"node_frees":             10,
"level_node_distribution":{
"level0": 7,
"level1": 3,
"level2": 0,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestDelete (1.01s)
=== RUN   TestGCPerf
final_node_count = 16000, average_live_node_count = 67577, wait_time_for_collection = 20ms
--- PASS: TestGCPerf (34.87s)
=== RUN   TestMemoryInUse
ItemsCount: 5000, MemoryInUse: 297264, NodesCount: 5000
ItemsCount: 0, MemoryInUse: 64, NodesCount: 0
--- PASS: TestMemoryInUse (1.01s)
=== RUN   TestFullScan
Inserting 1600000 items took 2.324654282s
{
"node_count":             1600000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       9,
"next_pointers_per_node": 1.3339,
"memory_used":            91747984,
"node_allocs":            1599999,
"node_frees":             0,
"level_node_distribution":{
"level0": 1199337,
"level1": 300431,
"level2": 75180,
"level3": 18778,
"level4": 4736,
"level5": 1174,
"level6": 257,
"level7": 88,
"level8": 19,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Full iteration of 1600000 items took 326.957064ms
--- PASS: TestFullScan (3.70s)
=== RUN   TestVisitor
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3332,
"memory_used":            57331888,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 749884,
"level1": 187599,
"level2": 47021,
"level3": 11654,
"level4": 2886,
"level5": 718,
"level6": 174,
"level7": 52,
"level8": 10,
"level9": 2,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 44.17093ms to iterate 1000000 items, 2.2639324e+07 items/s
shard - 0 count = 39448, range: 0-39447
shard - 1 count = 27517, range: 39448-66964
shard - 2 count = 20666, range: 66965-87630
shard - 3 count = 30935, range: 87631-118565
shard - 4 count = 60913, range: 118566-179478
shard - 5 count = 55019, range: 179479-234497
shard - 6 count = 21442, range: 234498-255939
shard - 7 count = 14069, range: 255940-270008
shard - 8 count = 86656, range: 270009-356664
shard - 9 count = 15401, range: 356665-372065
shard - 10 count = 6344, range: 372066-378409
shard - 11 count = 17684, range: 378410-396093
shard - 12 count = 23112, range: 396094-419205
shard - 13 count = 42109, range: 419206-461314
shard - 14 count = 14719, range: 461315-476033
shard - 15 count = 23095, range: 476034-499128
shard - 16 count = 14885, range: 499129-514013
shard - 17 count = 14565, range: 514014-528578
shard - 18 count = 27603, range: 528579-556181
shard - 19 count = 25262, range: 556182-581443
shard - 20 count = 45099, range: 581444-626542
shard - 21 count = 6420, range: 626543-632962
shard - 22 count = 13711, range: 632963-646673
shard - 23 count = 45358, range: 646674-692031
shard - 24 count = 20184, range: 692032-712215
shard - 25 count = 19563, range: 712216-731778
shard - 26 count = 15569, range: 731779-747347
shard - 27 count = 16975, range: 747348-764322
shard - 28 count = 42641, range: 764323-806963
shard - 29 count = 15222, range: 806964-822185
shard - 30 count = 71571, range: 822186-893756
shard - 31 count = 106243, range: 893757-999999
--- PASS: TestVisitor (1.29s)
=== RUN   TestVisitorError
--- PASS: TestVisitorError (0.11s)
=== RUN   TestLoadDeltaStoreDisk
snap count = 1000000
2022-08-04T23:21:38.769+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 120049 207865 239150 91080 95915 169814 76127 0 0 0]] total count [1000000] snap count [1000000] size per shard [[0 0 0 0 0 0 960392 1662920 1913200 728640 767320 1358512 609016 0 0 0]] total size [8000000] memoryInUse [121806440]
Storing to disk took 14.891231746s
Loading from disk took 743.632208ms
{
"node_count":             1000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       0,
"next_pointers_per_node": 1.3332,
"memory_used":            57330448,
"node_allocs":            1000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 750069,
"level1": 187471,
"level2": 46956,
"level3": 11562,
"level4": 2954,
"level5": 739,
"level6": 187,
"level7": 49,
"level8": 10,
"level9": 2,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Restored 0
RestoredFailed 414909
--- PASS: TestLoadDeltaStoreDisk (17.44s)
=== RUN   TestExecuteConcurrGCWorkers
--- PASS: TestExecuteConcurrGCWorkers (0.92s)
=== RUN   TestCloseWithActiveIterators
--- PASS: TestCloseWithActiveIterators (6.38s)
=== RUN   TestDiskCorruption
Inserting 100000 items took 96.824574ms
{
"node_count":             99999,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       4,
"next_pointers_per_node": 1.3320,
"memory_used":            5731248,
"node_allocs":            100000,
"node_frees":             0,
"level_node_distribution":{
"level0": 75013,
"level1": 18820,
"level2": 4620,
"level3": 1167,
"level4": 294,
"level5": 56,
"level6": 21,
"level7": 4,
"level8": 4,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
2022-08-04T23:21:59.998+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[4696 6091 6004 183 7882 1755 4386 5893 10700 4322 5949 10548 7436 7494 4753 11908]] total count [100000] snap count [100000] size per shard [[37568 48728 48032 1464 63056 14040 35088 47144 85600 34576 47592 84384 59488 59952 38024 95264]] total size [800000] memoryInUse [5731248]
Storing to disk took 76.987896ms
Loading from disk took 26.711534ms
--- PASS: TestDiskCorruption (0.26s)
=== RUN   TestSnapshotStats
--- PASS: TestSnapshotStats (0.00s)
=== RUN   TestInsertDeleteConcurrent
total items in snapshot: 9082458  items deleted: 917542
{
"node_count":             9082458,
"soft_deletes":           0,
"read_conflicts":         4043,
"insert_conflicts":       31,
"next_pointers_per_node": 1.3335,
"memory_used":            520751352,
"node_allocs":            10000000,
"node_frees":             10000002,
"level_node_distribution":{
"level0": 6810649,
"level1": 1703820,
"level2": 426223,
"level3": 106160,
"level4": 26754,
"level5": 6654,
"level6": 1618,
"level7": 453,
"level8": 97,
"level9": 19,
"level10": 8,
"level11": 3,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
allocs: 20000002 frees: 20000002
--- PASS: TestInsertDeleteConcurrent (14.51s)
=== RUN   TestNodeList
--- PASS: TestNodeList (0.00s)
PASS
ok  	github.com/couchbase/indexing/secondary/memdb	164.006s
=== RUN   TestInteger
--- PASS: TestInteger (0.00s)
=== RUN   TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN   TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN   TestFloat
--- PASS: TestFloat (0.00s)
=== RUN   TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN   TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN   TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN   TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN   TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN   TestReference
--- PASS: TestReference (0.00s)
=== RUN   TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN   TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN   TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN   TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN   TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN   TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN   TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN   TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN   TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618] 
PASS 
TESTING [0] 
PASS 
TESTING [0.0] 
PASS 
TESTING [0.0000] 
PASS 
TESTING [0.0000000] 
PASS 
TESTING [-0] 
PASS 
TESTING [-0.0] 
PASS 
TESTING [-0.0000] 
PASS 
TESTING [-0.0000000] 
PASS 
TESTING [1] 
PASS 
TESTING [20] 
PASS 
TESTING [3456] 
PASS 
TESTING [7645000] 
PASS 
TESTING [9223372036854775807] 
PASS 
TESTING [9223372036854775806] 
PASS 
TESTING [9223372036854775808] 
PASS 
TESTING [92233720368547758071234000] 
PASS 
TESTING [92233720368547758071234987437653] 
PASS 
TESTING [12300000000000000000000000000000056] 
PASS 
TESTING [12300000000000000000000000000000000] 
PASS 
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000] 
PASS 
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [210690] 
PASS 
TESTING [90000] 
PASS 
TESTING [123000000] 
PASS 
TESTING [3.60e2] 
PASS 
TESTING [36e2] 
PASS 
TESTING [1.9999999999e10] 
PASS 
TESTING [1.99999e10] 
PASS 
TESTING [1.99999e5] 
PASS 
TESTING [0.00000000000012e15] 
PASS 
TESTING [7.64507352e8] 
PASS 
TESTING [9.2233720368547758071234987437653e31] 
PASS 
TESTING [2650e-1] 
PASS 
TESTING [26500e-1] 
PASS 
TESTING [-1] 
PASS 
TESTING [-20] 
PASS 
TESTING [-3456] 
PASS 
TESTING [-7645000] 
PASS 
TESTING [-9223372036854775808] 
PASS 
TESTING [-9223372036854775807] 
PASS 
TESTING [-9223372036854775806] 
PASS 
TESTING [-9223372036854775809] 
PASS 
TESTING [-92233720368547758071234000] 
PASS 
TESTING [-92233720368547758071234987437653] 
PASS 
TESTING [-12300000000000000000000000000000056] 
PASS 
TESTING [-12300000000000000000000000000000000] 
PASS 
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056] 
PASS 
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000] 
PASS 
TESTING [-210690] 
PASS 
TESTING [-90000] 
PASS 
TESTING [-123000000] 
PASS 
TESTING [-3.60e2] 
PASS 
TESTING [-36e2] 
PASS 
TESTING [-1.9999999999e10] 
PASS 
TESTING [-1.99999e10] 
PASS 
TESTING [-1.99999e5] 
PASS 
TESTING [-0.00000000000012e15] 
PASS 
TESTING [-2650e-1] 
PASS 
TESTING [-26500e-1] 
PASS 
TESTING [0.03] 
PASS 
TESTING [198.60] 
PASS 
TESTING [2000045.178] 
PASS 
TESTING [1.7976931348623157e+308] 
PASS 
TESTING [0.000000000000000000890] 
PASS 
TESTING [257953786.9864236576] 
PASS 
TESTING [257953786.9864236576e8] 
PASS 
TESTING [36.912e3] 
PASS 
TESTING [2761.67e0] 
PASS 
TESTING [2761.67e00] 
PASS 
TESTING [2761.67e000] 
PASS 
TESTING [7676546.67e-3] 
PASS 
TESTING [-0.03] 
PASS 
TESTING [-198.60] 
PASS 
TESTING [-2000045.178] 
PASS 
TESTING [-1.7976931348623157e+308] 
PASS 
TESTING [-0.000000000000000000890] 
PASS 
TESTING [-257953786.9864236576] 
PASS 
TESTING [-257953786.9864236576e8] 
PASS 
TESTING [-36.912e3] 
PASS 
TESTING [-2761.67e0] 
PASS 
TESTING [-2761.67e00] 
PASS 
TESTING [-2761.67e000] 
PASS 
TESTING [-7676546.67e-3] 
PASS 
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN   TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN   TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN   TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok  	github.com/couchbase/indexing/secondary/collatejson	0.034s
Initializing write barrier = 8000
=== RUN   TestForestDBIterator
2022-08-04T23:22:19.789+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 5297 us

2022-08-04T23:22:19.790+05:30 [INFO][FDB] Forestdb opened database file test
2022-08-04T23:22:19.794+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.01s)
=== RUN   TestForestDBIteratorSeek
2022-08-04T23:22:19.794+05:30 [INFO][FDB] Forestdb opened database file test
2022-08-04T23:22:19.798+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.00s)
=== RUN   TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN   TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN   TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN   TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN   TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN   TestMemDBInsertionPerf
Maximum number of file descriptors = 200000
Set IO Concurrency: 7200
Initial build: 10000000 items took 2m9.225700799s -> 77383.98738153628 items/s
Incr build: 10000000 items took 1m51.642918714s -> 89571.28777345376 items/s
Main Index: {
"node_count":             18000000,
"soft_deletes":           0,
"read_conflicts":         0,
"insert_conflicts":       3,
"next_pointers_per_node": 1.3333,
"memory_used":            1695887692,
"node_allocs":            18000000,
"node_frees":             0,
"level_node_distribution":{
"level0": 13500190,
"level1": 3375550,
"level2": 843073,
"level3": 210794,
"level4": 52734,
"level5": 13348,
"level6": 3246,
"level7": 782,
"level8": 220,
"level9": 42,
"level10": 17,
"level11": 3,
"level12": 1,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount":  625000,
"SlowHTCount":  0,
"Conflicts":   0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (240.88s)
=== RUN   TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN   TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN   TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN   TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN   TestDequeueA
--- PASS: TestDequeueA (1.21s)
=== RUN   TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN   TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN   TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN   TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN   TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.01s)
=== RUN   TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN   TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN   TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN   TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.01s)
PASS
ok  	github.com/couchbase/indexing/secondary/indexer	264.893s
=== RUN   TestConnPoolBasicSanity
2022-08-04T23:26:47.633+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2022-08-04T23:26:47.840+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-08-04T23:26:48.634+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN   TestConnRelease
2022-08-04T23:26:52.636+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2022-08-04T23:27:32.393+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-08-04T23:27:32.653+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.76s)
=== RUN   TestLongevity
2022-08-04T23:27:36.395+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Releasing 1 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 0 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 4 conns.
Getting 1 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 3 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 2 conns.
Getting 1 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 3 conns.
Getting 3 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 0 conns.
2022-08-04T23:28:14.966+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-08-04T23:28:15.412+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.57s)
=== RUN   TestSustainedHighConns
2022-08-04T23:28:18.967+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Allocating 16 Connections
cp.curActConns = 0
Returning 3 Connections
cp.curActConns = 11
Returning 2 Connections
cp.curActConns = 11
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 14
Returning 1 Connections
Allocating 12 Connections
cp.curActConns = 23
Returning 1 Connections
cp.curActConns = 24
Allocating 10 Connections
Returning 1 Connections
cp.curActConns = 33
Returning 3 Connections
Allocating 15 Connections
cp.curActConns = 34
Returning 4 Connections
cp.curActConns = 41
Returning 3 Connections
Allocating 8 Connections
cp.curActConns = 45
Returning 2 Connections
cp.curActConns = 44
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 43
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 42
Returning 2 Connections
Allocating 21 Connections
cp.curActConns = 57
Returning 4 Connections
cp.curActConns = 57
Allocating 24 Connections
Returning 0 Connections
cp.curActConns = 69
Returning 0 Connections
cp.curActConns = 81
Returning 3 Connections
Allocating 13 Connections
cp.curActConns = 81
Returning 3 Connections
cp.curActConns = 88
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 89
Returning 0 Connections
Allocating 5 Connections
cp.curActConns = 93
Returning 1 Connections
cp.curActConns = 93
Allocating 16 Connections
Returning 3 Connections
cp.curActConns = 105
Returning 1 Connections
cp.curActConns = 105
Allocating 2 Connections
Returning 3 Connections
cp.curActConns = 104
Allocating 21 Connections
Returning 3 Connections
cp.curActConns = 117
Returning 1 Connections
cp.curActConns = 121
Returning 2 Connections
Allocating 18 Connections
cp.curActConns = 129
Returning 2 Connections
cp.curActConns = 135
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 133
Returning 3 Connections
Allocating 21 Connections
cp.curActConns = 141
Returning 0 Connections
cp.curActConns = 151
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 151
Returning 2 Connections
Allocating 8 Connections
cp.curActConns = 153
Returning 1 Connections
cp.curActConns = 156
Returning 4 Connections
Allocating 8 Connections
cp.curActConns = 160
Returning 3 Connections
Allocating 16 Connections
cp.curActConns = 165
Returning 2 Connections
cp.curActConns = 171
Returning 3 Connections
Allocating 11 Connections
cp.curActConns = 177
Returning 1 Connections
cp.curActConns = 178
Allocating 7 Connections
Returning 0 Connections
cp.curActConns = 185
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 184
Returning 3 Connections
Allocating 5 Connections
cp.curActConns = 186
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 183
Returning 1 Connections
Allocating 15 Connections
cp.curActConns = 189
Returning 2 Connections
cp.curActConns = 195
Returning 2 Connections
Allocating 10 Connections
cp.curActConns = 201
Returning 0 Connections
cp.curActConns = 203
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 203
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 204
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 202
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 203
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 200
Returning 2 Connections
Allocating 6 Connections
cp.curActConns = 204
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 201
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 204
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 207
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 208
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 208
Returning 0 Connections
Allocating 2 Connections
cp.curActConns = 210
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 209
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 210
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 211
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 211
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 210
Returning 4 Connections
Allocating 0 Connections
cp.curActConns = 206
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 206
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 205
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 208
Returning 4 Connections
Allocating 0 Connections
cp.curActConns = 204
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 202
Returning 0 Connections
Allocating 2 Connections
cp.curActConns = 204
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 203
Returning 1 Connections
Allocating 3 Connections
cp.curActConns = 205
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 203
Returning 3 Connections
Allocating 2 Connections
cp.curActConns = 202
Returning 3 Connections
Allocating 18 Connections
cp.curActConns = 213
Returning 3 Connections
cp.curActConns = 214
Allocating 1 Connections
Returning 0 Connections
cp.curActConns = 215
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 215
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 213
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 211
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 214
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 217
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 221
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 224
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 225
Returning 2 Connections
cp.curActConns = 226
Allocating 0 Connections
Returning 0 Connections
cp.curActConns = 226
Allocating 2 Connections
Returning 4 Connections
cp.curActConns = 224
Allocating 0 Connections
Returning 3 Connections
cp.curActConns = 221
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 220
Allocating 1 Connections
Returning 0 Connections
cp.curActConns = 221
Allocating 1 Connections
Returning 4 Connections
cp.curActConns = 218
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 217
Allocating 2 Connections
Returning 1 Connections
cp.curActConns = 218
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 222
Allocating 2 Connections
Returning 2 Connections
cp.curActConns = 222
Retuning from startDeallocatorRoutine
Retuning from startAllocatorRoutine
2022-08-04T23:29:14.038+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-08-04T23:29:15.002+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.07s)
=== RUN   TestLowWM
2022-08-04T23:29:18.040+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2022-08-04T23:30:18.056+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2022-08-04T23:31:18.072+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2022-08-04T23:31:23.539+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-08-04T23:31:24.073+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.50s)
=== RUN   TestTotalConns
2022-08-04T23:31:27.540+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2022-08-04T23:31:41.711+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-08-04T23:31:42.546+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.17s)
=== RUN   TestUpdateTickRate
2022-08-04T23:31:45.713+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2022-08-04T23:32:06.561+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2022-08-04T23:32:06.725+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.85s)
PASS
ok  	github.com/couchbase/indexing/secondary/queryport/client	322.977s
Starting server: attempt 1

Functional tests

2022/08/04 23:34:17 In TestMain()
2022/08/04 23:34:17 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2022/08/04 23:34:17 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2022/08/04 23:34:18 Initialising web UI on node: 127.0.0.1:9000
2022/08/04 23:34:18 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2022/08/04 23:34:19 Setting data quota of 1500M and Index quota of 1500M
2022/08/04 23:34:20 Adding node: https://127.0.0.1:19001 with role: kv,index to the cluster
2022/08/04 23:34:27 AddNode: Successfully added node: 127.0.0.1:9001 (role kv,index), response: {"otpNode":"n_1@127.0.0.1"}
2022/08/04 23:34:32 Rebalance progress: 0
2022/08/04 23:34:37 Rebalance progress: 0
2022/08/04 23:34:42 Rebalance progress: 100
2022/08/04 23:34:47 Created bucket default, responseBody: 
2022/08/04 23:34:53 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2022/08/04 23:34:53 Successfully initialised cluster
2022/08/04 23:34:53 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2022/08/04 23:34:53 Changing config key queryport.client.settings.backfillLimit to value 0
2022/08/04 23:34:53 Changing config key queryport.client.log_level to value Warn
2022/08/04 23:34:53 Changing config key indexer.api.enableTestServer to value true
2022/08/04 23:34:53 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2022/08/04 23:34:53 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2022/08/04 23:34:53 Changing config key indexer.settings.log_level to value info
2022/08/04 23:34:53 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2022/08/04 23:34:53 Using memory_optimized for creating indexes
2022/08/04 23:34:53 Changing config key indexer.settings.storage_mode to value memory_optimized
2022/08/04 23:34:58 Data file exists. Skipping download
2022/08/04 23:34:58 Data file exists. Skipping download
2022/08/04 23:34:59 In DropAllSecondaryIndexes()
2022/08/04 23:34:59 Emptying the default bucket
2022/08/04 23:35:02 Flush Enabled on bucket default, responseBody: 
2022/08/04 23:35:40 Flushed the bucket default, Response body: 
2022/08/04 23:35:40 Create Index On the empty default Bucket()
2022/08/04 23:35:44 Created the secondary index index_eyeColor. Waiting for it become active
2022/08/04 23:35:44 Index is 9820414544442872959 now active
2022/08/04 23:35:44 Populating the default bucket
=== RUN   TestScanAfterBucketPopulate
2022/08/04 23:35:53 In TestScanAfterBucketPopulate()
2022/08/04 23:35:53 Create an index on empty bucket, populate the bucket and Run a scan on the index
2022/08/04 23:35:53 Using n1ql client
2022-08-04T23:35:53.086+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2022/08/04 23:35:53 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.09s)
=== RUN   TestRestartNilSnapshot
2022/08/04 23:35:53 In TestRestartNilSnapshot()
2022/08/04 23:35:57 Created the secondary index idx_age. Waiting for it become active
2022/08/04 23:35:57 Index is 13875572807715314607 now active
2022/08/04 23:35:57 Restarting indexer process ...
2022/08/04 23:35:57 []
2022-08-04T23:35:57.243+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-04T23:35:57.243+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-04T23:35:57.243+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-04T23:35:57.244+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/04 23:39:17 Using n1ql client
2022-08-04T23:39:17.218+05:30 [Error] transport error between 127.0.0.1:43172->127.0.0.1:9107: write tcp 127.0.0.1:43172->127.0.0.1:9107: write: broken pipe
2022-08-04T23:39:17.218+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 7954439674622159036 request transport failed `write tcp 127.0.0.1:43172->127.0.0.1:9107: write: broken pipe`
2022-08-04T23:39:17.218+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-04T23:39:17.218+05:30 [Error] metadataClient:PickRandom: Replicas - [9961169013736689712], PrunedReplica - map[], FilteredReplica map[]
2022/08/04 23:39:17 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.10s)
=== RUN   TestThreeIndexCreates
2022/08/04 23:39:17 In TestThreeIndexCreates()
2022/08/04 23:39:21 Created the secondary index index_balance. Waiting for it become active
2022/08/04 23:39:21 Index is 2916323112065412339 now active
2022/08/04 23:39:21 Create docs mutations
2022/08/04 23:39:21 Using n1ql client
2022/08/04 23:39:21 Expected and Actual scan responses are the same
2022/08/04 23:39:25 Created the secondary index index_email. Waiting for it become active
2022/08/04 23:39:25 Index is 8220295191726589305 now active
2022/08/04 23:39:25 Create docs mutations
2022/08/04 23:39:25 Using n1ql client
2022/08/04 23:39:25 Expected and Actual scan responses are the same
2022/08/04 23:39:30 Created the secondary index index_pin. Waiting for it become active
2022/08/04 23:39:30 Index is 2043080806416025130 now active
2022/08/04 23:39:30 Delete docs mutations
2022/08/04 23:39:30 Using n1ql client
2022/08/04 23:39:30 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (13.05s)
=== RUN   TestMultipleIndexCreatesDropsWithMutations
2022/08/04 23:39:30 In TestThreeIndexCreates()
2022/08/04 23:39:34 Created the secondary index index_state. Waiting for it become active
2022/08/04 23:39:34 Index is 5003665987054984111 now active
2022/08/04 23:39:34 Create docs mutations
2022/08/04 23:39:34 Using n1ql client
2022/08/04 23:39:34 Expected and Actual scan responses are the same
2022/08/04 23:39:39 Created the secondary index index_registered. Waiting for it become active
2022/08/04 23:39:39 Index is 10591174055538942895 now active
2022/08/04 23:39:39 Create docs mutations
2022/08/04 23:39:39 Using n1ql client
2022/08/04 23:39:39 Expected and Actual scan responses are the same
2022/08/04 23:39:43 Created the secondary index index_gender. Waiting for it become active
2022/08/04 23:39:43 Index is 18058652249227848857 now active
2022/08/04 23:39:43 Create docs mutations
2022/08/04 23:39:43 Using n1ql client
2022/08/04 23:39:43 Expected and Actual scan responses are the same
2022/08/04 23:39:43 Dropping the secondary index index_registered
2022/08/04 23:39:43 Index dropped
2022/08/04 23:39:43 Create docs mutations
2022/08/04 23:39:43 Delete docs mutations
2022/08/04 23:39:44 Using n1ql client
2022/08/04 23:39:44 Expected and Actual scan responses are the same
2022/08/04 23:39:48 Created the secondary index index_longitude. Waiting for it become active
2022/08/04 23:39:48 Index is 12499568617975408837 now active
2022/08/04 23:39:48 Create docs mutations
2022/08/04 23:39:48 Using n1ql client
2022/08/04 23:39:48 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (18.25s)
=== RUN   TestCreateDropScan
2022/08/04 23:39:48 In TestCreateDropScan()
2022/08/04 23:39:52 Created the secondary index index_cd. Waiting for it become active
2022/08/04 23:39:52 Index is 4225548448767603690 now active
2022/08/04 23:39:52 Using n1ql client
2022/08/04 23:39:52 Expected and Actual scan responses are the same
2022/08/04 23:39:52 Dropping the secondary index index_cd
2022/08/04 23:39:52 Index dropped
2022/08/04 23:39:52 Using n1ql client
2022/08/04 23:39:52 Scan failed as expected with error: Index Not Found - cause: GSI index index_cd not found.
--- PASS: TestCreateDropScan (4.29s)
=== RUN   TestCreateDropCreate
2022/08/04 23:39:52 In TestCreateDropCreate()
2022/08/04 23:39:56 Created the secondary index index_cdc. Waiting for it become active
2022/08/04 23:39:56 Index is 13484368614983997998 now active
2022/08/04 23:39:56 Using n1ql client
2022/08/04 23:39:57 Expected and Actual scan responses are the same
2022/08/04 23:39:57 Dropping the secondary index index_cdc
2022/08/04 23:39:57 Index dropped
2022/08/04 23:39:57 Using n1ql client
2022/08/04 23:39:57 Scan 2 failed as expected with error: Index Not Found - cause: GSI index index_cdc not found.
2022/08/04 23:40:01 Created the secondary index index_cdc. Waiting for it become active
2022/08/04 23:40:01 Index is 17083232846974356619 now active
2022/08/04 23:40:01 Using n1ql client
2022/08/04 23:40:01 Expected and Actual scan responses are the same
2022/08/04 23:40:01 (Inclusion 1) Lengths of expected and actual scan results are 5057 and 5057. Num of docs in bucket = 10402
2022/08/04 23:40:01 Using n1ql client
2022/08/04 23:40:01 Expected and Actual scan responses are the same
2022/08/04 23:40:01 (Inclusion 3) Lengths of expected and actual scan results are 5057 and 5057. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (8.53s)
=== RUN   TestCreate2Drop1Scan2
2022/08/04 23:40:01 In TestCreate2Drop1Scan2()
2022/08/04 23:40:05 Created the secondary index index_i1. Waiting for it become active
2022/08/04 23:40:05 Index is 13714517299165486612 now active
2022/08/04 23:40:09 Created the secondary index index_i2. Waiting for it become active
2022/08/04 23:40:09 Index is 1971214383245262317 now active
2022/08/04 23:40:09 Using n1ql client
2022/08/04 23:40:09 Expected and Actual scan responses are the same
2022/08/04 23:40:09 Using n1ql client
2022/08/04 23:40:09 Expected and Actual scan responses are the same
2022/08/04 23:40:09 Dropping the secondary index index_i1
2022/08/04 23:40:09 Index dropped
2022/08/04 23:40:09 Using n1ql client
2022/08/04 23:40:09 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (8.32s)
=== RUN   TestIndexNameCaseSensitivity
2022/08/04 23:40:09 In TestIndexNameCaseSensitivity()
2022/08/04 23:40:13 Created the secondary index index_age. Waiting for it become active
2022/08/04 23:40:13 Index is 9641895756195664303 now active
2022/08/04 23:40:13 Using n1ql client
2022/08/04 23:40:13 Expected and Actual scan responses are the same
2022/08/04 23:40:13 Using n1ql client
2022/08/04 23:40:13 Scan failed as expected with error: Index Not Found - cause: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (4.10s)
=== RUN   TestCreateDuplicateIndex
2022/08/04 23:40:13 In TestCreateDuplicateIndex()
2022/08/04 23:40:17 Created the secondary index index_di1. Waiting for it become active
2022/08/04 23:40:17 Index is 11473947134306966322 now active
2022/08/04 23:40:17 Index found:  index_di1
2022/08/04 23:40:17 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (4.02s)
=== RUN   TestDropNonExistingIndex
2022/08/04 23:40:17 In TestDropNonExistingIndex()
2022/08/04 23:40:17 Dropping the secondary index 123456
2022/08/04 23:40:17 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.02s)
=== RUN   TestCreateIndexNonExistentBucket
2022/08/04 23:40:17 In TestCreateIndexNonExistentBucket()
2022-08-04T23:40:18.348+05:30 [Error] Encountered error during create index.  Error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2022-08-04T23:40:28.349+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2022/08/04 23:40:28 Index create failed as expected with error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- PASS: TestCreateIndexNonExistentBucket (10.51s)
=== RUN   TestScanWithNoTimeout
2022/08/04 23:40:28 Create an index on empty bucket, populate the bucket and Run a scan on the index
2022/08/04 23:40:28 Changing config key indexer.settings.scan_timeout to value 0
2022/08/04 23:40:28 Using n1ql client
2022/08/04 23:40:28 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.28s)
=== RUN   TestIndexingOnBinaryBucketMeta
2022/08/04 23:40:28 In TestIndexingOnBinaryBucketMeta()
2022/08/04 23:40:28 	 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2022/08/04 23:40:28 	 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2022/08/04 23:40:31 Modified parameters of bucket default, responseBody: 
2022/08/04 23:40:31 Created bucket binaryBucket, responseBody: 
2022/08/04 23:40:50 Created the secondary index index_binary_meta_id. Waiting for it become active
2022/08/04 23:40:50 Index is 4946355891083014443 now active
2022/08/04 23:40:55 items_count stat is 10 for index index_binary_meta_id
2022/08/04 23:40:55 Dropping the secondary index index_binary_meta_id
2022/08/04 23:40:55 Index dropped
2022/08/04 23:40:58 Created the secondary index index_binary_meta_cas. Waiting for it become active
2022/08/04 23:40:58 Index is 14728618465665585592 now active
2022/08/04 23:41:03 items_count stat is 10 for index index_binary_meta_cas
2022/08/04 23:41:03 Dropping the secondary index index_binary_meta_cas
2022/08/04 23:41:03 Index dropped
2022/08/04 23:41:06 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2022/08/04 23:41:06 Index is 1921245592914726206 now active
2022/08/04 23:41:11 items_count stat is 10 for index index_binary_meta_expiration
2022/08/04 23:41:11 Dropping the secondary index index_binary_meta_expiration
2022/08/04 23:41:11 Index dropped
2022/08/04 23:41:13 Deleted bucket binaryBucket, responseBody: 
2022/08/04 23:41:16 Modified parameters of bucket default, responseBody: 
--- PASS: TestIndexingOnBinaryBucketMeta (63.05s)
=== RUN   TestRetainDeleteXATTRBinaryDocs
2022/08/04 23:41:31 In TestRetainDeleteXATTRBinaryDocs()
2022/08/04 23:41:31 	 1. Populate a bucket with binary docs having system XATTRS
2022/08/04 23:41:31 	 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2022/08/04 23:41:31 	 3. Delete the documents in the bucket
2022/08/04 23:41:31 	 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2022/08/04 23:41:34 Modified parameters of bucket default, responseBody: 
2022/08/04 23:41:34 Created bucket binaryBucket, responseBody: 
2022/08/04 23:41:53 Created the secondary index index_system_xattr. Waiting for it become active
2022/08/04 23:41:53 Index is 11027975414812136779 now active
2022/08/04 23:41:58 Deleted all the documents in the bucket: binaryBucket successfully
2022/08/04 23:42:01 Deleted bucket binaryBucket, responseBody: 
2022/08/04 23:42:04 Modified parameters of bucket default, responseBody: 
--- PASS: TestRetainDeleteXATTRBinaryDocs (47.50s)
=== RUN   TestSimpleIndex_FloatDataType
2022/08/04 23:42:19 In TestSimpleIndex_FloatDataType()
2022/08/04 23:42:19 Index found:  index_age
2022/08/04 23:42:19 Using n1ql client
2022/08/04 23:42:19 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.02s)
=== RUN   TestSimpleIndex_StringDataType
2022/08/04 23:42:19 In TestSimpleIndex_StringDataType()
2022/08/04 23:42:23 Created the secondary index index_company. Waiting for it become active
2022/08/04 23:42:23 Index is 17174224869118219007 now active
2022/08/04 23:42:23 Using n1ql client
2022/08/04 23:42:23 Expected and Actual scan responses are the same
2022/08/04 23:42:23 Using n1ql client
2022/08/04 23:42:23 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.33s)
=== RUN   TestSimpleIndex_FieldValueCaseSensitivity
2022/08/04 23:42:23 In TestSimpleIndex_StringCaseSensitivity()
2022/08/04 23:42:23 Index found:  index_company
2022/08/04 23:42:23 Using n1ql client
2022/08/04 23:42:23 Expected and Actual scan responses are the same
2022/08/04 23:42:23 Using n1ql client
2022/08/04 23:42:23 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.07s)
=== RUN   TestSimpleIndex_BoolDataType
2022/08/04 23:42:23 In TestSimpleIndex_BoolDataType()
2022/08/04 23:42:27 Created the secondary index index_isActive. Waiting for it become active
2022/08/04 23:42:27 Index is 4206672424261615548 now active
2022/08/04 23:42:27 Using n1ql client
2022/08/04 23:42:28 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (4.42s)
=== RUN   TestBasicLookup
2022/08/04 23:42:28 In TestBasicLookup()
2022/08/04 23:42:28 Index found:  index_company
2022/08/04 23:42:28 Using n1ql client
2022/08/04 23:42:28 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.01s)
=== RUN   TestIndexOnNonExistentField
2022/08/04 23:42:28 In TestIndexOnNonExistentField()
2022/08/04 23:42:32 Created the secondary index index_height. Waiting for it become active
2022/08/04 23:42:32 Index is 9068254726356756277 now active
2022/08/04 23:42:32 Using n1ql client
2022/08/04 23:42:32 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (4.23s)
=== RUN   TestIndexPartiallyMissingField
2022/08/04 23:42:32 In TestIndexPartiallyMissingField()
2022/08/04 23:42:36 Created the secondary index index_nationality. Waiting for it become active
2022/08/04 23:42:36 Index is 4085089349500289828 now active
2022/08/04 23:42:36 Using n1ql client
2022/08/04 23:42:36 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (4.25s)
=== RUN   TestScanNonMatchingDatatype
2022/08/04 23:42:36 In TestScanNonMatchingDatatype()
2022/08/04 23:42:36 Index found:  index_age
2022/08/04 23:42:36 Using n1ql client
2022/08/04 23:42:36 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.01s)
=== RUN   TestInclusionNeither
2022/08/04 23:42:36 In TestInclusionNeither()
2022/08/04 23:42:36 Index found:  index_age
2022/08/04 23:42:36 Using n1ql client
2022/08/04 23:42:36 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.04s)
=== RUN   TestInclusionLow
2022/08/04 23:42:36 In TestInclusionLow()
2022/08/04 23:42:36 Index found:  index_age
2022/08/04 23:42:36 Using n1ql client
2022/08/04 23:42:36 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.03s)
=== RUN   TestInclusionHigh
2022/08/04 23:42:36 In TestInclusionHigh()
2022/08/04 23:42:36 Index found:  index_age
2022/08/04 23:42:36 Using n1ql client
2022/08/04 23:42:36 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.02s)
=== RUN   TestInclusionBoth
2022/08/04 23:42:36 In TestInclusionBoth()
2022/08/04 23:42:36 Index found:  index_age
2022/08/04 23:42:36 Using n1ql client
2022/08/04 23:42:36 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.02s)
=== RUN   TestNestedIndex_String
2022/08/04 23:42:36 In TestNestedIndex_String()
2022/08/04 23:42:40 Created the secondary index index_streetname. Waiting for it become active
2022/08/04 23:42:40 Index is 10460287527465624632 now active
2022/08/04 23:42:40 Using n1ql client
2022/08/04 23:42:40 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (4.07s)
=== RUN   TestNestedIndex_Float
2022/08/04 23:42:40 In TestNestedIndex_Float()
2022/08/04 23:42:44 Created the secondary index index_floor. Waiting for it become active
2022/08/04 23:42:44 Index is 7305202990586537539 now active
2022/08/04 23:42:44 Using n1ql client
2022/08/04 23:42:44 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (4.27s)
=== RUN   TestNestedIndex_Bool
2022/08/04 23:42:44 In TestNestedIndex_Bool()
2022/08/04 23:42:49 Created the secondary index index_isresidential. Waiting for it become active
2022/08/04 23:42:49 Index is 2222925895600472110 now active
2022/08/04 23:42:49 Using n1ql client
2022/08/04 23:42:49 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (4.29s)
=== RUN   TestLookupJsonObject
2022/08/04 23:42:49 In TestLookupJsonObject()
2022/08/04 23:42:55 Created the secondary index index_streetaddress. Waiting for it become active
2022/08/04 23:42:55 Index is 12756753012901312113 now active
2022/08/04 23:42:55 Using n1ql client
2022/08/04 23:42:55 Count of docScanResults is 1
2022/08/04 23:42:55 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2022/08/04 23:42:55 Count of scanResults is 1
2022/08/04 23:42:55 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2022/08/04 23:42:55 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.07s)
=== RUN   TestLookupObjDifferentOrdering
2022/08/04 23:42:55 In TestLookupObjDifferentOrdering()
2022/08/04 23:42:55 Index found:  index_streetaddress
2022/08/04 23:42:55 Using n1ql client
2022/08/04 23:42:55 Count of docScanResults is 1
2022/08/04 23:42:55 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2022/08/04 23:42:55 Count of scanResults is 1
2022/08/04 23:42:55 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2022/08/04 23:42:55 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.02s)
=== RUN   TestRangeJsonObject
2022/08/04 23:42:55 In TestRangeJsonObject()
2022/08/04 23:42:55 Index found:  index_streetaddress
2022/08/04 23:42:55 Using n1ql client
2022/08/04 23:42:55 Count of scanResults is 2
2022/08/04 23:42:55 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2022/08/04 23:42:55 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb  Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2022/08/04 23:42:55 Count of docScanResults is 2
2022/08/04 23:42:55 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c  Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2022/08/04 23:42:55 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb  Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2022/08/04 23:42:55 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.00s)
=== RUN   TestLookupFloatDiffForms
2022/08/04 23:42:55 In TestLookupFloatDiffForms()
2022/08/04 23:42:59 Created the secondary index index_latitude. Waiting for it become active
2022/08/04 23:42:59 Index is 700084071600685903 now active
2022/08/04 23:42:59 Scan 1
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 2
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 3
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 4
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 5
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 6
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (4.56s)
=== RUN   TestRangeFloatInclVariations
2022/08/04 23:42:59 In TestRangeFloatInclVariations()
2022/08/04 23:42:59 Index found:  index_latitude
2022/08/04 23:42:59 Scan 1
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 2
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 3
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 4
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 5
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
2022/08/04 23:42:59 Scan 6
2022/08/04 23:42:59 Using n1ql client
2022/08/04 23:42:59 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.04s)
=== RUN   TestScanAll
2022/08/04 23:42:59 In TestScanAll()
2022/08/04 23:43:04 Created the secondary index index_name. Waiting for it become active
2022/08/04 23:43:04 Index is 2779880683762157503 now active
2022/08/04 23:43:04 Length of docScanResults = 10502
2022/08/04 23:43:04 Using n1ql client
2022/08/04 23:43:04 Length of scanResults = 10502
2022/08/04 23:43:04 Expected and Actual scan responses are the same
--- PASS: TestScanAll (4.41s)
=== RUN   TestScanAllNestedField
2022/08/04 23:43:04 In TestScanAllNestedField()
2022/08/04 23:43:04 Index found:  index_streetname
2022/08/04 23:43:04 Length of docScanResults = 2
2022/08/04 23:43:04 Using n1ql client
2022/08/04 23:43:04 Length of scanResults = 2
2022/08/04 23:43:04 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN   TestBasicPrimaryIndex
2022/08/04 23:43:04 In TestBasicPrimaryIndex()
2022/08/04 23:43:09 Created the secondary index index_p1. Waiting for it become active
2022/08/04 23:43:09 Index is 5008398003619988362 now active
2022-08-04T23:43:09.362+05:30 [Error] transport error between 127.0.0.1:42446->127.0.0.1:9107: write tcp 127.0.0.1:42446->127.0.0.1:9107: write: broken pipe
2022-08-04T23:43:09.362+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:42446->127.0.0.1:9107: write: broken pipe`
2022-08-04T23:43:09.362+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-04T23:43:09.363+05:30 [Error] metadataClient:PickRandom: Replicas - [7356810911213552379], PrunedReplica - map[], FilteredReplica map[]
2022/08/04 23:43:09 Expected and Actual scan responses are the same
2022/08/04 23:43:09 CountRange() expected and actual is:  1872 and 1872
2022/08/04 23:43:09 lookupkey for CountLookup() = User2dd89bdb-3bcc-4291-8633-30b11f79069a
2022/08/04 23:43:09 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (5.11s)
=== RUN   TestBasicNullDataType
2022/08/04 23:43:09 In TestBasicNullDataType()
2022/08/04 23:43:09 Index found:  index_email
2022/08/04 23:43:09 Using n1ql client
2022/08/04 23:43:09 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.01s)
=== RUN   TestBasicArrayDataType_ScanAll
2022/08/04 23:43:09 In TestBasicArrayDataType_ScanAll()
2022/08/04 23:43:13 Created the secondary index index_tags. Waiting for it become active
2022/08/04 23:43:13 Index is 8283011097125545237 now active
2022/08/04 23:43:13 Using n1ql client
2022/08/04 23:43:14 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (4.65s)
=== RUN   TestBasicArrayDataType_Lookup
2022/08/04 23:43:14 In TestBasicArrayDataType_Lookup()
2022/08/04 23:43:16 Index found:  index_tags
2022/08/04 23:43:16 Count of scanResults is 1
2022/08/04 23:43:16 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75  Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN   TestArrayDataType_LookupMissingArrayValue
2022/08/04 23:43:16 In TestArrayDataType_LookupMissingArrayValue()
2022/08/04 23:43:16 Index found:  index_tags
2022/08/04 23:43:16 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.00s)
=== RUN   TestArrayDataType_LookupWrongOrder
2022/08/04 23:43:16 In TestArrayDataType_LookupWrongOrder()
2022/08/04 23:43:16 Index found:  index_tags
2022/08/04 23:43:16 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN   TestArrayDataType_LookupSubset
2022/08/04 23:43:16 In TestArrayDataType_LookupSubset()
2022/08/04 23:43:16 Index found:  index_tags
2022/08/04 23:43:16 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN   TestScanLimitParameter
2022/08/04 23:43:16 In TestScanLimitParameter()
2022/08/04 23:43:16 Index found:  index_age
2022/08/04 23:43:16 Using n1ql client
2022/08/04 23:43:16 Using n1ql client
--- PASS: TestScanLimitParameter (0.01s)
=== RUN   TestCountRange
2022/08/04 23:43:16 In TestRangeCount()
2022/08/04 23:43:16 Index found:  index_age
2022/08/04 23:43:16 Count of expected and actual Range is:  2398 and 2398
2022/08/04 23:43:16 Count of expected and actual Range is: 10002 and 10002
2022/08/04 23:43:16 Count of expected and actual Range are: 0 and 0
2022/08/04 23:43:16 Count of expected and actual Range are: 478 and 478
2022/08/04 23:43:16 Testing CountRange() for key <= val
2022/08/04 23:43:16 Count of expected and actual CountRange for key <= 30 are: 5240 and 5240
2022/08/04 23:43:16 Testing CountRange() for key >= val
2022/08/04 23:43:16 Count of expected and actual CountRange for key >= 25 are: 7693 and 7693
2022/08/04 23:43:16 Testing CountRange() for null < key <= val
2022/08/04 23:43:16 Count of expected and actual CountRange for key > null && key <= 30 are: 5240 and 5240
2022/08/04 23:43:16 Testing CountRange() for val <= key < null 
2022/08/04 23:43:16 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2022/08/04 23:43:16 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.06s)
=== RUN   TestCountLookup
2022/08/04 23:43:16 In TestCountLookup()
2022/08/04 23:43:16 Index found:  index_age
2022/08/04 23:43:16 Count of expected and actual Range are: 509 and 509
2022/08/04 23:43:16 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.01s)
=== RUN   TestRangeStatistics
2022/08/04 23:43:16 In TestRangeCount()
2022/08/04 23:43:16 Index found:  index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN   TestIndexCreateWithWhere
2022/08/04 23:43:16 In TestIndexCreateWithWhere()
2022/08/04 23:43:20 Created the secondary index index_ageabove30. Waiting for it become active
2022/08/04 23:43:20 Index is 10050825372476520221 now active
2022/08/04 23:43:20 Using n1ql client
2022/08/04 23:43:20 Expected and Actual scan responses are the same
2022/08/04 23:43:20 Lengths of expected and actual scanReuslts are:  4284 and 4284
2022/08/04 23:43:24 Created the secondary index index_ageteens. Waiting for it become active
2022/08/04 23:43:24 Index is 1193844799683250742 now active
2022/08/04 23:43:24 Using n1ql client
2022/08/04 23:43:24 Expected and Actual scan responses are the same
2022/08/04 23:43:24 Lengths of expected and actual scanReuslts are:  0 and 0
2022/08/04 23:43:29 Created the secondary index index_age35to45. Waiting for it become active
2022/08/04 23:43:29 Index is 17239250715163657918 now active
2022/08/04 23:43:29 Using n1ql client
2022/08/04 23:43:29 Expected and Actual scan responses are the same
2022/08/04 23:43:29 Lengths of expected and actual scanReuslts are:  2876 and 2876
--- PASS: TestIndexCreateWithWhere (13.08s)
=== RUN   TestDeferredIndexCreate
2022/08/04 23:43:29 In TestDeferredIndexCreate()
2022/08/04 23:43:29 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2022/08/04 23:43:31 Build the deferred index index_deferred. Waiting for the index to become active
2022/08/04 23:43:31 Waiting for index 14086455491208373327 to go active ...
2022/08/04 23:43:32 Waiting for index 14086455491208373327 to go active ...
2022/08/04 23:43:33 Waiting for index 14086455491208373327 to go active ...
2022/08/04 23:43:34 Index is 14086455491208373327 now active
2022/08/04 23:43:34 Using n1ql client
2022/08/04 23:43:34 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (5.11s)
=== RUN   TestCompositeIndex_NumAndString
2022/08/04 23:43:34 In TestCompositeIndex()
2022/08/04 23:43:38 Created the secondary index index_composite1. Waiting for it become active
2022/08/04 23:43:38 Index is 3520895860843253804 now active
2022/08/04 23:43:38 Using n1ql client
2022/08/04 23:43:38 Using n1ql client
2022/08/04 23:43:38 Using n1ql client
2022/08/04 23:43:38 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (4.53s)
=== RUN   TestCompositeIndex_TwoNumberFields
2022/08/04 23:43:38 In TestCompositeIndex()
2022/08/04 23:43:43 Created the secondary index index_composite2. Waiting for it become active
2022/08/04 23:43:43 Index is 7689378572189444089 now active
2022/08/04 23:43:43 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (4.62s)
=== RUN   TestNumbers_Int64_Float64
2022/08/04 23:43:43 In TestNumbers_Int64_Float64()
2022/08/04 23:43:47 Created the secondary index idx_numbertest. Waiting for it become active
2022/08/04 23:43:47 Index is 14261070336796045930 now active
2022/08/04 23:43:47 
 ==== Int64 test #0
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Int64 test #1
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Int64 test #2
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Int64 test #3
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Int64 test #4
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Int64 test #5
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Int64 test #6
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Int64 test #7
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Int64 test #8
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Float64 test #0
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Float64 test #1
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Float64 test #2
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
2022/08/04 23:43:48 
 ==== Float64 test #3
2022/08/04 23:43:48 Using n1ql client
2022/08/04 23:43:48 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (5.13s)
=== RUN   TestRestartIndexer
2022/08/04 23:43:48 In TestRestartIndexer()
2022/08/04 23:43:48 []
2022-08-04T23:43:48.753+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-04T23:43:48.753+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-04T23:43:48.753+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-04T23:43:48.754+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/04 23:44:08 Using n1ql client
2022-08-04T23:44:08.736+05:30 [Error] transport error between 127.0.0.1:45072->127.0.0.1:9107: write tcp 127.0.0.1:45072->127.0.0.1:9107: write: broken pipe
2022-08-04T23:44:08.736+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 4537895954196844199 request transport failed `write tcp 127.0.0.1:45072->127.0.0.1:9107: write: broken pipe`
2022/08/04 23:44:08 Len of expected and actual scan results are :  10002 and 10002
2022/08/04 23:44:08 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.13s)
=== RUN   TestCreateDocsMutation
2022/08/04 23:44:08 In TestCreateDocsMutation()
2022/08/04 23:44:08 Index found:  index_age
2022/08/04 23:44:08 Using n1ql client
2022/08/04 23:44:08 Len of expected and actual scan results are :  10002 and 10002
2022/08/04 23:44:08 Expected and Actual scan responses are the same
2022/08/04 23:44:09 Using n1ql client
2022/08/04 23:44:09 Index Scan after mutations took 46.894846ms
2022/08/04 23:44:09 Len of expected and actual scan results are :  10102 and 10102
2022/08/04 23:44:09 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.31s)
=== RUN   TestRestartProjector
2022/08/04 23:44:09 In TestRestartProjector()
2022/08/04 23:44:09 []
2022/08/04 23:44:29 Using n1ql client
2022/08/04 23:44:29 Len of expected and actual scan results are :  10102 and 10102
2022/08/04 23:44:29 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.07s)
=== RUN   TestDeleteDocsMutation
2022/08/04 23:44:29 In TestDeleteDocsMutation()
2022/08/04 23:44:29 Index found:  index_age
2022/08/04 23:44:29 Using n1ql client
2022/08/04 23:44:29 Len of expected and actual scan results are :  10102 and 10102
2022/08/04 23:44:29 Expected and Actual scan responses are the same
2022/08/04 23:44:29 Using n1ql client
2022/08/04 23:44:29 Index Scan after mutations took 30.906443ms
2022/08/04 23:44:29 Len of expected and actual scan results are :  9902 and 9902
2022/08/04 23:44:29 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (0.33s)
=== RUN   TestUpdateDocsMutation
2022/08/04 23:44:29 In TestUpdateDocsMutation()
2022/08/04 23:44:29 Index found:  index_age
2022/08/04 23:44:29 Using n1ql client
2022/08/04 23:44:29 Len of expected and actual scan results are :  9428 and 9428
2022/08/04 23:44:29 Expected and Actual scan responses are the same
2022/08/04 23:44:29 Num of keysFromMutDocs: 100
2022/08/04 23:44:29 Updating number of documents: 99
2022/08/04 23:44:29 Using n1ql client
2022/08/04 23:44:29 Index Scan after mutations took 39.532961ms
2022/08/04 23:44:29 Len of expected and actual scan results are :  9427 and 9427
2022/08/04 23:44:29 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.33s)
=== RUN   TestLargeMutations
2022/08/04 23:44:29 In TestLargeMutations()
2022/08/04 23:44:29 In DropAllSecondaryIndexes()
2022/08/04 23:44:29 Index found:  index_latitude
2022/08/04 23:44:29 Dropped index index_latitude
2022/08/04 23:44:29 Index found:  index_streetname
2022/08/04 23:44:30 Dropped index index_streetname
2022/08/04 23:44:30 Index found:  index_age35to45
2022/08/04 23:44:30 Dropped index index_age35to45
2022/08/04 23:44:30 Index found:  index_pin
2022/08/04 23:44:30 Dropped index index_pin
2022/08/04 23:44:30 Index found:  index_composite1
2022/08/04 23:44:30 Dropped index index_composite1
2022/08/04 23:44:30 Index found:  index_i2
2022/08/04 23:44:30 Dropped index index_i2
2022/08/04 23:44:30 Index found:  index_longitude
2022/08/04 23:44:30 Dropped index index_longitude
2022/08/04 23:44:30 Index found:  index_nationality
2022/08/04 23:44:30 Dropped index index_nationality
2022/08/04 23:44:30 Index found:  index_name
2022/08/04 23:44:30 Dropped index index_name
2022/08/04 23:44:30 Index found:  index_gender
2022/08/04 23:44:30 Dropped index index_gender
2022/08/04 23:44:30 Index found:  index_isresidential
2022/08/04 23:44:30 Dropped index index_isresidential
2022/08/04 23:44:30 Index found:  idx_age
2022/08/04 23:44:30 Dropped index idx_age
2022/08/04 23:44:30 Index found:  index_state
2022/08/04 23:44:31 Dropped index index_state
2022/08/04 23:44:31 Index found:  index_p1
2022/08/04 23:44:31 Dropped index index_p1
2022/08/04 23:44:31 Index found:  index_di1
2022/08/04 23:44:31 Dropped index index_di1
2022/08/04 23:44:31 Index found:  index_company
2022/08/04 23:44:31 Dropped index index_company
2022/08/04 23:44:31 Index found:  index_cdc
2022/08/04 23:44:31 Dropped index index_cdc
2022/08/04 23:44:31 Index found:  index_email
2022/08/04 23:44:31 Dropped index index_email
2022/08/04 23:44:31 Index found:  index_balance
2022/08/04 23:44:31 Dropped index index_balance
2022/08/04 23:44:31 Index found:  index_ageabove30
2022/08/04 23:44:31 Dropped index index_ageabove30
2022/08/04 23:44:31 Index found:  index_height
2022/08/04 23:44:31 Dropped index index_height
2022/08/04 23:44:31 Index found:  index_composite2
2022/08/04 23:44:31 Dropped index index_composite2
2022/08/04 23:44:31 Index found:  index_eyeColor
2022/08/04 23:44:31 Dropped index index_eyeColor
2022/08/04 23:44:31 Index found:  index_tags
2022/08/04 23:44:31 Dropped index index_tags
2022/08/04 23:44:31 Index found:  index_deferred
2022/08/04 23:44:31 Dropped index index_deferred
2022/08/04 23:44:31 Index found:  index_streetaddress
2022/08/04 23:44:31 Dropped index index_streetaddress
2022/08/04 23:44:31 Index found:  index_isActive
2022/08/04 23:44:31 Dropped index index_isActive
2022/08/04 23:44:31 Index found:  index_ageteens
2022/08/04 23:44:32 Dropped index index_ageteens
2022/08/04 23:44:32 Index found:  idx_numbertest
2022/08/04 23:44:32 Dropped index idx_numbertest
2022/08/04 23:44:32 Index found:  index_age
2022/08/04 23:44:32 Dropped index index_age
2022/08/04 23:44:32 Index found:  index_floor
2022/08/04 23:44:32 Dropped index index_floor
2022/08/04 23:44:50 Created the secondary index indexmut_1. Waiting for it become active
2022/08/04 23:44:50 Index is 1557761235329467208 now active
2022/08/04 23:44:50 Using n1ql client
2022/08/04 23:44:51 Expected and Actual scan responses are the same
2022/08/04 23:44:51 Len of expected and actual scan results are :  29902 and 29902
2022/08/04 23:44:51 ITERATION 0
2022/08/04 23:45:08 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:45:08 Index is 1160487296346528340 now active
2022/08/04 23:45:08 Using n1ql client
2022/08/04 23:45:08 Expected and Actual scan responses are the same
2022/08/04 23:45:08 Len of expected and actual scan results are :  39902 and 39902
2022/08/04 23:45:08 Using n1ql client
2022/08/04 23:45:08 Expected and Actual scan responses are the same
2022/08/04 23:45:08 Len of expected and actual scan results are :  39902 and 39902
2022/08/04 23:45:08 Dropping the secondary index indexmut_2
2022/08/04 23:45:08 Index dropped
2022/08/04 23:45:08 ITERATION 1
2022/08/04 23:45:25 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:45:25 Index is 14681464482599053315 now active
2022/08/04 23:45:25 Using n1ql client
2022/08/04 23:45:25 Expected and Actual scan responses are the same
2022/08/04 23:45:25 Len of expected and actual scan results are :  49902 and 49902
2022/08/04 23:45:25 Using n1ql client
2022/08/04 23:45:25 Expected and Actual scan responses are the same
2022/08/04 23:45:25 Len of expected and actual scan results are :  49902 and 49902
2022/08/04 23:45:25 Dropping the secondary index indexmut_2
2022/08/04 23:45:25 Index dropped
2022/08/04 23:45:25 ITERATION 2
2022/08/04 23:45:42 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:45:42 Index is 17505338753131224887 now active
2022/08/04 23:45:42 Using n1ql client
2022/08/04 23:45:43 Expected and Actual scan responses are the same
2022/08/04 23:45:43 Len of expected and actual scan results are :  59902 and 59902
2022/08/04 23:45:43 Using n1ql client
2022/08/04 23:45:43 Expected and Actual scan responses are the same
2022/08/04 23:45:43 Len of expected and actual scan results are :  59902 and 59902
2022/08/04 23:45:43 Dropping the secondary index indexmut_2
2022/08/04 23:45:43 Index dropped
2022/08/04 23:45:43 ITERATION 3
2022/08/04 23:46:01 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:46:01 Index is 3533473157922070966 now active
2022/08/04 23:46:01 Using n1ql client
2022/08/04 23:46:02 Expected and Actual scan responses are the same
2022/08/04 23:46:02 Len of expected and actual scan results are :  69902 and 69902
2022/08/04 23:46:02 Using n1ql client
2022/08/04 23:46:03 Expected and Actual scan responses are the same
2022/08/04 23:46:03 Len of expected and actual scan results are :  69902 and 69902
2022/08/04 23:46:03 Dropping the secondary index indexmut_2
2022/08/04 23:46:03 Index dropped
2022/08/04 23:46:03 ITERATION 4
2022/08/04 23:46:22 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:46:22 Index is 14258585058213855623 now active
2022/08/04 23:46:23 Using n1ql client
2022/08/04 23:46:23 Expected and Actual scan responses are the same
2022/08/04 23:46:23 Len of expected and actual scan results are :  79902 and 79902
2022/08/04 23:46:23 Using n1ql client
2022/08/04 23:46:24 Expected and Actual scan responses are the same
2022/08/04 23:46:24 Len of expected and actual scan results are :  79902 and 79902
2022/08/04 23:46:24 Dropping the secondary index indexmut_2
2022/08/04 23:46:24 Index dropped
2022/08/04 23:46:24 ITERATION 5
2022/08/04 23:46:42 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:46:42 Index is 854425538367676482 now active
2022/08/04 23:46:42 Using n1ql client
2022/08/04 23:46:42 Expected and Actual scan responses are the same
2022/08/04 23:46:42 Len of expected and actual scan results are :  89902 and 89902
2022/08/04 23:46:42 Using n1ql client
2022/08/04 23:46:43 Expected and Actual scan responses are the same
2022/08/04 23:46:43 Len of expected and actual scan results are :  89902 and 89902
2022/08/04 23:46:43 Dropping the secondary index indexmut_2
2022/08/04 23:46:43 Index dropped
2022/08/04 23:46:43 ITERATION 6
2022/08/04 23:47:03 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:47:03 Index is 5819010781344353002 now active
2022/08/04 23:47:03 Using n1ql client
2022/08/04 23:47:03 Expected and Actual scan responses are the same
2022/08/04 23:47:03 Len of expected and actual scan results are :  99902 and 99902
2022/08/04 23:47:03 Using n1ql client
2022/08/04 23:47:04 Expected and Actual scan responses are the same
2022/08/04 23:47:04 Len of expected and actual scan results are :  99902 and 99902
2022/08/04 23:47:04 Dropping the secondary index indexmut_2
2022/08/04 23:47:04 Index dropped
2022/08/04 23:47:04 ITERATION 7
2022/08/04 23:47:23 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:47:23 Index is 12228756787042620827 now active
2022/08/04 23:47:23 Using n1ql client
2022/08/04 23:47:24 Expected and Actual scan responses are the same
2022/08/04 23:47:24 Len of expected and actual scan results are :  109902 and 109902
2022/08/04 23:47:24 Using n1ql client
2022/08/04 23:47:25 Expected and Actual scan responses are the same
2022/08/04 23:47:25 Len of expected and actual scan results are :  109902 and 109902
2022/08/04 23:47:25 Dropping the secondary index indexmut_2
2022/08/04 23:47:25 Index dropped
2022/08/04 23:47:25 ITERATION 8
2022/08/04 23:47:45 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:47:45 Index is 10679370187430409689 now active
2022/08/04 23:47:46 Using n1ql client
2022/08/04 23:47:47 Expected and Actual scan responses are the same
2022/08/04 23:47:47 Len of expected and actual scan results are :  119902 and 119902
2022/08/04 23:47:47 Using n1ql client
2022/08/04 23:47:48 Expected and Actual scan responses are the same
2022/08/04 23:47:48 Len of expected and actual scan results are :  119902 and 119902
2022/08/04 23:47:48 Dropping the secondary index indexmut_2
2022/08/04 23:47:48 Index dropped
2022/08/04 23:47:48 ITERATION 9
2022/08/04 23:48:09 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:48:09 Index is 8097390161874977154 now active
2022/08/04 23:48:09 Using n1ql client
2022/08/04 23:48:10 Expected and Actual scan responses are the same
2022/08/04 23:48:10 Len of expected and actual scan results are :  129902 and 129902
2022/08/04 23:48:10 Using n1ql client
2022/08/04 23:48:12 Expected and Actual scan responses are the same
2022/08/04 23:48:12 Len of expected and actual scan results are :  129902 and 129902
2022/08/04 23:48:12 Dropping the secondary index indexmut_2
2022/08/04 23:48:12 Index dropped
2022/08/04 23:48:12 ITERATION 10
2022/08/04 23:48:32 Created the secondary index indexmut_2. Waiting for it become active
2022/08/04 23:48:32 Index is 9867437211011818153 now active
2022/08/04 23:48:33 Using n1ql client
2022/08/04 23:48:33 Expected and Actual scan responses are the same
2022/08/04 23:48:33 Len of expected and actual scan results are :  139902 and 139902
2022/08/04 23:48:34 Using n1ql client
2022/08/04 23:48:35 Expected and Actual scan responses are the same
2022/08/04 23:48:35 Len of expected and actual scan results are :  139902 and 139902
2022/08/04 23:48:35 Dropping the secondary index indexmut_2
2022/08/04 23:48:35 Index dropped
--- PASS: TestLargeMutations (245.24s)
=== RUN   TestPlanner
2022/08/04 23:48:35 In TestPlanner()
2022/08/04 23:48:35 -------------------------------------------
2022/08/04 23:48:35 initial placement - 20-50M, 10 index, 3 replica, 2x
2022-08-04T23:48:35.115+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:35.120+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-04T23:48:35.120+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-04T23:48:35.123+05:30 [Info] switched currmeta from 455 -> 455 force true 
2022-08-04T23:48:35.129+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-04T23:48:35.129+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-04T23:48:35.130+05:30 [Info] switched currmeta from 455 -> 455 force true 
2022-08-04T23:48:35.135+05:30 [Info] switched currmeta from 449 -> 451 force true 
2022-08-04T23:48:35.141+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-04T23:48:35.141+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-04T23:48:35.145+05:30 [Info] switched currmeta from 451 -> 451 force true 
2022-08-04T23:48:35.199+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:35.199+05:30 [Info] Score: 0.03908664824334135
2022-08-04T23:48:35.199+05:30 [Info] Memory Quota: 56600407600 (52.7132G)
2022-08-04T23:48:35.199+05:30 [Info] CPU Quota: 12
2022-08-04T23:48:35.199+05:30 [Info] Indexer Memory Mean 36172526504 (33.6883G)
2022-08-04T23:48:35.199+05:30 [Info] Indexer Memory Deviation 2827725639 (2.63352G) (7.82%)
2022-08-04T23:48:35.199+05:30 [Info] Indexer Memory Utilization 0.6391
2022-08-04T23:48:35.199+05:30 [Info] Indexer CPU Mean 9.0146
2022-08-04T23:48:35.199+05:30 [Info] Indexer CPU Deviation 2.67 (29.64%)
2022-08-04T23:48:35.199+05:30 [Info] Indexer CPU Utilization 0.7512
2022-08-04T23:48:35.199+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:35.199+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:35.199+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:35.199+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:35.199+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:35.199+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:35.199+05:30 [Info] Indexer Data Size Mean 36172526504 (33.6883G)
2022-08-04T23:48:35.199+05:30 [Info] Indexer Data Size Deviation 2827725639 (2.63352G) (7.82%)
2022-08-04T23:48:35.199+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:35.199+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:35.199+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:35.199+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:35 -------------------------------------------
2022/08/04 23:48:35 initial placement - 20-50M, 30 index, 3 replica, 2x
2022-08-04T23:48:35.200+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:36.160+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2022-08-04T23:48:36.165+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-04T23:48:36.165+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-04T23:48:36.166+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-04T23:48:36.166+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-04T23:48:36.167+05:30 [Info] switched currmeta from 455 -> 455 force true 
2022-08-04T23:48:36.167+05:30 [Info] switched currmeta from 451 -> 451 force true 
2022-08-04T23:48:36.250+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:36.250+05:30 [Info] Score: 0.034809893201812526
2022-08-04T23:48:36.250+05:30 [Info] Memory Quota: 56897076928 (52.9895G)
2022-08-04T23:48:36.250+05:30 [Info] CPU Quota: 12
2022-08-04T23:48:36.250+05:30 [Info] Indexer Memory Mean 37272559992 (34.7128G)
2022-08-04T23:48:36.250+05:30 [Info] Indexer Memory Deviation 2594907665 (2.4167G) (6.96%)
2022-08-04T23:48:36.250+05:30 [Info] Indexer Memory Utilization 0.6551
2022-08-04T23:48:36.250+05:30 [Info] Indexer CPU Mean 9.5684
2022-08-04T23:48:36.250+05:30 [Info] Indexer CPU Deviation 2.71 (28.31%)
2022-08-04T23:48:36.250+05:30 [Info] Indexer CPU Utilization 0.7974
2022-08-04T23:48:36.250+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:36.251+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:36.251+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:36.251+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:36.251+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:36.251+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:36.251+05:30 [Info] Indexer Data Size Mean 37272559992 (34.7128G)
2022-08-04T23:48:36.251+05:30 [Info] Indexer Data Size Deviation 2594907665 (2.4167G) (6.96%)
2022-08-04T23:48:36.251+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:36.251+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:36.251+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:36.251+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:36 -------------------------------------------
2022/08/04 23:48:36 initial placement - 20-50M, 30 index, 3 replica, 4x
2022-08-04T23:48:36.251+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:36.553+05:30 [Info] Score: 0.015403043582778381
2022-08-04T23:48:36.553+05:30 [Info] Memory Quota: 112234058460 (104.526G)
2022-08-04T23:48:36.553+05:30 [Info] CPU Quota: 24
2022-08-04T23:48:36.553+05:30 [Info] Indexer Memory Mean 75845101469 (70.6363G)
2022-08-04T23:48:36.553+05:30 [Info] Indexer Memory Deviation 2336490806 (2.17603G) (3.08%)
2022-08-04T23:48:36.553+05:30 [Info] Indexer Memory Utilization 0.6758
2022-08-04T23:48:36.553+05:30 [Info] Indexer CPU Mean 20.6128
2022-08-04T23:48:36.553+05:30 [Info] Indexer CPU Deviation 2.18 (10.56%)
2022-08-04T23:48:36.553+05:30 [Info] Indexer CPU Utilization 0.8589
2022-08-04T23:48:36.553+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:36.553+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:36.553+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:36.553+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:36.553+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:36.553+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:36.553+05:30 [Info] Indexer Data Size Mean 75845101469 (70.6363G)
2022-08-04T23:48:36.553+05:30 [Info] Indexer Data Size Deviation 2336490806 (2.17603G) (3.08%)
2022-08-04T23:48:36.553+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:36.553+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:36.553+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:36.553+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:36 -------------------------------------------
2022/08/04 23:48:36 initial placement - 200-500M, 10 index, 3 replica, 2x
2022-08-04T23:48:36.553+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:36.605+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:36.605+05:30 [Info] Score: 0.026977955521610787
2022-08-04T23:48:36.605+05:30 [Info] Memory Quota: 480259606018 (447.277G)
2022-08-04T23:48:36.605+05:30 [Info] CPU Quota: 12
2022-08-04T23:48:36.605+05:30 [Info] Indexer Memory Mean 368162087961 (342.878G)
2022-08-04T23:48:36.605+05:30 [Info] Indexer Memory Deviation 19864520867 (18.5003G) (5.40%)
2022-08-04T23:48:36.605+05:30 [Info] Indexer Memory Utilization 0.7666
2022-08-04T23:48:36.605+05:30 [Info] Indexer CPU Mean 9.7368
2022-08-04T23:48:36.605+05:30 [Info] Indexer CPU Deviation 3.03 (31.14%)
2022-08-04T23:48:36.605+05:30 [Info] Indexer CPU Utilization 0.8114
2022-08-04T23:48:36.605+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:36.605+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:36.605+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:36.605+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:36.605+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:36.605+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:36.605+05:30 [Info] Indexer Data Size Mean 368162087961 (342.878G)
2022-08-04T23:48:36.605+05:30 [Info] Indexer Data Size Deviation 19864520867 (18.5003G) (5.40%)
2022-08-04T23:48:36.605+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:36.605+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:36.605+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:36.605+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:36 -------------------------------------------
2022/08/04 23:48:36 initial placement - 200-500M, 30 index, 3 replica, 2x
2022-08-04T23:48:36.606+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:37.762+05:30 [Info] Score: 0.026158142940196277
2022-08-04T23:48:37.762+05:30 [Info] Memory Quota: 535313710562 (498.55G)
2022-08-04T23:48:37.762+05:30 [Info] CPU Quota: 12
2022-08-04T23:48:37.762+05:30 [Info] Indexer Memory Mean 410836783608 (382.622G)
2022-08-04T23:48:37.762+05:30 [Info] Indexer Memory Deviation 21493454621 (20.0173G) (5.23%)
2022-08-04T23:48:37.762+05:30 [Info] Indexer Memory Utilization 0.7675
2022-08-04T23:48:37.762+05:30 [Info] Indexer CPU Mean 10.4039
2022-08-04T23:48:37.762+05:30 [Info] Indexer CPU Deviation 2.61 (25.12%)
2022-08-04T23:48:37.762+05:30 [Info] Indexer CPU Utilization 0.8670
2022-08-04T23:48:37.762+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:37.762+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:37.762+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:37.762+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:37.762+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:37.762+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:37.762+05:30 [Info] Indexer Data Size Mean 410836783608 (382.622G)
2022-08-04T23:48:37.762+05:30 [Info] Indexer Data Size Deviation 21493454621 (20.0173G) (5.23%)
2022-08-04T23:48:37.762+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:37.762+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:37.762+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:37.762+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:37 -------------------------------------------
2022/08/04 23:48:37 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2022-08-04T23:48:37.763+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:37.973+05:30 [Info] Score: 0.010489058316434402
2022-08-04T23:48:37.973+05:30 [Info] Memory Quota: 331953596794 (309.156G)
2022-08-04T23:48:37.973+05:30 [Info] CPU Quota: 12
2022-08-04T23:48:37.973+05:30 [Info] Indexer Memory Mean 269057348925 (250.579G)
2022-08-04T23:48:37.973+05:30 [Info] Indexer Memory Deviation 5644316446 (5.25668G) (2.10%)
2022-08-04T23:48:37.973+05:30 [Info] Indexer Memory Utilization 0.8105
2022-08-04T23:48:37.973+05:30 [Info] Indexer CPU Mean 14.6861
2022-08-04T23:48:37.973+05:30 [Info] Indexer CPU Deviation 7.25 (49.34%)
2022-08-04T23:48:37.973+05:30 [Info] Indexer CPU Utilization 1.2238
2022-08-04T23:48:37.973+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:37.973+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:37.973+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:37.973+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:37.973+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:37.973+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:37.973+05:30 [Info] Indexer Data Size Mean 269057348925 (250.579G)
2022-08-04T23:48:37.973+05:30 [Info] Indexer Data Size Deviation 5644316446 (5.25668G) (2.10%)
2022-08-04T23:48:37.973+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:37.973+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:37.973+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:37.973+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:37 -------------------------------------------
2022/08/04 23:48:37 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2022-08-04T23:48:37.974+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:38.185+05:30 [Info] Score: 0.020619170423187536
2022-08-04T23:48:38.185+05:30 [Info] Memory Quota: 332201265687 (309.387G)
2022-08-04T23:48:38.185+05:30 [Info] CPU Quota: 20
2022-08-04T23:48:38.185+05:30 [Info] Indexer Memory Mean 262543604586 (244.513G)
2022-08-04T23:48:38.185+05:30 [Info] Indexer Memory Deviation 10826862652 (10.0833G) (4.12%)
2022-08-04T23:48:38.185+05:30 [Info] Indexer Memory Utilization 0.7903
2022-08-04T23:48:38.185+05:30 [Info] Indexer CPU Mean 13.4817
2022-08-04T23:48:38.185+05:30 [Info] Indexer CPU Deviation 7.00 (51.90%)
2022-08-04T23:48:38.185+05:30 [Info] Indexer CPU Utilization 0.6741
2022-08-04T23:48:38.185+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.185+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.185+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.185+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.185+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.185+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.185+05:30 [Info] Indexer Data Size Mean 262543604586 (244.513G)
2022-08-04T23:48:38.185+05:30 [Info] Indexer Data Size Deviation 10826862652 (10.0833G) (4.12%)
2022-08-04T23:48:38.185+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.185+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.185+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.185+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 initial placement - 6 2M index, 1 replica, 2x
2022-08-04T23:48:38.195+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:38.210+05:30 [Info] Score: 0
2022-08-04T23:48:38.210+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2022-08-04T23:48:38.210+05:30 [Info] CPU Quota: 2
2022-08-04T23:48:38.210+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2022-08-04T23:48:38.210+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.210+05:30 [Info] Indexer Memory Utilization 0.4290
2022-08-04T23:48:38.210+05:30 [Info] Indexer CPU Mean 1.2000
2022-08-04T23:48:38.210+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:38.210+05:30 [Info] Indexer CPU Utilization 0.6000
2022-08-04T23:48:38.210+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.210+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.210+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.210+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.210+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.210+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.210+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2022-08-04T23:48:38.210+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.210+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.210+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.210+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.210+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 initial placement - 5 20M primary index, 2 replica, 2x
2022-08-04T23:48:38.220+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:38.264+05:30 [Info] Score: 0
2022-08-04T23:48:38.265+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2022-08-04T23:48:38.265+05:30 [Info] CPU Quota: 2
2022-08-04T23:48:38.265+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2022-08-04T23:48:38.265+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.265+05:30 [Info] Indexer Memory Utilization 0.7659
2022-08-04T23:48:38.265+05:30 [Info] Indexer CPU Mean 1.2000
2022-08-04T23:48:38.265+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:38.265+05:30 [Info] Indexer CPU Utilization 0.6000
2022-08-04T23:48:38.265+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.265+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.265+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.265+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.265+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.265+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.265+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2022-08-04T23:48:38.265+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.265+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.265+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.265+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.265+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 initial placement - 5 20M array index, 2 replica, 2x
2022-08-04T23:48:38.275+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:38.314+05:30 [Info] Score: 0
2022-08-04T23:48:38.314+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2022-08-04T23:48:38.314+05:30 [Info] CPU Quota: 2
2022-08-04T23:48:38.314+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2022-08-04T23:48:38.314+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.314+05:30 [Info] Indexer Memory Utilization 0.8063
2022-08-04T23:48:38.314+05:30 [Info] Indexer CPU Mean 1.2000
2022-08-04T23:48:38.314+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:38.314+05:30 [Info] Indexer CPU Utilization 0.6000
2022-08-04T23:48:38.314+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.314+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.314+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.314+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.314+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.314+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.314+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2022-08-04T23:48:38.314+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.314+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.314+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.314+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.314+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 initial placement - 3 replica constraint, 2 index, 2x
2022-08-04T23:48:38.318+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:38.355+05:30 [Info] Score: 0
2022-08-04T23:48:38.355+05:30 [Info] Memory Quota: 530294000 (505.728M)
2022-08-04T23:48:38.355+05:30 [Info] CPU Quota: 2
2022-08-04T23:48:38.355+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2022-08-04T23:48:38.355+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.355+05:30 [Info] Indexer Memory Utilization 0.0049
2022-08-04T23:48:38.355+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:38.355+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:38.355+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:38.355+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.356+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.356+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.356+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.356+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.356+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.356+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2022-08-04T23:48:38.356+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.356+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.356+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.356+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.356+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2022-08-04T23:48:38.365+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.02148089679202831
2022-08-04T23:48:38.491+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:38.491+05:30 [Info] Score: 0.007189938568471697
2022-08-04T23:48:38.491+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2022-08-04T23:48:38.491+05:30 [Info] CPU Quota: 27
2022-08-04T23:48:38.491+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2022-08-04T23:48:38.491+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2022-08-04T23:48:38.491+05:30 [Info] Indexer Memory Utilization 0.5679
2022-08-04T23:48:38.491+05:30 [Info] Indexer CPU Mean 20.1734
2022-08-04T23:48:38.491+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2022-08-04T23:48:38.491+05:30 [Info] Indexer CPU Utilization 0.7472
2022-08-04T23:48:38.491+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.491+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.491+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.491+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.491+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.491+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.491+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2022-08-04T23:48:38.491+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2022-08-04T23:48:38.491+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.491+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.491+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.491+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2022-08-04T23:48:38.502+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002447833413464229
2022-08-04T23:48:38.720+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:38.720+05:30 [Info] Score: 0.00043718596495524715
2022-08-04T23:48:38.720+05:30 [Info] Memory Quota: 536870912000 (500G)
2022-08-04T23:48:38.720+05:30 [Info] CPU Quota: 20
2022-08-04T23:48:38.720+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2022-08-04T23:48:38.720+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2022-08-04T23:48:38.720+05:30 [Info] Indexer Memory Utilization 0.7321
2022-08-04T23:48:38.720+05:30 [Info] Indexer CPU Mean 14.2305
2022-08-04T23:48:38.720+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2022-08-04T23:48:38.720+05:30 [Info] Indexer CPU Utilization 0.7115
2022-08-04T23:48:38.720+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.720+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.720+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.720+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.720+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.720+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.720+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2022-08-04T23:48:38.720+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2022-08-04T23:48:38.720+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.720+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.720+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.720+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 incr placement - 3 server group, 3 replica, 1x
2022-08-04T23:48:38.723+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:38.736+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:38.736+05:30 [Info] Score: 0
2022-08-04T23:48:38.736+05:30 [Info] Memory Quota: 530294000 (505.728M)
2022-08-04T23:48:38.736+05:30 [Info] CPU Quota: 16
2022-08-04T23:48:38.736+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2022-08-04T23:48:38.736+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.736+05:30 [Info] Indexer Memory Utilization 0.0049
2022-08-04T23:48:38.736+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:38.736+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:38.736+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:38.736+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.736+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.736+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.736+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.736+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.736+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.736+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2022-08-04T23:48:38.736+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.736+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.736+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.736+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.736+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 incr placement - 2 server group, 3 replica, 1x
2022-08-04T23:48:38.739+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2022-08-04T23:48:38.739+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2022-08-04T23:48:38.739+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2022-08-04T23:48:38.739+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.414213562373095
2022-08-04T23:48:38.764+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:38.764+05:30 [Info] Score: 0
2022-08-04T23:48:38.764+05:30 [Info] Memory Quota: 530294000 (505.728M)
2022-08-04T23:48:38.764+05:30 [Info] CPU Quota: 16
2022-08-04T23:48:38.764+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2022-08-04T23:48:38.764+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.764+05:30 [Info] Indexer Memory Utilization 0.0049
2022-08-04T23:48:38.764+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:38.764+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:38.764+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:38.764+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.764+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.764+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.764+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.764+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.764+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.765+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2022-08-04T23:48:38.765+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:38.765+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:38.765+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:38.765+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:38.765+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2022-08-04T23:48:38.767+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.13077680594539962
2022-08-04T23:48:38.767+05:30 [Info] Planner::initial temperature: initial resource variation 0.13077680594539962 temp 0.013077680594539962
2022-08-04T23:48:38.932+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:38.932+05:30 [Info] Score: 0.20799143388659797
2022-08-04T23:48:38.932+05:30 [Info] Memory Quota: 139586437120 (130G)
2022-08-04T23:48:38.932+05:30 [Info] CPU Quota: 30
2022-08-04T23:48:38.932+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2022-08-04T23:48:38.932+05:30 [Info] Indexer Memory Deviation 2856975854 (2.66077G) (3.21%)
2022-08-04T23:48:38.932+05:30 [Info] Indexer Memory Utilization 0.6367
2022-08-04T23:48:38.932+05:30 [Info] Indexer CPU Mean 24.0538
2022-08-04T23:48:38.932+05:30 [Info] Indexer CPU Deviation 3.31 (13.75%)
2022-08-04T23:48:38.932+05:30 [Info] Indexer CPU Utilization 0.8018
2022-08-04T23:48:38.932+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:38.932+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:38.932+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:38.932+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.932+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:38.932+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:38.932+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2022-08-04T23:48:38.932+05:30 [Info] Indexer Data Size Deviation 2856975854 (2.66077G) (3.21%)
2022-08-04T23:48:38.932+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2022-08-04T23:48:38.932+05:30 [Info] Index Data Moved (exclude new node) 401.563G (40.43%)
2022-08-04T23:48:38.932+05:30 [Info] No. Index (from non-deleted node) 90
2022-08-04T23:48:38.932+05:30 [Info] No. Index Moved (exclude new node) 35 (38.89%)
2022/08/04 23:48:38 -------------------------------------------
2022/08/04 23:48:38 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2022-08-04T23:48:38.934+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.32896762844255256
2022-08-04T23:48:38.934+05:30 [Info] Planner::initial temperature: initial resource variation 0.32896762844255256 temp 0.03289676284425526
2022-08-04T23:48:39.121+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:39.122+05:30 [Info] Score: 0.22364699150483075
2022-08-04T23:48:39.122+05:30 [Info] Memory Quota: 536870912000 (500G)
2022-08-04T23:48:39.122+05:30 [Info] CPU Quota: 20
2022-08-04T23:48:39.122+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2022-08-04T23:48:39.122+05:30 [Info] Indexer Memory Deviation 35159990701 (32.7453G) (8.96%)
2022-08-04T23:48:39.122+05:30 [Info] Indexer Memory Utilization 0.7311
2022-08-04T23:48:39.122+05:30 [Info] Indexer CPU Mean 13.9305
2022-08-04T23:48:39.122+05:30 [Info] Indexer CPU Deviation 3.79 (27.21%)
2022-08-04T23:48:39.122+05:30 [Info] Indexer CPU Utilization 0.6965
2022-08-04T23:48:39.122+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.122+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.122+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.122+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.122+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.122+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.122+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2022-08-04T23:48:39.122+05:30 [Info] Indexer Data Size Deviation 35159990701 (32.7453G) (8.96%)
2022-08-04T23:48:39.122+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2022-08-04T23:48:39.122+05:30 [Info] Index Data Moved (exclude new node) 2.31915T (54.14%)
2022-08-04T23:48:39.122+05:30 [Info] No. Index (from non-deleted node) 90
2022-08-04T23:48:39.122+05:30 [Info] No. Index Moved (exclude new node) 22 (24.44%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 rebalance - travel sample, 10% shuffle, 1x
2022-08-04T23:48:39.122+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.13691781619622104
2022-08-04T23:48:39.123+05:30 [Info] Planner::initial temperature: initial resource variation 0.13691781619622104 temp 0.013691781619622104
2022-08-04T23:48:39.141+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:39.141+05:30 [Info] Score: 0.02999339696992057
2022-08-04T23:48:39.141+05:30 [Info] Memory Quota: 536870912 (512M)
2022-08-04T23:48:39.141+05:30 [Info] CPU Quota: 8
2022-08-04T23:48:39.142+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2022-08-04T23:48:39.142+05:30 [Info] Indexer Memory Deviation 368000 (359.375K) (2.10%)
2022-08-04T23:48:39.142+05:30 [Info] Indexer Memory Utilization 0.0326
2022-08-04T23:48:39.142+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:39.142+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:39.142+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:39.142+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.142+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.142+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.142+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.142+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.142+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.142+05:30 [Info] Indexer Data Size Mean 0 (0)
2022-08-04T23:48:39.142+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.142+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:39.142+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:39.142+05:30 [Info] No. Index (from non-deleted node) 10
2022-08-04T23:48:39.142+05:30 [Info] No. Index Moved (exclude new node) 1 (10.00%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 rebalance - 20-50M, 90 index, swap 2, 1x
2022-08-04T23:48:39.143+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4095843409677649
2022-08-04T23:48:39.143+05:30 [Info] Planner::initial temperature: initial resource variation 0.4095843409677649 temp 0.04095843409677649
2022-08-04T23:48:39.337+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:39.337+05:30 [Info] Score: 0.014358825799550981
2022-08-04T23:48:39.337+05:30 [Info] Memory Quota: 139586437120 (130G)
2022-08-04T23:48:39.337+05:30 [Info] CPU Quota: 30
2022-08-04T23:48:39.337+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2022-08-04T23:48:39.337+05:30 [Info] Indexer Memory Deviation 2552326335 (2.37704G) (2.87%)
2022-08-04T23:48:39.337+05:30 [Info] Indexer Memory Utilization 0.6367
2022-08-04T23:48:39.337+05:30 [Info] Indexer CPU Mean 24.0538
2022-08-04T23:48:39.337+05:30 [Info] Indexer CPU Deviation 2.22 (9.24%)
2022-08-04T23:48:39.337+05:30 [Info] Indexer CPU Utilization 0.8018
2022-08-04T23:48:39.337+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.337+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.337+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.337+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.337+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.337+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.337+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2022-08-04T23:48:39.337+05:30 [Info] Indexer Data Size Deviation 2552326335 (2.37704G) (2.87%)
2022-08-04T23:48:39.337+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:39.337+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:39.337+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:39.338+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 rebalance - mixed small/medium, 90 index, swap 2, 1x
2022-08-04T23:48:39.339+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4082556623939647
2022-08-04T23:48:39.339+05:30 [Info] Planner::initial temperature: initial resource variation 0.4082556623939647 temp 0.040825566239396475
2022-08-04T23:48:39.491+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:39.491+05:30 [Info] Score: 0.0011801176006832744
2022-08-04T23:48:39.491+05:30 [Info] Memory Quota: 536870912000 (500G)
2022-08-04T23:48:39.491+05:30 [Info] CPU Quota: 20
2022-08-04T23:48:39.491+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2022-08-04T23:48:39.491+05:30 [Info] Indexer Memory Deviation 926405539 (883.489M) (0.24%)
2022-08-04T23:48:39.491+05:30 [Info] Indexer Memory Utilization 0.7311
2022-08-04T23:48:39.491+05:30 [Info] Indexer CPU Mean 13.9305
2022-08-04T23:48:39.491+05:30 [Info] Indexer CPU Deviation 0.59 (4.21%)
2022-08-04T23:48:39.491+05:30 [Info] Indexer CPU Utilization 0.6965
2022-08-04T23:48:39.491+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.491+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.491+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.491+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.491+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.491+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.491+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2022-08-04T23:48:39.491+05:30 [Info] Indexer Data Size Deviation 926405539 (883.489M) (0.24%)
2022-08-04T23:48:39.491+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:39.491+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:39.491+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:39.491+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 rebalance - travel sample, swap 2, 1x
2022-08-04T23:48:39.492+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0086622738872069
2022-08-04T23:48:39.492+05:30 [Info] Planner::initial temperature: initial resource variation 1.0086622738872069 temp 0.1008662273887207
2022-08-04T23:48:39.623+05:30 [Info] Score: 0.0003181929343700274
2022-08-04T23:48:39.623+05:30 [Info] Memory Quota: 536870912 (512M)
2022-08-04T23:48:39.623+05:30 [Info] CPU Quota: 8
2022-08-04T23:48:39.623+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2022-08-04T23:48:39.623+05:30 [Info] Indexer Memory Deviation 22277 (21.7549K) (0.13%)
2022-08-04T23:48:39.623+05:30 [Info] Indexer Memory Utilization 0.0326
2022-08-04T23:48:39.623+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:39.623+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:39.624+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:39.624+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.624+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.624+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.624+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.624+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.624+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.624+05:30 [Info] Indexer Data Size Mean 0 (0)
2022-08-04T23:48:39.624+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.624+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:39.624+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:39.624+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:39.624+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 rebalance - 8 identical index, add 4, 1x
2022-08-04T23:48:39.624+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1
2022-08-04T23:48:39.624+05:30 [Info] Planner::initial temperature: initial resource variation 1 temp 0.1
2022-08-04T23:48:39.640+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:39.640+05:30 [Info] Score: 0.1875
2022-08-04T23:48:39.640+05:30 [Info] Memory Quota: 530294000 (505.728M)
2022-08-04T23:48:39.640+05:30 [Info] CPU Quota: 2
2022-08-04T23:48:39.640+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2022-08-04T23:48:39.640+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.641+05:30 [Info] Indexer Memory Utilization 0.0049
2022-08-04T23:48:39.641+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:39.641+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:39.641+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:39.641+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.641+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.641+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.641+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.641+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.641+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.641+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2022-08-04T23:48:39.641+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.641+05:30 [Info] Total Index Data (from non-deleted node) 19.8364M
2022-08-04T23:48:39.641+05:30 [Info] Index Data Moved (exclude new node) 7.43866M (37.50%)
2022-08-04T23:48:39.641+05:30 [Info] No. Index (from non-deleted node) 8
2022-08-04T23:48:39.641+05:30 [Info] No. Index Moved (exclude new node) 3 (37.50%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 rebalance - 8 identical index, delete 2, 2x
2022-08-04T23:48:39.641+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:39.641+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2022-08-04T23:48:39.689+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:39.689+05:30 [Info] Score: 0
2022-08-04T23:48:39.689+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2022-08-04T23:48:39.689+05:30 [Info] CPU Quota: 4
2022-08-04T23:48:39.689+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2022-08-04T23:48:39.689+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.689+05:30 [Info] Indexer Memory Utilization 0.0098
2022-08-04T23:48:39.689+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:39.689+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:39.689+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:39.689+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.689+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.689+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.689+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.689+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.689+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.689+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2022-08-04T23:48:39.689+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.689+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:39.689+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:39.689+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:39.689+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2022-08-04T23:48:39.690+05:30 [Warn] There is more replica than available nodes.  Will not move index replica (default,,,country) from ejected node 127.0.0.1:9003
2022-08-04T23:48:39.690+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2022-08-04T23:48:39.690+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2022-08-04T23:48:39.690+05:30 [Info] Score: 0
2022-08-04T23:48:39.690+05:30 [Info] Memory Quota: 536870912 (512M)
2022-08-04T23:48:39.690+05:30 [Info] CPU Quota: 16
2022-08-04T23:48:39.690+05:30 [Info] Indexer Memory Mean 0 (0)
2022-08-04T23:48:39.690+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.690+05:30 [Info] Indexer Memory Utilization 0.0000
2022-08-04T23:48:39.690+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:39.690+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:39.690+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:39.690+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.690+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.690+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.690+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.690+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.690+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.690+05:30 [Info] Indexer Data Size Mean 0 (0)
2022-08-04T23:48:39.690+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.690+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:39.690+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:39.691+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:39.691+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2022-08-04T23:48:39.691+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2022-08-04T23:48:39.691+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2022-08-04T23:48:39.691+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022-08-04T23:48:39.691+05:30 [Info] Score: 0
2022-08-04T23:48:39.691+05:30 [Info] Memory Quota: 268435456 (256M)
2022-08-04T23:48:39.691+05:30 [Info] CPU Quota: 8
2022-08-04T23:48:39.691+05:30 [Info] Indexer Memory Mean 0 (0)
2022-08-04T23:48:39.691+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.691+05:30 [Info] Indexer Memory Utilization 0.0000
2022-08-04T23:48:39.691+05:30 [Info] Indexer CPU Mean 0.0000
2022-08-04T23:48:39.691+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2022-08-04T23:48:39.691+05:30 [Info] Indexer CPU Utilization 0.0000
2022-08-04T23:48:39.691+05:30 [Info] Indexer IO Mean 0.0000
2022-08-04T23:48:39.691+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2022-08-04T23:48:39.691+05:30 [Info] Indexer Drain Rate Mean 0.0000
2022-08-04T23:48:39.691+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.691+05:30 [Info] Indexer Scan Rate Mean 0.0000
2022-08-04T23:48:39.691+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2022-08-04T23:48:39.691+05:30 [Info] Indexer Data Size Mean 0 (0)
2022-08-04T23:48:39.691+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2022-08-04T23:48:39.691+05:30 [Info] Total Index Data (from non-deleted node) 0
2022-08-04T23:48:39.691+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2022-08-04T23:48:39.691+05:30 [Info] No. Index (from non-deleted node) 0
2022-08-04T23:48:39.691+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 Minimum memory test 1: min memory = 0
2022-08-04T23:48:39.692+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2022-08-04T23:48:39.692+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2022-08-04T23:48:39.695+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022/08/04 23:48:39 -------------------------------------------
2022/08/04 23:48:39 Minimum memory test 2: min memory > quota
2022-08-04T23:48:39.695+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=5us
2022-08-04T23:48:39.695+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=5us
2022-08-04T23:48:39.695+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=4us
2022-08-04T23:48:39.695+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2022-08-04T23:48:39.695+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2022/08/04 23:48:40 -------------------------------------------
2022/08/04 23:48:40 Minimum memory test 3: min memory < quota
2022-08-04T23:48:40.667+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2022-08-04T23:48:40.667+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2022-08-04T23:48:41.162+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2022-08-04T23:48:41.168+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-04T23:48:41.168+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-04T23:48:41.169+05:30 [Info] switched currmeta from 455 -> 455 force true 
2022-08-04T23:48:41.169+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-04T23:48:41.169+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-04T23:48:41.171+05:30 [Info] switched currmeta from 451 -> 451 force true 
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Minimum memory test 4: replica repair with min memory > quota
2022-08-04T23:48:41.638+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2022-08-04T23:48:41.638+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=5us
2022-08-04T23:48:41.638+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=5us
2022-08-04T23:48:41.638+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=4us
2022-08-04T23:48:41.638+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2022-08-04T23:48:41.638+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2022-08-04T23:48:41.638+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022-08-04T23:48:41.638+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:41.638+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=202us
2022-08-04T23:48:41.638+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2022-08-04T23:48:41.638+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2022-08-04T23:48:41.638+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022-08-04T23:48:41.638+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:41.638+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=182us
2022-08-04T23:48:41.638+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster.  Will not rebuild lost replica.
2022-08-04T23:48:41.638+05:30 [Warn] 
MemoryQuota: 200
CpuQuota: 8
--- Violations for index  (mem 130, cpu 0) at node 127.0.0.1:9003 
	Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
	Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2022-08-04T23:48:41.638+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:41.639+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0 is less than threshold: 0. No nodes have been added or deleted and there are no violations observed
2022-08-04T23:48:41.639+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Minimum memory test 5: replica repair with min memory < quota
2022-08-04T23:48:41.639+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2022-08-04T23:48:41.639+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2022-08-04T23:48:41.639+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2022-08-04T23:48:41.647+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Minimum memory test 6: rebalance with min memory > quota
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=5us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=5us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=3us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=3us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=3us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=3us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7.  Elapsed Time=3us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8.  Elapsed Time=6us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9.  Elapsed Time=7us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10.  Elapsed Time=6us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11.  Elapsed Time=4us
2022-08-04T23:48:41.647+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12.  Elapsed Time=3us
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Minimum memory test 7: rebalance-out with min memory > quota
2022-08-04T23:48:41.648+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=5us
2022-08-04T23:48:41.648+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=4us
2022-08-04T23:48:41.648+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=3us
2022-08-04T23:48:41.648+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=3us
2022-08-04T23:48:41.648+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=4us
2022-08-04T23:48:41.648+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=3us
2022-08-04T23:48:41.648+05:30 [Warn] Unable to find a solution with resource constraint.  Relax resource constraint check.
2022-08-04T23:48:41.648+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2022-08-04T23:48:41.648+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2022-08-04T23:48:41.648+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Minimum memory test 8: plan with min memory > quota
2022-08-04T23:48:41.651+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2022-08-04T23:48:41.652+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022-08-04T23:48:41.652+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:41.652+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=970us
2022-08-04T23:48:41.652+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=4us
2022-08-04T23:48:41.652+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=3us
2022-08-04T23:48:41.652+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=3us
2022-08-04T23:48:41.652+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=4us
2022-08-04T23:48:41.652+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=6us
2022-08-04T23:48:41.652+05:30 [Warn] Unable to find a solution with resource constraint.  Relax resource constraint check.
2022-08-04T23:48:41.652+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.375
2022-08-04T23:48:41.652+05:30 [Info] Planner::finalizing the solution as final solution is found.
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Minimum memory test 9: single node rebalance with min memory > quota
2022-08-04T23:48:41.652+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=7us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=5us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=3us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=3us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=4us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=3us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7.  Elapsed Time=5us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8.  Elapsed Time=5us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9.  Elapsed Time=3us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10.  Elapsed Time=3us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11.  Elapsed Time=3us
2022-08-04T23:48:41.653+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12.  Elapsed Time=6us
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Minimum memory test 10: plan with partitioned index on empty cluster
2022-08-04T23:48:41.655+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2022-08-04T23:48:41.673+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 iterationTest :: Remove one node - failure
2022-08-04T23:48:41.674+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3349337357844169
2022-08-04T23:48:41.750+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:41.750+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.750+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.750+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.750+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.750+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12612216695439288).
2022-08-04T23:48:41.750+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1.  Elapsed Time=447us
2022-08-04T23:48:41.750+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.750+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.751+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.751+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.751+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13659811201736746).
2022-08-04T23:48:41.751+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2.  Elapsed Time=421us
2022-08-04T23:48:41.751+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.751+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.751+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.751+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.751+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.16653752062287006).
2022-08-04T23:48:41.751+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3.  Elapsed Time=485us
2022-08-04T23:48:41.751+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.751+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.752+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.752+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.752+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.16896095804043387).
2022-08-04T23:48:41.752+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4.  Elapsed Time=463us
2022-08-04T23:48:41.752+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.752+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.752+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.752+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.752+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.14679405468089415).
2022-08-04T23:48:41.752+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5.  Elapsed Time=487us
2022-08-04T23:48:41.752+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.752+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.753+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.753+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.753+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.18552448752391004).
2022-08-04T23:48:41.753+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6.  Elapsed Time=447us
2022-08-04T23:48:41.753+05:30 [Warn] Unable to find a solution with resource constraint.  Relax resource constraint check.
2022-08-04T23:48:41.753+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.753+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.753+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.753+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.753+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.11824095262183981).
2022-08-04T23:48:41.753+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7.  Elapsed Time=455us
2022-08-04T23:48:41.753+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.753+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.754+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.754+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.754+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.14831164324848478).
2022-08-04T23:48:41.754+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8.  Elapsed Time=407us
2022-08-04T23:48:41.754+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.754+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.754+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.754+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.754+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1650446464882298).
2022-08-04T23:48:41.754+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9.  Elapsed Time=410us
2022-08-04T23:48:41.754+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.754+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.754+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.755+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.755+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1638635530577652).
2022-08-04T23:48:41.755+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10.  Elapsed Time=447us
2022-08-04T23:48:41.755+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.755+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.755+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.755+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.755+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.13975448750491473).
2022-08-04T23:48:41.755+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11.  Elapsed Time=378us
2022-08-04T23:48:41.755+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.007511716683722629
2022-08-04T23:48:41.755+05:30 [Info] Planner::initial temperature: initial resource variation 0.007511716683722629 temp 0.034248828331627734
2022-08-04T23:48:41.755+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.755+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2022-08-04T23:48:41.755+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.20872408425308484).
2022-08-04T23:48:41.756+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12.  Elapsed Time=483us
2022-08-04T23:48:41.756+05:30 [Error] 
MemoryQuota: 5302940000000
CpuQuota: 6
--- Violations for index <5633103427246217052, bucket1, , > (mem 15.4401G, cpu 2.03092) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.5957T, free cpu -35.90016)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64431T, free cpu -25.138920000000002)
--- Violations for index <6287830300829480205, bucket1, , > (mem 21.7624G, cpu 4.1662) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.5957T, free cpu -35.90016)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64431T, free cpu -25.138920000000002)
--- Violations for index <7310285573408404893, bucket1, , > (mem 21.0243G, cpu 4.11768) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.5957T, free cpu -35.90016)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64431T, free cpu -25.138920000000002)
--- Violations for index <1768802022274013128, bucket1, , > (mem 18.3078G, cpu 1.05956) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.5957T, free cpu -35.90016)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64431T, free cpu -25.138920000000002)
--- Violations for index <135167126034792660, bucket1, , > (mem 17.4106G, cpu 3.60564) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.5957T, free cpu -35.90016)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64431T, free cpu -25.138920000000002)
--- Violations for index <1702492417850448870, bucket1, , > (mem 17.3311G, cpu 2.8224400000000003) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.5957T, free cpu -35.90016)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64431T, free cpu -25.138920000000002)
--- Violations for index <8808818563403735276, bucket1, , > (mem 14.6901G, cpu 4.343999999999999) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.5957T, free cpu -35.90016)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64431T, free cpu -25.138920000000002)
--- Violations for index <12719371816875230938, bucket1, , > (mem 13.992G, cpu 3.32524) at node 127.0.0.1:9001 
	Can move to 127.0.0.1:9002: NoViolation (free mem 4.5957T, free cpu -35.90016)
	Can move to 127.0.0.1:9003: NoViolation (free mem 4.64431T, free cpu -25.138920000000002)
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 iterationTest :: Remove one node - success
2022-08-04T23:48:41.756+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3320325981894003
2022-08-04T23:48:41.831+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:41.832+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.01012685573930425
2022-08-04T23:48:41.832+05:30 [Info] Planner::initial temperature: initial resource variation 0.01012685573930425 temp 0.023987314426069578
2022-08-04T23:48:41.832+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2022-08-04T23:48:41.832+05:30 [Info] Planner::Finished planner run after 11 iterations.
2022-08-04T23:48:41.832+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.005569820253487955).
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 iterationTest :: Index rebuild - success
2022-08-04T23:48:41.834+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i22,1)
2022-08-04T23:48:41.834+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i0,1)
2022-08-04T23:48:41.834+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i5,1)
2022-08-04T23:48:41.834+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i10,1)
2022-08-04T23:48:41.834+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i13,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i15,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i18,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i28,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i2,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i4,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i8,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i11,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i24,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i26,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i3,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i6,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i12,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i14,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i20,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i23,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i27,1)
2022-08-04T23:48:41.835+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i1,1)
2022-08-04T23:48:41.836+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i25,1)
2022-08-04T23:48:41.836+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i29,1)
2022-08-04T23:48:41.836+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i7,1)
2022-08-04T23:48:41.836+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i9,1)
2022-08-04T23:48:41.836+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i16,1)
2022-08-04T23:48:41.836+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i17,1)
2022-08-04T23:48:41.836+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i19,1)
2022-08-04T23:48:41.836+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i21,1)
2022-08-04T23:48:41.836+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5792715732327589
2022-08-04T23:48:41.836+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0.5792715732327589 is less than threshold: 0.8. No nodes have been added or deleted and there are no violations observed
2022-08-04T23:48:41.837+05:30 [Info] Planner::initial temperature: initial resource variation 0.5792715732327589 temp 0.022072842676724116
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 iterationTest :: Index rebuild - initial placement - success
2022-08-04T23:48:41.837+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1)
2022-08-04T23:48:41.837+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1)
2022-08-04T23:48:41.837+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1)
2022-08-04T23:48:41.837+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6236095644623236
2022-08-04T23:48:41.837+05:30 [Info] Planner::initial temperature: initial resource variation 0.6236095644623236 temp 0.03663904355376764
2022-08-04T23:48:41.838+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2022-08-04T23:48:41.838+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:41.838+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.6236095644623236).
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 iterationTest :: Index rebuild - initial placement - numReplica > numSG - success
2022-08-04T23:48:41.838+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1)
2022-08-04T23:48:41.838+05:30 [Info] Rebuilding lost replica for (default,,,idx1,2)
2022-08-04T23:48:41.838+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1)
2022-08-04T23:48:41.838+05:30 [Info] Rebuilding lost replica for (default,,,idx2,2)
2022-08-04T23:48:41.838+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1)
2022-08-04T23:48:41.838+05:30 [Info] Rebuilding lost replica for (default,,,idx3,2)
2022-08-04T23:48:41.838+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2022-08-04T23:48:41.838+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2022-08-04T23:48:41.838+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2022-08-04T23:48:41.838+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2022-08-04T23:48:41.838+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2022-08-04T23:48:41.838+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2022-08-04T23:48:41.838+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2022-08-04T23:48:41.839+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3333333333333333
2022-08-04T23:48:41.839+05:30 [Info] Planner::initial temperature: initial resource variation 0.3333333333333333 temp 0.06566666666666668
2022-08-04T23:48:41.839+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2022-08-04T23:48:41.839+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2022-08-04T23:48:41.839+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.3333333333333333).
--- PASS: TestPlanner (6.73s)
=== RUN   TestGreedyPlanner
2022/08/04 23:48:41 In TestGreedyPlanner()
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Single Index Instance - 3 empty nodes - 1 SG
2022-08-04T23:48:41.842+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Single Index Instance - 2 empty nodes, 1 non-empty node - 1 SG
2022-08-04T23:48:41.844+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Single Index Instance - 1 empty node, 2 non-empty nodes - 1 SG
2022-08-04T23:48:41.845+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Single Index Instance - 3 non-empty nodes - 1 SG
2022-08-04T23:48:41.848+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 1 Replica - 3 empty nodes - 1 SG
2022-08-04T23:48:41.850+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 1 SG
2022-08-04T23:48:41.852+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 1 SG
2022-08-04T23:48:41.854+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 1 Replica - 3 non-empty nodes - 1 SG
2022-08-04T23:48:41.856+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 2 Replica - 3 empty nodes - 1 SG
2022-08-04T23:48:41.858+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 2 Replica - 3 non-empty nodes - 1 SG
2022-08-04T23:48:41.860+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 2 SG
2022-08-04T23:48:41.861+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 2 SG
2022-08-04T23:48:41.864+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Index With 1 Replica - 3 non-empty nodes - 2 SG
2022-08-04T23:48:41.867+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Equivalent Index Without any replica - 3 non-empty nodes - 1 SG
2022-08-04T23:48:41.870+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Skip least loaded node
2022-08-04T23:48:41.872+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Use least loaded node
2022-08-04T23:48:41.875+05:30 [Info] Using greedy index placement for index 987654
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place 60 index instaces on 3 empty nodes - 1 SG
2022-08-04T23:48:41.876+05:30 [Info] Using greedy index placement for index 1000987654
2022-08-04T23:48:41.878+05:30 [Info] Using greedy index placement for index 1001987654
2022-08-04T23:48:41.880+05:30 [Info] Using greedy index placement for index 1002987654
2022-08-04T23:48:41.881+05:30 [Info] Using greedy index placement for index 1003987654
2022-08-04T23:48:41.883+05:30 [Info] Using greedy index placement for index 1004987654
2022-08-04T23:48:41.884+05:30 [Info] Using greedy index placement for index 1005987654
2022-08-04T23:48:41.886+05:30 [Info] Using greedy index placement for index 1006987654
2022-08-04T23:48:41.888+05:30 [Info] Using greedy index placement for index 1007987654
2022-08-04T23:48:41.889+05:30 [Info] Using greedy index placement for index 1008987654
2022-08-04T23:48:41.891+05:30 [Info] Using greedy index placement for index 1009987654
2022-08-04T23:48:41.893+05:30 [Info] Using greedy index placement for index 1010987654
2022-08-04T23:48:41.894+05:30 [Info] Using greedy index placement for index 1011987654
2022-08-04T23:48:41.896+05:30 [Info] Using greedy index placement for index 1012987654
2022-08-04T23:48:41.897+05:30 [Info] Using greedy index placement for index 1013987654
2022-08-04T23:48:41.899+05:30 [Info] Using greedy index placement for index 1014987654
2022-08-04T23:48:41.901+05:30 [Info] Using greedy index placement for index 1015987654
2022-08-04T23:48:41.902+05:30 [Info] Using greedy index placement for index 1016987654
2022-08-04T23:48:41.904+05:30 [Info] Using greedy index placement for index 1017987654
2022-08-04T23:48:41.906+05:30 [Info] Using greedy index placement for index 1018987654
2022-08-04T23:48:41.908+05:30 [Info] Using greedy index placement for index 1019987654
2022-08-04T23:48:41.910+05:30 [Info] Using greedy index placement for index 1020987654
2022-08-04T23:48:41.911+05:30 [Info] Using greedy index placement for index 1021987654
2022-08-04T23:48:41.913+05:30 [Info] Using greedy index placement for index 1022987654
2022-08-04T23:48:41.915+05:30 [Info] Using greedy index placement for index 1023987654
2022-08-04T23:48:41.917+05:30 [Info] Using greedy index placement for index 1024987654
2022-08-04T23:48:41.918+05:30 [Info] Using greedy index placement for index 1025987654
2022-08-04T23:48:41.920+05:30 [Info] Using greedy index placement for index 1026987654
2022-08-04T23:48:41.921+05:30 [Info] Using greedy index placement for index 1027987654
2022-08-04T23:48:41.923+05:30 [Info] Using greedy index placement for index 1028987654
2022-08-04T23:48:41.925+05:30 [Info] Using greedy index placement for index 1029987654
2022-08-04T23:48:41.927+05:30 [Info] Using greedy index placement for index 1030987654
2022-08-04T23:48:41.928+05:30 [Info] Using greedy index placement for index 1031987654
2022-08-04T23:48:41.930+05:30 [Info] Using greedy index placement for index 1032987654
2022-08-04T23:48:41.932+05:30 [Info] Using greedy index placement for index 1033987654
2022-08-04T23:48:41.933+05:30 [Info] Using greedy index placement for index 1034987654
2022-08-04T23:48:41.935+05:30 [Info] Using greedy index placement for index 1035987654
2022-08-04T23:48:41.937+05:30 [Info] Using greedy index placement for index 1036987654
2022-08-04T23:48:41.938+05:30 [Info] Using greedy index placement for index 1037987654
2022-08-04T23:48:41.940+05:30 [Info] Using greedy index placement for index 1038987654
2022-08-04T23:48:41.942+05:30 [Info] Using greedy index placement for index 1039987654
2022-08-04T23:48:41.943+05:30 [Info] Using greedy index placement for index 1040987654
2022-08-04T23:48:41.945+05:30 [Info] Using greedy index placement for index 1041987654
2022-08-04T23:48:41.947+05:30 [Info] Using greedy index placement for index 1042987654
2022-08-04T23:48:41.948+05:30 [Info] Using greedy index placement for index 1043987654
2022-08-04T23:48:41.950+05:30 [Info] Using greedy index placement for index 1044987654
2022-08-04T23:48:41.952+05:30 [Info] Using greedy index placement for index 1045987654
2022-08-04T23:48:41.954+05:30 [Info] Using greedy index placement for index 1046987654
2022-08-04T23:48:41.955+05:30 [Info] Using greedy index placement for index 1047987654
2022-08-04T23:48:41.957+05:30 [Info] Using greedy index placement for index 1048987654
2022-08-04T23:48:41.959+05:30 [Info] Using greedy index placement for index 1049987654
2022-08-04T23:48:41.961+05:30 [Info] Using greedy index placement for index 1050987654
2022-08-04T23:48:41.962+05:30 [Info] Using greedy index placement for index 1051987654
2022-08-04T23:48:41.964+05:30 [Info] Using greedy index placement for index 1052987654
2022-08-04T23:48:41.966+05:30 [Info] Using greedy index placement for index 1053987654
2022-08-04T23:48:41.967+05:30 [Info] Using greedy index placement for index 1054987654
2022-08-04T23:48:41.969+05:30 [Info] Using greedy index placement for index 1055987654
2022-08-04T23:48:41.971+05:30 [Info] Using greedy index placement for index 1056987654
2022-08-04T23:48:41.973+05:30 [Info] Using greedy index placement for index 1057987654
2022-08-04T23:48:41.975+05:30 [Info] Using greedy index placement for index 1058987654
2022-08-04T23:48:41.977+05:30 [Info] Using greedy index placement for index 1059987654
2022-08-04T23:48:41.977+05:30 [Info] Actual variance of deferred index count across nodes is 0
2022/08/04 23:48:41 -------------------------------------------
2022/08/04 23:48:41 Place 60 index instaces on 1 empty and 1 10 percent filled node - 1 SG
2022-08-04T23:48:41.979+05:30 [Info] Using greedy index placement for index 1000987654
2022-08-04T23:48:41.981+05:30 [Info] Using greedy index placement for index 1001987654
2022-08-04T23:48:41.982+05:30 [Info] Using greedy index placement for index 1002987654
2022-08-04T23:48:41.984+05:30 [Info] Using greedy index placement for index 1003987654
2022-08-04T23:48:41.985+05:30 [Info] Using greedy index placement for index 1004987654
2022-08-04T23:48:41.987+05:30 [Info] Using greedy index placement for index 1005987654
2022-08-04T23:48:41.989+05:30 [Info] Using greedy index placement for index 1006987654
2022-08-04T23:48:41.990+05:30 [Info] Using greedy index placement for index 1007987654
2022-08-04T23:48:41.992+05:30 [Info] Using greedy index placement for index 1008987654
2022-08-04T23:48:41.993+05:30 [Info] Using greedy index placement for index 1009987654
2022-08-04T23:48:41.995+05:30 [Info] Using greedy index placement for index 1010987654
2022-08-04T23:48:41.997+05:30 [Info] Using greedy index placement for index 1011987654
2022-08-04T23:48:41.998+05:30 [Info] Using greedy index placement for index 1012987654
2022-08-04T23:48:42.000+05:30 [Info] Using greedy index placement for index 1013987654
2022-08-04T23:48:42.002+05:30 [Info] Using greedy index placement for index 1014987654
2022-08-04T23:48:42.004+05:30 [Info] Using greedy index placement for index 1015987654
2022-08-04T23:48:42.005+05:30 [Info] Using greedy index placement for index 1016987654
2022-08-04T23:48:42.007+05:30 [Info] Using greedy index placement for index 1017987654
2022-08-04T23:48:42.009+05:30 [Info] Using greedy index placement for index 1018987654
2022-08-04T23:48:42.010+05:30 [Info] Using greedy index placement for index 1019987654
2022-08-04T23:48:42.012+05:30 [Info] Using greedy index placement for index 1020987654
2022-08-04T23:48:42.014+05:30 [Info] Using greedy index placement for index 1021987654
2022-08-04T23:48:42.016+05:30 [Info] Using greedy index placement for index 1022987654
2022-08-04T23:48:42.017+05:30 [Info] Using greedy index placement for index 1023987654
2022-08-04T23:48:42.019+05:30 [Info] Using greedy index placement for index 1024987654
2022-08-04T23:48:42.021+05:30 [Info] Using greedy index placement for index 1025987654
2022-08-04T23:48:42.022+05:30 [Info] Using greedy index placement for index 1026987654
2022-08-04T23:48:42.024+05:30 [Info] Using greedy index placement for index 1027987654
2022-08-04T23:48:42.026+05:30 [Info] Using greedy index placement for index 1028987654
2022-08-04T23:48:42.027+05:30 [Info] Using greedy index placement for index 1029987654
2022-08-04T23:48:42.029+05:30 [Info] Using greedy index placement for index 1030987654
2022-08-04T23:48:42.031+05:30 [Info] Using greedy index placement for index 1031987654
2022-08-04T23:48:42.032+05:30 [Info] Using greedy index placement for index 1032987654
2022-08-04T23:48:42.034+05:30 [Info] Using greedy index placement for index 1033987654
2022-08-04T23:48:42.036+05:30 [Info] Using greedy index placement for index 1034987654
2022-08-04T23:48:42.037+05:30 [Info] Using greedy index placement for index 1035987654
2022-08-04T23:48:42.039+05:30 [Info] Using greedy index placement for index 1036987654
2022-08-04T23:48:42.040+05:30 [Info] Using greedy index placement for index 1037987654
2022-08-04T23:48:42.042+05:30 [Info] Using greedy index placement for index 1038987654
2022-08-04T23:48:42.044+05:30 [Info] Using greedy index placement for index 1039987654
2022-08-04T23:48:42.045+05:30 [Info] Using greedy index placement for index 1040987654
2022-08-04T23:48:42.047+05:30 [Info] Using greedy index placement for index 1041987654
2022-08-04T23:48:42.049+05:30 [Info] Using greedy index placement for index 1042987654
2022-08-04T23:48:42.051+05:30 [Info] Using greedy index placement for index 1043987654
2022-08-04T23:48:42.053+05:30 [Info] Using greedy index placement for index 1044987654
2022-08-04T23:48:42.054+05:30 [Info] Using greedy index placement for index 1045987654
2022-08-04T23:48:42.056+05:30 [Info] Using greedy index placement for index 1046987654
2022-08-04T23:48:42.058+05:30 [Info] Using greedy index placement for index 1047987654
2022-08-04T23:48:42.059+05:30 [Info] Using greedy index placement for index 1048987654
2022-08-04T23:48:42.061+05:30 [Info] Using greedy index placement for index 1049987654
2022-08-04T23:48:42.063+05:30 [Info] Using greedy index placement for index 1050987654
2022-08-04T23:48:42.064+05:30 [Info] Using greedy index placement for index 1051987654
2022-08-04T23:48:42.066+05:30 [Info] Using greedy index placement for index 1052987654
2022-08-04T23:48:42.068+05:30 [Info] Using greedy index placement for index 1053987654
2022-08-04T23:48:42.070+05:30 [Info] Using greedy index placement for index 1054987654
2022-08-04T23:48:42.072+05:30 [Info] Using greedy index placement for index 1055987654
2022-08-04T23:48:42.074+05:30 [Info] Using greedy index placement for index 1056987654
2022-08-04T23:48:42.076+05:30 [Info] Using greedy index placement for index 1057987654
2022-08-04T23:48:42.077+05:30 [Info] Using greedy index placement for index 1058987654
2022-08-04T23:48:42.079+05:30 [Info] Using greedy index placement for index 1059987654
2022-08-04T23:48:42.079+05:30 [Info] Actual variance of deferred index count across nodes is 8
2022/08/04 23:48:42 -------------------------------------------
2022/08/04 23:48:42 Place 60 index instaces on 1 empty and 1 30 percent filled node - 1 SG
2022-08-04T23:48:42.081+05:30 [Info] Using greedy index placement for index 1000987654
2022-08-04T23:48:42.083+05:30 [Info] Using greedy index placement for index 1001987654
2022-08-04T23:48:42.085+05:30 [Info] Using greedy index placement for index 1002987654
2022-08-04T23:48:42.086+05:30 [Info] Using greedy index placement for index 1003987654
2022-08-04T23:48:42.088+05:30 [Info] Using greedy index placement for index 1004987654
2022-08-04T23:48:42.089+05:30 [Info] Using greedy index placement for index 1005987654
2022-08-04T23:48:42.091+05:30 [Info] Using greedy index placement for index 1006987654
2022-08-04T23:48:42.093+05:30 [Info] Using greedy index placement for index 1007987654
2022-08-04T23:48:42.094+05:30 [Info] Using greedy index placement for index 1008987654
2022-08-04T23:48:42.096+05:30 [Info] Using greedy index placement for index 1009987654
2022-08-04T23:48:42.098+05:30 [Info] Using greedy index placement for index 1010987654
2022-08-04T23:48:42.099+05:30 [Info] Using greedy index placement for index 1011987654
2022-08-04T23:48:42.101+05:30 [Info] Using greedy index placement for index 1012987654
2022-08-04T23:48:42.102+05:30 [Info] Using greedy index placement for index 1013987654
2022-08-04T23:48:42.104+05:30 [Info] Using greedy index placement for index 1014987654
2022-08-04T23:48:42.106+05:30 [Info] Using greedy index placement for index 1015987654
2022-08-04T23:48:42.108+05:30 [Info] Using greedy index placement for index 1016987654
2022-08-04T23:48:42.109+05:30 [Info] Using greedy index placement for index 1017987654
2022-08-04T23:48:42.111+05:30 [Info] Using greedy index placement for index 1018987654
2022-08-04T23:48:42.113+05:30 [Info] Using greedy index placement for index 1019987654
2022-08-04T23:48:42.114+05:30 [Info] Using greedy index placement for index 1020987654
2022-08-04T23:48:42.116+05:30 [Info] Using greedy index placement for index 1021987654
2022-08-04T23:48:42.118+05:30 [Info] Using greedy index placement for index 1022987654
2022-08-04T23:48:42.119+05:30 [Info] Using greedy index placement for index 1023987654
2022-08-04T23:48:42.121+05:30 [Info] Using greedy index placement for index 1024987654
2022-08-04T23:48:42.123+05:30 [Info] Using greedy index placement for index 1025987654
2022-08-04T23:48:42.124+05:30 [Info] Using greedy index placement for index 1026987654
2022-08-04T23:48:42.126+05:30 [Info] Using greedy index placement for index 1027987654
2022-08-04T23:48:42.128+05:30 [Info] Using greedy index placement for index 1028987654
2022-08-04T23:48:42.129+05:30 [Info] Using greedy index placement for index 1029987654
2022-08-04T23:48:42.131+05:30 [Info] Using greedy index placement for index 1030987654
2022-08-04T23:48:42.133+05:30 [Info] Using greedy index placement for index 1031987654
2022-08-04T23:48:42.134+05:30 [Info] Using greedy index placement for index 1032987654
2022-08-04T23:48:42.136+05:30 [Info] Using greedy index placement for index 1033987654
2022-08-04T23:48:42.138+05:30 [Info] Using greedy index placement for index 1034987654
2022-08-04T23:48:42.139+05:30 [Info] Using greedy index placement for index 1035987654
2022-08-04T23:48:42.141+05:30 [Info] Using greedy index placement for index 1036987654
2022-08-04T23:48:42.143+05:30 [Info] Using greedy index placement for index 1037987654
2022-08-04T23:48:42.144+05:30 [Info] Using greedy index placement for index 1038987654
2022-08-04T23:48:42.146+05:30 [Info] Using greedy index placement for index 1039987654
2022-08-04T23:48:42.148+05:30 [Info] Using greedy index placement for index 1040987654
2022-08-04T23:48:42.149+05:30 [Info] Using greedy index placement for index 1041987654
2022-08-04T23:48:42.151+05:30 [Info] Using greedy index placement for index 1042987654
2022-08-04T23:48:42.153+05:30 [Info] Using greedy index placement for index 1043987654
2022-08-04T23:48:42.155+05:30 [Info] Using greedy index placement for index 1044987654
2022-08-04T23:48:42.156+05:30 [Info] Using greedy index placement for index 1045987654
2022-08-04T23:48:42.158+05:30 [Info] Using greedy index placement for index 1046987654
2022-08-04T23:48:42.160+05:30 [Info] Using greedy index placement for index 1047987654
2022-08-04T23:48:42.162+05:30 [Info] Using greedy index placement for index 1048987654
2022-08-04T23:48:42.163+05:30 [Info] Using greedy index placement for index 1049987654
2022-08-04T23:48:42.165+05:30 [Info] Using greedy index placement for index 1050987654
2022-08-04T23:48:42.167+05:30 [Info] Using greedy index placement for index 1051987654
2022-08-04T23:48:42.169+05:30 [Info] Using greedy index placement for index 1052987654
2022-08-04T23:48:42.170+05:30 [Info] Using greedy index placement for index 1053987654
2022-08-04T23:48:42.172+05:30 [Info] Using greedy index placement for index 1054987654
2022-08-04T23:48:42.174+05:30 [Info] Using greedy index placement for index 1055987654
2022-08-04T23:48:42.176+05:30 [Info] Using greedy index placement for index 1056987654
2022-08-04T23:48:42.177+05:30 [Info] Using greedy index placement for index 1057987654
2022-08-04T23:48:42.179+05:30 [Info] Using greedy index placement for index 1058987654
2022-08-04T23:48:42.181+05:30 [Info] Using greedy index placement for index 1059987654
2022-08-04T23:48:42.181+05:30 [Info] Actual variance of deferred index count across nodes is 98
2022/08/04 23:48:42 -------------------------------------------
2022/08/04 23:48:42 Place 5 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2022-08-04T23:48:42.183+05:30 [Info] Using greedy index placement for index 1000987654
2022-08-04T23:48:42.185+05:30 [Info] Using greedy index placement for index 1001987654
2022-08-04T23:48:42.186+05:30 [Info] Using greedy index placement for index 1002987654
2022-08-04T23:48:42.188+05:30 [Info] Using greedy index placement for index 1003987654
2022-08-04T23:48:42.190+05:30 [Info] Using greedy index placement for index 1004987654
2022-08-04T23:48:42.190+05:30 [Info] Actual variance of deferred index count across nodes is 4.5
2022/08/04 23:48:42 -------------------------------------------
2022/08/04 23:48:42 Place 60 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2022-08-04T23:48:42.191+05:30 [Info] Using greedy index placement for index 1000987654
2022-08-04T23:48:42.193+05:30 [Info] Using greedy index placement for index 1001987654
2022-08-04T23:48:42.195+05:30 [Info] Using greedy index placement for index 1002987654
2022-08-04T23:48:42.197+05:30 [Info] Using greedy index placement for index 1003987654
2022-08-04T23:48:42.198+05:30 [Info] Using greedy index placement for index 1004987654
2022-08-04T23:48:42.200+05:30 [Info] Using greedy index placement for index 1005987654
2022-08-04T23:48:42.201+05:30 [Info] Using greedy index placement for index 1006987654
2022-08-04T23:48:42.203+05:30 [Info] Using greedy index placement for index 1007987654
2022-08-04T23:48:42.205+05:30 [Info] Using greedy index placement for index 1008987654
2022-08-04T23:48:42.206+05:30 [Info] Using greedy index placement for index 1009987654
2022-08-04T23:48:42.208+05:30 [Info] Using greedy index placement for index 1010987654
2022-08-04T23:48:42.209+05:30 [Info] Using greedy index placement for index 1011987654
2022-08-04T23:48:42.211+05:30 [Info] Using greedy index placement for index 1012987654
2022-08-04T23:48:42.213+05:30 [Info] Using greedy index placement for index 1013987654
2022-08-04T23:48:42.215+05:30 [Info] Using greedy index placement for index 1014987654
2022-08-04T23:48:42.216+05:30 [Info] Using greedy index placement for index 1015987654
2022-08-04T23:48:42.218+05:30 [Info] Using greedy index placement for index 1016987654
2022-08-04T23:48:42.220+05:30 [Info] Using greedy index placement for index 1017987654
2022-08-04T23:48:42.221+05:30 [Info] Using greedy index placement for index 1018987654
2022-08-04T23:48:42.223+05:30 [Info] Using greedy index placement for index 1019987654
2022-08-04T23:48:42.224+05:30 [Info] Using greedy index placement for index 1020987654
2022-08-04T23:48:42.226+05:30 [Info] Using greedy index placement for index 1021987654
2022-08-04T23:48:42.228+05:30 [Info] Using greedy index placement for index 1022987654
2022-08-04T23:48:42.229+05:30 [Info] Using greedy index placement for index 1023987654
2022-08-04T23:48:42.231+05:30 [Info] Using greedy index placement for index 1024987654
2022-08-04T23:48:42.233+05:30 [Info] Using greedy index placement for index 1025987654
2022-08-04T23:48:42.235+05:30 [Info] Using greedy index placement for index 1026987654
2022-08-04T23:48:42.237+05:30 [Info] Using greedy index placement for index 1027987654
2022-08-04T23:48:42.239+05:30 [Info] Using greedy index placement for index 1028987654
2022-08-04T23:48:42.241+05:30 [Info] Using greedy index placement for index 1029987654
2022-08-04T23:48:42.242+05:30 [Info] Using greedy index placement for index 1030987654
2022-08-04T23:48:42.244+05:30 [Info] Using greedy index placement for index 1031987654
2022-08-04T23:48:42.246+05:30 [Info] Using greedy index placement for index 1032987654
2022-08-04T23:48:42.247+05:30 [Info] Using greedy index placement for index 1033987654
2022-08-04T23:48:42.249+05:30 [Info] Using greedy index placement for index 1034987654
2022-08-04T23:48:42.251+05:30 [Info] Using greedy index placement for index 1035987654
2022-08-04T23:48:42.252+05:30 [Info] Using greedy index placement for index 1036987654
2022-08-04T23:48:42.254+05:30 [Info] Using greedy index placement for index 1037987654
2022-08-04T23:48:42.256+05:30 [Info] Using greedy index placement for index 1038987654
2022-08-04T23:48:42.258+05:30 [Info] Using greedy index placement for index 1039987654
2022-08-04T23:48:42.259+05:30 [Info] Using greedy index placement for index 1040987654
2022-08-04T23:48:42.261+05:30 [Info] Using greedy index placement for index 1041987654
2022-08-04T23:48:42.263+05:30 [Info] Using greedy index placement for index 1042987654
2022-08-04T23:48:42.265+05:30 [Info] Using greedy index placement for index 1043987654
2022-08-04T23:48:42.266+05:30 [Info] Using greedy index placement for index 1044987654
2022-08-04T23:48:42.268+05:30 [Info] Using greedy index placement for index 1045987654
2022-08-04T23:48:42.270+05:30 [Info] Using greedy index placement for index 1046987654
2022-08-04T23:48:42.272+05:30 [Info] Using greedy index placement for index 1047987654
2022-08-04T23:48:42.274+05:30 [Info] Using greedy index placement for index 1048987654
2022-08-04T23:48:42.275+05:30 [Info] Using greedy index placement for index 1049987654
2022-08-04T23:48:42.277+05:30 [Info] Using greedy index placement for index 1050987654
2022-08-04T23:48:42.279+05:30 [Info] Using greedy index placement for index 1051987654
2022-08-04T23:48:42.281+05:30 [Info] Using greedy index placement for index 1052987654
2022-08-04T23:48:42.282+05:30 [Info] Using greedy index placement for index 1053987654
2022-08-04T23:48:42.284+05:30 [Info] Using greedy index placement for index 1054987654
2022-08-04T23:48:42.286+05:30 [Info] Using greedy index placement for index 1055987654
2022-08-04T23:48:42.288+05:30 [Info] Using greedy index placement for index 1056987654
2022-08-04T23:48:42.289+05:30 [Info] Using greedy index placement for index 1057987654
2022-08-04T23:48:42.291+05:30 [Info] Using greedy index placement for index 1058987654
2022-08-04T23:48:42.293+05:30 [Info] Using greedy index placement for index 1059987654
2022-08-04T23:48:42.293+05:30 [Info] Actual variance of deferred index count across nodes is 648
--- PASS: TestGreedyPlanner (0.45s)
=== RUN   TestRestfulAPI
2022/08/04 23:48:42 In TestRestfulAPI()
2022/08/04 23:48:42 In DropAllSecondaryIndexes()
2022/08/04 23:48:42 Index found:  indexmut_1
2022/08/04 23:48:42 Dropped index indexmut_1
2022/08/04 23:48:42 Setting JSON docs in KV
2022/08/04 23:48:43 GET all indexes
2022/08/04 23:48:43 200 OK
2022/08/04 23:48:43 FOUND indexes: []
2022/08/04 23:48:43 DROP index: badindexid
2022/08/04 23:48:43 status: 400 Bad Request
2022/08/04 23:48:43 DROP index: 23544142
2022/08/04 23:48:43 status: 500 Internal Server Error
2022/08/04 23:48:43 TEST: malformed body
2022/08/04 23:48:43 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"

2022/08/04 23:48:43 TEST: missing field ``name``
2022/08/04 23:48:43 400 Bad Request "missing field name"
2022/08/04 23:48:43 TEST: empty field ``name``
2022/08/04 23:48:43 400 Bad Request "empty field name"
2022/08/04 23:48:43 TEST: missing field ``bucket``
2022/08/04 23:48:43 400 Bad Request "missing field bucket"
2022/08/04 23:48:43 TEST: empty field ``bucket``
2022/08/04 23:48:43 400 Bad Request "empty field bucket"
2022/08/04 23:48:43 TEST: missing field ``secExprs``
2022/08/04 23:48:43 400 Bad Request "missing field secExprs"
2022/08/04 23:48:43 TEST: empty field ``secExprs``
2022/08/04 23:48:43 400 Bad Request "empty field secExprs"
2022/08/04 23:48:43 TEST: incomplete field ``desc``
2022/08/04 23:48:43 400 Bad Request "incomplete desc information [true]"
2022/08/04 23:48:43 TEST: invalid field ``desc``
2022/08/04 23:48:43 400 Bad Request "incomplete desc information [1]"
2022/08/04 23:48:43 
2022/08/04 23:48:43 CREATE INDEX: idx1
2022/08/04 23:48:54 status : 201 Created
2022/08/04 23:48:54 {"id": "17395622560407069523"} 
2022/08/04 23:48:54 CREATE INDEX: idx2 (defer)
2022/08/04 23:48:54 status : 201 Created
2022/08/04 23:48:54 {"id": "10221980865690498323"} 
2022/08/04 23:48:54 CREATE INDEX: idx3 (defer)
2022/08/04 23:48:54 status : 201 Created
2022/08/04 23:48:54 {"id": "11192998132935968069"} 
2022/08/04 23:48:54 CREATE INDEX: idx4 (defer)
2022/08/04 23:48:54 status : 201 Created
2022/08/04 23:48:54 {"id": "13322462061249764802"} 
2022/08/04 23:48:54 CREATE INDEX: idx5
2022/08/04 23:49:06 status : 201 Created
2022/08/04 23:49:06 {"id": "3196796298590933909"} 
2022/08/04 23:49:06 BUILD single deferred index
2022/08/04 23:49:06 202 Accepted
2022/08/04 23:49:06 GET all indexes
2022/08/04 23:49:06 200 OK
2022/08/04 23:49:06 index idx1 in INDEX_STATE_ACTIVE
2022/08/04 23:49:06 GET all indexes
2022/08/04 23:49:06 200 OK
2022/08/04 23:49:06 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:07 GET all indexes
2022/08/04 23:49:07 200 OK
2022/08/04 23:49:07 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:08 GET all indexes
2022/08/04 23:49:08 200 OK
2022/08/04 23:49:08 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:09 GET all indexes
2022/08/04 23:49:09 200 OK
2022/08/04 23:49:09 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:10 GET all indexes
2022/08/04 23:49:10 200 OK
2022/08/04 23:49:10 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:11 GET all indexes
2022/08/04 23:49:11 200 OK
2022/08/04 23:49:11 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:12 GET all indexes
2022/08/04 23:49:12 200 OK
2022/08/04 23:49:12 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:13 GET all indexes
2022/08/04 23:49:13 200 OK
2022/08/04 23:49:13 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:14 GET all indexes
2022/08/04 23:49:14 200 OK
2022/08/04 23:49:14 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:15 GET all indexes
2022/08/04 23:49:15 200 OK
2022/08/04 23:49:15 index idx2 in INDEX_STATE_INITIAL
2022/08/04 23:49:16 GET all indexes
2022/08/04 23:49:16 200 OK
2022/08/04 23:49:16 index idx2 in INDEX_STATE_ACTIVE
2022/08/04 23:49:16 BUILD many deferred index
2022/08/04 23:49:16 202 Accepted 
2022/08/04 23:49:17 GET all indexes
2022/08/04 23:49:17 200 OK
2022/08/04 23:49:17 index idx1 in INDEX_STATE_ACTIVE
2022/08/04 23:49:17 GET all indexes
2022/08/04 23:49:17 200 OK
2022/08/04 23:49:17 index idx2 in INDEX_STATE_ACTIVE
2022/08/04 23:49:17 GET all indexes
2022/08/04 23:49:17 200 OK
2022/08/04 23:49:17 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:18 GET all indexes
2022/08/04 23:49:18 200 OK
2022/08/04 23:49:18 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:19 GET all indexes
2022/08/04 23:49:19 200 OK
2022/08/04 23:49:19 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:20 GET all indexes
2022/08/04 23:49:20 200 OK
2022/08/04 23:49:20 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:21 GET all indexes
2022/08/04 23:49:21 200 OK
2022/08/04 23:49:21 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:22 GET all indexes
2022/08/04 23:49:22 200 OK
2022/08/04 23:49:22 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:23 GET all indexes
2022/08/04 23:49:23 200 OK
2022/08/04 23:49:23 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:24 GET all indexes
2022/08/04 23:49:24 200 OK
2022/08/04 23:49:24 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:25 GET all indexes
2022/08/04 23:49:25 200 OK
2022/08/04 23:49:25 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:26 GET all indexes
2022/08/04 23:49:26 200 OK
2022/08/04 23:49:26 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:27 GET all indexes
2022/08/04 23:49:27 200 OK
2022/08/04 23:49:27 index idx3 in INDEX_STATE_INITIAL
2022/08/04 23:49:28 GET all indexes
2022/08/04 23:49:28 200 OK
2022/08/04 23:49:28 index idx3 in INDEX_STATE_CATCHUP
2022/08/04 23:49:29 GET all indexes
2022/08/04 23:49:29 200 OK
2022/08/04 23:49:29 index idx3 in INDEX_STATE_ACTIVE
2022/08/04 23:49:29 GET all indexes
2022/08/04 23:49:29 200 OK
2022/08/04 23:49:29 index idx4 in INDEX_STATE_ACTIVE
2022/08/04 23:49:29 GET all indexes
2022/08/04 23:49:29 200 OK
2022/08/04 23:49:29 index idx5 in INDEX_STATE_ACTIVE
2022/08/04 23:49:29 GET all indexes
2022/08/04 23:49:29 200 OK
2022/08/04 23:49:29 CREATED indexes: [17395622560407069523 10221980865690498323 11192998132935968069 13322462061249764802 3196796298590933909]
2022/08/04 23:49:29 
2022/08/04 23:49:29 LOOKUP missing index
2022/08/04 23:49:29 status : 404 Not Found
2022/08/04 23:49:29 LOOKUP Pyongyang
2022/08/04 23:49:29 status : 200 OK
2022/08/04 23:49:29 number of entries 579
2022/08/04 23:49:29 Expected and Actual scan responses are the same
2022/08/04 23:49:29 LOOKUP with stale as false
2022/08/04 23:49:29 status : 200 OK
2022/08/04 23:49:29 number of entries 579
2022/08/04 23:49:29 Expected and Actual scan responses are the same
2022/08/04 23:49:29 LOOKUP with Rome
2022/08/04 23:49:29 status : 200 OK
2022/08/04 23:49:29 number of entries 552
2022/08/04 23:49:30 Expected and Actual scan responses are the same
2022/08/04 23:49:30 RANGE missing index
2022/08/04 23:49:30 Status : 404 Not Found
2022/08/04 23:49:30 RANGE cities - none
2022/08/04 23:49:30 Status : 200 OK
2022/08/04 23:49:34 number of entries 140902
2022/08/04 23:49:35 Expected and Actual scan responses are the same
2022/08/04 23:49:35 RANGE cities -low
2022/08/04 23:49:35 Status : 200 OK
2022/08/04 23:49:39 number of entries 140902
2022/08/04 23:49:40 Expected and Actual scan responses are the same
2022/08/04 23:49:40 RANGE cities -high
2022/08/04 23:49:40 Status : 200 OK
2022/08/04 23:49:44 number of entries 140902
2022/08/04 23:49:46 Expected and Actual scan responses are the same
2022/08/04 23:49:46 RANGE cities - both
2022/08/04 23:49:46 Status : 200 OK
2022/08/04 23:49:50 number of entries 140902
2022/08/04 23:49:51 Expected and Actual scan responses are the same
2022/08/04 23:49:51 RANGE missing cities
2022/08/04 23:49:51 Status : 200 OK
2022/08/04 23:49:51 number of entries 0
2022/08/04 23:49:51 Expected and Actual scan responses are the same
2022/08/04 23:49:51 
2022/08/04 23:49:51 SCANALL missing index
2022/08/04 23:49:51 {"limit":1000000,"stale":"ok"}
2022/08/04 23:49:51 Status : 404 Not Found
2022/08/04 23:49:51 SCANALL stale ok
2022/08/04 23:49:51 {"limit":1000000,"stale":"ok"}
2022/08/04 23:49:51 Status : 200 OK
2022/08/04 23:49:56 number of entries 140902
2022/08/04 23:49:56 Expected and Actual scan responses are the same
2022/08/04 23:49:56 SCANALL stale false
2022/08/04 23:49:56 {"limit":1000000,"stale":"false"}
2022/08/04 23:49:56 Status : 200 OK
2022/08/04 23:50:00 number of entries 140902
2022/08/04 23:50:01 Expected and Actual scan responses are the same
2022/08/04 23:50:01 
2022/08/04 23:50:01 COUNT missing index
2022/08/04 23:50:01 Status : 404 Not Found
2022/08/04 23:50:01 COUNT cities - none
2022/08/04 23:50:01 Status : 200 OK
2022/08/04 23:50:01 number of entries 140902
2022/08/04 23:50:02 COUNT cities -low
2022/08/04 23:50:02 Status : 200 OK
2022/08/04 23:50:02 number of entries 140902
2022/08/04 23:50:02 COUNT cities -high
2022/08/04 23:50:02 Status : 200 OK
2022/08/04 23:50:02 number of entries 140902
2022/08/04 23:50:02 COUNT cities - both
2022/08/04 23:50:02 Status : 200 OK
2022/08/04 23:50:02 number of entries 140902
2022/08/04 23:50:02 COUNT missing cities
2022/08/04 23:50:02 Status : 200 OK
2022/08/04 23:50:02 number of entries 0
2022/08/04 23:50:03 
2022/08/04 23:50:04 STATS: Testing URLs with valid authentication
2022/08/04 23:50:04 STATS: Testing URLs with invalid authentication
2022/08/04 23:50:04 STATS: Testing invalid URLs
2022/08/04 23:50:04 STATS: Testing unsupported methods
2022/08/04 23:50:04 
--- PASS: TestRestfulAPI (82.14s)
=== RUN   TestStatIndexInstFilter
2022/08/04 23:50:04 CREATE INDEX: statIdx1
2022/08/04 23:50:15 status : 201 Created
2022/08/04 23:50:15 {"id": "5968988343411994482"} 
2022/08/04 23:50:15 CREATE INDEX: statIdx2
2022/08/04 23:50:25 status : 201 Created
2022/08/04 23:50:25 {"id": "6078813370139483968"} 
2022/08/04 23:50:26 Instance Id for statIdx2 is 17923943707887246548, common.IndexInstId
--- PASS: TestStatIndexInstFilter (21.61s)
=== RUN   TestBucketDefaultDelete
2022-08-04T23:50:26.174+05:30 [Warn] Client:runObserveStreamingEndpoint streaming endpoint for /pools/default/bs/default returned err EOF
2022-08-04T23:50:26.174+05:30 [Warn] serviceChangeNotifier: Connection terminated for collection manifest notifier instance of http://%40query@127.0.0.1:9000, default, bucket: default, (EOF)
2022/08/04 23:50:28 Deleted bucket default, responseBody: 
2022/08/04 23:50:43 Created bucket default, responseBody: 
2022/08/04 23:50:59 Populating the default bucket
2022/08/04 23:51:06 Using n1ql client
2022-08-04T23:51:06.772+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-04T23:51:06.773+05:30 [Info] GSIC[default/default-_default-_default-1659637266770898049] started ...
2022/08/04 23:51:06 Scan failed as expected with error: Index Not Found - cause: GSI index index_isActive not found.
2022/08/04 23:51:06 Populating the default bucket after it was deleted
2022/08/04 23:51:15 Created the secondary index index_isActive. Waiting for it become active
2022/08/04 23:51:15 Index is 489227290645035343 now active
2022/08/04 23:51:16 Using n1ql client
2022/08/04 23:51:16 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (49.96s)
=== RUN   TestMixedDatatypesScanAll
2022/08/04 23:51:16 In TestMixedDatatypesScanAll()
2022/08/04 23:51:16 Before test begin: Length of kv docs is 10002
2022/08/04 23:51:16 In DropAllSecondaryIndexes()
2022/08/04 23:51:16 Index found:  index_isActive
2022/08/04 23:51:16 Dropped index index_isActive
2022/08/04 23:51:16 Number of number fields is: 247
2022/08/04 23:51:16 Number of string fields is: 266
2022/08/04 23:51:16 Number of json fields is: 259
2022/08/04 23:51:16 Number of true bool fields is: 108
2022/08/04 23:51:16 Number of false bool fields is: 120
2022/08/04 23:51:16 After generate docs: Length of kv docs is 11002
2022/08/04 23:51:16 Setting mixed datatypes JSON docs in KV
2022/08/04 23:51:20 Created the secondary index index_mixeddt. Waiting for it become active
2022/08/04 23:51:20 Index is 2053479122113197722 now active
2022/08/04 23:51:20 Using n1ql client
2022/08/04 23:51:20 Expected and Actual scan responses are the same
2022/08/04 23:51:20 Lengths of expected and actual scan results are:  1000 and 1000
2022/08/04 23:51:20 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (4.78s)
=== RUN   TestMixedDatatypesRange_Float
2022/08/04 23:51:20 In TestMixedDatatypesRange_Float()
2022/08/04 23:51:20 In DropAllSecondaryIndexes()
2022/08/04 23:51:20 Index found:  index_mixeddt
2022/08/04 23:51:20 Dropped index index_mixeddt
2022/08/04 23:51:21 Number of number fields is: 259
2022/08/04 23:51:21 Number of string fields is: 243
2022/08/04 23:51:21 Number of json fields is: 223
2022/08/04 23:51:21 Number of true bool fields is: 132
2022/08/04 23:51:21 Number of false bool fields is: 143
2022/08/04 23:51:21 Setting mixed datatypes JSON docs in KV
2022/08/04 23:51:25 Created the secondary index index_mixeddt. Waiting for it become active
2022/08/04 23:51:25 Index is 18246496168829606220 now active
2022/08/04 23:51:25 Using n1ql client
2022/08/04 23:51:25 Expected and Actual scan responses are the same
2022/08/04 23:51:25 Lengths of expected and actual scan results are:  21 and 21
2022/08/04 23:51:25 Using n1ql client
2022/08/04 23:51:25 Expected and Actual scan responses are the same
2022/08/04 23:51:25 Lengths of expected and actual scan results are:  1 and 1
2022/08/04 23:51:25 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (5.03s)
=== RUN   TestMixedDatatypesRange_String
2022/08/04 23:51:25 In TestMixedDatatypesRange_String()
2022/08/04 23:51:25 In DropAllSecondaryIndexes()
2022/08/04 23:51:25 Index found:  index_mixeddt
2022/08/04 23:51:25 Dropped index index_mixeddt
2022/08/04 23:51:26 Number of number fields is: 248
2022/08/04 23:51:26 Number of string fields is: 259
2022/08/04 23:51:26 Number of json fields is: 253
2022/08/04 23:51:26 Number of true bool fields is: 107
2022/08/04 23:51:26 Number of false bool fields is: 133
2022/08/04 23:51:26 Setting mixed datatypes JSON docs in KV
2022/08/04 23:51:30 Created the secondary index index_mixeddt. Waiting for it become active
2022/08/04 23:51:30 Index is 15652176129780059652 now active
2022/08/04 23:51:30 Using n1ql client
2022/08/04 23:51:31 Expected and Actual scan responses are the same
2022/08/04 23:51:31 Lengths of expected and actual scan results are:  210 and 210
2022/08/04 23:51:31 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (5.83s)
=== RUN   TestMixedDatatypesRange_Json
2022/08/04 23:51:31 In TestMixedDatatypesRange_Json()
2022/08/04 23:51:31 In DropAllSecondaryIndexes()
2022/08/04 23:51:31 Index found:  index_mixeddt
2022/08/04 23:51:31 Dropped index index_mixeddt
2022/08/04 23:51:31 Number of number fields is: 277
2022/08/04 23:51:31 Number of string fields is: 243
2022/08/04 23:51:31 Number of json fields is: 246
2022/08/04 23:51:31 Number of true bool fields is: 122
2022/08/04 23:51:31 Number of false bool fields is: 112
2022/08/04 23:51:31 Setting mixed datatypes JSON docs in KV
2022/08/04 23:51:36 Created the secondary index index_mixeddt. Waiting for it become active
2022/08/04 23:51:36 Index is 14587522775795358783 now active
2022/08/04 23:51:36 Using n1ql client
2022/08/04 23:51:37 Expected and Actual scan responses are the same
2022/08/04 23:51:37 Lengths of expected and actual scan results are:  722 and 722
2022/08/04 23:51:37 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (5.36s)
=== RUN   TestMixedDatatypesScan_Bool
2022/08/04 23:51:37 In TestMixedDatatypesScan_Bool()
2022/08/04 23:51:37 In DropAllSecondaryIndexes()
2022/08/04 23:51:37 Index found:  index_mixeddt
2022/08/04 23:51:37 Dropped index index_mixeddt
2022/08/04 23:51:37 Number of number fields is: 270
2022/08/04 23:51:37 Number of string fields is: 253
2022/08/04 23:51:37 Number of json fields is: 221
2022/08/04 23:51:37 Number of true bool fields is: 129
2022/08/04 23:51:37 Number of false bool fields is: 127
2022/08/04 23:51:37 Setting mixed datatypes JSON docs in KV
2022/08/04 23:51:41 Created the secondary index index_mixeddt. Waiting for it become active
2022/08/04 23:51:41 Index is 14521473884776440332 now active
2022/08/04 23:51:41 Using n1ql client
2022/08/04 23:51:42 Expected and Actual scan responses are the same
2022/08/04 23:51:42 Lengths of expected and actual scan results are:  490 and 490
2022/08/04 23:51:42 Using n1ql client
2022/08/04 23:51:42 Expected and Actual scan responses are the same
2022/08/04 23:51:42 Lengths of expected and actual scan results are:  515 and 515
2022/08/04 23:51:42 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (5.02s)
=== RUN   TestLargeSecondaryKeyLength
2022/08/04 23:51:42 In TestLargeSecondaryKeyLength()
2022/08/04 23:51:42 In DropAllSecondaryIndexes()
2022/08/04 23:51:42 Index found:  index_mixeddt
2022/08/04 23:51:42 Dropped index index_mixeddt
2022/08/04 23:51:42 Setting JSON docs in KV
2022/08/04 23:51:47 Created the secondary index index_LongSecField. Waiting for it become active
2022/08/04 23:51:47 Index is 2522994734162083896 now active
2022/08/04 23:51:47 Using n1ql client
2022/08/04 23:51:47 ScanAll: Lengths of expected and actual scan results are:  1000 and 1000
2022/08/04 23:51:47 Expected and Actual scan responses are the same
2022/08/04 23:51:47 Using n1ql client
2022/08/04 23:51:47 Range: Lengths of expected and actual scan results are:  829 and 829
2022/08/04 23:51:47 Expected and Actual scan responses are the same
2022/08/04 23:51:47 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (5.37s)
=== RUN   TestLargePrimaryKeyLength
2022/08/04 23:51:47 In TestLargePrimaryKeyLength()
2022/08/04 23:51:47 In DropAllSecondaryIndexes()
2022/08/04 23:51:47 Index found:  index_LongSecField
2022/08/04 23:51:47 Dropped index index_LongSecField
2022/08/04 23:51:47 Setting JSON docs in KV
2022/08/04 23:51:54 Created the secondary index index_LongPrimaryField. Waiting for it become active
2022/08/04 23:51:54 Index is 202329632429495086 now active
2022/08/04 23:51:54 Using n1ql client
2022/08/04 23:51:54 Lengths of num of docs and scanResults are:  17002 and 17002
2022/08/04 23:51:54 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (7.52s)
=== RUN   TestUpdateMutations_DeleteField
2022/08/04 23:51:54 In TestUpdateMutations_DeleteField()
2022/08/04 23:51:55 Setting JSON docs in KV
2022/08/04 23:52:02 Created the secondary index index_bal. Waiting for it become active
2022/08/04 23:52:02 Index is 14468123880473145703 now active
2022/08/04 23:52:02 Using n1ql client
2022/08/04 23:52:02 Expected and Actual scan responses are the same
2022/08/04 23:52:02 Using n1ql client
2022/08/04 23:52:02 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (7.75s)
=== RUN   TestUpdateMutations_AddField
2022/08/04 23:52:02 In TestUpdateMutations_AddField()
2022/08/04 23:52:02 Setting JSON docs in KV
2022/08/04 23:52:08 Created the secondary index index_newField. Waiting for it become active
2022/08/04 23:52:08 Index is 5686824336358869021 now active
2022/08/04 23:52:08 Using n1ql client
2022/08/04 23:52:08 Count of scan results before add field mutations:  0
2022/08/04 23:52:08 Expected and Actual scan responses are the same
2022/08/04 23:52:09 Using n1ql client
2022/08/04 23:52:09 Count of scan results after add field mutations:  300
2022/08/04 23:52:09 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (6.50s)
=== RUN   TestUpdateMutations_DataTypeChange
2022/08/04 23:52:09 In TestUpdateMutations_DataTypeChange()
2022/08/04 23:52:09 Setting JSON docs in KV
2022/08/04 23:52:17 Created the secondary index index_isUserActive. Waiting for it become active
2022/08/04 23:52:17 Index is 1704498625469343767 now active
2022/08/04 23:52:17 Using n1ql client
2022/08/04 23:52:17 Expected and Actual scan responses are the same
2022/08/04 23:52:17 Using n1ql client
2022/08/04 23:52:18 Expected and Actual scan responses are the same
2022/08/04 23:52:18 Using n1ql client
2022/08/04 23:52:18 Expected and Actual scan responses are the same
2022/08/04 23:52:18 Using n1ql client
2022/08/04 23:52:18 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (8.87s)
=== RUN   TestMultipleBuckets
2022/08/04 23:52:18 In TestMultipleBuckets()
2022/08/04 23:52:18 In DropAllSecondaryIndexes()
2022/08/04 23:52:18 Index found:  index_bal
2022/08/04 23:52:18 Dropped index index_bal
2022/08/04 23:52:18 Index found:  index_isUserActive
2022/08/04 23:52:18 Dropped index index_isUserActive
2022/08/04 23:52:18 Index found:  index_newField
2022/08/04 23:52:18 Dropped index index_newField
2022/08/04 23:52:18 Index found:  index_LongPrimaryField
2022/08/04 23:52:18 Dropped index index_LongPrimaryField
2022/08/04 23:52:56 Flushed the bucket default, Response body: 
2022/08/04 23:52:59 Modified parameters of bucket default, responseBody: 
2022/08/04 23:52:59 Created bucket testbucket2, responseBody: 
2022/08/04 23:52:59 Created bucket testbucket3, responseBody: 
2022/08/04 23:52:59 Created bucket testbucket4, responseBody: 
2022/08/04 23:53:14 Generating docs and Populating all the buckets
2022/08/04 23:53:18 Created the secondary index bucket1_age. Waiting for it become active
2022/08/04 23:53:18 Index is 1710260683932263159 now active
2022/08/04 23:53:24 Created the secondary index bucket2_city. Waiting for it become active
2022/08/04 23:53:24 Index is 420856171962952419 now active
2022/08/04 23:53:30 Created the secondary index bucket3_gender. Waiting for it become active
2022/08/04 23:53:30 Index is 10094727246340354010 now active
2022/08/04 23:53:36 Created the secondary index bucket4_balance. Waiting for it become active
2022/08/04 23:53:36 Index is 16969611436968619017 now active
2022/08/04 23:53:39 Using n1ql client
2022/08/04 23:53:39 Expected and Actual scan responses are the same
2022/08/04 23:53:39 Using n1ql client
2022-08-04T23:53:39.408+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-04T23:53:39.409+05:30 [Info] GSIC[default/testbucket2-_default-_default-1659637419406642512] started ...
2022/08/04 23:53:39 Expected and Actual scan responses are the same
2022/08/04 23:53:39 Using n1ql client
2022-08-04T23:53:39.421+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-04T23:53:39.422+05:30 [Info] GSIC[default/testbucket3-_default-_default-1659637419417342655] started ...
2022/08/04 23:53:39 Expected and Actual scan responses are the same
2022/08/04 23:53:39 Using n1ql client
2022-08-04T23:53:39.436+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-04T23:53:39.437+05:30 [Info] GSIC[default/testbucket4-_default-_default-1659637419430942049] started ...
2022/08/04 23:53:39 Expected and Actual scan responses are the same
2022/08/04 23:53:41 Deleted bucket testbucket2, responseBody: 
2022/08/04 23:53:43 Deleted bucket testbucket3, responseBody: 
2022/08/04 23:53:45 Deleted bucket testbucket4, responseBody: 
2022/08/04 23:53:48 Modified parameters of bucket default, responseBody: 
--- PASS: TestMultipleBuckets (105.63s)
=== RUN   TestBucketFlush
2022/08/04 23:54:03 In TestBucketFlush()
2022/08/04 23:54:03 In DropAllSecondaryIndexes()
2022/08/04 23:54:03 Index found:  bucket1_age
2022/08/04 23:54:03 Dropped index bucket1_age
2022/08/04 23:54:41 Flushed the bucket default, Response body: 
2022/08/04 23:54:45 Created the secondary index index_age. Waiting for it become active
2022/08/04 23:54:45 Index is 10804591075923635657 now active
2022/08/04 23:54:45 Using n1ql client
2022/08/04 23:54:46 Expected and Actual scan responses are the same
2022/08/04 23:54:51 Created the secondary index index_gender. Waiting for it become active
2022/08/04 23:54:51 Index is 6269369067071136436 now active
2022/08/04 23:54:51 Using n1ql client
2022/08/04 23:54:52 Expected and Actual scan responses are the same
2022/08/04 23:54:55 Created the secondary index index_city. Waiting for it become active
2022/08/04 23:54:55 Index is 8452956951931341281 now active
2022/08/04 23:54:55 Using n1ql client
2022/08/04 23:54:56 Expected and Actual scan responses are the same
2022/08/04 23:55:33 Flushed the bucket default, Response body: 
2022/08/04 23:55:33 TestBucketFlush:: Flushed the bucket
2022/08/04 23:55:33 Using n1ql client
2022/08/04 23:55:33 Using n1ql client
2022/08/04 23:55:33 Using n1ql client
--- PASS: TestBucketFlush (90.15s)
=== RUN   TestLargeDocumentSize
2022/08/04 23:55:33 In TestLargeDocumentSize()
2022/08/04 23:55:33 Data file exists. Skipping download
2022/08/04 23:55:33 Length of docs and largeDocs = 200 and 200
2022/08/04 23:55:38 Created the secondary index index_userscreenname. Waiting for it become active
2022/08/04 23:55:38 Index is 12149172419958890335 now active
2022/08/04 23:55:38 Using n1ql client
2022/08/04 23:55:39 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (5.41s)
=== RUN   TestFieldsWithSpecialCharacters
2022/08/04 23:55:39 In TestFieldsWithSpecialCharacters()
2022/08/04 23:55:44 Created the secondary index index_specialchar. Waiting for it become active
2022/08/04 23:55:44 Index is 9467898091604017219 now active
2022/08/04 23:55:44 Looking up for value §£z£vvß
2022/08/04 23:55:44 Using n1ql client
2022/08/04 23:55:44 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (5.15s)
=== RUN   TestLargeKeyLookup
2022/08/04 23:55:44 In TestLargeKeyLookup()
2022/08/04 23:55:50 Created the secondary index index_largeKeyLookup. Waiting for it become active
2022/08/04 23:55:50 Index is 7792530596272124907 now active
2022/08/04 23:55:50 Looking up for a large key
2022/08/04 23:55:50 Using n1ql client
2022/08/04 23:55:51 Expected and Actual scan responses are the same
--- PASS: TestLargeKeyLookup (7.22s)
=== RUN   TestIndexNameValidation
2022/08/04 23:55:51 In TestIndexNameValidation()
2022/08/04 23:55:51 Setting JSON docs in KV
2022/08/04 23:55:52 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected
2022/08/04 23:55:57 Created the secondary index #primary-Index_test. Waiting for it become active
2022/08/04 23:55:57 Index is 7287722407711986872 now active
2022/08/04 23:55:57 Using n1ql client
2022/08/04 23:55:57 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (5.53s)
=== RUN   TestSameFieldNameAtDifferentLevels
2022/08/04 23:55:57 In TestSameFieldNameAtDifferentLevels()
2022/08/04 23:55:57 Setting JSON docs in KV
2022/08/04 23:56:02 Created the secondary index cityindex. Waiting for it become active
2022/08/04 23:56:02 Index is 1048779268220740355 now active
2022/08/04 23:56:02 Using n1ql client
2022/08/04 23:56:03 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (6.60s)
=== RUN   TestSameIndexNameInTwoBuckets
2022/08/04 23:56:03 In TestSameIndexNameInTwoBuckets()
2022/08/04 23:56:03 In DropAllSecondaryIndexes()
2022/08/04 23:56:03 Index found:  index_specialchar
2022/08/04 23:56:03 Dropped index index_specialchar
2022/08/04 23:56:03 Index found:  #primary-Index_test
2022/08/04 23:56:03 Dropped index #primary-Index_test
2022/08/04 23:56:03 Index found:  index_age
2022/08/04 23:56:03 Dropped index index_age
2022/08/04 23:56:03 Index found:  index_gender
2022/08/04 23:56:03 Dropped index index_gender
2022/08/04 23:56:03 Index found:  index_city
2022/08/04 23:56:04 Dropped index index_city
2022/08/04 23:56:04 Index found:  index_largeKeyLookup
2022/08/04 23:56:04 Dropped index index_largeKeyLookup
2022/08/04 23:56:04 Index found:  cityindex
2022/08/04 23:56:04 Dropped index cityindex
2022/08/04 23:56:04 Index found:  index_userscreenname
2022/08/04 23:56:04 Dropped index index_userscreenname
2022/08/04 23:56:42 Flushed the bucket default, Response body: 
2022/08/04 23:56:45 Modified parameters of bucket default, responseBody: 
2022/08/04 23:56:45 Created bucket buck2, responseBody: 
2022/08/04 23:57:00 Generating docs and Populating all the buckets
2022/08/04 23:57:04 Created the secondary index b_idx. Waiting for it become active
2022/08/04 23:57:04 Index is 2628086622990960966 now active
2022/08/04 23:57:10 Created the secondary index b_idx. Waiting for it become active
2022/08/04 23:57:10 Index is 5348581859831296912 now active
2022/08/04 23:57:13 Using n1ql client
2022/08/04 23:57:13 Expected and Actual scan responses are the same
2022/08/04 23:57:13 Using n1ql client
2022-08-04T23:57:13.224+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-04T23:57:13.225+05:30 [Info] GSIC[default/buck2-_default-_default-1659637633222591534] started ...
2022/08/04 23:57:13 Expected and Actual scan responses are the same
2022/08/04 23:57:16 Modified parameters of bucket default, responseBody: 
2022/08/04 23:57:18 Deleted bucket buck2, responseBody: 
--- PASS: TestSameIndexNameInTwoBuckets (89.75s)
=== RUN   TestLargeKeysSplChars
2022/08/04 23:57:33 In TestLargeKeysSplChars()
2022/08/04 23:57:42 Created the secondary index idspl1. Waiting for it become active
2022/08/04 23:57:42 Index is 11208351622532721725 now active
2022/08/04 23:57:48 Created the secondary index idspl2. Waiting for it become active
2022/08/04 23:57:48 Index is 1479516153259844983 now active
2022/08/04 23:57:53 Created the secondary index idspl3. Waiting for it become active
2022/08/04 23:57:53 Index is 14055153704195918774 now active
2022/08/04 23:57:53 Using n1ql client
2022/08/04 23:57:53 Expected and Actual scan responses are the same
2022-08-04T23:57:53.652+05:30 [Error] transport error between 127.0.0.1:48940->127.0.0.1:9107: write tcp 127.0.0.1:48940->127.0.0.1:9107: write: broken pipe
2022-08-04T23:57:53.652+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:48940->127.0.0.1:9107: write: broken pipe`
2022-08-04T23:57:53.652+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-04T23:57:53.652+05:30 [Error] metadataClient:PickRandom: Replicas - [10239069618675655627], PrunedReplica - map[], FilteredReplica map[]
2022/08/04 23:57:54 Expected and Actual scan responses are the same
2022/08/04 23:57:54 Using n1ql client
2022/08/04 23:57:54 Expected and Actual scan responses are the same
--- PASS: TestLargeKeysSplChars (20.67s)
=== RUN   TestVeryLargeIndexKey
2022/08/04 23:57:54 In DropAllSecondaryIndexes()
2022/08/04 23:57:54 Index found:  idspl1
2022/08/04 23:57:54 Dropped index idspl1
2022/08/04 23:57:54 Index found:  idspl3
2022/08/04 23:57:54 Dropped index idspl3
2022/08/04 23:57:54 Index found:  idspl2
2022/08/04 23:57:54 Dropped index idspl2
2022/08/04 23:57:54 Index found:  b_idx
2022/08/04 23:57:54 Dropped index b_idx
2022/08/04 23:58:32 Flushed the bucket default, Response body: 
2022/08/04 23:58:32 TestVeryLargeIndexKey:: Flushed the bucket
2022/08/04 23:58:32 clusterconfig.KVAddress = 127.0.0.1:9000
2022/08/04 23:58:37 Created the secondary index i1. Waiting for it become active
2022/08/04 23:58:37 Index is 17604090383852854478 now active
2022/08/04 23:58:37 Using n1ql client
2022/08/04 23:58:37 Expected and Actual scan responses are the same
2022/08/04 23:58:43 Created the secondary index i2. Waiting for it become active
2022/08/04 23:58:43 Index is 8392783840612755964 now active
2022/08/04 23:58:43 Using n1ql client
2022/08/04 23:58:44 Expected and Actual scan responses are the same
2022/08/04 23:58:44 In DropAllSecondaryIndexes()
2022/08/04 23:58:44 Index found:  i2
2022/08/04 23:58:44 Dropped index i2
2022/08/04 23:58:44 Index found:  i1
2022/08/04 23:58:44 Dropped index i1
2022/08/04 23:59:22 Flushed the bucket default, Response body: 
--- PASS: TestVeryLargeIndexKey (88.48s)
=== RUN   TestTempBufScanResult
2022/08/04 23:59:22 In DropAllSecondaryIndexes()
2022/08/05 00:00:00 Flushed the bucket default, Response body: 
2022/08/05 00:00:00 TestTempBufScanResult:: Flushed the bucket
2022/08/05 00:00:03 Created the secondary index index_idxKey. Waiting for it become active
2022/08/05 00:00:03 Index is 15457037766445587678 now active
2022/08/05 00:00:03 Using n1ql client
2022/08/05 00:00:03 Expected and Actual scan responses are the same
2022/08/05 00:00:03 In DropAllSecondaryIndexes()
2022/08/05 00:00:03 Index found:  index_idxKey
2022/08/05 00:00:03 Dropped index index_idxKey
2022/08/05 00:00:41 Flushed the bucket default, Response body: 
--- PASS: TestTempBufScanResult (78.94s)
=== RUN   TestBuildDeferredAnotherBuilding
2022/08/05 00:00:41 In TestBuildDeferredAnotherBuilding()
2022/08/05 00:00:41 In DropAllSecondaryIndexes()
2022/08/05 00:01:23 Setting JSON docs in KV
2022/08/05 00:03:03 Build the deferred index id_age1. Waiting for the index to become active
2022/08/05 00:03:03 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:04 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:05 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:06 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:07 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:08 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:09 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:10 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:11 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:12 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:13 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:14 Waiting for index 14501632759466922817 to go active ...
2022/08/05 00:03:15 Index is 14501632759466922817 now active
2022/08/05 00:03:15 Build command issued for the deferred indexes [3888293185726142876]
2022/08/05 00:03:17 Build index failed as expected: Build index fails. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2022/08/05 00:03:17 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:18 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:19 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:20 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:21 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:22 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:23 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:24 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:25 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:26 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:27 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:28 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:29 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:31 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:32 Waiting for index 3888293185726142876 to go active ...
2022/08/05 00:03:33 Index is 3888293185726142876 now active
2022/08/05 00:03:33 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:34 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:35 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:36 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:37 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:38 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:39 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:40 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:41 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:42 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:43 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:44 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:45 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:46 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:47 Waiting for index 4805981026111928106 to go active ...
2022/08/05 00:03:48 Index is 4805981026111928106 now active
2022/08/05 00:03:48 Using n1ql client
2022/08/05 00:03:48 Expected and Actual scan responses are the same
2022/08/05 00:03:48 Using n1ql client
2022/08/05 00:03:50 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (188.67s)
=== RUN   TestMultipleBucketsDeferredBuild
2022/08/05 00:03:50 In TestMultipleBucketsDeferredBuild()
2022/08/05 00:03:50 In DropAllSecondaryIndexes()
2022/08/05 00:03:50 Index found:  id_age1
2022/08/05 00:03:50 Dropped index id_age1
2022/08/05 00:03:50 Index found:  id_company
2022/08/05 00:03:50 Dropped index id_company
2022/08/05 00:03:50 Index found:  id_age
2022/08/05 00:03:50 Dropped index id_age
2022/08/05 00:04:27 Flushed the bucket default, Response body: 
2022/08/05 00:04:30 Modified parameters of bucket default, responseBody: 
2022/08/05 00:04:30 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2022/08/05 00:04:30 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003c0e0}
2022/08/05 00:04:30 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Thu, 04 Aug 2022 18:34:29 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00113ae40 31 [] false false map[] 0xc00d8fb100 }
2022/08/05 00:04:30 DeleteBucket failed for bucket defertest_buck2 
2022/08/05 00:04:30 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2022/08/05 00:04:30 Created bucket defertest_buck2, responseBody: 
2022/08/05 00:04:45 Setting JSON docs in KV
2022/08/05 00:05:52 Build command issued for the deferred indexes [1363373167606769757]
2022/08/05 00:05:53 Build command issued for the deferred indexes [7727434338077511888 7531951848466497273]
2022/08/05 00:05:53 Index state of 7531951848466497273 is INDEX_STATE_READY
2022/08/05 00:05:53 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:05:54 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:05:55 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:05:56 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:05:57 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:05:58 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:05:59 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:06:00 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:06:01 Waiting for index 1363373167606769757 to go active ...
2022/08/05 00:06:02 Index is 1363373167606769757 now active
2022/08/05 00:06:02 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:03 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:04 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:05 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:06 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:07 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:08 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:09 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:10 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:11 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:12 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:13 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:14 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:15 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:16 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:17 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:18 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:19 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:20 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:21 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:22 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:23 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:24 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:25 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:26 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:27 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:28 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:29 Waiting for index 7727434338077511888 to go active ...
2022/08/05 00:06:30 Index is 7727434338077511888 now active
2022/08/05 00:06:30 Using n1ql client
2022/08/05 00:06:30 Expected and Actual scan responses are the same
2022/08/05 00:06:30 Using n1ql client
2022/08/05 00:06:30 Expected and Actual scan responses are the same
2022/08/05 00:06:30 Using n1ql client
2022-08-05T00:06:30.565+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T00:06:30.565+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1659638190563236733] started ...
2022/08/05 00:06:30 Expected and Actual scan responses are the same
2022/08/05 00:06:33 Modified parameters of bucket default, responseBody: 
2022/08/05 00:06:35 Deleted bucket defertest_buck2, responseBody: 
--- PASS: TestMultipleBucketsDeferredBuild (170.03s)
=== RUN   TestCreateDropCreateDeferredIndex
2022/08/05 00:06:40 In TestCreateDropCreateDeferredIndex()
2022/08/05 00:06:40 In DropAllSecondaryIndexes()
2022/08/05 00:06:40 Index found:  buck1_id2
2022/08/05 00:06:40 Dropped index buck1_id2
2022/08/05 00:06:40 Index found:  buck1_id1
2022/08/05 00:06:40 Dropped index buck1_id1
2022/08/05 00:06:42 Setting JSON docs in KV
2022/08/05 00:06:54 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:06:54 Index is 14163627072098200096 now active
2022/08/05 00:06:55 Dropping the secondary index id_age
2022/08/05 00:06:55 Index dropped
2022/08/05 00:06:58 Setting JSON docs in KV
2022/08/05 00:07:06 Using n1ql client
2022/08/05 00:07:06 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (26.31s)
=== RUN   TestMultipleDeferredIndexes_BuildTogether
2022/08/05 00:07:06 In TestMultipleDeferredIndexes_BuildTogether()
2022/08/05 00:07:06 In DropAllSecondaryIndexes()
2022/08/05 00:07:06 Index found:  id_company
2022/08/05 00:07:06 Dropped index id_company
2022/08/05 00:07:08 Setting JSON docs in KV
2022/08/05 00:07:21 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:07:21 Index is 4694907116112889340 now active
2022/08/05 00:07:22 Build command issued for the deferred indexes [id_age id_gender id_isActive]
2022/08/05 00:07:22 Waiting for the index id_age to become active
2022/08/05 00:07:22 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:23 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:24 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:25 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:26 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:27 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:28 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:29 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:30 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:31 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:32 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:33 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:34 Waiting for index 6632454056182996802 to go active ...
2022/08/05 00:07:35 Index is 6632454056182996802 now active
2022/08/05 00:07:35 Waiting for the index id_gender to become active
2022/08/05 00:07:35 Index is 11385508188812277021 now active
2022/08/05 00:07:35 Waiting for the index id_isActive to become active
2022/08/05 00:07:35 Index is 2343347032735162361 now active
2022/08/05 00:07:35 Using n1ql client
2022/08/05 00:07:35 Expected and Actual scan responses are the same
2022/08/05 00:07:37 Setting JSON docs in KV
2022/08/05 00:07:45 Using n1ql client
2022/08/05 00:07:45 Expected and Actual scan responses are the same
2022/08/05 00:07:46 Using n1ql client
2022/08/05 00:07:46 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (39.71s)
=== RUN   TestMultipleDeferredIndexes_BuildOneByOne
2022/08/05 00:07:46 In TestMultipleDeferredIndexes_BuildOneByOne()
2022/08/05 00:07:46 In DropAllSecondaryIndexes()
2022/08/05 00:07:46 Index found:  id_company
2022/08/05 00:07:46 Dropped index id_company
2022/08/05 00:07:46 Index found:  id_age
2022/08/05 00:07:46 Dropped index id_age
2022/08/05 00:07:46 Index found:  id_gender
2022/08/05 00:07:46 Dropped index id_gender
2022/08/05 00:07:46 Index found:  id_isActive
2022/08/05 00:07:46 Dropped index id_isActive
2022/08/05 00:07:48 Setting JSON docs in KV
2022/08/05 00:08:03 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:08:03 Index is 11550013492801050424 now active
2022/08/05 00:08:05 Build command issued for the deferred indexes [id_age]
2022/08/05 00:08:05 Waiting for the index id_age to become active
2022/08/05 00:08:05 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:06 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:07 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:08 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:09 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:10 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:11 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:12 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:13 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:14 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:15 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:16 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:17 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:18 Waiting for index 11355594918343785116 to go active ...
2022/08/05 00:08:19 Index is 11355594918343785116 now active
2022/08/05 00:08:19 Build command issued for the deferred indexes [id_gender]
2022/08/05 00:08:19 Waiting for the index id_gender to become active
2022/08/05 00:08:19 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:20 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:21 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:22 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:23 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:24 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:25 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:26 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:27 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:28 Waiting for index 12526386109023860124 to go active ...
2022/08/05 00:08:29 Index is 12526386109023860124 now active
2022/08/05 00:08:29 Build command issued for the deferred indexes [id_isActive]
2022/08/05 00:08:29 Waiting for the index id_isActive to become active
2022/08/05 00:08:29 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:30 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:31 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:32 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:33 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:34 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:35 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:36 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:37 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:38 Waiting for index 13100330023742580061 to go active ...
2022/08/05 00:08:39 Index is 13100330023742580061 now active
2022/08/05 00:08:39 Using n1ql client
2022/08/05 00:08:39 Expected and Actual scan responses are the same
2022/08/05 00:08:41 Setting JSON docs in KV
2022/08/05 00:08:50 Using n1ql client
2022/08/05 00:08:50 Expected and Actual scan responses are the same
2022/08/05 00:08:51 Using n1ql client
2022/08/05 00:08:51 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (65.48s)
=== RUN   TestDropDeferredIndexWhileOthersBuilding
2022/08/05 00:08:51 In TestDropDeferredIndexWhileOthersBuilding()
2022/08/05 00:08:51 In DropAllSecondaryIndexes()
2022/08/05 00:08:51 Index found:  id_isActive
2022/08/05 00:08:51 Dropped index id_isActive
2022/08/05 00:08:51 Index found:  id_age
2022/08/05 00:08:51 Dropped index id_age
2022/08/05 00:08:51 Index found:  id_company
2022/08/05 00:08:52 Dropped index id_company
2022/08/05 00:08:52 Index found:  id_gender
2022/08/05 00:08:52 Dropped index id_gender
2022/08/05 00:08:54 Setting JSON docs in KV
2022/08/05 00:09:08 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:09:08 Index is 5544239488203375098 now active
2022/08/05 00:09:10 Build command issued for the deferred indexes [14558334034386750270 11790307771812225578]
2022/08/05 00:09:12 Dropping the secondary index id_isActive
2022/08/05 00:09:12 Index dropped
2022/08/05 00:09:12 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:13 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:14 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:15 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:16 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:17 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:18 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:19 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:20 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:21 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:22 Waiting for index 14558334034386750270 to go active ...
2022/08/05 00:09:23 Index is 14558334034386750270 now active
2022/08/05 00:09:23 Index is 11790307771812225578 now active
2022/08/05 00:09:24 Using n1ql client
2022/08/05 00:09:24 Expected and Actual scan responses are the same
2022/08/05 00:09:24 Using n1ql client
2022/08/05 00:09:24 Expected and Actual scan responses are the same
2022/08/05 00:09:26 Setting JSON docs in KV
2022/08/05 00:09:34 Using n1ql client
2022/08/05 00:09:34 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (43.08s)
=== RUN   TestDropBuildingDeferredIndex
2022/08/05 00:09:34 In TestDropBuildingDeferredIndex()
2022/08/05 00:09:34 In DropAllSecondaryIndexes()
2022/08/05 00:09:34 Index found:  id_company
2022/08/05 00:09:34 Dropped index id_company
2022/08/05 00:09:34 Index found:  id_age
2022/08/05 00:09:35 Dropped index id_age
2022/08/05 00:09:35 Index found:  id_gender
2022/08/05 00:09:35 Dropped index id_gender
2022/08/05 00:09:37 Setting JSON docs in KV
2022/08/05 00:09:42 Build command issued for the deferred indexes [13734367308846012809 5461601758536800131]
2022/08/05 00:09:43 Dropping the secondary index id_age
2022/08/05 00:09:43 Index dropped
2022/08/05 00:09:43 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:44 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:45 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:46 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:47 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:48 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:49 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:50 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:51 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:52 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:53 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:54 Waiting for index 13734367308846012809 to go active ...
2022/08/05 00:09:55 Index is 13734367308846012809 now active
2022/08/05 00:09:55 Build command issued for the deferred indexes [id_gender]
2022/08/05 00:09:55 Waiting for the index id_gender to become active
2022/08/05 00:09:55 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:09:56 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:09:57 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:09:58 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:09:59 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:00 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:01 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:02 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:03 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:04 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:05 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:06 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:07 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:08 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:09 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:10 Waiting for index 8603098739661342800 to go active ...
2022/08/05 00:10:11 Index is 8603098739661342800 now active
2022/08/05 00:10:12 Using n1ql client
2022/08/05 00:10:12 Expected and Actual scan responses are the same
2022/08/05 00:10:13 Using n1ql client
2022/08/05 00:10:13 Expected and Actual scan responses are the same
2022/08/05 00:10:16 Setting JSON docs in KV
2022/08/05 00:10:23 Using n1ql client
2022/08/05 00:10:25 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (50.44s)
=== RUN   TestDropMultipleBuildingDeferredIndexes
2022/08/05 00:10:25 In TestDropMultipleBuildingDeferredIndexes()
2022/08/05 00:10:25 In DropAllSecondaryIndexes()
2022/08/05 00:10:25 Index found:  id_company
2022/08/05 00:10:25 Dropped index id_company
2022/08/05 00:10:25 Index found:  id_gender
2022/08/05 00:10:25 Dropped index id_gender
2022/08/05 00:10:31 Setting JSON docs in KV
2022/08/05 00:11:00 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:11:00 Index is 7327359877484866255 now active
2022/08/05 00:11:02 Build command issued for the deferred indexes [5777826831638301020 7767297719097721198]
2022/08/05 00:11:03 Dropping the secondary index id_age
2022/08/05 00:11:03 Index dropped
2022/08/05 00:11:03 Dropping the secondary index id_gender
2022/08/05 00:11:18 Index dropped
2022/08/05 00:11:18 Build command issued for the deferred indexes [id_isActive]
2022/08/05 00:11:18 Waiting for the index id_isActive to become active
2022/08/05 00:11:18 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:19 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:20 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:21 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:22 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:23 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:24 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:25 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:26 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:27 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:28 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:29 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:30 Waiting for index 9383697409491943894 to go active ...
2022/08/05 00:11:31 Index is 9383697409491943894 now active
2022/08/05 00:11:42 Using n1ql client
2022/08/05 00:11:42 Expected and Actual scan responses are the same
2022/08/05 00:11:42 Number of docScanResults and scanResults = 180000 and 180000
2022/08/05 00:11:43 Using n1ql client
2022/08/05 00:11:44 Expected and Actual scan responses are the same
2022/08/05 00:11:44 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (79.07s)
=== RUN   TestDropOneIndexSecondDeferBuilding
2022/08/05 00:11:44 In TestDropOneIndexSecondDeferBuilding()
2022/08/05 00:11:44 In DropAllSecondaryIndexes()
2022/08/05 00:11:44 Index found:  id_company
2022/08/05 00:11:44 Dropped index id_company
2022/08/05 00:11:44 Index found:  id_isActive
2022/08/05 00:11:44 Dropped index id_isActive
2022/08/05 00:11:46 Setting JSON docs in KV
2022/08/05 00:11:52 Build command issued for the deferred indexes [id_company]
2022/08/05 00:11:52 Waiting for the index id_company to become active
2022/08/05 00:11:52 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:11:53 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:11:54 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:11:55 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:11:56 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:11:57 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:11:58 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:11:59 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:12:00 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:12:01 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:12:02 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:12:03 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:12:04 Waiting for index 5207214178557729983 to go active ...
2022/08/05 00:12:05 Index is 5207214178557729983 now active
2022/08/05 00:12:05 Build command issued for the deferred indexes [4694469874458177016]
2022/08/05 00:12:06 Dropping the secondary index id_company
2022/08/05 00:12:06 Index dropped
2022/08/05 00:12:15 Setting JSON docs in KV
2022/08/05 00:12:28 Index is 4694469874458177016 now active
2022/08/05 00:12:28 Build command issued for the deferred indexes [id_gender]
2022/08/05 00:12:28 Waiting for the index id_gender to become active
2022/08/05 00:12:28 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:29 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:30 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:31 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:32 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:33 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:34 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:35 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:36 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:37 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:38 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:39 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:40 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:41 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:42 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:43 Waiting for index 10144490827895034389 to go active ...
2022/08/05 00:12:44 Index is 10144490827895034389 now active
2022/08/05 00:12:44 Using n1ql client
2022/08/05 00:12:44 Expected and Actual scan responses are the same
2022/08/05 00:12:44 Using n1ql client
2022/08/05 00:12:46 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (61.70s)
=== RUN   TestDropSecondIndexSecondDeferBuilding
2022/08/05 00:12:46 In TestDropSecondIndexSecondDeferBuilding()
2022/08/05 00:12:46 In DropAllSecondaryIndexes()
2022/08/05 00:12:46 Index found:  id_age
2022/08/05 00:12:46 Dropped index id_age
2022/08/05 00:12:46 Index found:  id_gender
2022/08/05 00:12:46 Dropped index id_gender
2022/08/05 00:12:48 Setting JSON docs in KV
2022/08/05 00:12:53 Build command issued for the deferred indexes [id_company]
2022/08/05 00:12:53 Waiting for the index id_company to become active
2022/08/05 00:12:53 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:12:54 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:12:55 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:12:56 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:12:57 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:12:58 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:12:59 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:13:00 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:13:01 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:13:02 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:13:03 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:13:04 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:13:05 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:13:06 Waiting for index 11626237963232800251 to go active ...
2022/08/05 00:13:07 Index is 11626237963232800251 now active
2022/08/05 00:13:07 Build command issued for the deferred indexes [12880576920797751947]
2022/08/05 00:13:08 Dropping the secondary index id_age
2022/08/05 00:13:08 Index dropped
2022/08/05 00:13:14 Setting JSON docs in KV
2022/08/05 00:13:22 Build command issued for the deferred indexes [id_gender]
2022/08/05 00:13:22 Waiting for the index id_gender to become active
2022/08/05 00:13:22 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:23 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:24 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:25 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:26 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:27 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:28 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:29 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:30 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:31 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:32 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:33 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:34 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:35 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:36 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:37 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:38 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:39 Waiting for index 2162369011120466324 to go active ...
2022/08/05 00:13:40 Index is 2162369011120466324 now active
2022/08/05 00:13:40 Using n1ql client
2022/08/05 00:13:41 Expected and Actual scan responses are the same
2022/08/05 00:13:41 Using n1ql client
2022/08/05 00:13:43 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (57.74s)
=== RUN   TestCreateAfterDropWhileIndexBuilding
2022/08/05 00:13:43 In TestCreateAfterDropWhileIndexBuilding()
2022/08/05 00:13:43 In DropAllSecondaryIndexes()
2022/08/05 00:13:43 Index found:  id_gender
2022/08/05 00:13:43 Dropped index id_gender
2022/08/05 00:13:43 Index found:  id_company
2022/08/05 00:13:43 Dropped index id_company
2022/08/05 00:14:05 Setting JSON docs in KV
2022/08/05 00:14:56 Build command issued for the deferred indexes [18073940029562575926]
2022/08/05 00:14:57 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:14:58 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:14:59 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:00 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:01 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:02 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:03 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:04 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:05 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:06 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:07 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:08 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:09 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:10 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:11 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:12 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:13 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:14 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:15 Waiting for index 18073940029562575926 to go active ...
2022/08/05 00:15:16 Index is 18073940029562575926 now active
2022/08/05 00:15:17 Build command issued for the deferred indexes [17392474903002989474]
2022/08/05 00:15:18 Dropping the secondary index id_company
2022/08/05 00:15:18 Index dropped
2022/08/05 00:15:18 Dropping the secondary index id_age
2022/08/05 00:15:20 Index dropped
2022/08/05 00:15:25 Build command issued for the deferred indexes [id_gender]
2022/08/05 00:15:25 Waiting for the index id_gender to become active
2022/08/05 00:15:25 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:26 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:27 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:28 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:29 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:30 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:31 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:32 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:33 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:34 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:35 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:36 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:37 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:38 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:39 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:40 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:41 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:42 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:43 Waiting for index 17414855149054581477 to go active ...
2022/08/05 00:15:44 Index is 17414855149054581477 now active
2022/08/05 00:15:45 Index is 17414855149054581477 now active
2022/08/05 00:15:46 Using n1ql client
2022/08/05 00:15:47 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (124.13s)
=== RUN   TestDropBuildingIndex1
2022/08/05 00:15:47 In TestDropBuildingIndex1()
2022/08/05 00:15:47 In DropAllSecondaryIndexes()
2022/08/05 00:15:47 Index found:  id_gender
2022/08/05 00:15:48 Dropped index id_gender
2022/08/05 00:15:52 Setting JSON docs in KV
2022/08/05 00:16:21 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:16:21 Index is 156615874110573382 now active
2022/08/05 00:16:44 Dropping the secondary index id_age
2022/08/05 00:16:45 Index dropped
2022/08/05 00:17:05 Created the secondary index id_age. Waiting for it become active
2022/08/05 00:17:05 Index is 2985934690765610848 now active
2022/08/05 00:17:07 Setting JSON docs in KV
2022/08/05 00:17:15 Using n1ql client
2022/08/05 00:17:15 Expected and Actual scan responses are the same
2022/08/05 00:17:15 Using n1ql client
2022/08/05 00:17:16 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex1 (88.57s)
=== RUN   TestDropBuildingIndex2
2022/08/05 00:17:16 In TestDropBuildingIndex2()
2022/08/05 00:17:16 In DropAllSecondaryIndexes()
2022/08/05 00:17:16 Index found:  id_age
2022/08/05 00:17:16 Dropped index id_age
2022/08/05 00:17:16 Index found:  id_company
2022/08/05 00:17:16 Dropped index id_company
2022/08/05 00:17:21 Setting JSON docs in KV
2022/08/05 00:17:57 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:17:57 Index is 1185263599647971854 now active
2022/08/05 00:18:21 Dropping the secondary index id_company
2022/08/05 00:18:22 Index dropped
2022/08/05 00:18:22 Index is 2039052516621721379 now active
2022/08/05 00:18:43 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:18:43 Index is 10205849679240690042 now active
2022/08/05 00:18:44 Setting JSON docs in KV
2022/08/05 00:18:54 Using n1ql client
2022/08/05 00:18:54 Expected and Actual scan responses are the same
2022/08/05 00:18:55 Using n1ql client
2022/08/05 00:18:55 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex2 (99.48s)
=== RUN   TestDropIndexWithDataLoad
2022/08/05 00:18:55 In TestDropIndexWithDataLoad()
2022/08/05 00:18:55 In DropAllSecondaryIndexes()
2022/08/05 00:18:55 Index found:  id_company
2022/08/05 00:18:56 Dropped index id_company
2022/08/05 00:18:56 Index found:  id_age
2022/08/05 00:18:56 Dropped index id_age
2022/08/05 00:18:59 Setting JSON docs in KV
2022/08/05 00:19:25 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:19:25 Index is 3319692272321199332 now active
2022/08/05 00:19:49 Created the secondary index id_age. Waiting for it become active
2022/08/05 00:19:49 Index is 5678519272423171130 now active
2022/08/05 00:20:12 Created the secondary index id_gender. Waiting for it become active
2022/08/05 00:20:12 Index is 838148195615070635 now active
2022/08/05 00:20:34 Created the secondary index id_isActive. Waiting for it become active
2022/08/05 00:20:34 Index is 11297091506376252484 now active
2022/08/05 00:20:42 Setting JSON docs in KV
2022/08/05 00:20:42 In DropIndexWhileKVLoad
2022/08/05 00:20:42 In LoadKVBucket
2022/08/05 00:20:42 Bucket name = default
2022/08/05 00:20:43 Dropping the secondary index id_company
2022/08/05 00:20:43 Index dropped
2022/08/05 00:21:06 Using n1ql client
2022/08/05 00:21:07 Expected and Actual scan responses are the same
2022/08/05 00:21:07 Number of docScanResults and scanResults = 96752 and 96752
2022/08/05 00:21:07 Using n1ql client
2022/08/05 00:21:10 Expected and Actual scan responses are the same
2022/08/05 00:21:10 Number of docScanResults and scanResults = 420000 and 420000
--- PASS: TestDropIndexWithDataLoad (134.83s)
=== RUN   TestDropAllIndexesWithDataLoad
2022/08/05 00:21:10 In TestDropAllIndexesWithDataLoad()
2022/08/05 00:21:10 In DropAllSecondaryIndexes()
2022/08/05 00:21:10 Index found:  id_age
2022/08/05 00:21:10 Dropped index id_age
2022/08/05 00:21:10 Index found:  id_isActive
2022/08/05 00:21:11 Dropped index id_isActive
2022/08/05 00:21:11 Index found:  id_gender
2022/08/05 00:21:11 Dropped index id_gender
2022/08/05 00:21:13 Setting JSON docs in KV
2022/08/05 00:21:43 Created the secondary index id_company. Waiting for it become active
2022/08/05 00:21:43 Index is 5321747356578416489 now active
2022/08/05 00:22:10 Created the secondary index id_age. Waiting for it become active
2022/08/05 00:22:10 Index is 3302535992719910718 now active
2022/08/05 00:22:34 Created the secondary index id_gender. Waiting for it become active
2022/08/05 00:22:34 Index is 17273828391505857531 now active
2022/08/05 00:23:00 Created the secondary index id_isActive. Waiting for it become active
2022/08/05 00:23:00 Index is 17417422296005266863 now active
2022/08/05 00:23:06 Setting JSON docs in KV
2022/08/05 00:23:06 In LoadKVBucket
2022/08/05 00:23:06 Bucket name = default
2022/08/05 00:23:06 In DropIndexWhileKVLoad
2022/08/05 00:23:06 In DropIndexWhileKVLoad
2022/08/05 00:23:06 In DropIndexWhileKVLoad
2022/08/05 00:23:06 In DropIndexWhileKVLoad
2022/08/05 00:23:07 Dropping the secondary index id_isActive
2022/08/05 00:23:07 Dropping the secondary index id_gender
2022/08/05 00:23:07 Dropping the secondary index id_company
2022/08/05 00:23:07 Dropping the secondary index id_age
2022/08/05 00:23:08 Index dropped
2022/08/05 00:23:08 Index dropped
2022/08/05 00:23:08 Index dropped
2022/08/05 00:23:08 Index dropped
2022/08/05 00:23:22 Using n1ql client
2022/08/05 00:23:22 Scan failed as expected with error: Index Not Found - cause: GSI index id_company not found.
--- PASS: TestDropAllIndexesWithDataLoad (132.13s)
=== RUN   TestCreateBucket_AnotherIndexBuilding
2022/08/05 00:23:22 In TestCreateBucket_AnotherIndexBuilding()
2022/08/05 00:23:22 In DropAllSecondaryIndexes()
2022/08/05 00:23:59 Flushed the bucket default, Response body: 
2022/08/05 00:24:02 Modified parameters of bucket default, responseBody: 
2022/08/05 00:24:02 http://127.0.0.1:9000/pools/default/buckets/multi_buck2
2022/08/05 00:24:02 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003c0e0}
2022/08/05 00:24:02 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Thu, 04 Aug 2022 18:54:02 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0aa5c9680 31 [] false false map[] 0xc000200c00 }
2022/08/05 00:24:02 DeleteBucket failed for bucket multi_buck2 
2022/08/05 00:24:02 Deleted bucket multi_buck2, responseBody: Requested resource not found.
2022/08/05 00:24:17 Setting JSON docs in KV
2022/08/05 00:26:07 Created bucket multi_buck2, responseBody: 
2022/08/05 00:26:30 Index is 16760591258121605568 now active
2022/08/05 00:26:30 Index is 14819388000232624004 now active
2022/08/05 00:26:30 Using n1ql client
2022-08-05T00:26:30.950+05:30 [Info] metadata provider version changed 1206 -> 1207
2022-08-05T00:26:30.950+05:30 [Info] switched currmeta from 1206 -> 1207 force false 
2022-08-05T00:26:30.950+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T00:26:30.950+05:30 [Info] GSIC[default/multi_buck2-_default-_default-1659639390927965387] started ...
2022/08/05 00:26:31 Expected and Actual scan responses are the same
2022/08/05 00:26:31 Number of docScanResults and scanResults = 10000 and 10000
2022/08/05 00:26:31 Using n1ql client
2022/08/05 00:26:34 Expected and Actual scan responses are the same
2022/08/05 00:26:34 Number of docScanResults and scanResults = 200000 and 200000
2022/08/05 00:26:36 Deleted bucket multi_buck2, responseBody: 
2022/08/05 00:27:13 Flushed the bucket default, Response body: 
--- PASS: TestCreateBucket_AnotherIndexBuilding (230.32s)
=== RUN   TestDropBucket2Index_Bucket1IndexBuilding
2022/08/05 00:27:13 In TestDropBucket2Index_Bucket1IndexBuilding()
2022/08/05 00:27:13 In DropAllSecondaryIndexes()
2022/08/05 00:27:13 Index found:  buck1_idx
2022/08/05 00:27:13 Dropped index buck1_idx
2022/08/05 00:27:51 Flushed the bucket default, Response body: 
2022/08/05 00:27:54 Modified parameters of bucket default, responseBody: 
2022/08/05 00:27:54 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3
2022/08/05 00:27:54 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003c0e0}
2022/08/05 00:27:54 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Thu, 04 Aug 2022 18:57:53 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0022af140 31 [] false false map[] 0xc006757900 }
2022/08/05 00:27:54 DeleteBucket failed for bucket multibucket_test3 
2022/08/05 00:27:54 Deleted bucket multibucket_test3, responseBody: Requested resource not found.
2022/08/05 00:27:54 Created bucket multibucket_test3, responseBody: 
2022/08/05 00:28:09 Setting JSON docs in KV
2022/08/05 00:29:04 Created the secondary index buck2_idx. Waiting for it become active
2022/08/05 00:29:04 Index is 7365390262689820447 now active
2022/08/05 00:29:16 Dropping the secondary index buck2_idx
2022/08/05 00:29:16 Index dropped
2022/08/05 00:29:16 Index is 17483591679984462306 now active
2022/08/05 00:29:16 Using n1ql client
2022/08/05 00:29:17 Expected and Actual scan responses are the same
2022/08/05 00:29:17 Number of docScanResults and scanResults = 100000 and 100000
2022/08/05 00:29:19 Deleted bucket multibucket_test3, responseBody: 
2022/08/05 00:29:56 Flushed the bucket default, Response body: 
--- PASS: TestDropBucket2Index_Bucket1IndexBuilding (163.31s)
=== RUN   TestDeleteBucketWhileInitialIndexBuild
2022/08/05 00:29:56 In TestDeleteBucketWhileInitialIndexBuild()
2022/08/05 00:29:56 ============== DBG: Drop all indexes in all buckets
2022/08/05 00:29:56 In DropAllSecondaryIndexes()
2022/08/05 00:29:56 Index found:  buck1_idx
2022/08/05 00:29:56 Dropped index buck1_idx
2022/08/05 00:29:56 ============== DBG: Delete bucket default
2022/08/05 00:29:58 Deleted bucket default, responseBody: 
2022/08/05 00:29:58 ============== DBG: Create bucket default
2022/08/05 00:29:58 Created bucket default, responseBody: 
2022/08/05 00:30:01 Flush Enabled on bucket default, responseBody: 
2022/08/05 00:30:34 Flushed the bucket default, Response body: 
2022/08/05 00:30:34 ============== DBG: Delete bucket testbucket2
2022/08/05 00:30:34 http://127.0.0.1:9000/pools/default/buckets/testbucket2
2022/08/05 00:30:34 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003c0e0}
2022/08/05 00:30:34 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Thu, 04 Aug 2022 19:00:33 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00610a440 31 [] false false map[] 0xc005ca8300 }
2022/08/05 00:30:34 DeleteBucket failed for bucket testbucket2 
2022/08/05 00:30:34 Deleted bucket testbucket2, responseBody: Requested resource not found.
2022/08/05 00:30:34 ============== DBG: Create bucket testbucket2
2022/08/05 00:30:34 Created bucket testbucket2, responseBody: 
2022/08/05 00:30:37 Flush Enabled on bucket testbucket2, responseBody: 
2022/08/05 00:31:11 Flushed the bucket testbucket2, Response body: 
2022/08/05 00:31:11 ============== DBG: Delete bucket testbucket3
2022/08/05 00:31:11 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2022/08/05 00:31:11 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003c0e0}
2022/08/05 00:31:11 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Thu, 04 Aug 2022 19:01:10 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00610b440 31 [] false false map[] 0xc00d8fa500 }
2022/08/05 00:31:11 DeleteBucket failed for bucket testbucket3 
2022/08/05 00:31:11 Deleted bucket testbucket3, responseBody: Requested resource not found.
2022/08/05 00:31:11 ============== DBG: Create bucket testbucket3
2022/08/05 00:31:11 Created bucket testbucket3, responseBody: 
2022/08/05 00:31:14 Flush Enabled on bucket testbucket3, responseBody: 
2022/08/05 00:31:47 Flushed the bucket testbucket3, Response body: 
2022/08/05 00:31:47 ============== DBG: Delete bucket testbucket4
2022/08/05 00:31:47 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2022/08/05 00:31:47 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003c0e0}
2022/08/05 00:31:47 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Thu, 04 Aug 2022 19:01:46 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc00a392a40 31 [] false false map[] 0xc0069ddf00 }
2022/08/05 00:31:47 DeleteBucket failed for bucket testbucket4 
2022/08/05 00:31:47 Deleted bucket testbucket4, responseBody: Requested resource not found.
2022/08/05 00:31:47 ============== DBG: Create bucket testbucket4
2022/08/05 00:31:47 Created bucket testbucket4, responseBody: 
2022/08/05 00:31:50 Flush Enabled on bucket testbucket4, responseBody: 
2022/08/05 00:32:24 Flushed the bucket testbucket4, Response body: 
2022/08/05 00:32:39 Generating docs and Populating all the buckets
2022/08/05 00:32:39 ============== DBG: Creating docs in bucket default
2022/08/05 00:32:40 ============== DBG: Creating index bucket1_age in bucket default
2022/08/05 00:32:44 Created the secondary index bucket1_age. Waiting for it become active
2022/08/05 00:32:44 Index is 2108916614598477918 now active
2022/08/05 00:32:44 ============== DBG: Creating index bucket1_gender in bucket default
2022/08/05 00:32:49 Created the secondary index bucket1_gender. Waiting for it become active
2022/08/05 00:32:49 Index is 10452399114108103249 now active
2022/08/05 00:32:49 ============== DBG: Creating docs in bucket testbucket2
2022/08/05 00:32:50 ============== DBG: Creating index bucket2_city in bucket testbucket2
2022/08/05 00:32:55 Created the secondary index bucket2_city. Waiting for it become active
2022/08/05 00:32:55 Index is 7717935610106316690 now active
2022/08/05 00:32:55 ============== DBG: Creating index bucket2_company in bucket testbucket2
2022/08/05 00:33:00 Created the secondary index bucket2_company. Waiting for it become active
2022/08/05 00:33:00 Index is 1109929192113585632 now active
2022/08/05 00:33:01 ============== DBG: Creating docs in bucket testbucket3
2022/08/05 00:33:01 ============== DBG: Creating index bucket3_gender in bucket testbucket3
2022/08/05 00:33:06 Created the secondary index bucket3_gender. Waiting for it become active
2022/08/05 00:33:06 Index is 5534564237252851431 now active
2022/08/05 00:33:06 ============== DBG: Creating index bucket3_address in bucket testbucket3
2022/08/05 00:33:11 Created the secondary index bucket3_address. Waiting for it become active
2022/08/05 00:33:11 Index is 2629537505877088651 now active
2022/08/05 00:33:11 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2022/08/05 00:33:11 Using n1ql client
2022-08-05T00:33:11.434+05:30 [Info] metadata provider version changed 1265 -> 1266
2022-08-05T00:33:11.434+05:30 [Info] switched currmeta from 1265 -> 1266 force false 
2022-08-05T00:33:11.434+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T00:33:11.434+05:30 [Info] GSIC[default/default-_default-_default-1659639791430806481] started ...
2022/08/05 00:33:11 ============== DBG: First bucket scan:: Expected results = 310 Actual results = 310
2022/08/05 00:33:11 Expected and Actual scan responses are the same
2022/08/05 00:33:22 ============== DBG: Creating 50K docs in bucket testbucket4
2022/08/05 00:33:45 ============== DBG: Creating index bucket4_balance asynchronously in bucket testbucket4
2022/08/05 00:33:56 ============== DBG: Deleting bucket testbucket4
2022/08/05 00:33:58 Deleted bucket testbucket4, responseBody: 
2022/08/05 00:33:58 ============== DBG: First bucket scan:: Scanning index bucket1_age in bucket default
2022/08/05 00:33:58 Using n1ql client
2022/08/05 00:33:58 ============== DBG: First bucket scan:: Expected results = 310 Actual results = 310
2022/08/05 00:33:58 Expected and Actual scan responses are the same
2022/08/05 00:33:58 ============== DBG: Second bucket scan:: Scanning index bucket2_city in bucket testbucket2
2022/08/05 00:33:58 Using n1ql client
2022-08-05T00:33:58.420+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T00:33:58.421+05:30 [Info] GSIC[default/testbucket2-_default-_default-1659639838418459067] started ...
2022/08/05 00:33:58 ============== DBG: Second bucket scan:: Expected results = 423 Actual results = 423
2022/08/05 00:33:58 Expected and Actual scan responses are the same
2022/08/05 00:33:58 ============== DBG: Third bucket scan:: Scanning index bucket3_gender in bucket testbucket3
2022/08/05 00:33:58 Using n1ql client
2022-08-05T00:33:58.427+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T00:33:58.428+05:30 [Info] GSIC[default/testbucket3-_default-_default-1659639838426304416] started ...
2022/08/05 00:33:58 ============== DBG: Third bucket scan:: Expected results = 521 Actual results = 521
2022/08/05 00:33:58 Expected and Actual scan responses are the same
2022/08/05 00:33:58 ============== DBG: Deleting buckets testbucket2 testbucket3 testbucket4
2022/08/05 00:34:00 Deleted bucket testbucket2, responseBody: 
2022/08/05 00:34:02 Deleted bucket testbucket3, responseBody: 
2022/08/05 00:34:02 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2022/08/05 00:34:02 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]]   0 [] false 127.0.0.1:9000 map[] map[]  map[]      0xc00003c0e0}
2022/08/05 00:34:02 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Thu, 04 Aug 2022 19:04:02 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0170c6240 31 [] false false map[] 0xc0171a8900 }
2022/08/05 00:34:02 DeleteBucket failed for bucket testbucket4 
2022/08/05 00:34:02 Deleted bucket testbucket4, responseBody: Requested resource not found.
2022/08/05 00:34:05 Modified parameters of bucket default, responseBody: 
--- PASS: TestDeleteBucketWhileInitialIndexBuild (264.36s)
=== RUN   TestWherClause_UpdateDocument
2022/08/05 00:34:20 In TestWherClause_UpdateDocument()
2022/08/05 00:34:20 In DropAllSecondaryIndexes()
2022/08/05 00:34:20 Index found:  bucket1_age
2022/08/05 00:34:21 Dropped index bucket1_age
2022/08/05 00:34:21 Index found:  bucket1_gender
2022/08/05 00:34:21 Dropped index bucket1_gender
2022/08/05 00:34:59 Flushed the bucket default, Response body: 
2022/08/05 00:35:01 Setting JSON docs in KV
2022/08/05 00:35:09 Created the secondary index id_ageGreaterThan40. Waiting for it become active
2022/08/05 00:35:09 Index is 16554974970672030491 now active
2022/08/05 00:35:09 Using n1ql client
2022/08/05 00:35:09 Expected and Actual scan responses are the same
2022/08/05 00:35:09 Number of docScanResults and scanResults = 6008 and 6008
2022/08/05 00:35:13 Using n1ql client
2022/08/05 00:35:13 Expected and Actual scan responses are the same
2022/08/05 00:35:13 Number of docScanResults and scanResults = 2008 and 2008
--- PASS: TestWherClause_UpdateDocument (52.83s)
=== RUN   TestDeferFalse
2022/08/05 00:35:13 In TestDeferFalse()
2022/08/05 00:35:16 Setting JSON docs in KV
2022/08/05 00:35:28 Created the secondary index index_deferfalse1. Waiting for it become active
2022/08/05 00:35:28 Index is 2793087567073980531 now active
2022/08/05 00:35:28 Using n1ql client
2022/08/05 00:35:28 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse (14.82s)
=== RUN   TestDeferFalse_CloseClientConnection
2022/08/05 00:35:28 In TestDeferFalse_CloseClientConnection()
2022/08/05 00:35:28 In CloseClientThread
2022/08/05 00:35:28 In CreateIndexThread
2022-08-05T00:35:30.609+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:56102->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022/08/05 00:35:30 Create Index call failed as expected due to error : Terminate Request due to client termination
2022/08/05 00:35:30 Waiting for index 2110153305856349583 to go active ...
2022/08/05 00:35:31 Waiting for index 2110153305856349583 to go active ...
2022/08/05 00:35:32 Waiting for index 2110153305856349583 to go active ...
2022/08/05 00:35:33 Waiting for index 2110153305856349583 to go active ...
2022/08/05 00:35:34 Index is 2110153305856349583 now active
2022/08/05 00:35:34 Using n1ql client
2022/08/05 00:35:34 Expected and Actual scan responses are the same
--- PASS: TestDeferFalse_CloseClientConnection (6.18s)
=== RUN   TestOrphanIndexCleanup
2022-08-05T00:35:34.727+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:56166->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022/08/05 00:35:34 In DropAllSecondaryIndexes()
2022/08/05 00:35:34 Index found:  index_deferfalse2
2022/08/05 00:35:34 Dropped index index_deferfalse2
2022/08/05 00:35:34 Index found:  id_ageGreaterThan40
2022/08/05 00:35:34 Dropped index id_ageGreaterThan40
2022/08/05 00:35:34 Index found:  index_deferfalse1
2022/08/05 00:35:34 Dropped index index_deferfalse1
2022/08/05 00:35:48 Created the secondary index idx1_age_regular. Waiting for it become active
2022/08/05 00:35:48 Index is 6249335478355267736 now active
2022/08/05 00:35:56 Created the secondary index idx2_company_regular. Waiting for it become active
2022/08/05 00:35:56 Index is 17786594444224387553 now active
2022/08/05 00:36:06 Using n1ql client
2022/08/05 00:36:06 Query on idx1_age_regular is successful
2022/08/05 00:36:06 Using n1ql client
2022/08/05 00:36:06 Query on idx2_company_regular is successful
Restarting indexer process ...
2022/08/05 00:36:06 []
2022-08-05T00:36:06.323+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T00:36:06.324+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T00:36:06.324+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T00:36:06.324+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 00:36:26 Using n1ql client
2022-08-05T00:36:26.269+05:30 [Error] transport error between 127.0.0.1:50032->127.0.0.1:9107: write tcp 127.0.0.1:50032->127.0.0.1:9107: write: broken pipe
2022-08-05T00:36:26.269+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -1360135274717086566 request transport failed `write tcp 127.0.0.1:50032->127.0.0.1:9107: write: broken pipe`
2022-08-05T00:36:26.270+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T00:36:26.270+05:30 [Error] metadataClient:PickRandom: Replicas - [309245209626065317], PrunedReplica - map[], FilteredReplica map[]
2022/08/05 00:36:26 Query on idx1_age_regular is successful - after indexer restart.
2022/08/05 00:36:26 Using n1ql client
2022/08/05 00:36:26 Query on idx2_company_regular is successful - after indexer restart.
--- PASS: TestOrphanIndexCleanup (51.58s)
=== RUN   TestOrphanPartitionCleanup
2022/08/05 00:36:31 Created the secondary index idx3_age_regular. Waiting for it become active
2022/08/05 00:36:31 Index is 9151195007222018330 now active
2022/08/05 00:36:41 Using n1ql client
2022/08/05 00:36:41 Query on idx3_age_regular is successful
Restarting indexer process ...
2022/08/05 00:36:41 []
2022-08-05T00:36:41.300+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T00:36:41.300+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T00:36:41.300+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T00:36:41.300+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 00:37:01 Using n1ql client
2022-08-05T00:37:01.273+05:30 [Error] transport error between 127.0.0.1:35506->127.0.0.1:9107: write tcp 127.0.0.1:35506->127.0.0.1:9107: write: broken pipe
2022-08-05T00:37:01.273+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -2126612806780703385 request transport failed `write tcp 127.0.0.1:35506->127.0.0.1:9107: write: broken pipe`
2022-08-05T00:37:01.273+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8.  Partition with instances 0 
2022-08-05T00:37:01.273+05:30 [Error] metadataClient:PickRandom: Replicas - [15625968841668047961], PrunedReplica - map[], FilteredReplica map[]
2022/08/05 00:37:01 Query on idx3_age_regular is successful - after indexer restart.
--- PASS: TestOrphanPartitionCleanup (34.98s)
=== RUN   TestIndexerSettings
2022/08/05 00:37:01 In TestIndexerSettings()
2022/08/05 00:37:01 Changing config key indexer.settings.max_cpu_percent to value 300
2022/08/05 00:37:01 Changing config key indexer.settings.inmemory_snapshot.interval to value 300
2022/08/05 00:37:01 Changing config key indexer.settings.persisted_snapshot.interval to value 20000
2022/08/05 00:37:01 Changing config key indexer.settings.recovery.max_rollbacks to value 3
2022/08/05 00:37:01 Changing config key indexer.settings.log_level to value error
--- PASS: TestIndexerSettings (0.15s)
=== RUN   TestRestoreDefaultSettings
2022/08/05 00:37:01 In TestIndexerSettings_RestoreDefault()
2022/08/05 00:37:01 Changing config key indexer.settings.max_cpu_percent to value 0
2022/08/05 00:37:01 Changing config key indexer.settings.inmemory_snapshot.interval to value 200
2022/08/05 00:37:01 Changing config key indexer.settings.persisted_snapshot.interval to value 5000
2022/08/05 00:37:01 Changing config key indexer.settings.recovery.max_rollbacks to value 5
2022/08/05 00:37:01 Changing config key indexer.settings.log_level to value info
--- PASS: TestRestoreDefaultSettings (0.18s)
=== RUN   TestStat_ItemsCount
2022/08/05 00:37:01 In TestStat_ItemsCount()
2022/08/05 00:37:01 In DropAllSecondaryIndexes()
2022/08/05 00:37:01 Index found:  idx3_age_regular
2022/08/05 00:37:01 Dropped index idx3_age_regular
2022/08/05 00:37:01 Index found:  idx2_company_regular
2022/08/05 00:37:01 Dropped index idx2_company_regular
2022/08/05 00:37:01 Index found:  idx1_age_regular
2022/08/05 00:37:01 Dropped index idx1_age_regular
2022/08/05 00:37:01 Emptying the default bucket
2022/08/05 00:37:05 Flush Enabled on bucket default, responseBody: 
2022/08/05 00:37:42 Flushed the bucket default, Response body: 
2022/08/05 00:37:42 Generating JSON docs
2022/08/05 00:37:43 Setting initial JSON docs in KV
2022/08/05 00:37:47 Creating a 2i
2022/08/05 00:37:50 Created the secondary index index_test1. Waiting for it become active
2022/08/05 00:37:50 Index is 7140554407598946404 now active
2022/08/05 00:37:55 items_count stat is 10000
--- PASS: TestStat_ItemsCount (53.69s)
=== RUN   TestRangeArrayIndex_Distinct
2022/08/05 00:37:55 In TestRangeArrayIndex_Distinct()
2022/08/05 00:37:55 In DropAllSecondaryIndexes()
2022/08/05 00:37:55 Index found:  index_test1
2022/08/05 00:37:55 Dropped index index_test1
2022/08/05 00:38:33 Flushed the bucket default, Response body: 
2022/08/05 00:38:36 Created the secondary index arridx_friends. Waiting for it become active
2022/08/05 00:38:36 Index is 12905913366443512395 now active
2022-08-05T00:38:36.998+05:30 [Error] transport error between 127.0.0.1:34178->127.0.0.1:9107: write tcp 127.0.0.1:34178->127.0.0.1:9107: write: broken pipe
2022-08-05T00:38:36.998+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:34178->127.0.0.1:9107: write: broken pipe`
2022-08-05T00:38:36.998+05:30 [Warn] scan failed: requestId  queryport 127.0.0.1:9107 inst 5715995425780951890 partition [0]
2022-08-05T00:38:36.998+05:30 [Warn] Scan failed with error for index 12905913366443512395.  Trying scan again with replica, reqId: :  write tcp 127.0.0.1:34178->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2022-08-05T00:38:36.998+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T00:38:36.998+05:30 [Error] metadataClient:PickRandom: Replicas - [5715995425780951890], PrunedReplica - map[], FilteredReplica map[]
2022-08-05T00:38:36.998+05:30 [Warn] Fail to find indexers to satisfy query request.  Trying scan again for index 12905913366443512395, reqId: :  write tcp 127.0.0.1:34178->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2022/08/05 00:38:37 Expected and Actual scan responses are the same
2022/08/05 00:38:39 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Distinct (44.59s)
=== RUN   TestUpdateArrayIndex_Distinct
2022/08/05 00:38:39 In TestUpdateArrayIndex_Distinct()
2022/08/05 00:38:39 In DropAllSecondaryIndexes()
2022/08/05 00:38:39 Index found:  arridx_friends
2022/08/05 00:38:40 Dropped index arridx_friends
2022/08/05 00:39:18 Flushed the bucket default, Response body: 
2022/08/05 00:39:21 Created the secondary index arridx_friends. Waiting for it become active
2022/08/05 00:39:21 Index is 701983443605267634 now active
2022/08/05 00:39:21 Expected and Actual scan responses are the same
2022/08/05 00:39:24 Expected and Actual scan responses are the same
2022/08/05 00:39:25 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Distinct (45.14s)
=== RUN   TestRangeArrayIndex_Duplicate
2022/08/05 00:39:25 In TestRangeArrayIndex_Duplicate()
2022/08/05 00:39:25 In DropAllSecondaryIndexes()
2022/08/05 00:39:25 Index found:  arridx_friends
2022/08/05 00:39:25 Dropped index arridx_friends
2022/08/05 00:40:02 Flushed the bucket default, Response body: 
2022/08/05 00:40:06 Created the secondary index arridx_friends. Waiting for it become active
2022/08/05 00:40:06 Index is 11894065289105541246 now active
2022/08/05 00:40:06 Expected and Actual scan responses are the same
2022/08/05 00:40:09 Expected and Actual scan responses are the same
--- PASS: TestRangeArrayIndex_Duplicate (44.03s)
=== RUN   TestUpdateArrayIndex_Duplicate
2022/08/05 00:40:09 In TestUpdateArrayIndex_Duplicate()
2022/08/05 00:40:09 In DropAllSecondaryIndexes()
2022/08/05 00:40:09 Index found:  arridx_friends
2022/08/05 00:40:09 Dropped index arridx_friends
2022/08/05 00:40:47 Flushed the bucket default, Response body: 
2022/08/05 00:40:50 Created the secondary index arridx_friends. Waiting for it become active
2022/08/05 00:40:50 Index is 7671367458040445439 now active
2022/08/05 00:40:50 Expected and Actual scan responses are the same
2022/08/05 00:40:53 Expected and Actual scan responses are the same
2022/08/05 00:40:53 Expected and Actual scan responses are the same
--- PASS: TestUpdateArrayIndex_Duplicate (44.86s)
=== RUN   TestArrayIndexCornerCases
2022/08/05 00:40:53 In TestArrayIndexCornerCases()
2022/08/05 00:40:57 Created the secondary index arr_single. Waiting for it become active
2022/08/05 00:40:57 Index is 17920021680513639260 now active
2022/08/05 00:41:01 Created the secondary index arr_leading. Waiting for it become active
2022/08/05 00:41:01 Index is 14872557362180871005 now active
2022/08/05 00:41:05 Created the secondary index arr_nonleading. Waiting for it become active
2022/08/05 00:41:05 Index is 14455114233727509114 now active
2022/08/05 00:41:05 

--------ScanAll for EMPTY array--------
2022/08/05 00:41:05 Count of scanResults is 0
2022/08/05 00:41:05 Count of scanResults is 0
2022/08/05 00:41:05 Count of scanResults is 1
2022/08/05 00:41:05 Key: string 6970391005027976747  Value: value.Values ["qIoFI" Missing field or index.] false
2022/08/05 00:41:05 Expected and Actual scan responses are the same
2022/08/05 00:41:05 

--------ScanAll for MISSING array--------
2022/08/05 00:41:05 Count of scanResults is 0
2022/08/05 00:41:05 Count of scanResults is 0
2022/08/05 00:41:05 Count of scanResults is 1
2022/08/05 00:41:05 Key: string 6970391005027976747  Value: value.Values ["YlpcU" Missing field or index.] false
2022/08/05 00:41:05 Expected and Actual scan responses are the same
2022/08/05 00:41:05 

--------ScanAll for NULL array--------
2022/08/05 00:41:05 Count of scanResults is 1
2022/08/05 00:41:05 Key: string 6970391005027976747  Value: value.Values [null] false
2022/08/05 00:41:05 Expected and Actual scan responses are the same
2022/08/05 00:41:05 Count of scanResults is 1
2022/08/05 00:41:05 Key: string 6970391005027976747  Value: value.Values [null "x44mn"] false
2022/08/05 00:41:05 Expected and Actual scan responses are the same
2022/08/05 00:41:05 Count of scanResults is 1
2022/08/05 00:41:05 Key: string 6970391005027976747  Value: value.Values ["x44mn" null] false
2022/08/05 00:41:05 Expected and Actual scan responses are the same
2022/08/05 00:41:05 

--------ScanAll for SCALARVALUE array--------
2022/08/05 00:41:06 Count of scanResults is 1
2022/08/05 00:41:06 Key: string 6970391005027976747  Value: value.Values ["IamScalar"] false
2022/08/05 00:41:06 Expected and Actual scan responses are the same
2022/08/05 00:41:06 Count of scanResults is 1
2022/08/05 00:41:06 Key: string 6970391005027976747  Value: value.Values ["IamScalar" "dpxwq"] false
2022/08/05 00:41:06 Expected and Actual scan responses are the same
2022/08/05 00:41:06 Count of scanResults is 1
2022/08/05 00:41:06 Key: string 6970391005027976747  Value: value.Values ["dpxwq" "IamScalar"] false
2022/08/05 00:41:06 Expected and Actual scan responses are the same
2022/08/05 00:41:06 

--------ScanAll for SCALAROBJECT array--------
2022/08/05 00:41:06 Count of scanResults is 1
2022/08/05 00:41:06 Key: string 6970391005027976747  Value: value.Values [{"1":"abc","2":"def"}] false
2022/08/05 00:41:06 Expected and Actual scan responses are the same
2022/08/05 00:41:06 Count of scanResults is 1
2022/08/05 00:41:06 Key: string 6970391005027976747  Value: value.Values [{"1":"abc","2":"def"} "RGXK8f"] false
2022/08/05 00:41:06 Expected and Actual scan responses are the same
2022/08/05 00:41:06 Count of scanResults is 1
2022/08/05 00:41:06 Key: string 6970391005027976747  Value: value.Values ["RGXK8f" {"1":"abc","2":"def"}] false
2022/08/05 00:41:06 Expected and Actual scan responses are the same
--- PASS: TestArrayIndexCornerCases (12.16s)
=== RUN   TestArraySizeIncreaseDecrease1
2022/08/05 00:41:06 In TestArraySizeIncreaseDecrease1()
2022/08/05 00:41:06 In DropAllSecondaryIndexes()
2022/08/05 00:41:06 Index found:  arr_leading
2022/08/05 00:41:06 Dropped index arr_leading
2022/08/05 00:41:06 Index found:  arr_nonleading
2022/08/05 00:41:06 Dropped index arr_nonleading
2022/08/05 00:41:06 Index found:  arridx_friends
2022/08/05 00:41:06 Dropped index arridx_friends
2022/08/05 00:41:06 Index found:  arr_single
2022/08/05 00:41:06 Dropped index arr_single
2022/08/05 00:41:44 Flushed the bucket default, Response body: 
2022/08/05 00:41:44 Changing config key indexer.settings.allow_large_keys to value false
2022/08/05 00:41:45 Changing config key indexer.settings.max_seckey_size to value 100
2022/08/05 00:41:45 Changing config key indexer.settings.max_array_seckey_size to value 2000
2022/08/05 00:41:46 Start of createArrayDocs()
2022/08/05 00:42:03 End of createArrayDocs()
2022/08/05 00:42:03 Start of createArrayDocs()
2022/08/05 00:42:03 End of createArrayDocs()
2022/08/05 00:42:06 Created the secondary index arr1. Waiting for it become active
2022/08/05 00:42:06 Index is 674339921328968218 now active
2022/08/05 00:42:11 Created the secondary index arr2. Waiting for it become active
2022/08/05 00:42:11 Index is 6184529979159828404 now active
2022/08/05 00:42:15 Created the secondary index idx3. Waiting for it become active
2022/08/05 00:42:15 Index is 5405218735229205408 now active
2022/08/05 00:42:15 Using n1ql client
2022/08/05 00:42:15 Length of scanResults = 10
2022/08/05 00:42:15 Changing config key indexer.settings.max_seckey_size to value 4096
2022/08/05 00:42:15 Changing config key indexer.settings.max_array_seckey_size to value 51200
2022/08/05 00:42:20 Expected and Actual scan responses are the same
2022/08/05 00:42:20 Using n1ql client
2022/08/05 00:42:20 Expected and Actual scan responses are the same
2022/08/05 00:42:20 Using n1ql client
2022/08/05 00:42:20 Expected and Actual scan responses are the same
2022/08/05 00:42:20 Changing config key indexer.settings.max_seckey_size to value 100
2022/08/05 00:42:20 Changing config key indexer.settings.max_array_seckey_size to value 2200
2022/08/05 00:42:24 Using n1ql client
2022/08/05 00:42:24 Length of scanResults = 10
2022/08/05 00:42:24 Changing config key indexer.settings.max_seckey_size to value 4608
2022/08/05 00:42:24 Changing config key indexer.settings.max_array_seckey_size to value 10240
--- PASS: TestArraySizeIncreaseDecrease1 (79.03s)
=== RUN   TestArraySizeIncreaseDecrease2
2022/08/05 00:42:25 In TestArraySizeIncreaseDecrease2()
2022/08/05 00:42:25 In DropAllSecondaryIndexes()
2022/08/05 00:42:25 Index found:  arr2
2022/08/05 00:42:25 Dropped index arr2
2022/08/05 00:42:25 Index found:  idx3
2022/08/05 00:42:25 Dropped index idx3
2022/08/05 00:42:25 Index found:  arr1
2022/08/05 00:42:25 Dropped index arr1
2022/08/05 00:43:02 Flushed the bucket default, Response body: 
2022/08/05 00:43:02 Changing config key indexer.settings.allow_large_keys to value true
2022/08/05 00:43:03 Changing config key indexer.settings.max_seckey_size to value 100
2022/08/05 00:43:03 Changing config key indexer.settings.max_array_seckey_size to value 2000
2022/08/05 00:43:04 Start of createArrayDocs()
2022/08/05 00:43:22 End of createArrayDocs()
2022/08/05 00:43:22 Start of createArrayDocs()
2022/08/05 00:43:22 End of createArrayDocs()
2022/08/05 00:43:29 Created the secondary index arr1. Waiting for it become active
2022/08/05 00:43:29 Index is 16830099478724424781 now active
2022/08/05 00:43:34 Created the secondary index arr2. Waiting for it become active
2022/08/05 00:43:34 Index is 6671649180879804993 now active
2022/08/05 00:43:38 Created the secondary index idx3. Waiting for it become active
2022/08/05 00:43:38 Index is 15844230842108747132 now active
2022/08/05 00:43:38 Expected and Actual scan responses are the same
2022/08/05 00:43:38 Using n1ql client
2022/08/05 00:43:38 Expected and Actual scan responses are the same
2022/08/05 00:43:38 Using n1ql client
2022/08/05 00:43:38 Expected and Actual scan responses are the same
2022/08/05 00:43:38 Changing config key indexer.settings.max_seckey_size to value 4096
2022/08/05 00:43:38 Changing config key indexer.settings.max_array_seckey_size to value 51200
2022/08/05 00:43:42 Expected and Actual scan responses are the same
2022/08/05 00:43:42 Using n1ql client
2022/08/05 00:43:42 Expected and Actual scan responses are the same
2022/08/05 00:43:42 Using n1ql client
2022/08/05 00:43:42 Expected and Actual scan responses are the same
2022/08/05 00:43:42 Changing config key indexer.settings.max_seckey_size to value 100
2022/08/05 00:43:42 Changing config key indexer.settings.max_array_seckey_size to value 2200
2022/08/05 00:43:47 Expected and Actual scan responses are the same
2022/08/05 00:43:47 Using n1ql client
2022/08/05 00:43:47 Expected and Actual scan responses are the same
2022/08/05 00:43:47 Using n1ql client
2022/08/05 00:43:47 Expected and Actual scan responses are the same
2022/08/05 00:43:47 Changing config key indexer.settings.max_seckey_size to value 4608
2022/08/05 00:43:47 Changing config key indexer.settings.max_array_seckey_size to value 10240
--- PASS: TestArraySizeIncreaseDecrease2 (83.44s)
=== RUN   TestBufferedScan_BackfillDisabled
2022/08/05 00:43:48 In TestBufferedScan_BackfillDisabled()
2022/08/05 00:43:48 In DropAllSecondaryIndexes()
2022/08/05 00:43:48 Index found:  idx3
2022/08/05 00:43:48 Dropped index idx3
2022/08/05 00:43:48 Index found:  arr1
2022/08/05 00:43:48 Dropped index arr1
2022/08/05 00:43:48 Index found:  arr2
2022/08/05 00:43:48 Dropped index arr2
2022/08/05 00:44:26 Flushed the bucket default, Response body: 
2022/08/05 00:44:59 Changing config key queryport.client.settings.backfillLimit to value 0
2022/08/05 00:45:05 Created the secondary index addressidx. Waiting for it become active
2022/08/05 00:45:05 Index is 6431255061181181903 now active
2022-08-05T00:45:05.858+05:30 [Info] metadata provider version changed 1480 -> 1481
2022-08-05T00:45:05.858+05:30 [Info] switched currmeta from 1480 -> 1481 force false 
2022-08-05T00:45:05.858+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T00:45:05.858+05:30 [Info] GSIC[default/default-_default-_default-1659640505853457132] started ...
2022-08-05T00:45:05.858+05:30 [Warn] MonitorIndexer: Indexer for default:_default:_default is already being monitored
2022/08/05 00:45:05 Non-backfill file found: /tmp/.ICE-unix
2022/08/05 00:45:05 Non-backfill file found: /tmp/.Test-unix
2022/08/05 00:45:05 Non-backfill file found: /tmp/.X11-unix
2022/08/05 00:45:05 Non-backfill file found: /tmp/.XIM-unix
2022/08/05 00:45:05 Non-backfill file found: /tmp/.font-unix
2022/08/05 00:45:05 Non-backfill file found: /tmp/fail.log
2022/08/05 00:45:05 Non-backfill file found: /tmp/go-build2428309147
2022/08/05 00:45:05 Non-backfill file found: /tmp/go-build3649170400
2022/08/05 00:45:05 Non-backfill file found: /tmp/mdbslice
2022/08/05 00:45:05 Non-backfill file found: /tmp/systemd-private-875652f61b8248bfa7e6fb568f15735b-apache2.service-E9AQDi
2022/08/05 00:45:05 Non-backfill file found: /tmp/systemd-private-875652f61b8248bfa7e6fb568f15735b-systemd-timesyncd.service-mD8GoS
2022/08/05 00:45:05 limit=1,chsize=256; received 1 items; took 2.775388ms
2022-08-05T00:45:05.865+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-05T00:45:05.865+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-05T00:45:05.867+05:30 [Info] switched currmeta from 1485 -> 1485 force true 
2022-08-05T00:45:05.892+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-05T00:45:05.892+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-05T00:45:05.895+05:30 [Info] switched currmeta from 1481 -> 1481 force true 
2022-08-05T00:45:07.440+05:30 [Info] serviceChangeNotifier: received PoolChangeNotification
2022-08-05T00:45:07.446+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-05T00:45:07.446+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-05T00:45:07.447+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-05T00:45:07.447+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-05T00:45:07.449+05:30 [Info] switched currmeta from 1481 -> 1481 force true 
2022-08-05T00:45:07.451+05:30 [Info] switched currmeta from 1485 -> 1485 force true 
2022/08/05 00:45:08 limit=1000,chsize=256; received 1000 items; took 1.259788987s
2022-08-05T00:45:09.125+05:30 [Info] gsiKeyspace::Close Closing default:_default:_default
--- PASS: TestBufferedScan_BackfillDisabled (80.58s)
=== RUN   TestBufferedScan_BackfillEnabled
2022/08/05 00:45:09 In TestBufferedScan_BackfillEnabled()
2022-08-05T00:45:09.125+05:30 [Info] MetadataProvider.CheckIndexerStatus(): adminport=127.0.0.1:9106 connected=true
2022/08/05 00:45:09 Changing config key queryport.client.settings.backfillLimit to value 1
2022-08-05T00:45:09.138+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T00:45:09.138+05:30 [Info] GSIC[default/default-_default-_default-1659640509134275818] started ...
2022-08-05T00:45:09.149+05:30 [Info] New settings received: 
{"indexer.api.enableTestServer":true,"indexer.plasma.backIndex.enableInMemoryCompression":true,"indexer.plasma.backIndex.enablePageBloomFilter":false,"indexer.plasma.mainIndex.enableInMemoryCompression":true,"indexer.settings.allow_large_keys":true,"indexer.settings.bufferPoolBlockSize":16384,"indexer.settings.build.batch_size":5,"indexer.settings.compaction.abort_exceed_interval":false,"indexer.settings.compaction.check_period":30,"indexer.settings.compaction.compaction_mode":"circular","indexer.settings.compaction.days_of_week":"Sunday,Monday,Tuesday,Wednesday,Thursday,Friday,Saturday","indexer.settings.compaction.interval":"00:00,00:00","indexer.settings.compaction.min_frag":30,"indexer.settings.compaction.min_size":524288000,"indexer.settings.compaction.plasma.manual":false,"indexer.settings.compaction.plasma.optional.decrement":5,"indexer.settings.compaction.plasma.optional.min_frag":20,"indexer.settings.compaction.plasma.optional.quota":25,"indexer.settings.corrupt_index_num_backups":1,"indexer.settings.cpuProfDir":"","indexer.settings.cpuProfile":false,"indexer.settings.eTagPeriod":240,"indexer.settings.enable_corrupt_index_backup":false,"indexer.settings.enable_page_bloom_filter":false,"indexer.settings.fast_flush_mode":true,"indexer.settings.gc_percent":100,"indexer.settings.inmemory_snapshot.fdb.interval":200,"indexer.settings.inmemory_snapshot.interval":200,"indexer.settings.inmemory_snapshot.moi.interval":10,"indexer.settings.largeSnapshotThreshold":200,"indexer.settings.log_level":"info","indexer.settings.maxVbQueueLength":0,"indexer.settings.max_array_seckey_size":10240,"indexer.settings.max_cpu_percent":0,"indexer.settings.max_seckey_size":4608,"indexer.settings.max_writer_lock_prob":20,"indexer.settings.memProfDir":"","indexer.settings.memProfile":false,"indexer.settings.memory_quota":1572864000,"indexer.settings.minVbQueueLength":250,"indexer.settings.moi.debug":false,"indexer.settings.moi.persistence_threads":2,"indexer.settings.moi.recovery.max_rollbacks":2,"indexer.settings.moi.recovery_threads":4,"indexer.settings.num_replica":0,"indexer.settings.persisted_snapshot.fdb.interval":5000,"indexer.settings.persisted_snapshot.interval":5000,"indexer.settings.persisted_snapshot.moi.interval":60000,"indexer.settings.persisted_snapshot_init_build.fdb.interval":5000,"indexer.settings.persisted_snapshot_init_build.interval":5000,"indexer.settings.persisted_snapshot_init_build.moi.interval":60000,"indexer.settings.plasma.recovery.max_rollbacks":2,"indexer.settings.rebalance.redistribute_indexes":false,"indexer.settings.recovery.max_rollbacks":5,"indexer.settings.scan_getseqnos_retries":30,"indexer.settings.scan_timeout":0,"indexer.settings.send_buffer_size":1024,"indexer.settings.serverless.indexLimit":200,"indexer.settings.sliceBufSize":800,"indexer.settings.smallSnapshotThreshold":30,"indexer.settings.snapshotListeners":2,"indexer.settings.snapshotRequestWorkers":2,"indexer.settings.statsLogDumpInterval":60,"indexer.settings.storage_mode":"memory_optimized","indexer.settings.storage_mode.disable_upgrade":true,"indexer.settings.thresholds.mem_high":80,"indexer.settings.thresholds.mem_low":60,"indexer.settings.wal_size":4096,"projector.settings.log_level":"info","queryport.client.log_level":"warn","queryport.client.settings.backfillLimit":1,"queryport.client.settings.minPoolSizeWM":1000,"queryport.client.settings.poolOverflow":30,"queryport.client.settings.poolSize":5000,"queryport.client.settings.relConnBatchSize":100}
2022/08/05 00:45:09 limit=1,chsize=256; received 1 items; took 11.906682ms
2022/08/05 00:45:10 limit=1000,chsize=256; received 1000 items; took 12.2075ms
2022/08/05 00:45:22 limit=1000,chsize=256; received 1000 items; took 10.341311366s
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error: bufferedscan temp file size exceeded limit 1, 13 - cause: bufferedscan temp file size exceeded limit 1, 13
Scan error:  bufferedscan temp file size exceeded limit 1, 13 - cause:  bufferedscan temp file size exceeded limit 1, 13
Scan error:  bufferedscan temp file size exceeded limit 1, 13 - cause:  bufferedscan temp file size exceeded limit 1, 13
2022/08/05 00:45:39 limit=1000,chsize=256; received 762 items; took 15.717133541s
2022/08/05 00:45:39 limit=1000,chsize=256; received 762 items; took 15.726511309s
2022/08/05 00:45:40 Changing config key queryport.client.settings.backfillLimit to value 0
--- PASS: TestBufferedScan_BackfillEnabled (31.13s)
=== RUN   TestMultiScanSetup
2022/08/05 00:45:40 In TestMultiScanSetup()
2022/08/05 00:45:41 Emptying the default bucket
2022/08/05 00:45:44 Flush Enabled on bucket default, responseBody: 
2022/08/05 00:46:21 Flushed the bucket default, Response body: 
2022/08/05 00:46:21 Populating the default bucket
2022/08/05 00:46:33 Created the secondary index index_companyname. Waiting for it become active
2022/08/05 00:46:33 Index is 7039470547167679628 now active
2022/08/05 00:46:37 Created the secondary index index_company. Waiting for it become active
2022/08/05 00:46:37 Index is 345984908176267564 now active
2022/08/05 00:46:42 Created the secondary index index_company_name_age. Waiting for it become active
2022/08/05 00:46:42 Index is 3986732334271703289 now active
2022/08/05 00:46:48 Created the secondary index index_primary. Waiting for it become active
2022/08/05 00:46:48 Index is 12428592194848189609 now active
2022/08/05 00:46:53 Created the secondary index index_company_name_age_address. Waiting for it become active
2022/08/05 00:46:53 Index is 13857272088214375944 now active
2022/08/05 00:46:57 Created the secondary index index_company_name_age_address_friends. Waiting for it become active
2022/08/05 00:46:57 Index is 17773669187575157371 now active
--- PASS: TestMultiScanSetup (77.67s)
=== RUN   TestMultiScanCount
2022/08/05 00:46:57 In TestMultiScanCount()
2022/08/05 00:46:57 

--------- Composite Index with 2 fields ---------
2022/08/05 00:46:57 
--- ScanAllNoFilter ---
2022/08/05 00:46:57 distinct = false
2022/08/05 00:46:58 Using n1ql client
2022/08/05 00:46:58 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:46:58 
--- ScanAllFilterNil ---
2022/08/05 00:46:58 distinct = false
2022/08/05 00:46:58 Using n1ql client
2022/08/05 00:46:58 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:46:58 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:46:58 distinct = false
2022/08/05 00:46:59 Using n1ql client
2022/08/05 00:46:59 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:46:59 
--- SingleSeek ---
2022/08/05 00:46:59 distinct = false
2022/08/05 00:46:59 Using n1ql client
2022/08/05 00:46:59 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:46:59 
--- MultipleSeek ---
2022/08/05 00:46:59 distinct = false
2022/08/05 00:46:59 Using n1ql client
2022/08/05 00:46:59 MultiScanCount = 2 ExpectedMultiScanCount = 2
2022/08/05 00:46:59 
--- SimpleRange ---
2022/08/05 00:46:59 distinct = false
2022/08/05 00:47:00 Using n1ql client
2022/08/05 00:47:00 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2022/08/05 00:47:00 
--- NonOverlappingRanges ---
2022/08/05 00:47:00 distinct = false
2022/08/05 00:47:00 Using n1ql client
2022/08/05 00:47:00 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2022/08/05 00:47:00 
--- OverlappingRanges ---
2022/08/05 00:47:00 distinct = false
2022/08/05 00:47:01 Using n1ql client
2022/08/05 00:47:01 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2022/08/05 00:47:01 
--- NonOverlappingFilters ---
2022/08/05 00:47:01 distinct = false
2022/08/05 00:47:01 Using n1ql client
2022/08/05 00:47:01 MultiScanCount = 337 ExpectedMultiScanCount = 337
2022/08/05 00:47:01 
--- OverlappingFilters ---
2022/08/05 00:47:01 distinct = false
2022/08/05 00:47:01 Using n1ql client
2022/08/05 00:47:01 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2022/08/05 00:47:01 
--- BoundaryFilters ---
2022/08/05 00:47:01 distinct = false
2022/08/05 00:47:02 Using n1ql client
2022/08/05 00:47:02 MultiScanCount = 499 ExpectedMultiScanCount = 499
2022/08/05 00:47:02 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:47:02 distinct = false
2022/08/05 00:47:02 Using n1ql client
2022/08/05 00:47:02 MultiScanCount = 256 ExpectedMultiScanCount = 256
2022/08/05 00:47:02 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:47:02 distinct = false
2022/08/05 00:47:03 Using n1ql client
2022/08/05 00:47:03 MultiScanCount = 255 ExpectedMultiScanCount = 255
2022/08/05 00:47:03 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:47:03 distinct = false
2022/08/05 00:47:03 Using n1ql client
2022/08/05 00:47:03 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2022/08/05 00:47:03 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:47:03 distinct = false
2022/08/05 00:47:03 Using n1ql client
2022/08/05 00:47:03 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2022/08/05 00:47:03 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:47:03 distinct = false
2022/08/05 00:47:04 Using n1ql client
2022/08/05 00:47:04 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:47:04 
--- FiltersWithUnbounded ---
2022/08/05 00:47:04 distinct = false
2022/08/05 00:47:04 Using n1ql client
2022/08/05 00:47:04 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2022/08/05 00:47:04 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:47:04 distinct = false
2022/08/05 00:47:04 Using n1ql client
2022/08/05 00:47:04 MultiScanCount = 418 ExpectedMultiScanCount = 418
2022/08/05 00:47:04 

--------- Simple Index with 1 field ---------
2022/08/05 00:47:04 
--- SingleIndexSimpleRange ---
2022/08/05 00:47:04 distinct = false
2022/08/05 00:47:05 Using n1ql client
2022/08/05 00:47:05 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2022/08/05 00:47:05 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:47:05 distinct = false
2022/08/05 00:47:05 Using n1ql client
2022/08/05 00:47:05 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2022/08/05 00:47:05 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:47:05 distinct = false
2022/08/05 00:47:05 Using n1ql client
2022/08/05 00:47:05 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2022/08/05 00:47:05 

--------- Composite Index with 3 fields ---------
2022/08/05 00:47:05 
--- ScanAllNoFilter ---
2022/08/05 00:47:05 distinct = false
2022/08/05 00:47:06 Using n1ql client
2022/08/05 00:47:06 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:47:06 
--- ScanAllFilterNil ---
2022/08/05 00:47:06 distinct = false
2022/08/05 00:47:06 Using n1ql client
2022/08/05 00:47:06 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:47:06 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:47:06 distinct = false
2022/08/05 00:47:07 Using n1ql client
2022/08/05 00:47:07 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:47:07 
--- 3FieldsSingleSeek ---
2022/08/05 00:47:07 distinct = false
2022/08/05 00:47:07 Using n1ql client
2022/08/05 00:47:07 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:47:07 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:47:07 distinct = false
2022/08/05 00:47:07 Using n1ql client
2022/08/05 00:47:07 MultiScanCount = 3 ExpectedMultiScanCount = 3
2022/08/05 00:47:07 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:47:07 distinct = false
2022/08/05 00:47:08 Using n1ql client
2022/08/05 00:47:08 MultiScanCount = 2 ExpectedMultiScanCount = 2
2022/08/05 00:47:08 

--------- New scenarios ---------
2022/08/05 00:47:08 
--- CompIndexHighUnbounded1 ---
2022/08/05 00:47:08 
--- Multi Scan 0 ---
2022/08/05 00:47:08 distinct = false
2022/08/05 00:47:08 Using n1ql client
2022/08/05 00:47:08 Using n1ql client
2022/08/05 00:47:08 len(scanResults) = 8 MultiScanCount = 8
2022/08/05 00:47:08 Expected and Actual scan responses are the same
2022/08/05 00:47:08 
--- Multi Scan 1 ---
2022/08/05 00:47:08 distinct = false
2022/08/05 00:47:08 Using n1ql client
2022/08/05 00:47:08 Using n1ql client
2022/08/05 00:47:08 len(scanResults) = 0 MultiScanCount = 0
2022/08/05 00:47:08 Expected and Actual scan responses are the same
2022/08/05 00:47:08 
--- Multi Scan 2 ---
2022/08/05 00:47:08 distinct = false
2022/08/05 00:47:09 Using n1ql client
2022/08/05 00:47:09 Using n1ql client
2022/08/05 00:47:09 len(scanResults) = 9 MultiScanCount = 9
2022/08/05 00:47:09 Expected and Actual scan responses are the same
2022/08/05 00:47:09 
--- CompIndexHighUnbounded2 ---
2022/08/05 00:47:09 
--- Multi Scan 0 ---
2022/08/05 00:47:09 distinct = false
2022/08/05 00:47:09 Using n1ql client
2022/08/05 00:47:09 Using n1ql client
2022/08/05 00:47:09 len(scanResults) = 4138 MultiScanCount = 4138
2022/08/05 00:47:09 Expected and Actual scan responses are the same
2022/08/05 00:47:09 
--- Multi Scan 1 ---
2022/08/05 00:47:09 distinct = false
2022/08/05 00:47:10 Using n1ql client
2022/08/05 00:47:10 Using n1ql client
2022/08/05 00:47:10 len(scanResults) = 2746 MultiScanCount = 2746
2022/08/05 00:47:10 Expected and Actual scan responses are the same
2022/08/05 00:47:10 
--- Multi Scan 2 ---
2022/08/05 00:47:10 distinct = false
2022/08/05 00:47:10 Using n1ql client
2022/08/05 00:47:10 Using n1ql client
2022/08/05 00:47:10 len(scanResults) = 4691 MultiScanCount = 4691
2022/08/05 00:47:10 Expected and Actual scan responses are the same
2022/08/05 00:47:10 
--- CompIndexHighUnbounded3 ---
2022/08/05 00:47:10 
--- Multi Scan 0 ---
2022/08/05 00:47:10 distinct = false
2022/08/05 00:47:10 Using n1ql client
2022/08/05 00:47:10 Using n1ql client
2022/08/05 00:47:10 len(scanResults) = 1329 MultiScanCount = 1329
2022/08/05 00:47:10 Expected and Actual scan responses are the same
2022/08/05 00:47:10 
--- CompIndexHighUnbounded4 ---
2022/08/05 00:47:10 
--- Multi Scan 0 ---
2022/08/05 00:47:10 distinct = false
2022/08/05 00:47:11 Using n1ql client
2022/08/05 00:47:11 Using n1ql client
2022/08/05 00:47:11 len(scanResults) = 5349 MultiScanCount = 5349
2022/08/05 00:47:11 Expected and Actual scan responses are the same
2022/08/05 00:47:11 
--- CompIndexHighUnbounded5 ---
2022/08/05 00:47:11 
--- Multi Scan 0 ---
2022/08/05 00:47:11 distinct = false
2022/08/05 00:47:11 Using n1ql client
2022/08/05 00:47:11 Using n1ql client
2022/08/05 00:47:11 len(scanResults) = 8210 MultiScanCount = 8210
2022/08/05 00:47:11 Expected and Actual scan responses are the same
2022/08/05 00:47:11 
--- SeekBoundaries ---
2022/08/05 00:47:11 
--- Multi Scan 0 ---
2022/08/05 00:47:11 distinct = false
2022/08/05 00:47:12 Using n1ql client
2022/08/05 00:47:12 Using n1ql client
2022/08/05 00:47:12 len(scanResults) = 175 MultiScanCount = 175
2022/08/05 00:47:12 Expected and Actual scan responses are the same
2022/08/05 00:47:12 
--- Multi Scan 1 ---
2022/08/05 00:47:12 distinct = false
2022/08/05 00:47:12 Using n1ql client
2022/08/05 00:47:12 Using n1ql client
2022/08/05 00:47:12 len(scanResults) = 1 MultiScanCount = 1
2022/08/05 00:47:12 Expected and Actual scan responses are the same
2022/08/05 00:47:12 
--- Multi Scan 2 ---
2022/08/05 00:47:12 distinct = false
2022/08/05 00:47:12 Using n1ql client
2022/08/05 00:47:12 Using n1ql client
2022/08/05 00:47:12 len(scanResults) = 555 MultiScanCount = 555
2022/08/05 00:47:12 Expected and Actual scan responses are the same
2022/08/05 00:47:12 
--- Multi Scan 3 ---
2022/08/05 00:47:12 distinct = false
2022/08/05 00:47:13 Using n1ql client
2022/08/05 00:47:13 Using n1ql client
2022/08/05 00:47:13 len(scanResults) = 872 MultiScanCount = 872
2022/08/05 00:47:13 Expected and Actual scan responses are the same
2022/08/05 00:47:13 
--- Multi Scan 4 ---
2022/08/05 00:47:13 distinct = false
2022/08/05 00:47:13 Using n1ql client
2022/08/05 00:47:13 Using n1ql client
2022/08/05 00:47:13 len(scanResults) = 287 MultiScanCount = 287
2022/08/05 00:47:13 Expected and Actual scan responses are the same
2022/08/05 00:47:13 
--- Multi Scan 5 ---
2022/08/05 00:47:13 distinct = false
2022/08/05 00:47:14 Using n1ql client
2022/08/05 00:47:14 Using n1ql client
2022/08/05 00:47:14 len(scanResults) = 5254 MultiScanCount = 5254
2022/08/05 00:47:14 Expected and Actual scan responses are the same
2022/08/05 00:47:14 
--- Multi Scan 6 ---
2022/08/05 00:47:14 distinct = false
2022/08/05 00:47:14 Using n1ql client
2022/08/05 00:47:14 Using n1ql client
2022/08/05 00:47:14 len(scanResults) = 5566 MultiScanCount = 5566
2022/08/05 00:47:14 Expected and Actual scan responses are the same
2022/08/05 00:47:14 
--- Multi Scan 7 ---
2022/08/05 00:47:14 distinct = false
2022/08/05 00:47:14 Using n1ql client
2022/08/05 00:47:14 Using n1ql client
2022/08/05 00:47:14 len(scanResults) = 8 MultiScanCount = 8
2022/08/05 00:47:14 Expected and Actual scan responses are the same
2022/08/05 00:47:14 

--------- With DISTINCT True ---------
2022/08/05 00:47:14 
--- ScanAllNoFilter ---
2022/08/05 00:47:14 distinct = true
2022/08/05 00:47:15 Using n1ql client
2022/08/05 00:47:15 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:47:15 
--- ScanAllFilterNil ---
2022/08/05 00:47:15 distinct = true
2022/08/05 00:47:15 Using n1ql client
2022/08/05 00:47:15 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:47:15 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:47:15 distinct = true
2022/08/05 00:47:16 Using n1ql client
2022/08/05 00:47:16 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:47:16 
--- SingleSeek ---
2022/08/05 00:47:16 distinct = true
2022/08/05 00:47:16 Using n1ql client
2022/08/05 00:47:16 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:47:16 
--- MultipleSeek ---
2022/08/05 00:47:16 distinct = true
2022/08/05 00:47:16 Using n1ql client
2022/08/05 00:47:16 MultiScanCount = 2 ExpectedMultiScanCount = 2
2022/08/05 00:47:16 
--- SimpleRange ---
2022/08/05 00:47:16 distinct = true
2022/08/05 00:47:17 Using n1ql client
2022/08/05 00:47:17 MultiScanCount = 227 ExpectedMultiScanCount = 227
2022/08/05 00:47:17 
--- NonOverlappingRanges ---
2022/08/05 00:47:17 distinct = true
2022/08/05 00:47:17 Using n1ql client
2022/08/05 00:47:17 MultiScanCount = 428 ExpectedMultiScanCount = 428
2022/08/05 00:47:17 
--- OverlappingRanges ---
2022/08/05 00:47:17 distinct = true
2022/08/05 00:47:17 Using n1ql client
2022/08/05 00:47:17 MultiScanCount = 575 ExpectedMultiScanCount = 575
2022/08/05 00:47:17 
--- NonOverlappingFilters ---
2022/08/05 00:47:17 distinct = true
2022/08/05 00:47:18 Using n1ql client
2022/08/05 00:47:18 MultiScanCount = 186 ExpectedMultiScanCount = 186
2022/08/05 00:47:18 
--- NonOverlappingFilters2 ---
2022/08/05 00:47:18 distinct = true
2022/08/05 00:47:18 Using n1ql client
2022/08/05 00:47:18 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:47:18 
--- OverlappingFilters ---
2022/08/05 00:47:18 distinct = true
2022/08/05 00:47:19 Using n1ql client
2022/08/05 00:47:19 MultiScanCount = 543 ExpectedMultiScanCount = 543
2022/08/05 00:47:19 
--- BoundaryFilters ---
2022/08/05 00:47:19 distinct = true
2022/08/05 00:47:19 Using n1ql client
2022/08/05 00:47:19 MultiScanCount = 172 ExpectedMultiScanCount = 172
2022/08/05 00:47:19 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:47:19 distinct = true
2022/08/05 00:47:19 Using n1ql client
2022/08/05 00:47:19 MultiScanCount = 135 ExpectedMultiScanCount = 135
2022/08/05 00:47:19 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:47:19 distinct = true
2022/08/05 00:47:20 Using n1ql client
2022/08/05 00:47:20 MultiScanCount = 134 ExpectedMultiScanCount = 134
2022/08/05 00:47:20 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:47:20 distinct = false
2022/08/05 00:47:20 Using n1ql client
2022/08/05 00:47:20 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2022/08/05 00:47:20 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:47:20 distinct = false
2022/08/05 00:47:20 Using n1ql client
2022/08/05 00:47:20 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2022/08/05 00:47:20 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:47:20 distinct = false
2022/08/05 00:47:21 Using n1ql client
2022/08/05 00:47:21 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:47:21 
--- FiltersWithUnbounded ---
2022/08/05 00:47:21 distinct = false
2022/08/05 00:47:21 Using n1ql client
2022/08/05 00:47:21 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2022/08/05 00:47:21 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:47:21 distinct = false
2022/08/05 00:47:22 Using n1ql client
2022/08/05 00:47:22 MultiScanCount = 418 ExpectedMultiScanCount = 418
2022/08/05 00:47:22 

--------- Simple Index with 1 field ---------
2022/08/05 00:47:22 
--- SingleIndexSimpleRange ---
2022/08/05 00:47:22 distinct = true
2022/08/05 00:47:22 Using n1ql client
2022/08/05 00:47:22 MultiScanCount = 227 ExpectedMultiScanCount = 227
2022/08/05 00:47:22 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:47:22 distinct = true
2022/08/05 00:47:22 Using n1ql client
2022/08/05 00:47:22 MultiScanCount = 713 ExpectedMultiScanCount = 713
2022/08/05 00:47:22 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:47:22 distinct = true
2022/08/05 00:47:23 Using n1ql client
2022/08/05 00:47:23 MultiScanCount = 869 ExpectedMultiScanCount = 869
2022/08/05 00:47:23 

--------- Composite Index with 3 fields ---------
2022/08/05 00:47:23 
--- ScanAllNoFilter ---
2022/08/05 00:47:23 distinct = true
2022/08/05 00:47:23 Using n1ql client
2022/08/05 00:47:23 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:47:23 
--- ScanAllFilterNil ---
2022/08/05 00:47:23 distinct = true
2022/08/05 00:47:23 Using n1ql client
2022/08/05 00:47:23 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:47:23 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:47:23 distinct = true
2022/08/05 00:47:24 Using n1ql client
2022/08/05 00:47:24 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:47:24 
--- 3FieldsSingleSeek ---
2022/08/05 00:47:24 distinct = true
2022/08/05 00:47:24 Using n1ql client
2022/08/05 00:47:24 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:47:24 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:47:24 distinct = true
2022/08/05 00:47:25 Using n1ql client
2022/08/05 00:47:25 MultiScanCount = 3 ExpectedMultiScanCount = 3
2022/08/05 00:47:25 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:47:25 distinct = true
2022/08/05 00:47:25 Using n1ql client
2022/08/05 00:47:25 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanCount (27.69s)
=== RUN   TestMultiScanScenarios
2022/08/05 00:47:25 In TestMultiScanScenarios()
2022/08/05 00:47:25 

--------- Composite Index with 2 fields ---------
2022/08/05 00:47:25 
--- ScanAllNoFilter ---
2022/08/05 00:47:25 distinct = false
2022/08/05 00:47:25 Using n1ql client
2022/08/05 00:47:26 Expected and Actual scan responses are the same
2022/08/05 00:47:26 
--- ScanAllFilterNil ---
2022/08/05 00:47:26 distinct = false
2022/08/05 00:47:26 Using n1ql client
2022/08/05 00:47:26 Expected and Actual scan responses are the same
2022/08/05 00:47:26 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:47:26 distinct = false
2022/08/05 00:47:26 Using n1ql client
2022/08/05 00:47:26 Expected and Actual scan responses are the same
2022/08/05 00:47:26 
--- SingleSeek ---
2022/08/05 00:47:26 distinct = false
2022/08/05 00:47:27 Using n1ql client
2022/08/05 00:47:27 Expected and Actual scan responses are the same
2022/08/05 00:47:27 
--- MultipleSeek ---
2022/08/05 00:47:27 distinct = false
2022/08/05 00:47:27 Using n1ql client
2022/08/05 00:47:27 Expected and Actual scan responses are the same
2022/08/05 00:47:27 
--- SimpleRange ---
2022/08/05 00:47:27 distinct = false
2022/08/05 00:47:28 Using n1ql client
2022/08/05 00:47:28 Expected and Actual scan responses are the same
2022/08/05 00:47:28 
--- NonOverlappingRanges ---
2022/08/05 00:47:28 distinct = false
2022/08/05 00:47:28 Using n1ql client
2022/08/05 00:47:28 Expected and Actual scan responses are the same
2022/08/05 00:47:28 
--- OverlappingRanges ---
2022/08/05 00:47:28 distinct = false
2022/08/05 00:47:28 Using n1ql client
2022/08/05 00:47:28 Expected and Actual scan responses are the same
2022/08/05 00:47:28 
--- NonOverlappingFilters ---
2022/08/05 00:47:28 distinct = false
2022/08/05 00:47:29 Using n1ql client
2022/08/05 00:47:29 Expected and Actual scan responses are the same
2022/08/05 00:47:29 
--- OverlappingFilters ---
2022/08/05 00:47:29 distinct = false
2022/08/05 00:47:29 Using n1ql client
2022/08/05 00:47:29 Expected and Actual scan responses are the same
2022/08/05 00:47:29 
--- BoundaryFilters ---
2022/08/05 00:47:29 distinct = false
2022/08/05 00:47:30 Using n1ql client
2022/08/05 00:47:30 Expected and Actual scan responses are the same
2022/08/05 00:47:30 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:47:30 distinct = false
2022/08/05 00:47:30 Using n1ql client
2022/08/05 00:47:30 Expected and Actual scan responses are the same
2022/08/05 00:47:30 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:47:30 distinct = false
2022/08/05 00:47:30 Using n1ql client
2022/08/05 00:47:30 Expected and Actual scan responses are the same
2022/08/05 00:47:30 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:47:30 distinct = false
2022/08/05 00:47:31 Using n1ql client
2022/08/05 00:47:31 Expected and Actual scan responses are the same
2022/08/05 00:47:31 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:47:31 distinct = false
2022/08/05 00:47:31 Using n1ql client
2022/08/05 00:47:31 Expected and Actual scan responses are the same
2022/08/05 00:47:31 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:47:31 distinct = false
2022/08/05 00:47:32 Using n1ql client
2022/08/05 00:47:32 Expected and Actual scan responses are the same
2022/08/05 00:47:32 
--- FiltersWithUnbounded ---
2022/08/05 00:47:32 distinct = false
2022/08/05 00:47:32 Using n1ql client
2022/08/05 00:47:32 Expected and Actual scan responses are the same
2022/08/05 00:47:32 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:47:32 distinct = false
2022/08/05 00:47:32 Using n1ql client
2022/08/05 00:47:32 Expected and Actual scan responses are the same
2022/08/05 00:47:32 

--------- Simple Index with 1 field ---------
2022/08/05 00:47:32 
--- SingleIndexSimpleRange ---
2022/08/05 00:47:32 distinct = false
2022/08/05 00:47:33 Using n1ql client
2022/08/05 00:47:33 Expected and Actual scan responses are the same
2022/08/05 00:47:33 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:47:33 distinct = false
2022/08/05 00:47:33 Using n1ql client
2022/08/05 00:47:33 Expected and Actual scan responses are the same
2022/08/05 00:47:33 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:47:33 distinct = false
2022/08/05 00:47:33 Using n1ql client
2022/08/05 00:47:33 Expected and Actual scan responses are the same
2022/08/05 00:47:33 

--------- Composite Index with 3 fields ---------
2022/08/05 00:47:33 
--- ScanAllNoFilter ---
2022/08/05 00:47:33 distinct = false
2022/08/05 00:47:34 Using n1ql client
2022/08/05 00:47:34 Expected and Actual scan responses are the same
2022/08/05 00:47:34 
--- ScanAllFilterNil ---
2022/08/05 00:47:34 distinct = false
2022/08/05 00:47:34 Using n1ql client
2022/08/05 00:47:34 Expected and Actual scan responses are the same
2022/08/05 00:47:34 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:47:34 distinct = false
2022/08/05 00:47:35 Using n1ql client
2022/08/05 00:47:35 Expected and Actual scan responses are the same
2022/08/05 00:47:35 
--- 3FieldsSingleSeek ---
2022/08/05 00:47:35 distinct = false
2022/08/05 00:47:35 Using n1ql client
2022/08/05 00:47:35 Expected and Actual scan responses are the same
2022/08/05 00:47:35 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:47:35 distinct = false
2022/08/05 00:47:36 Using n1ql client
2022/08/05 00:47:36 Expected and Actual scan responses are the same
2022/08/05 00:47:36 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:47:36 distinct = false
2022/08/05 00:47:36 Using n1ql client
2022/08/05 00:47:36 Expected and Actual scan responses are the same
2022/08/05 00:47:36 

--------- New scenarios ---------
2022/08/05 00:47:36 
--- CompIndexHighUnbounded1 ---
2022/08/05 00:47:36 
--- Multi Scan 0 ---
2022/08/05 00:47:36 distinct = false
2022/08/05 00:47:37 Using n1ql client
2022/08/05 00:47:37 Expected and Actual scan responses are the same
2022/08/05 00:47:37 
--- Multi Scan 1 ---
2022/08/05 00:47:37 distinct = false
2022/08/05 00:47:37 Using n1ql client
2022/08/05 00:47:37 Expected and Actual scan responses are the same
2022/08/05 00:47:37 
--- Multi Scan 2 ---
2022/08/05 00:47:37 distinct = false
2022/08/05 00:47:37 Using n1ql client
2022/08/05 00:47:37 Expected and Actual scan responses are the same
2022/08/05 00:47:37 
--- CompIndexHighUnbounded2 ---
2022/08/05 00:47:37 
--- Multi Scan 0 ---
2022/08/05 00:47:37 distinct = false
2022/08/05 00:47:38 Using n1ql client
2022/08/05 00:47:38 Expected and Actual scan responses are the same
2022/08/05 00:47:38 
--- Multi Scan 1 ---
2022/08/05 00:47:38 distinct = false
2022/08/05 00:47:38 Using n1ql client
2022/08/05 00:47:38 Expected and Actual scan responses are the same
2022/08/05 00:47:38 
--- Multi Scan 2 ---
2022/08/05 00:47:38 distinct = false
2022/08/05 00:47:38 Using n1ql client
2022/08/05 00:47:38 Expected and Actual scan responses are the same
2022/08/05 00:47:38 
--- CompIndexHighUnbounded3 ---
2022/08/05 00:47:38 
--- Multi Scan 0 ---
2022/08/05 00:47:38 distinct = false
2022/08/05 00:47:39 Using n1ql client
2022/08/05 00:47:39 Expected and Actual scan responses are the same
2022/08/05 00:47:39 
--- CompIndexHighUnbounded4 ---
2022/08/05 00:47:39 
--- Multi Scan 0 ---
2022/08/05 00:47:39 distinct = false
2022/08/05 00:47:39 Using n1ql client
2022/08/05 00:47:39 Expected and Actual scan responses are the same
2022/08/05 00:47:39 
--- CompIndexHighUnbounded5 ---
2022/08/05 00:47:39 
--- Multi Scan 0 ---
2022/08/05 00:47:39 distinct = false
2022/08/05 00:47:40 Using n1ql client
2022/08/05 00:47:40 Expected and Actual scan responses are the same
2022/08/05 00:47:40 
--- SeekBoundaries ---
2022/08/05 00:47:40 
--- Multi Scan 0 ---
2022/08/05 00:47:40 distinct = false
2022/08/05 00:47:40 Using n1ql client
2022/08/05 00:47:40 Expected and Actual scan responses are the same
2022/08/05 00:47:40 
--- Multi Scan 1 ---
2022/08/05 00:47:40 distinct = false
2022/08/05 00:47:40 Using n1ql client
2022/08/05 00:47:40 Expected and Actual scan responses are the same
2022/08/05 00:47:40 
--- Multi Scan 2 ---
2022/08/05 00:47:40 distinct = false
2022/08/05 00:47:41 Using n1ql client
2022/08/05 00:47:41 Expected and Actual scan responses are the same
2022/08/05 00:47:41 
--- Multi Scan 3 ---
2022/08/05 00:47:41 distinct = false
2022/08/05 00:47:41 Using n1ql client
2022/08/05 00:47:41 Expected and Actual scan responses are the same
2022/08/05 00:47:41 
--- Multi Scan 4 ---
2022/08/05 00:47:41 distinct = false
2022/08/05 00:47:42 Using n1ql client
2022/08/05 00:47:42 Expected and Actual scan responses are the same
2022/08/05 00:47:42 
--- Multi Scan 5 ---
2022/08/05 00:47:42 distinct = false
2022/08/05 00:47:42 Using n1ql client
2022/08/05 00:47:42 Expected and Actual scan responses are the same
2022/08/05 00:47:42 
--- Multi Scan 6 ---
2022/08/05 00:47:42 distinct = false
2022/08/05 00:47:42 Using n1ql client
2022/08/05 00:47:42 Expected and Actual scan responses are the same
2022/08/05 00:47:42 
--- Multi Scan 7 ---
2022/08/05 00:47:42 distinct = false
2022/08/05 00:47:43 Using n1ql client
2022/08/05 00:47:43 Expected and Actual scan responses are the same
2022/08/05 00:47:43 
--- PrefixSortVariations ---
2022/08/05 00:47:43 
--- Multi Scan 0 ---
2022/08/05 00:47:43 distinct = false
2022/08/05 00:47:44 Using n1ql client
2022/08/05 00:47:44 Expected and Actual scan responses are the same
2022/08/05 00:47:44 
--- Multi Scan 1 ---
2022/08/05 00:47:44 distinct = false
2022/08/05 00:47:44 Using n1ql client
2022/08/05 00:47:44 Expected and Actual scan responses are the same
--- PASS: TestMultiScanScenarios (19.24s)
=== RUN   TestMultiScanOffset
2022/08/05 00:47:44 In TestMultiScanOffset()
2022/08/05 00:47:44 

--------- Composite Index with 2 fields ---------
2022/08/05 00:47:44 
--- ScanAllNoFilter ---
2022/08/05 00:47:44 distinct = false
2022/08/05 00:47:45 Using n1ql client
2022/08/05 00:47:45 
--- ScanAllFilterNil ---
2022/08/05 00:47:45 distinct = false
2022/08/05 00:47:45 Using n1ql client
2022/08/05 00:47:45 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:47:45 distinct = false
2022/08/05 00:47:45 Using n1ql client
2022/08/05 00:47:45 
--- SingleSeek ---
2022/08/05 00:47:45 distinct = false
2022/08/05 00:47:46 Using n1ql client
2022/08/05 00:47:46 
--- MultipleSeek ---
2022/08/05 00:47:46 distinct = false
2022/08/05 00:47:46 Using n1ql client
2022/08/05 00:47:46 
--- SimpleRange ---
2022/08/05 00:47:46 distinct = false
2022/08/05 00:47:47 Using n1ql client
2022/08/05 00:47:47 
--- NonOverlappingRanges ---
2022/08/05 00:47:47 distinct = false
2022/08/05 00:47:47 Using n1ql client
2022/08/05 00:47:47 
--- OverlappingRanges ---
2022/08/05 00:47:47 distinct = false
2022/08/05 00:47:47 Using n1ql client
2022/08/05 00:47:47 
--- NonOverlappingFilters ---
2022/08/05 00:47:47 distinct = false
2022/08/05 00:47:48 Using n1ql client
2022/08/05 00:47:48 
--- OverlappingFilters ---
2022/08/05 00:47:48 distinct = false
2022/08/05 00:47:48 Using n1ql client
2022/08/05 00:47:48 
--- BoundaryFilters ---
2022/08/05 00:47:48 distinct = false
2022/08/05 00:47:49 Using n1ql client
2022/08/05 00:47:49 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:47:49 distinct = false
2022/08/05 00:47:49 Using n1ql client
2022/08/05 00:47:49 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:47:49 distinct = false
2022/08/05 00:47:49 Using n1ql client
2022/08/05 00:47:49 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:47:49 distinct = false
2022/08/05 00:47:50 Using n1ql client
2022/08/05 00:47:50 Expected and Actual scan responses are the same
2022/08/05 00:47:50 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:47:50 distinct = false
2022/08/05 00:47:50 Using n1ql client
2022/08/05 00:47:50 Expected and Actual scan responses are the same
2022/08/05 00:47:50 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:47:50 distinct = false
2022/08/05 00:47:50 Using n1ql client
2022/08/05 00:47:50 Expected and Actual scan responses are the same
2022/08/05 00:47:50 
--- FiltersWithUnbounded ---
2022/08/05 00:47:50 distinct = false
2022/08/05 00:47:51 Using n1ql client
2022/08/05 00:47:51 Expected and Actual scan responses are the same
2022/08/05 00:47:51 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:47:51 distinct = false
2022/08/05 00:47:51 Using n1ql client
2022/08/05 00:47:51 Expected and Actual scan responses are the same
2022/08/05 00:47:51 

--------- Simple Index with 1 field ---------
2022/08/05 00:47:51 
--- SingleIndexSimpleRange ---
2022/08/05 00:47:51 distinct = false
2022/08/05 00:47:51 Using n1ql client
2022/08/05 00:47:51 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:47:51 distinct = false
2022/08/05 00:47:52 Using n1ql client
2022/08/05 00:47:52 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:47:52 distinct = false
2022/08/05 00:47:52 Using n1ql client
2022/08/05 00:47:52 

--------- Composite Index with 3 fields ---------
2022/08/05 00:47:52 
--- ScanAllNoFilter ---
2022/08/05 00:47:52 distinct = false
2022/08/05 00:47:53 Using n1ql client
2022/08/05 00:47:53 
--- ScanAllFilterNil ---
2022/08/05 00:47:53 distinct = false
2022/08/05 00:47:53 Using n1ql client
2022/08/05 00:47:53 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:47:53 distinct = false
2022/08/05 00:47:53 Using n1ql client
2022/08/05 00:47:53 
--- 3FieldsSingleSeek ---
2022/08/05 00:47:53 distinct = false
2022/08/05 00:47:54 Using n1ql client
2022/08/05 00:47:54 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:47:54 distinct = false
2022/08/05 00:47:54 Using n1ql client
2022/08/05 00:47:54 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:47:54 distinct = false
2022/08/05 00:47:55 Using n1ql client
--- PASS: TestMultiScanOffset (10.33s)
=== RUN   TestMultiScanPrimaryIndex
2022/08/05 00:47:55 In TestMultiScanPrimaryIndex()
2022/08/05 00:47:55 
--- PrimaryRange ---
2022/08/05 00:47:55 Using n1ql client
2022/08/05 00:47:55 Expected and Actual scan responses are the same
2022/08/05 00:47:55 
--- PrimaryScanAllNoFilter ---
2022/08/05 00:47:55 Using n1ql client
2022/08/05 00:47:55 Expected and Actual scan responses are the same
--- PASS: TestMultiScanPrimaryIndex (0.07s)
=== RUN   TestMultiScanDistinct
2022/08/05 00:47:55 In TestScansDistinct()
2022/08/05 00:47:55 

--------- Composite Index with 2 fields ---------
2022/08/05 00:47:55 
--- ScanAllNoFilter ---
2022/08/05 00:47:55 distinct = true
2022/08/05 00:47:55 Using n1ql client
2022/08/05 00:47:55 Expected and Actual scan responses are the same
2022/08/05 00:47:55 
--- ScanAllFilterNil ---
2022/08/05 00:47:55 distinct = true
2022/08/05 00:47:56 Using n1ql client
2022/08/05 00:47:56 Expected and Actual scan responses are the same
2022/08/05 00:47:56 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:47:56 distinct = true
2022/08/05 00:47:56 Using n1ql client
2022/08/05 00:47:56 Expected and Actual scan responses are the same
2022/08/05 00:47:56 
--- SingleSeek ---
2022/08/05 00:47:56 distinct = true
2022/08/05 00:47:56 Using n1ql client
2022/08/05 00:47:56 Expected and Actual scan responses are the same
2022/08/05 00:47:56 
--- MultipleSeek ---
2022/08/05 00:47:56 distinct = true
2022/08/05 00:47:57 Using n1ql client
2022/08/05 00:47:57 Expected and Actual scan responses are the same
2022/08/05 00:47:57 
--- SimpleRange ---
2022/08/05 00:47:57 distinct = true
2022/08/05 00:47:57 Using n1ql client
2022/08/05 00:47:57 Expected and Actual scan responses are the same
2022/08/05 00:47:57 
--- NonOverlappingRanges ---
2022/08/05 00:47:57 distinct = true
2022/08/05 00:47:58 Using n1ql client
2022/08/05 00:47:58 Expected and Actual scan responses are the same
2022/08/05 00:47:58 
--- OverlappingRanges ---
2022/08/05 00:47:58 distinct = true
2022/08/05 00:47:58 Using n1ql client
2022/08/05 00:47:58 Expected and Actual scan responses are the same
2022/08/05 00:47:58 
--- NonOverlappingFilters ---
2022/08/05 00:47:58 distinct = true
2022/08/05 00:47:58 Using n1ql client
2022/08/05 00:47:58 Expected and Actual scan responses are the same
2022/08/05 00:47:58 
--- OverlappingFilters ---
2022/08/05 00:47:58 distinct = true
2022/08/05 00:47:59 Using n1ql client
2022/08/05 00:47:59 Expected and Actual scan responses are the same
2022/08/05 00:47:59 
--- BoundaryFilters ---
2022/08/05 00:47:59 distinct = true
2022/08/05 00:47:59 Using n1ql client
2022/08/05 00:47:59 Expected and Actual scan responses are the same
2022/08/05 00:47:59 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:47:59 distinct = true
2022/08/05 00:48:00 Using n1ql client
2022/08/05 00:48:00 Expected and Actual scan responses are the same
2022/08/05 00:48:00 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:48:00 distinct = true
2022/08/05 00:48:00 Using n1ql client
2022/08/05 00:48:00 Expected and Actual scan responses are the same
2022/08/05 00:48:00 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:48:00 distinct = false
2022/08/05 00:48:00 Using n1ql client
2022/08/05 00:48:00 Expected and Actual scan responses are the same
2022/08/05 00:48:00 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:48:00 distinct = false
2022/08/05 00:48:01 Using n1ql client
2022/08/05 00:48:01 Expected and Actual scan responses are the same
2022/08/05 00:48:01 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:48:01 distinct = false
2022/08/05 00:48:01 Using n1ql client
2022/08/05 00:48:01 Expected and Actual scan responses are the same
2022/08/05 00:48:01 
--- FiltersWithUnbounded ---
2022/08/05 00:48:01 distinct = false
2022/08/05 00:48:02 Using n1ql client
2022/08/05 00:48:02 Expected and Actual scan responses are the same
2022/08/05 00:48:02 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:48:02 distinct = false
2022/08/05 00:48:02 Using n1ql client
2022/08/05 00:48:02 Expected and Actual scan responses are the same
2022/08/05 00:48:02 

--------- Simple Index with 1 field ---------
2022/08/05 00:48:02 
--- SingleIndexSimpleRange ---
2022/08/05 00:48:02 distinct = true
2022/08/05 00:48:02 Using n1ql client
2022/08/05 00:48:02 Expected and Actual scan responses are the same
2022/08/05 00:48:02 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:48:02 distinct = true
2022/08/05 00:48:03 Using n1ql client
2022/08/05 00:48:03 Expected and Actual scan responses are the same
2022/08/05 00:48:03 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:48:03 distinct = true
2022/08/05 00:48:03 Using n1ql client
2022/08/05 00:48:03 Expected and Actual scan responses are the same
2022/08/05 00:48:03 

--------- Composite Index with 3 fields ---------
2022/08/05 00:48:03 
--- ScanAllNoFilter ---
2022/08/05 00:48:03 distinct = true
2022/08/05 00:48:03 Using n1ql client
2022/08/05 00:48:03 Expected and Actual scan responses are the same
2022/08/05 00:48:03 
--- ScanAllFilterNil ---
2022/08/05 00:48:03 distinct = true
2022/08/05 00:48:04 Using n1ql client
2022/08/05 00:48:04 Expected and Actual scan responses are the same
2022/08/05 00:48:04 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:48:04 distinct = true
2022/08/05 00:48:04 Using n1ql client
2022/08/05 00:48:05 Expected and Actual scan responses are the same
2022/08/05 00:48:05 
--- 3FieldsSingleSeek ---
2022/08/05 00:48:05 distinct = true
2022/08/05 00:48:05 Using n1ql client
2022/08/05 00:48:05 Expected and Actual scan responses are the same
2022/08/05 00:48:05 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:48:05 distinct = true
2022/08/05 00:48:05 Using n1ql client
2022/08/05 00:48:05 Expected and Actual scan responses are the same
2022/08/05 00:48:05 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:48:05 distinct = true
2022/08/05 00:48:06 Using n1ql client
2022/08/05 00:48:06 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDistinct (11.04s)
=== RUN   TestMultiScanProjection
2022/08/05 00:48:06 In TestMultiScanProjection()
2022/08/05 00:48:06 

--------- Composite Index with 2 fields ---------
2022/08/05 00:48:06 
--- ScanAllNoFilter ---
2022/08/05 00:48:06 distinct = true
2022/08/05 00:48:06 Using n1ql client
2022/08/05 00:48:06 Expected and Actual scan responses are the same
2022/08/05 00:48:06 
--- ScanAllFilterNil ---
2022/08/05 00:48:06 distinct = true
2022/08/05 00:48:07 Using n1ql client
2022/08/05 00:48:07 Expected and Actual scan responses are the same
2022/08/05 00:48:07 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:48:07 distinct = true
2022/08/05 00:48:07 Using n1ql client
2022/08/05 00:48:07 Expected and Actual scan responses are the same
2022/08/05 00:48:07 
--- SingleSeek ---
2022/08/05 00:48:07 distinct = true
2022/08/05 00:48:07 Using n1ql client
2022/08/05 00:48:07 Expected and Actual scan responses are the same
2022/08/05 00:48:07 
--- MultipleSeek ---
2022/08/05 00:48:07 distinct = true
2022/08/05 00:48:08 Using n1ql client
2022/08/05 00:48:08 Expected and Actual scan responses are the same
2022/08/05 00:48:08 
--- SimpleRange ---
2022/08/05 00:48:08 distinct = true
2022/08/05 00:48:08 Using n1ql client
2022/08/05 00:48:08 Expected and Actual scan responses are the same
2022/08/05 00:48:08 
--- NonOverlappingRanges ---
2022/08/05 00:48:08 distinct = true
2022/08/05 00:48:09 Using n1ql client
2022/08/05 00:48:09 Expected and Actual scan responses are the same
2022/08/05 00:48:09 
--- OverlappingRanges ---
2022/08/05 00:48:09 distinct = true
2022/08/05 00:48:09 Using n1ql client
2022/08/05 00:48:09 Expected and Actual scan responses are the same
2022/08/05 00:48:09 
--- NonOverlappingFilters ---
2022/08/05 00:48:09 distinct = true
2022/08/05 00:48:09 Using n1ql client
2022/08/05 00:48:09 Expected and Actual scan responses are the same
2022/08/05 00:48:09 
--- OverlappingFilters ---
2022/08/05 00:48:09 distinct = true
2022/08/05 00:48:10 Using n1ql client
2022/08/05 00:48:10 Expected and Actual scan responses are the same
2022/08/05 00:48:10 
--- BoundaryFilters ---
2022/08/05 00:48:10 distinct = true
2022/08/05 00:48:10 Using n1ql client
2022/08/05 00:48:10 Expected and Actual scan responses are the same
2022/08/05 00:48:10 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:48:10 distinct = true
2022/08/05 00:48:11 Using n1ql client
2022/08/05 00:48:11 Expected and Actual scan responses are the same
2022/08/05 00:48:11 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:48:11 distinct = true
2022/08/05 00:48:11 Using n1ql client
2022/08/05 00:48:11 Expected and Actual scan responses are the same
2022/08/05 00:48:11 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:48:11 distinct = false
2022/08/05 00:48:11 Using n1ql client
2022/08/05 00:48:11 Expected and Actual scan responses are the same
2022/08/05 00:48:11 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:48:11 distinct = false
2022/08/05 00:48:12 Using n1ql client
2022/08/05 00:48:12 Expected and Actual scan responses are the same
2022/08/05 00:48:12 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:48:12 distinct = false
2022/08/05 00:48:12 Using n1ql client
2022/08/05 00:48:12 Expected and Actual scan responses are the same
2022/08/05 00:48:12 
--- FiltersWithUnbounded ---
2022/08/05 00:48:12 distinct = false
2022/08/05 00:48:12 Using n1ql client
2022/08/05 00:48:13 Expected and Actual scan responses are the same
2022/08/05 00:48:13 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:48:13 distinct = false
2022/08/05 00:48:13 Using n1ql client
2022/08/05 00:48:13 Expected and Actual scan responses are the same
2022/08/05 00:48:13 

--------- Simple Index with 1 field ---------
2022/08/05 00:48:13 
--- SingleIndexSimpleRange ---
2022/08/05 00:48:13 distinct = true
2022/08/05 00:48:13 Using n1ql client
2022/08/05 00:48:13 Expected and Actual scan responses are the same
2022/08/05 00:48:13 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:48:13 distinct = true
2022/08/05 00:48:14 Using n1ql client
2022/08/05 00:48:14 Expected and Actual scan responses are the same
2022/08/05 00:48:14 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:48:14 distinct = true
2022/08/05 00:48:14 Using n1ql client
2022/08/05 00:48:14 Expected and Actual scan responses are the same
2022/08/05 00:48:14 

--------- Composite Index with 3 fields ---------
2022/08/05 00:48:14 
--- ScanAllNoFilter ---
2022/08/05 00:48:14 distinct = true
2022/08/05 00:48:14 Using n1ql client
2022/08/05 00:48:14 Expected and Actual scan responses are the same
2022/08/05 00:48:14 
--- ScanAllFilterNil ---
2022/08/05 00:48:14 distinct = true
2022/08/05 00:48:15 Using n1ql client
2022/08/05 00:48:15 Expected and Actual scan responses are the same
2022/08/05 00:48:15 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:48:15 distinct = true
2022/08/05 00:48:15 Using n1ql client
2022/08/05 00:48:15 Expected and Actual scan responses are the same
2022/08/05 00:48:15 
--- 3FieldsSingleSeek ---
2022/08/05 00:48:15 distinct = true
2022/08/05 00:48:16 Using n1ql client
2022/08/05 00:48:16 Expected and Actual scan responses are the same
2022/08/05 00:48:16 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:48:16 distinct = true
2022/08/05 00:48:16 Using n1ql client
2022/08/05 00:48:16 Expected and Actual scan responses are the same
2022/08/05 00:48:16 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:48:16 distinct = true
2022/08/05 00:48:17 Using n1ql client
2022/08/05 00:48:17 Expected and Actual scan responses are the same
2022/08/05 00:48:17 indexes are: index_company, index_companyname, index_company_name_age, index_company_name_age_address, index_company_name_age_address_friends
2022/08/05 00:48:17 fields are: [company], [company name], [company name age], [company name age address], [company name age address friends]
2022/08/05 00:48:17 
--- SingleIndexProjectFirst ---
2022/08/05 00:48:17 distinct = true
2022/08/05 00:48:17 Using n1ql client
2022/08/05 00:48:17 Expected and Actual scan responses are the same
2022/08/05 00:48:17 
--- 2FieldIndexProjectSecond ---
2022/08/05 00:48:17 distinct = true
2022/08/05 00:48:17 Using n1ql client
2022/08/05 00:48:17 Expected and Actual scan responses are the same
2022/08/05 00:48:17 
--- 3FieldIndexProjectThird ---
2022/08/05 00:48:17 distinct = true
2022/08/05 00:48:18 Using n1ql client
2022/08/05 00:48:18 Expected and Actual scan responses are the same
2022/08/05 00:48:18 
--- 4FieldIndexProjectFourth ---
2022/08/05 00:48:18 distinct = true
2022/08/05 00:48:19 Using n1ql client
2022/08/05 00:48:19 Expected and Actual scan responses are the same
2022/08/05 00:48:19 
--- 5FieldIndexProjectFifth ---
2022/08/05 00:48:19 distinct = true
2022/08/05 00:48:23 Using n1ql client
2022/08/05 00:48:23 Expected and Actual scan responses are the same
2022/08/05 00:48:23 
--- 2FieldIndexProjectTwo ---
2022/08/05 00:48:23 distinct = true
2022/08/05 00:48:23 Using n1ql client
2022/08/05 00:48:23 Expected and Actual scan responses are the same
2022/08/05 00:48:23 
--- 3FieldIndexProjectTwo ---
2022/08/05 00:48:23 distinct = true
2022/08/05 00:48:23 Using n1ql client
2022/08/05 00:48:24 Expected and Actual scan responses are the same
2022/08/05 00:48:24 
--- 3FieldIndexProjectTwo ---
2022/08/05 00:48:24 distinct = true
2022/08/05 00:48:24 Using n1ql client
2022/08/05 00:48:24 Expected and Actual scan responses are the same
2022/08/05 00:48:24 
--- 3FieldIndexProjectTwo ---
2022/08/05 00:48:24 distinct = true
2022/08/05 00:48:24 Using n1ql client
2022/08/05 00:48:24 Expected and Actual scan responses are the same
2022/08/05 00:48:24 
--- 4FieldIndexProjectTwo ---
2022/08/05 00:48:24 distinct = true
2022/08/05 00:48:26 Using n1ql client
2022/08/05 00:48:26 Expected and Actual scan responses are the same
2022/08/05 00:48:26 
--- 4FieldIndexProjectTwo ---
2022/08/05 00:48:26 distinct = true
2022/08/05 00:48:28 Using n1ql client
2022/08/05 00:48:28 Expected and Actual scan responses are the same
2022/08/05 00:48:28 
--- 4FieldIndexProjectTwo ---
2022/08/05 00:48:28 distinct = true
2022/08/05 00:48:29 Using n1ql client
2022/08/05 00:48:29 Expected and Actual scan responses are the same
2022/08/05 00:48:29 
--- 4FieldIndexProjectTwo ---
2022/08/05 00:48:29 distinct = true
2022/08/05 00:48:31 Using n1ql client
2022/08/05 00:48:31 Expected and Actual scan responses are the same
2022/08/05 00:48:31 
--- 4FieldIndexProjectTwo ---
2022/08/05 00:48:31 distinct = true
2022/08/05 00:48:32 Using n1ql client
2022/08/05 00:48:32 Expected and Actual scan responses are the same
2022/08/05 00:48:32 
--- 5FieldIndexProjectTwo ---
2022/08/05 00:48:32 distinct = true
2022/08/05 00:48:36 Using n1ql client
2022/08/05 00:48:36 Expected and Actual scan responses are the same
2022/08/05 00:48:36 
--- 5FieldIndexProjectTwo ---
2022/08/05 00:48:36 distinct = true
2022/08/05 00:48:39 Using n1ql client
2022/08/05 00:48:39 Expected and Actual scan responses are the same
2022/08/05 00:48:39 
--- 5FieldIndexProjectTwo ---
2022/08/05 00:48:39 distinct = true
2022/08/05 00:48:42 Using n1ql client
2022/08/05 00:48:42 Expected and Actual scan responses are the same
2022/08/05 00:48:42 
--- 5FieldIndexProjectTwo ---
2022/08/05 00:48:42 distinct = true
2022/08/05 00:48:46 Using n1ql client
2022/08/05 00:48:47 Expected and Actual scan responses are the same
2022/08/05 00:48:47 
--- 5FieldIndexProjectThree ---
2022/08/05 00:48:47 distinct = true
2022/08/05 00:48:50 Using n1ql client
2022/08/05 00:48:50 Expected and Actual scan responses are the same
2022/08/05 00:48:50 
--- 5FieldIndexProjectFour ---
2022/08/05 00:48:50 distinct = true
2022/08/05 00:48:53 Using n1ql client
2022/08/05 00:48:53 Expected and Actual scan responses are the same
2022/08/05 00:48:53 
--- 5FieldIndexProjectAll ---
2022/08/05 00:48:53 distinct = true
2022/08/05 00:48:57 Using n1ql client
2022/08/05 00:48:57 Expected and Actual scan responses are the same
2022/08/05 00:48:57 
--- 5FieldIndexProjectAlternate ---
2022/08/05 00:48:57 distinct = true
2022/08/05 00:49:00 Using n1ql client
2022/08/05 00:49:00 Expected and Actual scan responses are the same
2022/08/05 00:49:00 
--- 5FieldIndexProjectEmptyEntryKeys ---
2022/08/05 00:49:00 distinct = true
2022/08/05 00:49:04 Using n1ql client
2022/08/05 00:49:04 Expected and Actual scan responses are the same
--- PASS: TestMultiScanProjection (57.98s)
=== RUN   TestMultiScanRestAPI
2022/08/05 00:49:04 In TestMultiScanRestAPI()
2022/08/05 00:49:04 In DropAllSecondaryIndexes()
2022/08/05 00:49:04 Index found:  index_companyname
2022/08/05 00:49:04 Dropped index index_companyname
2022/08/05 00:49:04 Index found:  index_company_name_age_address_friends
2022/08/05 00:49:04 Dropped index index_company_name_age_address_friends
2022/08/05 00:49:04 Index found:  index_company
2022/08/05 00:49:04 Dropped index index_company
2022/08/05 00:49:04 Index found:  index_company_name_age
2022/08/05 00:49:04 Dropped index index_company_name_age
2022/08/05 00:49:04 Index found:  index_primary
2022/08/05 00:49:04 Dropped index index_primary
2022/08/05 00:49:04 Index found:  index_company_name_age_address
2022/08/05 00:49:04 Dropped index index_company_name_age_address
2022/08/05 00:49:04 Index found:  addressidx
2022/08/05 00:49:04 Dropped index addressidx
2022/08/05 00:49:08 Created the secondary index index_companyname. Waiting for it become active
2022/08/05 00:49:08 Index is 14270835172943951062 now active
2022/08/05 00:49:08 GET all indexes
2022/08/05 00:49:08 200 OK
2022/08/05 00:49:08 getscans status : 200 OK
2022/08/05 00:49:08 number of entries 337
2022/08/05 00:49:08 Status : 200 OK
2022/08/05 00:49:08 Result from multiscancount API = 0
--- PASS: TestMultiScanRestAPI (4.18s)
=== RUN   TestMultiScanPrimaryIndexVariations
2022/08/05 00:49:08 In TestMultiScanPrimaryIndexVariations()
2022/08/05 00:49:14 Created the secondary index index_pi. Waiting for it become active
2022/08/05 00:49:14 Index is 12697343667927842479 now active
2022/08/05 00:49:14 
--- No Overlap ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 
--- Proper Overlap ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 
--- Low Boundary Overlap ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 
--- Complex Overlaps ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 
--- Multiple Equal Overlaps ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 
--- Boundary and Subset Overlaps ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 
--- Point Overlaps ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 
--- Boundary and Point Overlaps ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 
--- Primary index range null ---
2022/08/05 00:49:14 Using n1ql client
2022/08/05 00:49:14 Expected and Actual scan responses are the same
2022/08/05 00:49:14 Dropping the secondary index index_pi
2022/08/05 00:49:14 Index dropped
--- PASS: TestMultiScanPrimaryIndexVariations (6.13s)
=== RUN   TestMultiScanDescSetup
2022/08/05 00:49:14 In TestMultiScanDescSetup()
2022/08/05 00:49:14 In DropAllSecondaryIndexes()
2022/08/05 00:49:14 Index found:  index_companyname
2022/08/05 00:49:14 Dropped index index_companyname
2022/08/05 00:49:18 Created the secondary index index_companyname_desc. Waiting for it become active
2022/08/05 00:49:18 Index is 15038821864927439623 now active
2022/08/05 00:49:23 Created the secondary index index_company_desc. Waiting for it become active
2022/08/05 00:49:23 Index is 6679998273329656974 now active
2022/08/05 00:49:28 Created the secondary index index_company_name_age_desc. Waiting for it become active
2022/08/05 00:49:28 Index is 5409125567337425824 now active
--- PASS: TestMultiScanDescSetup (13.91s)
=== RUN   TestMultiScanDescScenarios
2022/08/05 00:49:28 In TestMultiScanDescScenarios()
2022/08/05 00:49:28 

--------- Composite Index with 2 fields ---------
2022/08/05 00:49:28 
--- ScanAllNoFilter ---
2022/08/05 00:49:28 distinct = false
2022/08/05 00:49:28 Using n1ql client
2022/08/05 00:49:29 Expected and Actual scan responses are the same
2022/08/05 00:49:29 
--- ScanAllFilterNil ---
2022/08/05 00:49:29 distinct = false
2022/08/05 00:49:29 Using n1ql client
2022/08/05 00:49:29 Expected and Actual scan responses are the same
2022/08/05 00:49:29 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:49:29 distinct = false
2022/08/05 00:49:29 Using n1ql client
2022/08/05 00:49:29 Expected and Actual scan responses are the same
2022/08/05 00:49:29 
--- SingleSeek ---
2022/08/05 00:49:29 distinct = false
2022/08/05 00:49:30 Using n1ql client
2022/08/05 00:49:30 Expected and Actual scan responses are the same
2022/08/05 00:49:30 
--- MultipleSeek ---
2022/08/05 00:49:30 distinct = false
2022/08/05 00:49:30 Using n1ql client
2022/08/05 00:49:30 Expected and Actual scan responses are the same
2022/08/05 00:49:30 
--- SimpleRange ---
2022/08/05 00:49:30 distinct = false
2022/08/05 00:49:30 Using n1ql client
2022/08/05 00:49:31 Expected and Actual scan responses are the same
2022/08/05 00:49:31 
--- NonOverlappingRanges ---
2022/08/05 00:49:31 distinct = false
2022/08/05 00:49:31 Using n1ql client
2022/08/05 00:49:31 Expected and Actual scan responses are the same
2022/08/05 00:49:31 
--- OverlappingRanges ---
2022/08/05 00:49:31 distinct = false
2022/08/05 00:49:31 Using n1ql client
2022/08/05 00:49:31 Expected and Actual scan responses are the same
2022/08/05 00:49:31 
--- NonOverlappingFilters ---
2022/08/05 00:49:31 distinct = false
2022/08/05 00:49:32 Using n1ql client
2022/08/05 00:49:32 Expected and Actual scan responses are the same
2022/08/05 00:49:32 
--- OverlappingFilters ---
2022/08/05 00:49:32 distinct = false
2022/08/05 00:49:32 Using n1ql client
2022/08/05 00:49:32 Expected and Actual scan responses are the same
2022/08/05 00:49:32 
--- BoundaryFilters ---
2022/08/05 00:49:32 distinct = false
2022/08/05 00:49:32 Using n1ql client
2022/08/05 00:49:33 Expected and Actual scan responses are the same
2022/08/05 00:49:33 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:49:33 distinct = false
2022/08/05 00:49:33 Using n1ql client
2022/08/05 00:49:33 Expected and Actual scan responses are the same
2022/08/05 00:49:33 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:49:33 distinct = false
2022/08/05 00:49:33 Using n1ql client
2022/08/05 00:49:33 Expected and Actual scan responses are the same
2022/08/05 00:49:33 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:49:33 distinct = false
2022/08/05 00:49:34 Using n1ql client
2022/08/05 00:49:34 Expected and Actual scan responses are the same
2022/08/05 00:49:34 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:49:34 distinct = false
2022/08/05 00:49:34 Using n1ql client
2022/08/05 00:49:34 Expected and Actual scan responses are the same
2022/08/05 00:49:34 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:49:34 distinct = false
2022/08/05 00:49:34 Using n1ql client
2022/08/05 00:49:34 Expected and Actual scan responses are the same
2022/08/05 00:49:34 
--- FiltersWithUnbounded ---
2022/08/05 00:49:34 distinct = false
2022/08/05 00:49:35 Using n1ql client
2022/08/05 00:49:35 Expected and Actual scan responses are the same
2022/08/05 00:49:35 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:49:35 distinct = false
2022/08/05 00:49:35 Using n1ql client
2022/08/05 00:49:35 Expected and Actual scan responses are the same
2022/08/05 00:49:35 

--------- Simple Index with 1 field ---------
2022/08/05 00:49:35 
--- SingleIndexSimpleRange ---
2022/08/05 00:49:35 distinct = false
2022/08/05 00:49:36 Using n1ql client
2022/08/05 00:49:36 Expected and Actual scan responses are the same
2022/08/05 00:49:36 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:49:36 distinct = false
2022/08/05 00:49:36 Using n1ql client
2022/08/05 00:49:36 Expected and Actual scan responses are the same
2022/08/05 00:49:36 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:49:36 distinct = false
2022/08/05 00:49:36 Using n1ql client
2022/08/05 00:49:36 Expected and Actual scan responses are the same
2022/08/05 00:49:36 

--------- Composite Index with 3 fields ---------
2022/08/05 00:49:36 
--- ScanAllNoFilter ---
2022/08/05 00:49:36 distinct = false
2022/08/05 00:49:37 Using n1ql client
2022/08/05 00:49:37 Expected and Actual scan responses are the same
2022/08/05 00:49:37 
--- ScanAllFilterNil ---
2022/08/05 00:49:37 distinct = false
2022/08/05 00:49:37 Using n1ql client
2022/08/05 00:49:37 Expected and Actual scan responses are the same
2022/08/05 00:49:37 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:49:37 distinct = false
2022/08/05 00:49:38 Using n1ql client
2022/08/05 00:49:38 Expected and Actual scan responses are the same
2022/08/05 00:49:38 
--- 3FieldsSingleSeek ---
2022/08/05 00:49:38 distinct = false
2022/08/05 00:49:38 Using n1ql client
2022/08/05 00:49:38 Expected and Actual scan responses are the same
2022/08/05 00:49:38 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:49:38 distinct = false
2022/08/05 00:49:39 Using n1ql client
2022/08/05 00:49:39 Expected and Actual scan responses are the same
2022/08/05 00:49:39 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:49:39 distinct = false
2022/08/05 00:49:39 Using n1ql client
2022/08/05 00:49:39 Expected and Actual scan responses are the same
2022/08/05 00:49:39 

--------- New scenarios ---------
2022/08/05 00:49:39 
--- CompIndexHighUnbounded1 ---
2022/08/05 00:49:39 
--- Multi Scan 0 ---
2022/08/05 00:49:39 distinct = false
2022/08/05 00:49:39 Using n1ql client
2022/08/05 00:49:39 Expected and Actual scan responses are the same
2022/08/05 00:49:39 
--- Multi Scan 1 ---
2022/08/05 00:49:39 distinct = false
2022/08/05 00:49:40 Using n1ql client
2022/08/05 00:49:40 Expected and Actual scan responses are the same
2022/08/05 00:49:40 
--- Multi Scan 2 ---
2022/08/05 00:49:40 distinct = false
2022/08/05 00:49:40 Using n1ql client
2022/08/05 00:49:40 Expected and Actual scan responses are the same
2022/08/05 00:49:40 
--- CompIndexHighUnbounded2 ---
2022/08/05 00:49:40 
--- Multi Scan 0 ---
2022/08/05 00:49:40 distinct = false
2022/08/05 00:49:40 Using n1ql client
2022/08/05 00:49:40 Expected and Actual scan responses are the same
2022/08/05 00:49:40 
--- Multi Scan 1 ---
2022/08/05 00:49:40 distinct = false
2022/08/05 00:49:41 Using n1ql client
2022/08/05 00:49:41 Expected and Actual scan responses are the same
2022/08/05 00:49:41 
--- Multi Scan 2 ---
2022/08/05 00:49:41 distinct = false
2022/08/05 00:49:41 Using n1ql client
2022/08/05 00:49:41 Expected and Actual scan responses are the same
2022/08/05 00:49:41 
--- CompIndexHighUnbounded3 ---
2022/08/05 00:49:41 
--- Multi Scan 0 ---
2022/08/05 00:49:41 distinct = false
2022/08/05 00:49:42 Using n1ql client
2022/08/05 00:49:42 Expected and Actual scan responses are the same
2022/08/05 00:49:42 
--- CompIndexHighUnbounded4 ---
2022/08/05 00:49:42 
--- Multi Scan 0 ---
2022/08/05 00:49:42 distinct = false
2022/08/05 00:49:42 Using n1ql client
2022/08/05 00:49:42 Expected and Actual scan responses are the same
2022/08/05 00:49:42 
--- CompIndexHighUnbounded5 ---
2022/08/05 00:49:42 
--- Multi Scan 0 ---
2022/08/05 00:49:42 distinct = false
2022/08/05 00:49:43 Using n1ql client
2022/08/05 00:49:43 Expected and Actual scan responses are the same
2022/08/05 00:49:43 
--- SeekBoundaries ---
2022/08/05 00:49:43 
--- Multi Scan 0 ---
2022/08/05 00:49:43 distinct = false
2022/08/05 00:49:43 Using n1ql client
2022/08/05 00:49:43 Expected and Actual scan responses are the same
2022/08/05 00:49:43 
--- Multi Scan 1 ---
2022/08/05 00:49:43 distinct = false
2022/08/05 00:49:44 Using n1ql client
2022/08/05 00:49:44 Expected and Actual scan responses are the same
2022/08/05 00:49:44 
--- Multi Scan 2 ---
2022/08/05 00:49:44 distinct = false
2022/08/05 00:49:44 Using n1ql client
2022/08/05 00:49:44 Expected and Actual scan responses are the same
2022/08/05 00:49:44 
--- Multi Scan 3 ---
2022/08/05 00:49:44 distinct = false
2022/08/05 00:49:45 Using n1ql client
2022/08/05 00:49:45 Expected and Actual scan responses are the same
2022/08/05 00:49:45 
--- Multi Scan 4 ---
2022/08/05 00:49:45 distinct = false
2022/08/05 00:49:45 Using n1ql client
2022/08/05 00:49:45 Expected and Actual scan responses are the same
2022/08/05 00:49:45 
--- Multi Scan 5 ---
2022/08/05 00:49:45 distinct = false
2022/08/05 00:49:46 Using n1ql client
2022/08/05 00:49:46 Expected and Actual scan responses are the same
2022/08/05 00:49:46 
--- Multi Scan 6 ---
2022/08/05 00:49:46 distinct = false
2022/08/05 00:49:46 Using n1ql client
2022/08/05 00:49:46 Expected and Actual scan responses are the same
2022/08/05 00:49:46 
--- Multi Scan 7 ---
2022/08/05 00:49:46 distinct = false
2022/08/05 00:49:46 Using n1ql client
2022/08/05 00:49:46 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescScenarios (18.42s)
=== RUN   TestMultiScanDescCount
2022/08/05 00:49:46 In TestMultiScanDescCount()
2022/08/05 00:49:46 

--------- Composite Index with 2 fields ---------
2022/08/05 00:49:46 
--- ScanAllNoFilter ---
2022/08/05 00:49:46 distinct = false
2022/08/05 00:49:47 Using n1ql client
2022/08/05 00:49:47 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:49:47 
--- ScanAllFilterNil ---
2022/08/05 00:49:47 distinct = false
2022/08/05 00:49:47 Using n1ql client
2022/08/05 00:49:47 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:49:47 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:49:47 distinct = false
2022/08/05 00:49:47 Using n1ql client
2022/08/05 00:49:47 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:49:47 
--- SingleSeek ---
2022/08/05 00:49:47 distinct = false
2022/08/05 00:49:48 Using n1ql client
2022/08/05 00:49:48 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:49:48 
--- MultipleSeek ---
2022/08/05 00:49:48 distinct = false
2022/08/05 00:49:48 Using n1ql client
2022/08/05 00:49:48 MultiScanCount = 2 ExpectedMultiScanCount = 2
2022/08/05 00:49:48 
--- SimpleRange ---
2022/08/05 00:49:48 distinct = false
2022/08/05 00:49:49 Using n1ql client
2022/08/05 00:49:49 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2022/08/05 00:49:49 
--- NonOverlappingRanges ---
2022/08/05 00:49:49 distinct = false
2022/08/05 00:49:49 Using n1ql client
2022/08/05 00:49:49 MultiScanCount = 4283 ExpectedMultiScanCount = 4283
2022/08/05 00:49:49 
--- OverlappingRanges ---
2022/08/05 00:49:49 distinct = false
2022/08/05 00:49:49 Using n1ql client
2022/08/05 00:49:49 MultiScanCount = 5756 ExpectedMultiScanCount = 5756
2022/08/05 00:49:49 
--- NonOverlappingFilters ---
2022/08/05 00:49:49 distinct = false
2022/08/05 00:49:50 Using n1ql client
2022/08/05 00:49:50 MultiScanCount = 337 ExpectedMultiScanCount = 337
2022/08/05 00:49:50 
--- OverlappingFilters ---
2022/08/05 00:49:50 distinct = false
2022/08/05 00:49:50 Using n1ql client
2022/08/05 00:49:50 MultiScanCount = 2559 ExpectedMultiScanCount = 2559
2022/08/05 00:49:50 
--- BoundaryFilters ---
2022/08/05 00:49:50 distinct = false
2022/08/05 00:49:50 Using n1ql client
2022/08/05 00:49:50 MultiScanCount = 499 ExpectedMultiScanCount = 499
2022/08/05 00:49:50 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:49:50 distinct = false
2022/08/05 00:49:51 Using n1ql client
2022/08/05 00:49:51 MultiScanCount = 256 ExpectedMultiScanCount = 256
2022/08/05 00:49:51 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:49:51 distinct = false
2022/08/05 00:49:51 Using n1ql client
2022/08/05 00:49:51 MultiScanCount = 255 ExpectedMultiScanCount = 255
2022/08/05 00:49:51 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:49:51 distinct = false
2022/08/05 00:49:51 Using n1ql client
2022/08/05 00:49:51 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2022/08/05 00:49:51 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:49:51 distinct = false
2022/08/05 00:49:52 Using n1ql client
2022/08/05 00:49:52 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2022/08/05 00:49:52 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:49:52 distinct = false
2022/08/05 00:49:52 Using n1ql client
2022/08/05 00:49:52 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:49:52 
--- FiltersWithUnbounded ---
2022/08/05 00:49:52 distinct = false
2022/08/05 00:49:53 Using n1ql client
2022/08/05 00:49:53 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2022/08/05 00:49:53 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:49:53 distinct = false
2022/08/05 00:49:53 Using n1ql client
2022/08/05 00:49:53 MultiScanCount = 418 ExpectedMultiScanCount = 418
2022/08/05 00:49:53 

--------- Simple Index with 1 field ---------
2022/08/05 00:49:53 
--- SingleIndexSimpleRange ---
2022/08/05 00:49:53 distinct = false
2022/08/05 00:49:53 Using n1ql client
2022/08/05 00:49:53 MultiScanCount = 2273 ExpectedMultiScanCount = 2273
2022/08/05 00:49:53 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:49:53 distinct = false
2022/08/05 00:49:54 Using n1ql client
2022/08/05 00:49:54 MultiScanCount = 7140 ExpectedMultiScanCount = 7140
2022/08/05 00:49:54 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:49:54 distinct = false
2022/08/05 00:49:54 Using n1ql client
2022/08/05 00:49:54 MultiScanCount = 8701 ExpectedMultiScanCount = 8701
2022/08/05 00:49:54 

--------- Composite Index with 3 fields ---------
2022/08/05 00:49:54 
--- ScanAllNoFilter ---
2022/08/05 00:49:54 distinct = false
2022/08/05 00:49:54 Using n1ql client
2022/08/05 00:49:54 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:49:54 
--- ScanAllFilterNil ---
2022/08/05 00:49:54 distinct = false
2022/08/05 00:49:55 Using n1ql client
2022/08/05 00:49:55 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:49:55 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:49:55 distinct = false
2022/08/05 00:49:55 Using n1ql client
2022/08/05 00:49:55 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:49:55 
--- 3FieldsSingleSeek ---
2022/08/05 00:49:55 distinct = false
2022/08/05 00:49:56 Using n1ql client
2022/08/05 00:49:56 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:49:56 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:49:56 distinct = false
2022/08/05 00:49:56 Using n1ql client
2022/08/05 00:49:56 MultiScanCount = 3 ExpectedMultiScanCount = 3
2022/08/05 00:49:56 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:49:56 distinct = false
2022/08/05 00:49:56 Using n1ql client
2022/08/05 00:49:56 MultiScanCount = 2 ExpectedMultiScanCount = 2
2022/08/05 00:49:56 

--------- New scenarios ---------
2022/08/05 00:49:56 
--- CompIndexHighUnbounded1 ---
2022/08/05 00:49:56 
--- Multi Scan 0 ---
2022/08/05 00:49:56 distinct = false
2022/08/05 00:49:57 Using n1ql client
2022/08/05 00:49:57 Using n1ql client
2022/08/05 00:49:57 len(scanResults) = 8 MultiScanCount = 8
2022/08/05 00:49:57 Expected and Actual scan responses are the same
2022/08/05 00:49:57 
--- Multi Scan 1 ---
2022/08/05 00:49:57 distinct = false
2022/08/05 00:49:57 Using n1ql client
2022/08/05 00:49:57 Using n1ql client
2022/08/05 00:49:57 len(scanResults) = 0 MultiScanCount = 0
2022/08/05 00:49:57 Expected and Actual scan responses are the same
2022/08/05 00:49:57 
--- Multi Scan 2 ---
2022/08/05 00:49:57 distinct = false
2022/08/05 00:49:58 Using n1ql client
2022/08/05 00:49:58 Using n1ql client
2022/08/05 00:49:58 len(scanResults) = 9 MultiScanCount = 9
2022/08/05 00:49:58 Expected and Actual scan responses are the same
2022/08/05 00:49:58 
--- CompIndexHighUnbounded2 ---
2022/08/05 00:49:58 
--- Multi Scan 0 ---
2022/08/05 00:49:58 distinct = false
2022/08/05 00:49:58 Using n1ql client
2022/08/05 00:49:58 Using n1ql client
2022/08/05 00:49:58 len(scanResults) = 4138 MultiScanCount = 4138
2022/08/05 00:49:58 Expected and Actual scan responses are the same
2022/08/05 00:49:58 
--- Multi Scan 1 ---
2022/08/05 00:49:58 distinct = false
2022/08/05 00:49:58 Using n1ql client
2022/08/05 00:49:58 Using n1ql client
2022/08/05 00:49:58 len(scanResults) = 2746 MultiScanCount = 2746
2022/08/05 00:49:58 Expected and Actual scan responses are the same
2022/08/05 00:49:58 
--- Multi Scan 2 ---
2022/08/05 00:49:58 distinct = false
2022/08/05 00:49:59 Using n1ql client
2022/08/05 00:49:59 Using n1ql client
2022/08/05 00:49:59 len(scanResults) = 4691 MultiScanCount = 4691
2022/08/05 00:49:59 Expected and Actual scan responses are the same
2022/08/05 00:49:59 
--- CompIndexHighUnbounded3 ---
2022/08/05 00:49:59 
--- Multi Scan 0 ---
2022/08/05 00:49:59 distinct = false
2022/08/05 00:49:59 Using n1ql client
2022/08/05 00:49:59 Using n1ql client
2022/08/05 00:49:59 len(scanResults) = 1329 MultiScanCount = 1329
2022/08/05 00:49:59 Expected and Actual scan responses are the same
2022/08/05 00:49:59 
--- CompIndexHighUnbounded4 ---
2022/08/05 00:49:59 
--- Multi Scan 0 ---
2022/08/05 00:49:59 distinct = false
2022/08/05 00:50:00 Using n1ql client
2022/08/05 00:50:00 Using n1ql client
2022/08/05 00:50:00 len(scanResults) = 5349 MultiScanCount = 5349
2022/08/05 00:50:00 Expected and Actual scan responses are the same
2022/08/05 00:50:00 
--- CompIndexHighUnbounded5 ---
2022/08/05 00:50:00 
--- Multi Scan 0 ---
2022/08/05 00:50:00 distinct = false
2022/08/05 00:50:00 Using n1ql client
2022/08/05 00:50:00 Using n1ql client
2022/08/05 00:50:00 len(scanResults) = 8210 MultiScanCount = 8210
2022/08/05 00:50:00 Expected and Actual scan responses are the same
2022/08/05 00:50:00 
--- SeekBoundaries ---
2022/08/05 00:50:00 
--- Multi Scan 0 ---
2022/08/05 00:50:00 distinct = false
2022/08/05 00:50:00 Using n1ql client
2022/08/05 00:50:00 Using n1ql client
2022/08/05 00:50:00 len(scanResults) = 175 MultiScanCount = 175
2022/08/05 00:50:00 Expected and Actual scan responses are the same
2022/08/05 00:50:00 
--- Multi Scan 1 ---
2022/08/05 00:50:00 distinct = false
2022/08/05 00:50:01 Using n1ql client
2022/08/05 00:50:01 Using n1ql client
2022/08/05 00:50:01 len(scanResults) = 1 MultiScanCount = 1
2022/08/05 00:50:01 Expected and Actual scan responses are the same
2022/08/05 00:50:01 
--- Multi Scan 2 ---
2022/08/05 00:50:01 distinct = false
2022/08/05 00:50:01 Using n1ql client
2022/08/05 00:50:01 Using n1ql client
2022/08/05 00:50:01 len(scanResults) = 555 MultiScanCount = 555
2022/08/05 00:50:01 Expected and Actual scan responses are the same
2022/08/05 00:50:01 
--- Multi Scan 3 ---
2022/08/05 00:50:01 distinct = false
2022/08/05 00:50:02 Using n1ql client
2022/08/05 00:50:02 Using n1ql client
2022/08/05 00:50:02 len(scanResults) = 872 MultiScanCount = 872
2022/08/05 00:50:02 Expected and Actual scan responses are the same
2022/08/05 00:50:02 
--- Multi Scan 4 ---
2022/08/05 00:50:02 distinct = false
2022/08/05 00:50:02 Using n1ql client
2022/08/05 00:50:02 Using n1ql client
2022/08/05 00:50:02 len(scanResults) = 287 MultiScanCount = 287
2022/08/05 00:50:02 Expected and Actual scan responses are the same
2022/08/05 00:50:02 
--- Multi Scan 5 ---
2022/08/05 00:50:02 distinct = false
2022/08/05 00:50:02 Using n1ql client
2022/08/05 00:50:02 Using n1ql client
2022/08/05 00:50:02 len(scanResults) = 5254 MultiScanCount = 5254
2022/08/05 00:50:02 Expected and Actual scan responses are the same
2022/08/05 00:50:02 
--- Multi Scan 6 ---
2022/08/05 00:50:02 distinct = false
2022/08/05 00:50:03 Using n1ql client
2022/08/05 00:50:03 Using n1ql client
2022/08/05 00:50:03 len(scanResults) = 5566 MultiScanCount = 5566
2022/08/05 00:50:03 Expected and Actual scan responses are the same
2022/08/05 00:50:03 
--- Multi Scan 7 ---
2022/08/05 00:50:03 distinct = false
2022/08/05 00:50:03 Using n1ql client
2022/08/05 00:50:03 Using n1ql client
2022/08/05 00:50:03 len(scanResults) = 8 MultiScanCount = 8
2022/08/05 00:50:03 Expected and Actual scan responses are the same
2022/08/05 00:50:03 

--------- With DISTINCT True ---------
2022/08/05 00:50:03 
--- ScanAllNoFilter ---
2022/08/05 00:50:03 distinct = true
2022/08/05 00:50:04 Using n1ql client
2022/08/05 00:50:04 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:50:04 
--- ScanAllFilterNil ---
2022/08/05 00:50:04 distinct = true
2022/08/05 00:50:04 Using n1ql client
2022/08/05 00:50:04 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:50:04 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:50:04 distinct = true
2022/08/05 00:50:04 Using n1ql client
2022/08/05 00:50:04 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:50:04 
--- SingleSeek ---
2022/08/05 00:50:04 distinct = true
2022/08/05 00:50:05 Using n1ql client
2022/08/05 00:50:05 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:50:05 
--- MultipleSeek ---
2022/08/05 00:50:05 distinct = true
2022/08/05 00:50:05 Using n1ql client
2022/08/05 00:50:05 MultiScanCount = 2 ExpectedMultiScanCount = 2
2022/08/05 00:50:05 
--- SimpleRange ---
2022/08/05 00:50:05 distinct = true
2022/08/05 00:50:05 Using n1ql client
2022/08/05 00:50:05 MultiScanCount = 227 ExpectedMultiScanCount = 227
2022/08/05 00:50:05 
--- NonOverlappingRanges ---
2022/08/05 00:50:05 distinct = true
2022/08/05 00:50:06 Using n1ql client
2022/08/05 00:50:06 MultiScanCount = 428 ExpectedMultiScanCount = 428
2022/08/05 00:50:06 
--- NonOverlappingFilters2 ---
2022/08/05 00:50:06 distinct = true
2022/08/05 00:50:06 Using n1ql client
2022/08/05 00:50:06 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:50:06 
--- OverlappingRanges ---
2022/08/05 00:50:06 distinct = true
2022/08/05 00:50:06 Using n1ql client
2022/08/05 00:50:07 MultiScanCount = 575 ExpectedMultiScanCount = 575
2022/08/05 00:50:07 
--- NonOverlappingFilters ---
2022/08/05 00:50:07 distinct = true
2022/08/05 00:50:07 Using n1ql client
2022/08/05 00:50:07 MultiScanCount = 186 ExpectedMultiScanCount = 186
2022/08/05 00:50:07 
--- OverlappingFilters ---
2022/08/05 00:50:07 distinct = true
2022/08/05 00:50:07 Using n1ql client
2022/08/05 00:50:07 MultiScanCount = 543 ExpectedMultiScanCount = 543
2022/08/05 00:50:07 
--- BoundaryFilters ---
2022/08/05 00:50:07 distinct = true
2022/08/05 00:50:08 Using n1ql client
2022/08/05 00:50:08 MultiScanCount = 172 ExpectedMultiScanCount = 172
2022/08/05 00:50:08 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:50:08 distinct = true
2022/08/05 00:50:08 Using n1ql client
2022/08/05 00:50:08 MultiScanCount = 135 ExpectedMultiScanCount = 135
2022/08/05 00:50:08 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:50:08 distinct = true
2022/08/05 00:50:08 Using n1ql client
2022/08/05 00:50:08 MultiScanCount = 134 ExpectedMultiScanCount = 134
2022/08/05 00:50:08 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:50:08 distinct = false
2022/08/05 00:50:09 Using n1ql client
2022/08/05 00:50:09 MultiScanCount = 5618 ExpectedMultiScanCount = 5618
2022/08/05 00:50:09 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:50:09 distinct = false
2022/08/05 00:50:09 Using n1ql client
2022/08/05 00:50:09 MultiScanCount = 3704 ExpectedMultiScanCount = 3704
2022/08/05 00:50:09 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:50:09 distinct = false
2022/08/05 00:50:09 Using n1ql client
2022/08/05 00:50:09 MultiScanCount = 10002 ExpectedMultiScanCount = 10002
2022/08/05 00:50:09 
--- FiltersWithUnbounded ---
2022/08/05 00:50:09 distinct = false
2022/08/05 00:50:10 Using n1ql client
2022/08/05 00:50:10 MultiScanCount = 3173 ExpectedMultiScanCount = 3173
2022/08/05 00:50:10 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:50:10 distinct = false
2022/08/05 00:50:10 Using n1ql client
2022/08/05 00:50:10 MultiScanCount = 418 ExpectedMultiScanCount = 418
2022/08/05 00:50:10 

--------- Simple Index with 1 field ---------
2022/08/05 00:50:10 
--- SingleIndexSimpleRange ---
2022/08/05 00:50:10 distinct = true
2022/08/05 00:50:11 Using n1ql client
2022/08/05 00:50:11 MultiScanCount = 227 ExpectedMultiScanCount = 227
2022/08/05 00:50:11 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:50:11 distinct = true
2022/08/05 00:50:11 Using n1ql client
2022/08/05 00:50:11 MultiScanCount = 713 ExpectedMultiScanCount = 713
2022/08/05 00:50:11 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:50:11 distinct = true
2022/08/05 00:50:11 Using n1ql client
2022/08/05 00:50:11 MultiScanCount = 869 ExpectedMultiScanCount = 869
2022/08/05 00:50:11 

--------- Composite Index with 3 fields ---------
2022/08/05 00:50:11 
--- ScanAllNoFilter ---
2022/08/05 00:50:11 distinct = true
2022/08/05 00:50:12 Using n1ql client
2022/08/05 00:50:12 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:50:12 
--- ScanAllFilterNil ---
2022/08/05 00:50:12 distinct = true
2022/08/05 00:50:12 Using n1ql client
2022/08/05 00:50:12 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:50:12 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:50:12 distinct = true
2022/08/05 00:50:13 Using n1ql client
2022/08/05 00:50:13 MultiScanCount = 999 ExpectedMultiScanCount = 999
2022/08/05 00:50:13 
--- 3FieldsSingleSeek ---
2022/08/05 00:50:13 distinct = true
2022/08/05 00:50:13 Using n1ql client
2022/08/05 00:50:13 MultiScanCount = 1 ExpectedMultiScanCount = 1
2022/08/05 00:50:13 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:50:13 distinct = true
2022/08/05 00:50:13 Using n1ql client
2022/08/05 00:50:13 MultiScanCount = 3 ExpectedMultiScanCount = 3
2022/08/05 00:50:13 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:50:13 distinct = true
2022/08/05 00:50:14 Using n1ql client
2022/08/05 00:50:14 MultiScanCount = 2 ExpectedMultiScanCount = 2
--- PASS: TestMultiScanDescCount (27.40s)
=== RUN   TestMultiScanDescOffset
2022/08/05 00:50:14 In SkipTestMultiScanDescOffset()
2022/08/05 00:50:14 

--------- Composite Index with 2 fields ---------
2022/08/05 00:50:14 
--- ScanAllNoFilter ---
2022/08/05 00:50:14 distinct = false
2022/08/05 00:50:14 Using n1ql client
2022/08/05 00:50:14 
--- ScanAllFilterNil ---
2022/08/05 00:50:14 distinct = false
2022/08/05 00:50:15 Using n1ql client
2022/08/05 00:50:15 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:50:15 distinct = false
2022/08/05 00:50:15 Using n1ql client
2022/08/05 00:50:15 
--- SingleSeek ---
2022/08/05 00:50:15 distinct = false
2022/08/05 00:50:15 Using n1ql client
2022/08/05 00:50:15 
--- MultipleSeek ---
2022/08/05 00:50:15 distinct = false
2022/08/05 00:50:16 Using n1ql client
2022/08/05 00:50:16 
--- SimpleRange ---
2022/08/05 00:50:16 distinct = false
2022/08/05 00:50:16 Using n1ql client
2022/08/05 00:50:16 
--- NonOverlappingRanges ---
2022/08/05 00:50:16 distinct = false
2022/08/05 00:50:16 Using n1ql client
2022/08/05 00:50:16 
--- OverlappingRanges ---
2022/08/05 00:50:16 distinct = false
2022/08/05 00:50:17 Using n1ql client
2022/08/05 00:50:17 
--- NonOverlappingFilters ---
2022/08/05 00:50:17 distinct = false
2022/08/05 00:50:17 Using n1ql client
2022/08/05 00:50:17 
--- OverlappingFilters ---
2022/08/05 00:50:17 distinct = false
2022/08/05 00:50:18 Using n1ql client
2022/08/05 00:50:18 
--- BoundaryFilters ---
2022/08/05 00:50:18 distinct = false
2022/08/05 00:50:18 Using n1ql client
2022/08/05 00:50:18 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:50:18 distinct = false
2022/08/05 00:50:18 Using n1ql client
2022/08/05 00:50:18 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:50:18 distinct = false
2022/08/05 00:50:19 Using n1ql client
2022/08/05 00:50:19 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:50:19 distinct = false
2022/08/05 00:50:19 Using n1ql client
2022/08/05 00:50:19 Expected and Actual scan responses are the same
2022/08/05 00:50:19 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:50:19 distinct = false
2022/08/05 00:50:19 Using n1ql client
2022/08/05 00:50:19 Expected and Actual scan responses are the same
2022/08/05 00:50:19 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:50:19 distinct = false
2022/08/05 00:50:20 Using n1ql client
2022/08/05 00:50:20 Expected and Actual scan responses are the same
2022/08/05 00:50:20 
--- FiltersWithUnbounded ---
2022/08/05 00:50:20 distinct = false
2022/08/05 00:50:20 Using n1ql client
2022/08/05 00:50:20 Expected and Actual scan responses are the same
2022/08/05 00:50:20 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:50:20 distinct = false
2022/08/05 00:50:21 Using n1ql client
2022/08/05 00:50:21 Expected and Actual scan responses are the same
2022/08/05 00:50:21 

--------- Simple Index with 1 field ---------
2022/08/05 00:50:21 
--- SingleIndexSimpleRange ---
2022/08/05 00:50:21 distinct = false
2022/08/05 00:50:21 Using n1ql client
2022/08/05 00:50:21 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:50:21 distinct = false
2022/08/05 00:50:21 Using n1ql client
2022/08/05 00:50:21 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:50:21 distinct = false
2022/08/05 00:50:22 Using n1ql client
2022/08/05 00:50:22 

--------- Composite Index with 3 fields ---------
2022/08/05 00:50:22 
--- ScanAllNoFilter ---
2022/08/05 00:50:22 distinct = false
2022/08/05 00:50:22 Using n1ql client
2022/08/05 00:50:22 
--- ScanAllFilterNil ---
2022/08/05 00:50:22 distinct = false
2022/08/05 00:50:23 Using n1ql client
2022/08/05 00:50:23 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:50:23 distinct = false
2022/08/05 00:50:23 Using n1ql client
2022/08/05 00:50:23 
--- 3FieldsSingleSeek ---
2022/08/05 00:50:23 distinct = false
2022/08/05 00:50:23 Using n1ql client
2022/08/05 00:50:23 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:50:23 distinct = false
2022/08/05 00:50:24 Using n1ql client
2022/08/05 00:50:24 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:50:24 distinct = false
2022/08/05 00:50:24 Using n1ql client
--- PASS: TestMultiScanDescOffset (10.45s)
=== RUN   TestMultiScanDescDistinct
2022/08/05 00:50:24 In SkipTestMultiScanDescDistinct()
2022/08/05 00:50:24 

--------- Composite Index with 2 fields ---------
2022/08/05 00:50:24 
--- ScanAllNoFilter ---
2022/08/05 00:50:24 distinct = true
2022/08/05 00:50:25 Using n1ql client
2022/08/05 00:50:25 Expected and Actual scan responses are the same
2022/08/05 00:50:25 
--- ScanAllFilterNil ---
2022/08/05 00:50:25 distinct = true
2022/08/05 00:50:25 Using n1ql client
2022/08/05 00:50:25 Expected and Actual scan responses are the same
2022/08/05 00:50:25 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:50:25 distinct = true
2022/08/05 00:50:26 Using n1ql client
2022/08/05 00:50:26 Expected and Actual scan responses are the same
2022/08/05 00:50:26 
--- SingleSeek ---
2022/08/05 00:50:26 distinct = true
2022/08/05 00:50:26 Using n1ql client
2022/08/05 00:50:26 Expected and Actual scan responses are the same
2022/08/05 00:50:26 
--- MultipleSeek ---
2022/08/05 00:50:26 distinct = true
2022/08/05 00:50:26 Using n1ql client
2022/08/05 00:50:26 Expected and Actual scan responses are the same
2022/08/05 00:50:26 
--- SimpleRange ---
2022/08/05 00:50:26 distinct = true
2022/08/05 00:50:27 Using n1ql client
2022/08/05 00:50:27 Expected and Actual scan responses are the same
2022/08/05 00:50:27 
--- NonOverlappingRanges ---
2022/08/05 00:50:27 distinct = true
2022/08/05 00:50:27 Using n1ql client
2022/08/05 00:50:27 Expected and Actual scan responses are the same
2022/08/05 00:50:27 
--- OverlappingRanges ---
2022/08/05 00:50:27 distinct = true
2022/08/05 00:50:28 Using n1ql client
2022/08/05 00:50:28 Expected and Actual scan responses are the same
2022/08/05 00:50:28 
--- NonOverlappingFilters ---
2022/08/05 00:50:28 distinct = true
2022/08/05 00:50:28 Using n1ql client
2022/08/05 00:50:28 Expected and Actual scan responses are the same
2022/08/05 00:50:28 
--- OverlappingFilters ---
2022/08/05 00:50:28 distinct = true
2022/08/05 00:50:28 Using n1ql client
2022/08/05 00:50:28 Expected and Actual scan responses are the same
2022/08/05 00:50:28 
--- BoundaryFilters ---
2022/08/05 00:50:28 distinct = true
2022/08/05 00:50:29 Using n1ql client
2022/08/05 00:50:29 Expected and Actual scan responses are the same
2022/08/05 00:50:29 
--- SeekAndFilters_NonOverlapping ---
2022/08/05 00:50:29 distinct = true
2022/08/05 00:50:29 Using n1ql client
2022/08/05 00:50:29 Expected and Actual scan responses are the same
2022/08/05 00:50:29 
--- SeekAndFilters_Overlapping ---
2022/08/05 00:50:29 distinct = true
2022/08/05 00:50:29 Using n1ql client
2022/08/05 00:50:29 Expected and Actual scan responses are the same
2022/08/05 00:50:29 
--- SimpleRangeLowUnbounded ---
2022/08/05 00:50:29 distinct = false
2022/08/05 00:50:30 Using n1ql client
2022/08/05 00:50:30 Expected and Actual scan responses are the same
2022/08/05 00:50:30 
--- SimpleRangeHighUnbounded ---
2022/08/05 00:50:30 distinct = false
2022/08/05 00:50:30 Using n1ql client
2022/08/05 00:50:30 Expected and Actual scan responses are the same
2022/08/05 00:50:30 
--- SimpleRangeMultipleUnbounded ---
2022/08/05 00:50:30 distinct = false
2022/08/05 00:50:31 Using n1ql client
2022/08/05 00:50:31 Expected and Actual scan responses are the same
2022/08/05 00:50:31 
--- FiltersWithUnbounded ---
2022/08/05 00:50:31 distinct = false
2022/08/05 00:50:31 Using n1ql client
2022/08/05 00:50:31 Expected and Actual scan responses are the same
2022/08/05 00:50:31 
--- FiltersLowGreaterThanHigh ---
2022/08/05 00:50:31 distinct = false
2022/08/05 00:50:31 Using n1ql client
2022/08/05 00:50:31 Expected and Actual scan responses are the same
2022/08/05 00:50:31 

--------- Simple Index with 1 field ---------
2022/08/05 00:50:31 
--- SingleIndexSimpleRange ---
2022/08/05 00:50:31 distinct = true
2022/08/05 00:50:32 Using n1ql client
2022/08/05 00:50:32 Expected and Actual scan responses are the same
2022/08/05 00:50:32 
--- SingleIndex_SimpleRanges_NonOverlapping ---
2022/08/05 00:50:32 distinct = true
2022/08/05 00:50:32 Using n1ql client
2022/08/05 00:50:32 Expected and Actual scan responses are the same
2022/08/05 00:50:32 
--- SingleIndex_SimpleRanges_Overlapping ---
2022/08/05 00:50:32 distinct = true
2022/08/05 00:50:32 Using n1ql client
2022/08/05 00:50:32 Expected and Actual scan responses are the same
2022/08/05 00:50:32 

--------- Composite Index with 3 fields ---------
2022/08/05 00:50:32 
--- ScanAllNoFilter ---
2022/08/05 00:50:32 distinct = true
2022/08/05 00:50:33 Using n1ql client
2022/08/05 00:50:33 Expected and Actual scan responses are the same
2022/08/05 00:50:33 
--- ScanAllFilterNil ---
2022/08/05 00:50:33 distinct = true
2022/08/05 00:50:33 Using n1ql client
2022/08/05 00:50:33 Expected and Actual scan responses are the same
2022/08/05 00:50:33 
--- ScanAll_AllFiltersNil ---
2022/08/05 00:50:33 distinct = true
2022/08/05 00:50:34 Using n1ql client
2022/08/05 00:50:34 Expected and Actual scan responses are the same
2022/08/05 00:50:34 
--- 3FieldsSingleSeek ---
2022/08/05 00:50:34 distinct = true
2022/08/05 00:50:34 Using n1ql client
2022/08/05 00:50:34 Expected and Actual scan responses are the same
2022/08/05 00:50:34 
--- 3FieldsMultipleSeeks ---
2022/08/05 00:50:34 distinct = true
2022/08/05 00:50:35 Using n1ql client
2022/08/05 00:50:35 Expected and Actual scan responses are the same
2022/08/05 00:50:35 
--- 3FieldsMultipleSeeks_Identical ---
2022/08/05 00:50:35 distinct = true
2022/08/05 00:50:35 Using n1ql client
2022/08/05 00:50:35 Expected and Actual scan responses are the same
--- PASS: TestMultiScanDescDistinct (10.98s)
=== RUN   TestGroupAggrSetup
2022/08/05 00:50:35 In TestGroupAggrSetup()
2022/08/05 00:50:35 Emptying the default bucket
2022/08/05 00:50:38 Flush Enabled on bucket default, responseBody: 
2022/08/05 00:51:17 Flushed the bucket default, Response body: 
2022/08/05 00:51:17 Dropping the secondary index index_agg
2022/08/05 00:51:17 Populating the default bucket
2022/08/05 00:51:21 Created the secondary index index_agg. Waiting for it become active
2022/08/05 00:51:21 Index is 5133413197159550237 now active
--- PASS: TestGroupAggrSetup (49.71s)
=== RUN   TestGroupAggrLeading
2022/08/05 00:51:25 In TestGroupAggrLeading()
2022/08/05 00:51:25 Total Scanresults = 7
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 3
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLeading (0.01s)
=== RUN   TestGroupAggrNonLeading
2022/08/05 00:51:25 In TestGroupAggrNonLeading()
2022/08/05 00:51:25 Total Scanresults = 4
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNonLeading (0.00s)
=== RUN   TestGroupAggrNoGroup
2022/08/05 00:51:25 In TestGroupAggrNoGroup()
2022/08/05 00:51:25 Total Scanresults = 1
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroup (0.01s)
=== RUN   TestGroupAggrMinMax
2022/08/05 00:51:25 In TestGroupAggrMinMax()
2022/08/05 00:51:25 Total Scanresults = 4
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax (0.01s)
=== RUN   TestGroupAggrMinMax2
2022/08/05 00:51:25 In TestGroupAggrMinMax()
2022/08/05 00:51:25 Total Scanresults = 1
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMinMax2 (0.00s)
=== RUN   TestGroupAggrLeading_N1QLExprs
2022/08/05 00:51:25 In TestGroupAggrLeading_N1QLExprs()
2022/08/05 00:51:25 Total Scanresults = 17
2022/08/05 00:51:25 basicGroupAggrN1QLExprs1: Scan validation passed
2022/08/05 00:51:25 Total Scanresults = 9
2022/08/05 00:51:25 basicGroupAggrN1QLExprs2: Scan validation passed
--- PASS: TestGroupAggrLeading_N1QLExprs (0.26s)
=== RUN   TestGroupAggrLimit
2022/08/05 00:51:25 In TestGroupAggrLimit()
2022/08/05 00:51:25 Total Scanresults = 3
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrLimit (0.00s)
=== RUN   TestGroupAggrOffset
2022/08/05 00:51:25 In TestGroupAggrOffset()
2022/08/05 00:51:25 Total Scanresults = 3
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrOffset (0.00s)
=== RUN   TestGroupAggrCountN
2022/08/05 00:51:25 In TestGroupAggrCountN()
2022/08/05 00:51:25 Total Scanresults = 4
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 4
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrCountN (0.01s)
=== RUN   TestGroupAggrNoGroupNoMatch
2022/08/05 00:51:25 In TestGroupAggrNoGroupNoMatch()
2022/08/05 00:51:25 Total Scanresults = 1
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNoGroupNoMatch (0.00s)
=== RUN   TestGroupAggrGroupNoMatch
2022/08/05 00:51:25 In TestGroupAggrGroupNoMatch()
2022/08/05 00:51:25 Total Scanresults = 0
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrGroupNoMatch (0.00s)
=== RUN   TestGroupAggrMultDataTypes
2022/08/05 00:51:25 In TestGroupAggrMultDataTypes()
2022/08/05 00:51:25 Total Scanresults = 8
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrMultDataTypes (0.00s)
=== RUN   TestGroupAggrDistinct
2022/08/05 00:51:25 In TestGroupAggrDistinct()
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct (0.00s)
=== RUN   TestGroupAggrDistinct2
2022/08/05 00:51:25 In TestGroupAggrDistinct2()
2022/08/05 00:51:25 Total Scanresults = 1
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 4
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 4
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDistinct2 (0.00s)
=== RUN   TestGroupAggrNull
2022/08/05 00:51:25 In TestGroupAggrNull()
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrNull (0.00s)
=== RUN   TestGroupAggrInt64
2022/08/05 00:51:25 In TestGroupAggrInt64()
2022/08/05 00:51:25 Updating the default bucket
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
2022/08/05 00:51:25 Total Scanresults = 2
2022/08/05 00:51:25 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrInt64 (0.19s)
=== RUN   TestGroupAggr1
2022/08/05 00:51:25 In TestGroupAggr1()
2022/08/05 00:51:25 In DropAllSecondaryIndexes()
2022/08/05 00:51:25 Index found:  index_agg
2022/08/05 00:51:26 Dropped index index_agg
2022/08/05 00:51:26 Index found:  index_company_desc
2022/08/05 00:51:26 Dropped index index_company_desc
2022/08/05 00:51:26 Index found:  index_company_name_age_desc
2022/08/05 00:51:26 Dropped index index_company_name_age_desc
2022/08/05 00:51:26 Index found:  index_companyname_desc
2022/08/05 00:51:26 Dropped index index_companyname_desc
2022/08/05 00:51:26 Index found:  #primary
2022/08/05 00:51:26 Dropped index #primary
2022/08/05 00:52:04 Flushed the bucket default, Response body: 
2022/08/05 00:52:12 Created the secondary index idx_aggrs. Waiting for it become active
2022/08/05 00:52:12 Index is 5106838308414785907 now active
2022/08/05 00:52:12 Total Scanresults = 641
2022/08/05 00:52:13 Total Scanresults = 753
--- PASS: TestGroupAggr1 (47.74s)
=== RUN   TestGroupAggrArrayIndex
2022/08/05 00:52:13 In TestGroupAggrArrayIndex()
2022/08/05 00:52:17 Created the secondary index ga_arr1. Waiting for it become active
2022/08/05 00:52:17 Index is 3349620594971410885 now active
2022/08/05 00:52:21 Created the secondary index ga_arr2. Waiting for it become active
2022/08/05 00:52:21 Index is 10367962437229212992 now active
2022/08/05 00:52:21 Scenario 1
2022/08/05 00:52:21 Total Scanresults = 641
2022/08/05 00:52:22 Scenario 2
2022/08/05 00:52:22 Total Scanresults = 2835
2022/08/05 00:52:22 Scenario 3
2022/08/05 00:52:22 Total Scanresults = 1
2022/08/05 00:52:22 Scenario 4
2022/08/05 00:52:22 Total Scanresults = 991
2022/08/05 00:52:23 Scenario 5
2022/08/05 00:52:23 Total Scanresults = 2835
2022/08/05 00:52:24 Scenario 6
2022/08/05 00:52:24 Total Scanresults = 1
2022/08/05 00:52:24 Scenario 7
2022/08/05 00:52:24 Total Scanresults = 2931
2022/08/05 00:52:27 Scenario 8
2022/08/05 00:52:27 Total Scanresults = 1168
2022/08/05 00:52:28 Scenario 9
2022/08/05 00:52:28 Total Scanresults = 1
2022/08/05 00:52:28 Scenario 10
2022/08/05 00:52:28 Total Scanresults = 641
2022/08/05 00:52:29 Scenario 11
2022/08/05 00:52:29 Total Scanresults = 1168
2022/08/05 00:52:29 Scenario 12
2022/08/05 00:52:29 Total Scanresults = 1
2022/08/05 00:52:30 Scenario 13
2022/08/05 00:52:34 Total Scanresults = 1
2022/08/05 00:52:34 Count of scanResults is 1
2022/08/05 00:52:34 Value: [2 117]
--- PASS: TestGroupAggrArrayIndex (20.51s)
=== RUN   TestGroupAggr_FirstValidAggrOnly
2022/08/05 00:52:34 In TestGroupAggr_FirstValidAggrOnly()
2022/08/05 00:52:34 In DropAllSecondaryIndexes()
2022/08/05 00:52:34 Index found:  #primary
2022/08/05 00:52:34 Dropped index #primary
2022/08/05 00:52:34 Index found:  ga_arr2
2022/08/05 00:52:34 Dropped index ga_arr2
2022/08/05 00:52:34 Index found:  test_oneperprimarykey
2022/08/05 00:52:34 Dropped index test_oneperprimarykey
2022/08/05 00:52:34 Index found:  ga_arr1
2022/08/05 00:52:34 Dropped index ga_arr1
2022/08/05 00:52:34 Index found:  idx_aggrs
2022/08/05 00:52:34 Dropped index idx_aggrs
2022/08/05 00:52:49 Created the secondary index idx_asc_3field. Waiting for it become active
2022/08/05 00:52:49 Index is 2672720014264594124 now active
2022/08/05 00:52:53 Created the secondary index idx_desc_3field. Waiting for it become active
2022/08/05 00:52:53 Index is 7049314437163197001 now active
2022/08/05 00:52:53 === MIN no group by ===
2022/08/05 00:52:53 Total Scanresults = 1
2022/08/05 00:52:53 Count of scanResults is 1
2022/08/05 00:52:53 Value: ["ACCEL"]
2022/08/05 00:52:53 === MIN no group by, no row match ===
2022/08/05 00:52:53 Total Scanresults = 1
2022/08/05 00:52:53 Count of scanResults is 1
2022/08/05 00:52:53 Value: [null]
2022/08/05 00:52:53 === MIN with group by ===
2022/08/05 00:52:53 Total Scanresults = 641
2022/08/05 00:52:53 === MIN with group by, no row match ===
2022/08/05 00:52:53 Total Scanresults = 0
2022/08/05 00:52:54 === One Aggr, no group by ===
2022/08/05 00:52:54 Total Scanresults = 1
2022/08/05 00:52:54 Count of scanResults is 1
2022/08/05 00:52:54 Value: ["FANFARE"]
2022/08/05 00:52:54 === One Aggr, no group by, no row match ===
2022/08/05 00:52:54 Total Scanresults = 1
2022/08/05 00:52:54 Count of scanResults is 1
2022/08/05 00:52:54 Value: [null]
2022/08/05 00:52:54 === Multiple Aggr, no group by ===
2022/08/05 00:52:54 Total Scanresults = 1
2022/08/05 00:52:54 Count of scanResults is 1
2022/08/05 00:52:54 Value: ["FANFARE" 15]
2022/08/05 00:52:54 === Multiple Aggr, no group by, no row match ===
2022/08/05 00:52:54 Total Scanresults = 1
2022/08/05 00:52:54 Count of scanResults is 1
2022/08/05 00:52:54 Value: [null null]
2022/08/05 00:52:54 === No Aggr, 1 group by ===
2022/08/05 00:52:54 Total Scanresults = 211
2022/08/05 00:52:54 === Aggr on non-leading key, previous equality filter, no group ===
2022/08/05 00:52:54 Total Scanresults = 1
2022/08/05 00:52:54 Count of scanResults is 1
2022/08/05 00:52:54 Value: [59]
2022/08/05 00:52:55 === Aggr on non-leading key, previous equality filters, no group ===
2022/08/05 00:52:55 Total Scanresults = 1
2022/08/05 00:52:55 Count of scanResults is 1
2022/08/05 00:52:55 Value: [null]
2022/08/05 00:52:55 === Aggr on non-leading key, previous non-equality filters, no group ===
2022/08/05 00:52:55 Total Scanresults = 1
2022/08/05 00:52:55 Count of scanResults is 1
2022/08/05 00:52:55 Value: ["Adam"]
2022/08/05 00:52:55 === MIN on desc, no group ===
2022/08/05 00:52:55 Total Scanresults = 1
2022/08/05 00:52:55 Count of scanResults is 1
2022/08/05 00:52:55 Value: ["FANFARE"]
2022/08/05 00:52:55 === MAX on asc, no group ===
2022/08/05 00:52:55 Total Scanresults = 1
2022/08/05 00:52:55 Count of scanResults is 1
2022/08/05 00:52:55 Value: ["OZEAN"]
2022/08/05 00:52:55 === MAX on desc, no group ===
2022/08/05 00:52:55 Total Scanresults = 1
2022/08/05 00:52:55 Count of scanResults is 1
2022/08/05 00:52:55 Value: ["OZEAN"]
2022/08/05 00:52:55 === COUNT(DISTINCT const_expr, no group ===
2022/08/05 00:52:55 Total Scanresults = 1
2022/08/05 00:52:55 Count of scanResults is 1
2022/08/05 00:52:55 Value: [1]
2022/08/05 00:52:55 === COUNT(DISTINCT const_expr, no group, no row match ===
2022/08/05 00:52:55 Total Scanresults = 1
2022/08/05 00:52:55 Count of scanResults is 1
2022/08/05 00:52:55 Value: [0]
2022/08/05 00:52:56 === COUNT(const_expr, no group ===
2022/08/05 00:52:56 Total Scanresults = 1
2022/08/05 00:52:56 Count of scanResults is 1
2022/08/05 00:52:56 Value: [345]
2022/08/05 00:53:00 Created the secondary index indexMinAggr. Waiting for it become active
2022/08/05 00:53:00 Index is 7265924216114668803 now active
2022/08/05 00:53:00 === Equality filter check: Equality for a, nil filter for b - inclusion 0, no filter for c ===
2022/08/05 00:53:00 Total Scanresults = 1
2022/08/05 00:53:00 Count of scanResults is 1
2022/08/05 00:53:00 Value: [5]
2022/08/05 00:53:00 === Equality filter check: Equality for a, nil filter for b - inclusion 3, no filter for c ===
2022/08/05 00:53:00 Total Scanresults = 1
2022/08/05 00:53:00 Count of scanResults is 1
2022/08/05 00:53:00 Value: [5]
2022/08/05 00:53:00 === Equality filter check: Equality for a, nil filter for b - inclusion 3, nil filter for c ===
2022/08/05 00:53:00 Total Scanresults = 1
2022/08/05 00:53:00 Count of scanResults is 1
2022/08/05 00:53:00 Value: [5]
--- PASS: TestGroupAggr_FirstValidAggrOnly (26.53s)
=== RUN   TestGroupAggrPrimary
2022/08/05 00:53:00 In TestGroupAggrPrimary()
2022/08/05 00:53:00 Total Scanresults = 1
2022/08/05 00:53:00 Total Scanresults = 1
2022/08/05 00:53:00 Total Scanresults = 1
2022/08/05 00:53:00 Total Scanresults = 1002
2022/08/05 00:53:01 Total Scanresults = 1002
2022/08/05 00:53:01 Total Scanresults = 1
2022/08/05 00:53:01 Total Scanresults = 1
2022/08/05 00:53:01 Total Scanresults = 1
2022/08/05 00:53:01 Total Scanresults = 1
2022/08/05 00:53:01 Total Scanresults = 1
2022/08/05 00:53:02 Total Scanresults = 1
2022/08/05 00:53:02 --- MB-28305 Scenario 1 ---
2022/08/05 00:53:02 Total Scanresults = 1
2022/08/05 00:53:02 Count of scanResults is 1
2022/08/05 00:53:02 Value: [0]
2022/08/05 00:53:02 --- MB-28305 Scenario 2 ---
2022/08/05 00:53:02 Total Scanresults = 1
2022/08/05 00:53:02 Count of scanResults is 1
2022/08/05 00:53:02 Value: [0]
2022/08/05 00:53:02 --- MB-28305 Scenario 3 ---
2022/08/05 00:53:02 Total Scanresults = 1
2022/08/05 00:53:02 Count of scanResults is 1
2022/08/05 00:53:02 Value: [0]
--- PASS: TestGroupAggrPrimary (1.47s)
=== RUN   TestGroupAggrDocumentKey
2022/08/05 00:53:02 In TestGroupAggrDocumentKey()
2022/08/05 00:53:02 Dropping the secondary index documentkey_idx1
2022/08/05 00:53:02 Dropping the secondary index documentkey_idx2
2022/08/05 00:53:02 Populating the default bucket for TestGroupAggrDocumentKey single key index
2022/08/05 00:53:06 Created the secondary index documentkey_idx1. Waiting for it become active
2022/08/05 00:53:06 Index is 1938537489619634221 now active
2022/08/05 00:53:06 Using n1ql client
2022/08/05 00:53:06 Scanresult Row  ["1"] :  
2022/08/05 00:53:06 Scanresult Row  ["2"] :  
2022/08/05 00:53:06 Scanresult Row  ["3"] :  
2022/08/05 00:53:06 Expected and Actual scan responses are the same
2022/08/05 00:53:06 Populating the default bucket for TestGroupAggrDocumentKey composite key index
2022/08/05 00:53:10 Created the secondary index documentkey_idx2. Waiting for it become active
2022/08/05 00:53:10 Index is 8969821963661817948 now active
2022/08/05 00:53:10 Using n1ql client
2022/08/05 00:53:10 Scanresult Row  ["1"] :  
2022/08/05 00:53:10 Scanresult Row  ["2"] :  
2022/08/05 00:53:10 Scanresult Row  ["3"] :  
2022/08/05 00:53:10 Expected and Actual scan responses are the same
--- PASS: TestGroupAggrDocumentKey (8.54s)
=== RUN   TestRebalanceSetupCluster
2022/08/05 00:53:10 set14_rebalance_test.go::TestRebalanceSetupCluster: entry: Current cluster configuration: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 00:53:10 set14_rebalance_test.go::TestRebalanceSetupCluster: 1. Setting up initial cluster configuration
2022/08/05 00:53:10 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2022/08/05 00:53:16 Rebalance progress: 3.255208333333334
2022/08/05 00:53:21 Rebalance progress: 9.700520833333334
2022/08/05 00:53:26 Rebalance progress: 15.36458333333333
2022/08/05 00:53:31 Rebalance progress: 21.32161458333334
2022/08/05 00:53:36 Rebalance progress: 26.82291666666666
2022/08/05 00:53:41 Rebalance progress: 32.55208333333334
2022/08/05 00:53:46 Rebalance progress: 37.23958333333334
2022/08/05 00:53:51 Rebalance progress: 43.81510416666666
2022/08/05 00:53:56 Rebalance progress: 50
2022/08/05 00:54:01 Rebalance progress: 50
2022/08/05 00:54:06 Rebalance progress: 50
2022-08-05T00:54:07.018+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:57490->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T00:54:07.018+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:57492->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022/08/05 00:54:11 Rebalance progress: 100
2022/08/05 00:54:11 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 00:54:21 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2022/08/05 00:54:27 Rebalance progress: 100
2022/08/05 00:54:27 set14_rebalance_test.go::TestRebalanceSetupCluster: 2. Changing indexer.settings.rebalance.redistribute_indexes to true
2022/08/05 00:54:27 Changing config key indexer.settings.rebalance.redistribute_indexes to value true
2022/08/05 00:54:27 set14_rebalance_test.go::TestRebalanceSetupCluster: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceSetupCluster (76.53s)
=== RUN   TestCreateDocsBeforeRebalance
2022/08/05 00:54:27 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 00:54:27 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: 1. Creating 100 documents
2022/08/05 00:54:27 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: 100 documents created
2022/08/05 00:54:27 set14_rebalance_test.go::TestCreateDocsBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateDocsBeforeRebalance (0.14s)
=== RUN   TestCreateIndexesBeforeRebalance
2022/08/05 00:54:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 00:54:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 1. Creating 17 indexes: non-partitioned, 0-replica, non-deferred
2022/08/05 00:54:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN__id on `default`(_id)
2022/08/05 00:54:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN__id index is now active.
2022/08/05 00:54:30 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_docid on `default`(docid)
2022/08/05 00:54:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_docid index is now active.
2022/08/05 00:54:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_guid on `default`(guid)
2022/08/05 00:54:39 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_guid index is now active.
2022/08/05 00:54:39 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_isActive on `default`(isActive)
2022/08/05 00:54:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_isActive index is now active.
2022/08/05 00:54:43 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_balance on `default`(balance)
2022/08/05 00:54:47 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_balance index is now active.
2022/08/05 00:54:47 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_picture on `default`(picture)
2022/08/05 00:54:51 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_picture index is now active.
2022/08/05 00:54:51 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_age on `default`(age)
2022/08/05 00:54:55 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_age index is now active.
2022/08/05 00:54:55 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_eyeColor on `default`(eyeColor)
2022/08/05 00:54:58 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_eyeColor index is now active.
2022/08/05 00:54:58 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_name on `default`(name)
2022/08/05 00:55:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_name index is now active.
2022/08/05 00:55:03 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_gender on `default`(gender)
2022/08/05 00:55:06 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_gender index is now active.
2022/08/05 00:55:06 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_company on `default`(company)
2022/08/05 00:55:10 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_company index is now active.
2022/08/05 00:55:10 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_email on `default`(email)
2022/08/05 00:55:14 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_email index is now active.
2022/08/05 00:55:14 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_phone on `default`(phone)
2022/08/05 00:55:18 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_phone index is now active.
2022/08/05 00:55:18 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_registered on `default`(registered)
2022/08/05 00:55:22 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_registered index is now active.
2022/08/05 00:55:22 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_latitude on `default`(latitude)
2022/08/05 00:55:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_latitude index is now active.
2022/08/05 00:55:27 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_longitude on `default`(longitude)
2022/08/05 00:55:31 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_longitude index is now active.
2022/08/05 00:55:31 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_PLAIN_favoriteFruit on `default`(favoriteFruit)
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_PLAIN_favoriteFruit index is now active.
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 2. Creating 17 indexes: non-partitioned, 0-replica, DEFERRED
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED__id_docid on `default`(_id, docid) with {"defer_build":true}
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED__id_docid index is now deferred.
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_docid_guid on `default`(docid, guid) with {"defer_build":true}
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_docid_guid index is now deferred.
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_guid_isActive on `default`(guid, isActive) with {"defer_build":true}
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_guid_isActive index is now deferred.
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_isActive_balance on `default`(isActive, balance) with {"defer_build":true}
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_isActive_balance index is now deferred.
2022/08/05 00:55:35 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_balance_picture on `default`(balance, picture) with {"defer_build":true}
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_balance_picture index is now deferred.
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_picture_age on `default`(picture, age) with {"defer_build":true}
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_picture_age index is now deferred.
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_age_eyeColor on `default`(age, eyeColor) with {"defer_build":true}
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_age_eyeColor index is now deferred.
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_eyeColor_name on `default`(eyeColor, name) with {"defer_build":true}
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_eyeColor_name index is now deferred.
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_name_gender on `default`(name, gender) with {"defer_build":true}
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_name_gender index is now deferred.
2022/08/05 00:55:36 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_gender_company on `default`(gender, company) with {"defer_build":true}
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_gender_company index is now deferred.
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_company_email on `default`(company, email) with {"defer_build":true}
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_company_email index is now deferred.
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_email_phone on `default`(email, phone) with {"defer_build":true}
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_email_phone index is now deferred.
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_phone_registered on `default`(phone, registered) with {"defer_build":true}
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_phone_registered index is now deferred.
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_registered_latitude on `default`(registered, latitude) with {"defer_build":true}
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_registered_latitude index is now deferred.
2022/08/05 00:55:37 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_latitude_longitude on `default`(latitude, longitude) with {"defer_build":true}
2022/08/05 00:55:38 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_latitude_longitude index is now deferred.
2022/08/05 00:55:38 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_longitude_favoriteFruit on `default`(longitude, favoriteFruit) with {"defer_build":true}
2022/08/05 00:55:38 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_longitude_favoriteFruit index is now deferred.
2022/08/05 00:55:38 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_DEFERRED_favoriteFruit__id on `default`(favoriteFruit, _id) with {"defer_build":true}
2022/08/05 00:55:38 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_DEFERRED_favoriteFruit__id index is now deferred.
2022/08/05 00:55:38 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: 3. Creating 3 indexes: 7-PARTITION, 0-replica, non-deferred
2022/08/05 00:55:38 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS__id_guid on `default`(_id, guid) partition by hash(Meta().id) with {"num_partition":7}
2022/08/05 00:55:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS__id_guid index is now active.
2022/08/05 00:55:42 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS_docid_isActive on `default`(docid, isActive) partition by hash(Meta().id) with {"num_partition":7}
2022/08/05 00:55:46 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS_docid_isActive index is now active.
2022/08/05 00:55:46 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_7PARTITIONS_guid_balance on `default`(guid, balance) partition by hash(Meta().id) with {"num_partition":7}
2022/08/05 00:55:50 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: set14_idx_7PARTITIONS_guid_balance index is now active.
2022/08/05 00:55:50 set14_rebalance_test.go::TestCreateIndexesBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateIndexesBeforeRebalance (83.20s)
=== RUN   TestIndexNodeRebalanceIn
2022/08/05 00:55:50 TestIndexNodeRebalanceIn entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 00:55:50 TestIndexNodeRebalanceIn: 1. Adding index node 127.0.0.1:9002 to the cluster
2022/08/05 00:55:50 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2022/08/05 00:55:57 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2022/08/05 00:55:57 TestIndexNodeRebalanceIn: 2. Adding index node 127.0.0.1:9003 to the cluster
2022/08/05 00:55:57 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2022/08/05 00:56:06 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2022/08/05 00:56:06 TestIndexNodeRebalanceIn: 3. Rebalancing
2022/08/05 00:56:11 Rebalance progress: 0
2022/08/05 00:56:16 Rebalance progress: 12.5
2022/08/05 00:56:21 Rebalance progress: 40
2022/08/05 00:56:26 Rebalance progress: 47.5
2022/08/05 00:56:31 Rebalance progress: 52.5
2022/08/05 00:56:36 Rebalance progress: 52.5
2022/08/05 00:56:41 Rebalance progress: 57.49999999999999
2022/08/05 00:56:46 Rebalance progress: 62.5
2022/08/05 00:56:51 Rebalance progress: 67.5
2022/08/05 00:56:56 Rebalance progress: 72.50000000000001
2022/08/05 00:57:01 Rebalance progress: 77.5
2022/08/05 00:57:06 Rebalance progress: 100
2022/08/05 00:57:06 TestIndexNodeRebalanceIn exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestIndexNodeRebalanceIn (77.95s)
=== RUN   TestCreateReplicatedIndexesBeforeRebalance
2022/08/05 00:57:08 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 00:57:08 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: 1. Creating 5 indexes: non-partitioned, 2-REPLICA, non-deferred
2022/08/05 00:57:08 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS__id_isActive on `default`(_id, isActive) with {"num_replica":2}
2022/08/05 00:57:22 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS__id_isActive index is now active.
2022/08/05 00:57:22 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_docid_balance on `default`(docid, balance) with {"num_replica":2}
2022/08/05 00:57:32 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_docid_balance index is now active.
2022/08/05 00:57:32 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_guid_picture on `default`(guid, picture) with {"num_replica":2}
2022/08/05 00:57:42 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_guid_picture index is now active.
2022/08/05 00:57:42 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_isActive_age on `default`(isActive, age) with {"num_replica":2}
2022/08/05 00:57:51 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_isActive_age index is now active.
2022/08/05 00:57:51 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_2REPLICAS_balance_eyeColor on `default`(balance, eyeColor) with {"num_replica":2}
2022/08/05 00:57:59 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_2REPLICAS_balance_eyeColor index is now active.
2022/08/05 00:57:59 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: 2. Creating 2 indexes: 5-PARTITION, 1-REPLICA, non-deferred
2022/08/05 00:57:59 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_5PARTITIONS_1REPLICAS__id_balance on `default`(_id, balance) partition by hash(Meta().id) with {"num_partition":5, "num_replica":1}
2022/08/05 00:58:09 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_5PARTITIONS_1REPLICAS__id_balance index is now active.
2022/08/05 00:58:09 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance:: Executing N1QL: create index set14_idx_5PARTITIONS_1REPLICAS_docid_picture on `default`(docid, picture) partition by hash(Meta().id) with {"num_partition":5, "num_replica":1}
2022/08/05 00:58:21 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: set14_idx_5PARTITIONS_1REPLICAS_docid_picture index is now active.
2022/08/05 00:58:21 set14_rebalance_test.go::TestCreateReplicatedIndexesBeforeRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestCreateReplicatedIndexesBeforeRebalance (72.91s)
=== RUN   TestIndexNodeRebalanceOut
2022/08/05 00:58:21 set14_rebalance_test.go::TestIndexNodeRebalanceOut: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 00:58:21 set14_rebalance_test.go::TestIndexNodeRebalanceOut: 1. Rebalancing index node 127.0.0.1:9001 out of the cluster
2022/08/05 00:58:21 Removing node(s): [127.0.0.1:9001] from the cluster
2022/08/05 00:58:27 Rebalance progress: 12.5
2022/08/05 00:58:32 Rebalance progress: 12.5
2022/08/05 00:58:37 Rebalance progress: 42.50000000000001
2022/08/05 00:58:42 Rebalance progress: 57.49999999999999
2022/08/05 00:58:47 Rebalance progress: 67.5
2022/08/05 00:58:52 Rebalance progress: 77.5
2022-08-05T00:58:53.770+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:44648->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T00:58:53.770+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:44646->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022/08/05 00:58:57 Rebalance progress: 100
2022/08/05 00:58:57 set14_rebalance_test.go::TestIndexNodeRebalanceOut: exit: Current cluster configuration: map[127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestIndexNodeRebalanceOut (37.74s)
=== RUN   TestFailoverAndRebalance
2022/08/05 00:58:59 set14_rebalance_test.go::TestFailoverAndRebalance: entry: Current cluster configuration: map[127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 00:58:59 set14_rebalance_test.go::TestFailoverAndRebalance: 1. Failing over index node 127.0.0.1:9002
2022/08/05 00:58:59 Failing over: [127.0.0.1:9002]
2022-08-05T00:58:59.531+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:40520->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022-08-05T00:58:59.557+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:40528->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022/08/05 00:59:00 set14_rebalance_test.go::TestFailoverAndRebalance: 2. Rebalancing
2022/08/05 00:59:05 Rebalance progress: 25
2022/08/05 00:59:10 Rebalance progress: 75
2022/08/05 00:59:15 Rebalance progress: 100
2022/08/05 00:59:15 set14_rebalance_test.go::TestFailoverAndRebalance: exit: Current cluster configuration: map[127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestFailoverAndRebalance (18.63s)
=== RUN   TestSwapRebalance
2022/08/05 00:59:17 set14_rebalance_test.go::TestSwapRebalance: entry: Current cluster configuration: map[127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 00:59:17 set14_rebalance_test.go::TestSwapRebalance: 1. Adding index node 127.0.0.1:9001 to the cluster
2022/08/05 00:59:17 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 00:59:26 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2022/08/05 00:59:26 set14_rebalance_test.go::TestSwapRebalance: 2. Swap rebalancing index node 127.0.0.1:9003 out of the cluster
2022/08/05 00:59:26 Removing node(s): [127.0.0.1:9003] from the cluster
2022/08/05 00:59:31 Rebalance progress: 16.66666666666667
2022/08/05 00:59:37 Rebalance progress: 33.87096774193548
2022/08/05 00:59:41 Rebalance progress: 40.32258064516129
2022/08/05 00:59:47 Rebalance progress: 46.7741935483871
2022/08/05 00:59:51 Rebalance progress: 53.2258064516129
2022/08/05 00:59:56 Rebalance progress: 59.67741935483871
2022/08/05 01:00:01 Rebalance progress: 59.67741935483871
2022/08/05 01:00:06 Rebalance progress: 66.12903225806451
2022/08/05 01:00:11 Rebalance progress: 72.58064516129033
2022/08/05 01:00:16 Rebalance progress: 79.03225806451614
2022-08-05T01:00:20.119+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = read tcp 127.0.0.1:45316->127.0.0.1:9118: use of closed network connection. Kill Pipe.
2022-08-05T01:00:20.132+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = read tcp 127.0.0.1:45314->127.0.0.1:9118: use of closed network connection. Kill Pipe.
2022/08/05 01:00:21 Rebalance progress: 100
2022/08/05 01:00:21 set14_rebalance_test.go::TestSwapRebalance: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestSwapRebalance (66.00s)
=== RUN   TestRebalanceReplicaRepair
2022/08/05 01:00:23 TestRebalanceReplicaRepair entry: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 01:00:23 TestRebalanceReplicaRepair: 1. Adding index node 127.0.0.1:9002 to the cluster
2022/08/05 01:00:23 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2022/08/05 01:00:34 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2022/08/05 01:00:34 TestRebalanceReplicaRepair: 2. Adding index node 127.0.0.1:9003 to the cluster
2022/08/05 01:00:34 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2022/08/05 01:00:42 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2022/08/05 01:00:42 TestRebalanceReplicaRepair: 3. Rebalancing
2022/08/05 01:00:47 Rebalance progress: 12.5
2022/08/05 01:00:52 Rebalance progress: 22.17741935483871
2022/08/05 01:00:57 Rebalance progress: 29.43548387096774
2022/08/05 01:01:02 Rebalance progress: 34.2741935483871
2022/08/05 01:01:07 Rebalance progress: 39.11290322580645
2022/08/05 01:01:12 Rebalance progress: 43.95161290322581
2022/08/05 01:01:17 Rebalance progress: 43.95161290322581
2022/08/05 01:01:22 Rebalance progress: 48.79032258064516
2022/08/05 01:01:27 Rebalance progress: 53.62903225806451
2022/08/05 01:01:32 Rebalance progress: 58.46774193548387
2022/08/05 01:01:37 Rebalance progress: 58.46774193548387
2022/08/05 01:01:42 Rebalance progress: 65.7258064516129
2022/08/05 01:01:47 Rebalance progress: 68.14516129032258
2022/08/05 01:01:52 Rebalance progress: 72.98387096774192
2022/08/05 01:01:57 Rebalance progress: 77.82258064516128
2022/08/05 01:02:02 Rebalance progress: 82.66129032258064
2022/08/05 01:02:07 Rebalance progress: 100
2022/08/05 01:02:07 TestRebalanceReplicaRepair exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceReplicaRepair (105.69s)
=== RUN   TestPauseAndResume
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Before start, calling GetTaskList
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00b73afc0}, TaskList &{Rev:[0 0 0 0 0 0 0 16] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00b678f60}, TaskList &{Rev:[0 0 0 0 0 0 0 20] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00b6792f0}, TaskList &{Rev:[0 0 0 0 0 0 0 3] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Calling PreparePause
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Calling GetTaskList(PreparePause)
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc0090bc120}, TaskList &{Rev:[0 0 0 0 0 0 0 16] Tasks:[{Rev:[0 0 0 0 0 0 0 0] ID:fakeTaskId Type:task-pause Status:task-running IsCancelable:true Progress:0 DetailedProgress:map[] Description: ErrorMessage: Extra:map[archiveDir:/fakeRemotePath/ archiveType:File bucket:fakeBucket bucketUuid:fakeBucketUuid master:false]}]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00bdc4e70}, TaskList &{Rev:[0 0 0 0 0 0 0 20] Tasks:[{Rev:[0 0 0 0 0 0 0 0] ID:fakeTaskId Type:task-pause Status:task-running IsCancelable:true Progress:0 DetailedProgress:map[] Description: ErrorMessage: Extra:map[archiveDir:/fakeRemotePath/ archiveType:File bucket:fakeBucket bucketUuid:fakeBucketUuid master:false]}]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00bdc5110}, TaskList &{Rev:[0 0 0 0 0 0 0 3] Tasks:[{Rev:[0 0 0 0 0 0 0 0] ID:fakeTaskId Type:task-pause Status:task-running IsCancelable:true Progress:0 DetailedProgress:map[] Description: ErrorMessage: Extra:map[archiveDir:/fakeRemotePath/ archiveType:File bucket:fakeBucket bucketUuid:fakeBucketUuid master:false]}]}
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Calling CancelTask(PreparePause)
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Calling GetTaskList()
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00f644840}, TaskList &{Rev:[0 0 0 0 0 0 0 16] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc0090bd770}, TaskList &{Rev:[0 0 0 0 0 0 0 20] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc0090bdb00}, TaskList &{Rev:[0 0 0 0 0 0 0 3] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Calling PrepareResume
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Calling GetTaskList(PrepareResume)
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00f7fddd0}, TaskList &{Rev:[0 0 0 0 0 0 0 16] Tasks:[{Rev:[0 0 0 0 0 0 0 0] ID:fakeTaskId Type:task-resume Status:task-running IsCancelable:true Progress:0 DetailedProgress:map[] Description: ErrorMessage: Extra:map[archiveDir:/fakeRemotePath/ archiveType:File bucket:fakeBucket dryRun:true master:false]}]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00d412150}, TaskList &{Rev:[0 0 0 0 0 0 0 20] Tasks:[{Rev:[0 0 0 0 0 0 0 0] ID:fakeTaskId Type:task-resume Status:task-running IsCancelable:true Progress:0 DetailedProgress:map[] Description: ErrorMessage: Extra:map[archiveDir:/fakeRemotePath/ archiveType:File bucket:fakeBucket dryRun:true master:false]}]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00f644ae0}, TaskList &{Rev:[0 0 0 0 0 0 0 3] Tasks:[{Rev:[0 0 0 0 0 0 0 0] ID:fakeTaskId Type:task-resume Status:task-running IsCancelable:true Progress:0 DetailedProgress:map[] Description: ErrorMessage: Extra:map[archiveDir:/fakeRemotePath/ archiveType:File bucket:fakeBucket dryRun:true master:false]}]}
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Calling CancelTask(PrepareResume)
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: Calling GetTaskList()
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00b3d3ad0}, TaskList &{Rev:[0 0 0 0 0 0 0 16] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00d413bc0}, TaskList &{Rev:[0 0 0 0 0 0 0 20] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::getTaskList: getTaskListResponse: {Code:success Error: TaskList:0xc00b3d3d40}, TaskList &{Rev:[0 0 0 0 0 0 0 3] Tasks:[]}
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestPauseAndResume (0.32s)
=== RUN   TestFailureAndRebalanceDuringInitialIndexBuild
2022/08/05 01:02:09 set14_rebalance_test.go::TestPauseAndResume: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 01:02:14 Created the secondary index index_0. Waiting for it become active
2022/08/05 01:02:14 Index is 377354621117187627 now active
2022/08/05 01:02:18 Created the secondary index index_1. Waiting for it become active
2022/08/05 01:02:18 Index is 2008693877609470997 now active
2022/08/05 01:02:23 Created the secondary index index_2. Waiting for it become active
2022/08/05 01:02:23 Index is 13277206779261465586 now active
2022/08/05 01:02:27 Created the secondary index index_3. Waiting for it become active
2022/08/05 01:02:27 Index is 1955836009201978306 now active
2022/08/05 01:02:32 Created the secondary index index_4. Waiting for it become active
2022/08/05 01:02:32 Index is 11562217147900629529 now active
2022/08/05 01:02:39 Created the secondary index index_5. Waiting for it become active
2022/08/05 01:02:39 Index is 8600981138422036412 now active
2022/08/05 01:02:43 Created the secondary index index_6. Waiting for it become active
2022/08/05 01:02:43 Index is 16759951866264485301 now active
2022/08/05 01:02:49 Created the secondary index index_7. Waiting for it become active
2022/08/05 01:02:49 Index is 3473887715672623174 now active
2022/08/05 01:02:57 Created the secondary index index_8. Waiting for it become active
2022/08/05 01:02:57 Index is 15084086304569859110 now active
2022/08/05 01:03:01 Created the secondary index index_9. Waiting for it become active
2022/08/05 01:03:01 Index is 12128783622587178161 now active
2022/08/05 01:03:23 Failing over: [127.0.0.1:9002]
2022-08-05T01:03:24.132+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:52364->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022-08-05T01:03:24.142+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:52362->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022/08/05 01:03:24 Build the deferred index index_11. Waiting for the index to become active
2022/08/05 01:03:24 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:25 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:25 TestFailureAndRebalanceDuringInitialIndexBuild: 1. Adding index node 127.0.0.1:9002 to the cluster
2022/08/05 01:03:25 Kicking off failover recovery, type: full
2022/08/05 01:03:26 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:27 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:28 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:29 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:30 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:31 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:32 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:32 Rebalance progress: 12.5
2022/08/05 01:03:33 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:34 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:35 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:36 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:37 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:37 Rebalance failed. See logs for detailed reason. You can try again.
2022/08/05 01:03:37 set14_rebalance_test.go::TestPauseAndResume: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestFailureAndRebalanceDuringInitialIndexBuild (88.11s)
=== RUN   TestRebalanceResetCluster
2022/08/05 01:03:38 set14_rebalance_test.go::TestRebalanceResetCluster: entry: Current cluster configuration: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 127.0.0.1:9003:[index] 172.31.5.112:9000:[kv n1ql]]
2022/08/05 01:03:38 set14_rebalance_test.go::TestRebalanceResetCluster: 1. Restoring indexer.settings.rebalance.redistribute_indexes to false
2022/08/05 01:03:38 Changing config key indexer.settings.rebalance.redistribute_indexes to value false
2022/08/05 01:03:38 set14_rebalance_test.go::TestRebalanceResetCluster: 2. Resetting cluster to initial configuration
2022/08/05 01:03:38 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2022/08/05 01:03:38 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:39 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:40 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:41 Waiting for index 10534567981901228102 to go active ...
2022/08/05 01:03:42 Index is 10534567981901228102 now active
2022-08-05T01:03:43.181+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = read tcp 127.0.0.1:57186->127.0.0.1:9118: use of closed network connection. Kill Pipe.
2022-08-05T01:03:43.181+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:57114->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T01:03:43.181+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:58306->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022-08-05T01:03:43.213+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = read tcp 127.0.0.1:57174->127.0.0.1:9118: use of closed network connection. Kill Pipe.
2022-08-05T01:03:43.213+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:57118->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T01:03:43.214+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:58308->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022/08/05 01:03:44 Rebalance progress: 87.5
2022/08/05 01:03:48 Rebalance progress: 100
2022/08/05 01:03:48 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 01:04:03 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2022/08/05 01:04:08 Rebalance progress: 100
2022/08/05 01:04:08 set14_rebalance_test.go::TestRebalanceResetCluster: exit: Current cluster configuration: map[127.0.0.1:9001:[index] 172.31.5.112:9000:[kv n1ql]]
--- PASS: TestRebalanceResetCluster (32.70s)
=== RUN   TestAlterIndexIncrReplica
2022/08/05 01:04:10 In TestAlterIndexIncrReplica()
2022/08/05 01:04:10 This test creates an index with one replica and then increments replica count to 2
2022/08/05 01:04:10 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2022-08-05T01:04:12.368+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:40626->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T01:04:12.375+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:40618->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022/08/05 01:04:15 Rebalance progress: 100
2022/08/05 01:04:15 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 01:04:26 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2022/08/05 01:04:31 Rebalance progress: 100
2022/08/05 01:04:31 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2022/08/05 01:04:38 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2022-08-05T01:04:40.422+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:04:40.461+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:04:40.464+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:04:40.472+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2022-08-05T01:04:40.472+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2022-08-05T01:04:40.482+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022/08/05 01:04:43 Rebalance progress: 100
2022/08/05 01:04:43 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2022-08-05T01:04:46.128+05:30 [Warn] serviceChangeNotifier: Consumer (meta_client) for http://%40query@127.0.0.1:9000 took too long to read notification, making the consumer invalid
2022/08/05 01:04:50 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2022-08-05T01:04:51.129+05:30 [Warn] serviceChangeNotifier: Consumer (meta_client) for http://%40query@127.0.0.1:9000 took too long to read notification, making the consumer invalid
2022-08-05T01:04:53.494+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:04:53.508+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2022-08-05T01:04:53.529+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:04:53.539+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2022-08-05T01:04:53.576+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:04:53.583+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022/08/05 01:04:56 Rebalance progress: 100
2022/08/05 01:04:56 In DropAllSecondaryIndexes()
2022/08/05 01:05:42 Flushed the bucket default, Response body: 
2022/08/05 01:05:49 Created the secondary index idx_1. Waiting for it become active
2022/08/05 01:05:49 Index is 12226899446232917650 now active
2022/08/05 01:05:49 Executing alter index command: alter index `default`.idx_1 with {"action":"replica_count", "num_replica":2}
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
2022/08/05 01:06:15 Using n1ql client
--- PASS: TestAlterIndexIncrReplica (125.31s)
=== RUN   TestAlterIndexDecrReplica
2022/08/05 01:06:16 In TestAlterIndexDecrReplica()
2022/08/05 01:06:16 This test creates an index with two replicas and then decrements replica count to 1
2022/08/05 01:06:16 In DropAllSecondaryIndexes()
2022/08/05 01:06:16 Index found:  idx_1
2022/08/05 01:06:16 Dropped index idx_1
2022/08/05 01:06:33 Created the secondary index idx_2. Waiting for it become active
2022/08/05 01:06:33 Index is 5125368158835598639 now active
2022/08/05 01:06:33 Executing alter index command: alter index `default`.idx_2 with {"action":"replica_count", "num_replica":1}
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
2022/08/05 01:06:55 Using n1ql client
--- PASS: TestAlterIndexDecrReplica (39.54s)
=== RUN   TestAlterIndexDropReplica
2022/08/05 01:06:55 In TestAlterIndexDropReplica()
2022/08/05 01:06:55 This test creates an index with two replicas and then drops one replica from cluster
2022/08/05 01:06:55 In DropAllSecondaryIndexes()
2022/08/05 01:06:55 Index found:  idx_2
2022/08/05 01:06:55 Dropped index idx_2
2022/08/05 01:07:11 Created the secondary index idx_3. Waiting for it become active
2022/08/05 01:07:11 Index is 9360231054120952166 now active
2022/08/05 01:07:11 Executing alter index command: alter index `default`.idx_3 with {"action":"drop_replica", "replicaId":0}
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:36 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
2022/08/05 01:07:37 Using n1ql client
--- PASS: TestAlterIndexDropReplica (41.63s)
=== RUN   TestResetCluster_1
2022/08/05 01:07:37 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2022-08-05T01:07:40.472+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:34244->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022-08-05T01:07:40.473+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = read tcp 127.0.0.1:39724->127.0.0.1:9118: use of closed network connection. Kill Pipe.
2022-08-05T01:07:40.473+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:41976->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T01:07:40.474+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = read tcp 127.0.0.1:39712->127.0.0.1:9118: use of closed network connection. Kill Pipe.
2022-08-05T01:07:40.474+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:41962->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T01:07:40.474+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:34246->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022/08/05 01:07:42 Rebalance progress: 87.5
2022/08/05 01:07:47 Rebalance progress: 100
2022/08/05 01:07:47 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 01:08:00 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2022/08/05 01:08:06 Rebalance progress: 100
--- PASS: TestResetCluster_1 (29.01s)
=== RUN   TestPartitionDistributionWithReplica
2022/08/05 01:08:06 In TestPartitionDistributionWithReplica()
2022/08/05 01:08:06 This test will create a paritioned index with replica and checks the parition distribution
2022/08/05 01:08:06 Parititions with same ID beloning to both replica and source index should not be on the same node
2022/08/05 01:08:06 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2022-08-05T01:08:08.867+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:50492->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T01:08:08.871+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:50496->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022/08/05 01:08:11 Rebalance progress: 100
2022/08/05 01:08:11 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 01:08:22 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2022/08/05 01:08:28 Rebalance progress: 100
2022/08/05 01:08:28 Adding node: https://127.0.0.1:19002 with role: index to the cluster
2022/08/05 01:08:35 AddNode: Successfully added node: 127.0.0.1:9002 (role index), response: {"otpNode":"n_2@127.0.0.1"}
2022-08-05T01:08:37.095+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:08:37.134+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:08:37.171+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2022-08-05T01:08:37.203+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:08:37.214+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2022/08/05 01:08:40 Rebalance progress: 100
2022/08/05 01:08:40 Adding node: https://127.0.0.1:19003 with role: index to the cluster
2022/08/05 01:08:47 AddNode: Successfully added node: 127.0.0.1:9003 (role index), response: {"otpNode":"n_3@127.0.0.1"}
2022-08-05T01:08:49.783+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:08:49.789+05:30 [Error] watcher.refreshServiceMap() Server Config Error : Key = IndexerNodeUUID : FDB_RESULT_KEY_NOT_FOUND
2022-08-05T01:08:49.793+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2022-08-05T01:08:49.798+05:30 [Error] updateIndexerList(): Cannot locate cluster node.
2022/08/05 01:08:52 Rebalance progress: 100
2022/08/05 01:08:52 In DropAllSecondaryIndexes()
2022/08/05 01:09:38 Flushed the bucket default, Response body: 
2022/08/05 01:09:38 Executing create partition index command on: create index `idx_partn` on `default`(age) partition by hash(meta().id) with {"num_partition":8, "num_replica":1}
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
2022/08/05 01:10:09 Using n1ql client
--- PASS: TestPartitionDistributionWithReplica (123.58s)
=== RUN   TestPartitionedPartialIndex
2022/08/05 01:10:09 Executing create index command: CREATE INDEX `idx_regular` ON `default`(partn_name)
2022/08/05 01:10:14 Using n1ql client
2022/08/05 01:10:14 Dropping the secondary index idx_regular
2022/08/05 01:10:14 Index dropped
2022/08/05 01:10:14 Executing create index command: CREATE INDEX `idx_partial` ON `default`(partn_name) WHERE partn_age >= 0
2022/08/05 01:10:19 Using n1ql client
2022/08/05 01:10:20 Using n1ql client
2022/08/05 01:10:20 Using n1ql client
2022/08/05 01:10:20 Dropping the secondary index idx_partial
2022/08/05 01:10:20 Index dropped
2022/08/05 01:10:20 Executing create index command: CREATE INDEX `idx_partitioned` ON `default`(partn_name) PARTITION BY HASH(meta().id) 
2022/08/05 01:10:28 Using n1ql client
2022/08/05 01:10:29 Using n1ql client
2022/08/05 01:10:29 Dropping the secondary index idx_partitioned
2022/08/05 01:10:30 Index dropped
2022/08/05 01:10:31 Executing create index command: CREATE INDEX `idx_partitioned_partial` ON `default`(partn_name) PARTITION BY HASH(meta().id) WHERE partn_age >= 0
2022/08/05 01:10:39 Using n1ql client
2022/08/05 01:10:39 Using n1ql client
2022/08/05 01:10:39 Using n1ql client
2022/08/05 01:10:39 Using n1ql client
2022/08/05 01:10:39 Dropping the secondary index idx_partitioned_partial
2022/08/05 01:10:39 Index dropped
--- PASS: TestPartitionedPartialIndex (40.02s)
=== RUN   TestResetCluster_2
2022/08/05 01:10:49 Removing node(s): [127.0.0.1:9001 127.0.0.1:9002 127.0.0.1:9003] from the cluster
2022-08-05T01:10:53.408+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:51806->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T01:10:53.409+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:44092->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022-08-05T01:10:53.410+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = read tcp 127.0.0.1:49562->127.0.0.1:9118: use of closed network connection. Kill Pipe.
2022-08-05T01:10:53.416+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9112.  Error = read tcp 127.0.0.1:44110->127.0.0.1:9112: use of closed network connection. Kill Pipe.
2022-08-05T01:10:53.417+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = read tcp 127.0.0.1:51800->127.0.0.1:9106: use of closed network connection. Kill Pipe.
2022-08-05T01:10:53.417+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9118.  Error = read tcp 127.0.0.1:49560->127.0.0.1:9118: use of closed network connection. Kill Pipe.
2022/08/05 01:10:55 Rebalance progress: 100
2022/08/05 01:10:55 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 01:10:56 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 01:10:57 Adding node: https://127.0.0.1:19001 with role: index to the cluster
2022/08/05 01:11:14 AddNode: Successfully added node: 127.0.0.1:9001 (role index), response: {"otpNode":"n_1@127.0.0.1"}
2022/08/05 01:11:19 Rebalance progress: 100
--- PASS: TestResetCluster_2 (30.13s)
=== RUN   TestCollectionSetup
2022/08/05 01:11:19 In TestCollectionSetup()
2022/08/05 01:11:19 In DropAllSecondaryIndexes()
2022/08/05 01:12:15 Flushed the bucket default, Response body: 
--- PASS: TestCollectionSetup (57.47s)
=== RUN   TestCollectionDefault
2022/08/05 01:12:17 In TestCollectionDefault()
2022/08/05 01:12:27 Created the secondary index _default__default_i1. Waiting for it become active
2022/08/05 01:12:27 Index is 17067939895135979459 now active
2022/08/05 01:12:27 Using n1ql client
2022/08/05 01:12:27 Expected and Actual scan responses are the same
2022/08/05 01:12:32 Created the secondary index _default__default_i2. Waiting for it become active
2022/08/05 01:12:32 Index is 6274208267587097508 now active
2022/08/05 01:12:32 Using n1ql client
2022/08/05 01:12:32 Expected and Actual scan responses are the same
2022/08/05 01:12:32 Dropping the secondary index _default__default_i1
2022/08/05 01:12:32 Index dropped
2022/08/05 01:12:32 Using n1ql client
2022/08/05 01:12:32 Expected and Actual scan responses are the same
2022/08/05 01:12:36 Created the secondary index _default__default_i1. Waiting for it become active
2022/08/05 01:12:36 Index is 7685692179277498906 now active
2022/08/05 01:12:36 Using n1ql client
2022/08/05 01:12:36 Expected and Actual scan responses are the same
2022/08/05 01:12:36 Dropping the secondary index _default__default_i1
2022/08/05 01:12:36 Index dropped
2022/08/05 01:12:36 Dropping the secondary index _default__default_i2
2022/08/05 01:12:37 Index dropped
2022/08/05 01:12:39 Created the secondary index _default__default_i1. Waiting for it become active
2022/08/05 01:12:39 Index is 5147271178544997774 now active
2022/08/05 01:12:39 Using n1ql client
2022/08/05 01:12:40 Expected and Actual scan responses are the same
2022/08/05 01:12:45 Created the secondary index _default__default_i2. Waiting for it become active
2022/08/05 01:12:45 Index is 10344599479454105196 now active
2022/08/05 01:12:45 Using n1ql client
2022/08/05 01:12:46 Expected and Actual scan responses are the same
2022/08/05 01:12:46 Dropping the secondary index _default__default_i1
2022/08/05 01:12:46 Index dropped
2022/08/05 01:12:46 Dropping the secondary index _default__default_i2
2022/08/05 01:12:46 Index dropped
2022/08/05 01:12:46 Build command issued for the deferred indexes [_default__default_i1 _default__default_i2]
2022/08/05 01:12:46 Waiting for the index _default__default_i1 to become active
2022/08/05 01:12:46 Waiting for index 6730625527747014194 to go active ...
2022/08/05 01:12:47 Waiting for index 6730625527747014194 to go active ...
2022/08/05 01:12:48 Waiting for index 6730625527747014194 to go active ...
2022/08/05 01:12:49 Index is 6730625527747014194 now active
2022/08/05 01:12:49 Waiting for the index _default__default_i2 to become active
2022/08/05 01:12:49 Index is 8811841136522100137 now active
2022/08/05 01:12:55 Using n1ql client
2022/08/05 01:12:55 Expected and Actual scan responses are the same
2022/08/05 01:12:55 Using n1ql client
2022/08/05 01:12:55 Expected and Actual scan responses are the same
2022/08/05 01:12:55 Dropping the secondary index _default__default_i1
2022/08/05 01:12:55 Index dropped
2022/08/05 01:13:01 Using n1ql client
2022/08/05 01:13:01 Expected and Actual scan responses are the same
2022/08/05 01:13:01 Dropping the secondary index _default__default_i2
2022/08/05 01:13:01 Index dropped
--- PASS: TestCollectionDefault (44.57s)
=== RUN   TestCollectionNonDefault
2022/08/05 01:13:01 In TestCollectionNonDefault()
2022/08/05 01:13:02 Creating scope: s1 for bucket: default as it does not exist
2022/08/05 01:13:02 Create scope succeeded for bucket default, scopeName: s1, body: {"uid":"1"} 
2022/08/05 01:13:02 Created collection succeeded for bucket: default, scope: s1, collection: c1, body: {"uid":"2"}
2022/08/05 01:13:16 Created the secondary index s1_c1_i1. Waiting for it become active
2022/08/05 01:13:16 Index is 5998921173147471689 now active
2022/08/05 01:13:16 Using n1ql client
2022-08-05T01:13:16.958+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-05T01:13:16.958+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-05T01:13:16.959+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-05T01:13:16.959+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-05T01:13:16.959+05:30 [Info] metadata provider version changed 3188 -> 3189
2022-08-05T01:13:16.959+05:30 [Info] switched currmeta from 3188 -> 3189 force false 
2022-08-05T01:13:16.960+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:13:16.968+05:30 [Info] GSIC[default/default-s1-c1-1659642196875679106] started ...
2022/08/05 01:13:17 Expected and Actual scan responses are the same
2022/08/05 01:13:23 Created the secondary index s1_c1_i2. Waiting for it become active
2022/08/05 01:13:23 Index is 16283950963151811686 now active
2022/08/05 01:13:23 Using n1ql client
2022/08/05 01:13:23 Expected and Actual scan responses are the same
2022/08/05 01:13:23 Dropping the secondary index s1_c1_i1
2022/08/05 01:13:23 Index dropped
2022/08/05 01:13:23 Using n1ql client
2022/08/05 01:13:23 Expected and Actual scan responses are the same
2022/08/05 01:13:28 Created the secondary index s1_c1_i1. Waiting for it become active
2022/08/05 01:13:28 Index is 14065371795423670226 now active
2022/08/05 01:13:28 Using n1ql client
2022/08/05 01:13:29 Expected and Actual scan responses are the same
2022/08/05 01:13:29 Dropping the secondary index s1_c1_i1
2022/08/05 01:13:29 Index dropped
2022/08/05 01:13:29 Dropping the secondary index s1_c1_i2
2022/08/05 01:13:29 Index dropped
2022/08/05 01:13:33 Created the secondary index s1_c1_i1. Waiting for it become active
2022/08/05 01:13:33 Index is 6989757059602017289 now active
2022/08/05 01:13:33 Using n1ql client
2022/08/05 01:13:33 Expected and Actual scan responses are the same
2022/08/05 01:13:38 Created the secondary index s1_c1_i2. Waiting for it become active
2022/08/05 01:13:38 Index is 15241888541294399215 now active
2022/08/05 01:13:38 Using n1ql client
2022/08/05 01:13:38 Expected and Actual scan responses are the same
2022/08/05 01:13:38 Dropping the secondary index s1_c1_i1
2022/08/05 01:13:38 Index dropped
2022/08/05 01:13:38 Dropping the secondary index s1_c1_i2
2022/08/05 01:13:39 Index dropped
2022/08/05 01:13:39 Build command issued for the deferred indexes [s1_c1_i1 s1_c1_i2]
2022/08/05 01:13:39 Waiting for the index s1_c1_i1 to become active
2022/08/05 01:13:39 Waiting for index 15617863764272889965 to go active ...
2022/08/05 01:13:40 Waiting for index 15617863764272889965 to go active ...
2022/08/05 01:13:41 Waiting for index 15617863764272889965 to go active ...
2022/08/05 01:13:42 Waiting for index 15617863764272889965 to go active ...
2022/08/05 01:13:43 Index is 15617863764272889965 now active
2022/08/05 01:13:43 Waiting for the index s1_c1_i2 to become active
2022/08/05 01:13:43 Index is 6451527761555485378 now active
2022/08/05 01:13:45 Using n1ql client
2022/08/05 01:13:45 Expected and Actual scan responses are the same
2022/08/05 01:13:45 Using n1ql client
2022/08/05 01:13:45 Expected and Actual scan responses are the same
2022/08/05 01:13:45 Dropping the secondary index s1_c1_i1
2022/08/05 01:13:46 Index dropped
2022/08/05 01:13:46 Using n1ql client
2022/08/05 01:13:46 Expected and Actual scan responses are the same
2022/08/05 01:13:46 Dropping the secondary index s1_c1_i2
2022/08/05 01:13:47 Index dropped
--- PASS: TestCollectionNonDefault (45.07s)
=== RUN   TestCollectionMetaAtSnapEnd
2022/08/05 01:13:47 In TestCollectionMetaAtSnapEnd()
2022/08/05 01:13:47 Creating scope: s2 for bucket: default as it does not exist
2022/08/05 01:13:47 Create scope succeeded for bucket default, scopeName: s2, body: {"uid":"3"} 
2022/08/05 01:13:47 Created collection succeeded for bucket: default, scope: s2, collection: c2, body: {"uid":"4"}
2022/08/05 01:14:00 Created the secondary index s2_c2_i1. Waiting for it become active
2022/08/05 01:14:00 Index is 2287468246902557325 now active
2022/08/05 01:14:00 Using n1ql client
2022-08-05T01:14:00.391+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-05T01:14:00.391+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-05T01:14:00.393+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2022-08-05T01:14:00.393+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2022-08-05T01:14:00.397+05:30 [Info] metadata provider version changed 3247 -> 3248
2022-08-05T01:14:00.397+05:30 [Info] switched currmeta from 3247 -> 3248 force false 
2022-08-05T01:14:00.397+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:14:00.398+05:30 [Info] GSIC[default/default-s2-c2-1659642240378902280] started ...
2022/08/05 01:14:00 Expected and Actual scan responses are the same
2022/08/05 01:14:02 Using n1ql client
2022/08/05 01:14:03 Expected and Actual scan responses are the same
2022/08/05 01:14:04 Created collection succeeded for bucket: default, scope: s2, collection: c3, body: {"uid":"5"}
2022/08/05 01:14:14 Using n1ql client
2022/08/05 01:14:14 Expected and Actual scan responses are the same
2022/08/05 01:14:18 Created the secondary index s2_c2_i2. Waiting for it become active
2022/08/05 01:14:18 Index is 18166253358858942803 now active
2022/08/05 01:14:18 Using n1ql client
2022/08/05 01:14:18 Expected and Actual scan responses are the same
2022/08/05 01:14:18 Using n1ql client
2022/08/05 01:14:18 Expected and Actual scan responses are the same
2022/08/05 01:14:25 Using n1ql client
2022/08/05 01:14:25 Expected and Actual scan responses are the same
2022/08/05 01:14:25 Using n1ql client
2022/08/05 01:14:25 Expected and Actual scan responses are the same
--- PASS: TestCollectionMetaAtSnapEnd (38.46s)
=== RUN   TestCollectionUpdateSeq
2022/08/05 01:14:25 In TestCollectionUpdateSeq()
2022/08/05 01:14:26 Using n1ql client
2022/08/05 01:14:26 Expected and Actual scan responses are the same
2022/08/05 01:14:26 Using n1ql client
2022/08/05 01:14:26 Expected and Actual scan responses are the same
2022/08/05 01:14:32 Using n1ql client
2022/08/05 01:14:32 Expected and Actual scan responses are the same
2022/08/05 01:14:32 Using n1ql client
2022/08/05 01:14:32 Expected and Actual scan responses are the same
2022/08/05 01:14:32 Dropping the secondary index s2_c2_i1
2022/08/05 01:14:32 Index dropped
2022/08/05 01:14:32 Dropping the secondary index s2_c2_i2
2022/08/05 01:14:32 Index dropped
--- PASS: TestCollectionUpdateSeq (7.02s)
=== RUN   TestCollectionMultiple
2022/08/05 01:14:32 In TestCollectionMultiple()
2022/08/05 01:14:36 Created the secondary index _default__default_i3. Waiting for it become active
2022/08/05 01:14:36 Index is 4529162324147030336 now active
2022/08/05 01:14:36 Using n1ql client
2022/08/05 01:14:36 Expected and Actual scan responses are the same
2022/08/05 01:14:41 Created the secondary index s1_c1_i4. Waiting for it become active
2022/08/05 01:14:41 Index is 5759232391222743959 now active
2022/08/05 01:14:41 Using n1ql client
2022/08/05 01:14:42 Expected and Actual scan responses are the same
2022/08/05 01:14:42 Dropping the secondary index _default__default_i3
2022/08/05 01:14:43 Index dropped
2022/08/05 01:14:43 Dropping the secondary index s1_c1_i4
2022/08/05 01:14:43 Index dropped
--- PASS: TestCollectionMultiple (10.64s)
=== RUN   TestCollectionNoDocs
2022/08/05 01:14:43 In TestCollectionNoDocs()
2022/08/05 01:14:48 Created the secondary index s1_c1_i1. Waiting for it become active
2022/08/05 01:14:48 Index is 2983296039189735125 now active
2022/08/05 01:14:48 Using n1ql client
2022/08/05 01:14:48 Expected and Actual scan responses are the same
2022/08/05 01:14:53 Created the secondary index s1_c1_i2. Waiting for it become active
2022/08/05 01:14:53 Index is 9648634243171495966 now active
2022/08/05 01:14:53 Using n1ql client
2022/08/05 01:14:54 Expected and Actual scan responses are the same
2022/08/05 01:14:54 Dropping the secondary index s1_c1_i1
2022/08/05 01:14:54 Index dropped
2022/08/05 01:14:54 Using n1ql client
2022/08/05 01:14:54 Expected and Actual scan responses are the same
2022/08/05 01:14:59 Created the secondary index s1_c1_i1. Waiting for it become active
2022/08/05 01:14:59 Index is 16728369858421826976 now active
2022/08/05 01:14:59 Using n1ql client
2022/08/05 01:15:00 Expected and Actual scan responses are the same
2022/08/05 01:15:06 Using n1ql client
2022/08/05 01:15:06 Expected and Actual scan responses are the same
2022/08/05 01:15:06 Using n1ql client
2022/08/05 01:15:06 Expected and Actual scan responses are the same
2022/08/05 01:15:06 Dropping the secondary index s1_c1_i1
2022/08/05 01:15:06 Index dropped
2022/08/05 01:15:06 Dropping the secondary index s1_c1_i2
2022/08/05 01:15:06 Index dropped
--- PASS: TestCollectionNoDocs (23.18s)
=== RUN   TestCollectionPrimaryIndex
2022/08/05 01:15:06 In TestCollectionPrimaryIndex()
2022/08/05 01:15:11 Created the secondary index s1_c1_i1. Waiting for it become active
2022/08/05 01:15:11 Index is 15836557696313291372 now active
2022/08/05 01:15:11 Using n1ql client
2022/08/05 01:15:18 Created the secondary index s1_c1_i2. Waiting for it become active
2022/08/05 01:15:18 Index is 4610018639878791161 now active
2022/08/05 01:15:18 Using n1ql client
2022/08/05 01:15:20 Using n1ql client
2022/08/05 01:15:20 Using n1ql client
2022/08/05 01:15:20 Dropping the secondary index s1_c1_i1
2022/08/05 01:15:20 Index dropped
2022/08/05 01:15:26 Created the secondary index s1_c1_i1. Waiting for it become active
2022/08/05 01:15:26 Index is 129656875178812180 now active
2022/08/05 01:15:26 Using n1ql client
2022/08/05 01:15:26 Expected and Actual scan responses are the same
2022/08/05 01:15:27 Using n1ql client
2022/08/05 01:15:27 Expected and Actual scan responses are the same
2022/08/05 01:15:27 Using n1ql client
2022/08/05 01:15:27 Dropping the secondary index s1_c1_i1
2022/08/05 01:15:27 Index dropped
2022/08/05 01:15:27 Dropping the secondary index s1_c1_i2
2022/08/05 01:15:27 Index dropped
--- PASS: TestCollectionPrimaryIndex (21.07s)
=== RUN   TestCollectionMultipleBuilds
2022/08/05 01:15:27 Build command issued for the deferred indexes [17669069459754917004 15010609486728396950]
2022/08/05 01:15:27 Build command issued for the deferred indexes [1095188148845646669 9114420160039344427]
2022/08/05 01:15:27 Waiting for index 17669069459754917004 to go active ...
2022/08/05 01:15:28 Waiting for index 17669069459754917004 to go active ...
2022/08/05 01:15:29 Waiting for index 17669069459754917004 to go active ...
2022/08/05 01:15:30 Waiting for index 17669069459754917004 to go active ...
2022/08/05 01:15:31 Index is 17669069459754917004 now active
2022/08/05 01:15:31 Index is 15010609486728396950 now active
2022/08/05 01:15:31 Waiting for index 1095188148845646669 to go active ...
2022/08/05 01:15:32 Waiting for index 1095188148845646669 to go active ...
2022/08/05 01:15:33 Waiting for index 1095188148845646669 to go active ...
2022/08/05 01:15:34 Waiting for index 1095188148845646669 to go active ...
2022/08/05 01:15:35 Waiting for index 1095188148845646669 to go active ...
2022/08/05 01:15:36 Waiting for index 1095188148845646669 to go active ...
2022/08/05 01:15:37 Waiting for index 1095188148845646669 to go active ...
2022/08/05 01:15:38 Waiting for index 1095188148845646669 to go active ...
2022/08/05 01:15:39 Index is 1095188148845646669 now active
2022/08/05 01:15:39 Index is 9114420160039344427 now active
2022/08/05 01:15:39 Using n1ql client
2022/08/05 01:15:39 Expected and Actual scan responses are the same
2022/08/05 01:15:39 Using n1ql client
2022/08/05 01:15:39 Expected and Actual scan responses are the same
2022/08/05 01:15:39 Using n1ql client
2022/08/05 01:15:39 Expected and Actual scan responses are the same
2022/08/05 01:15:39 Using n1ql client
2022/08/05 01:15:39 Expected and Actual scan responses are the same
2022/08/05 01:15:39 Dropping the secondary index s2_c2_i3
2022/08/05 01:15:40 Index dropped
2022/08/05 01:15:40 Dropping the secondary index s2_c2_i4
2022/08/05 01:15:40 Index dropped
2022/08/05 01:15:40 Dropping the secondary index s1_c1_i1
2022/08/05 01:15:40 Index dropped
2022/08/05 01:15:40 Dropping the secondary index s1_c1_i2
2022/08/05 01:15:40 Index dropped
--- PASS: TestCollectionMultipleBuilds (12.87s)
=== RUN   TestCollectionMultipleBuilds2
2022/08/05 01:15:40 Build command issued for the deferred indexes [17075779154122312880 12331572603102156899 12338228113722813640 11031733381850721827 3151774100658995633 10419428046959022343 9177545309422323388 2948312859540240760]
2022/08/05 01:15:40 Waiting for index 17075779154122312880 to go active ...
2022/08/05 01:15:41 Waiting for index 17075779154122312880 to go active ...
2022/08/05 01:15:42 Waiting for index 17075779154122312880 to go active ...
2022/08/05 01:15:43 Waiting for index 17075779154122312880 to go active ...
2022/08/05 01:15:44 Waiting for index 17075779154122312880 to go active ...
2022/08/05 01:15:45 Index is 17075779154122312880 now active
2022/08/05 01:15:45 Index is 12331572603102156899 now active
2022/08/05 01:15:45 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:46 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:47 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:48 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:49 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:50 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:51 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:52 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:53 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:54 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:55 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:56 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:57 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:58 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:15:59 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:16:00 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:16:01 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:16:02 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:16:03 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:16:04 Waiting for index 12338228113722813640 to go active ...
2022/08/05 01:16:05 Index is 12338228113722813640 now active
2022/08/05 01:16:05 Index is 11031733381850721827 now active
2022/08/05 01:16:05 Waiting for index 3151774100658995633 to go active ...
2022/08/05 01:16:06 Index is 3151774100658995633 now active
2022/08/05 01:16:06 Index is 10419428046959022343 now active
2022/08/05 01:16:06 Index is 9177545309422323388 now active
2022/08/05 01:16:06 Index is 2948312859540240760 now active
2022/08/05 01:16:06 Using n1ql client
2022/08/05 01:16:06 Expected and Actual scan responses are the same
2022/08/05 01:16:06 Using n1ql client
2022/08/05 01:16:06 Expected and Actual scan responses are the same
2022/08/05 01:16:06 Using n1ql client
2022/08/05 01:16:07 Expected and Actual scan responses are the same
2022/08/05 01:16:07 Using n1ql client
2022/08/05 01:16:07 Expected and Actual scan responses are the same
2022/08/05 01:16:07 Using n1ql client
2022-08-05T01:16:07.064+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:16:07.064+05:30 [Info] GSIC[default/default-s2-c3-1659642367060184035] started ...
2022/08/05 01:16:07 Expected and Actual scan responses are the same
2022/08/05 01:16:07 Using n1ql client
2022/08/05 01:16:07 Expected and Actual scan responses are the same
2022/08/05 01:16:07 Using n1ql client
2022/08/05 01:16:07 Expected and Actual scan responses are the same
2022/08/05 01:16:07 Using n1ql client
2022/08/05 01:16:07 Expected and Actual scan responses are the same
2022/08/05 01:16:08 Using n1ql client
2022/08/05 01:16:08 Expected and Actual scan responses are the same
2022/08/05 01:16:08 Using n1ql client
2022/08/05 01:16:08 Expected and Actual scan responses are the same
2022/08/05 01:16:08 Dropping the secondary index s1_c1_i1
2022/08/05 01:16:08 Index dropped
2022/08/05 01:16:08 Dropping the secondary index s1_c1_i2
2022/08/05 01:16:08 Index dropped
2022/08/05 01:16:08 Dropping the secondary index s2_c2_i1
2022/08/05 01:16:08 Index dropped
2022/08/05 01:16:08 Dropping the secondary index s2_c2_i2
2022/08/05 01:16:08 Index dropped
2022/08/05 01:16:08 Dropping the secondary index s2_c3_i1
2022/08/05 01:16:08 Index dropped
2022/08/05 01:16:08 Dropping the secondary index s2_c3_i2
2022/08/05 01:16:09 Index dropped
2022/08/05 01:16:09 Dropping the secondary index _default__default_i1
2022/08/05 01:16:09 Index dropped
2022/08/05 01:16:09 Dropping the secondary index _default__default_i2
2022/08/05 01:16:09 Index dropped
--- PASS: TestCollectionMultipleBuilds2 (28.97s)
=== RUN   TestCollectionIndexDropConcurrentBuild
2022/08/05 01:16:09 In TestCollectionIndexDropConcurrentBuild()
2022/08/05 01:16:09 Build command issued for the deferred indexes [3123569631187955265 1035844783328951066]
2022/08/05 01:16:10 Dropping the secondary index s1_c1_i1
2022/08/05 01:16:10 Index dropped
2022/08/05 01:16:10 Waiting for index 1035844783328951066 to go active ...
2022/08/05 01:16:11 Waiting for index 1035844783328951066 to go active ...
2022/08/05 01:16:12 Waiting for index 1035844783328951066 to go active ...
2022/08/05 01:16:13 Index is 1035844783328951066 now active
2022/08/05 01:16:13 Using n1ql client
2022/08/05 01:16:13 Expected and Actual scan responses are the same
2022/08/05 01:16:13 Dropping the secondary index s1_c1_i2
2022/08/05 01:16:13 Index dropped
--- PASS: TestCollectionIndexDropConcurrentBuild (4.50s)
=== RUN   TestCollectionIndexDropConcurrentBuild2
2022/08/05 01:16:13 In TestCollectionIndexDropConcurrentBuild2()
2022/08/05 01:16:19 Created the secondary index s1_c1_i3. Waiting for it become active
2022/08/05 01:16:19 Index is 1226745591250248146 now active
2022/08/05 01:16:19 Using n1ql client
2022-08-05T01:16:19.486+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] Range(-6449368208735330529) response failed `Index not found`
2022-08-05T01:16:19.496+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] Range(-6449368208735330529) response failed `Index not found`
2022-08-05T01:16:19.499+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] Range(-6449368208735330529) response failed `Index not found`
2022-08-05T01:16:19.502+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] Range(-6449368208735330529) response failed `Index not found`
2022/08/05 01:16:19 Expected and Actual scan responses are the same
2022/08/05 01:16:20 Build command issued for the deferred indexes [13307009981331186866 14695039620366973711]
2022/08/05 01:16:21 Dropping the secondary index s1_c1_i3
2022/08/05 01:16:21 Index dropped
2022/08/05 01:16:21 Waiting for index 13307009981331186866 to go active ...
2022/08/05 01:16:22 Waiting for index 13307009981331186866 to go active ...
2022/08/05 01:16:23 Waiting for index 13307009981331186866 to go active ...
2022/08/05 01:16:24 Waiting for index 13307009981331186866 to go active ...
2022/08/05 01:16:25 Waiting for index 13307009981331186866 to go active ...
2022/08/05 01:16:26 Waiting for index 13307009981331186866 to go active ...
2022/08/05 01:16:27 Index is 13307009981331186866 now active
2022/08/05 01:16:27 Index is 14695039620366973711 now active
2022/08/05 01:16:27 Using n1ql client
2022/08/05 01:16:27 Expected and Actual scan responses are the same
2022/08/05 01:16:27 Using n1ql client
2022/08/05 01:16:28 Expected and Actual scan responses are the same
2022/08/05 01:16:28 Dropping the secondary index s1_c1_i1
2022/08/05 01:16:28 Index dropped
2022/08/05 01:16:28 Dropping the secondary index s1_c1_i2
2022/08/05 01:16:31 Index dropped
--- PASS: TestCollectionIndexDropConcurrentBuild2 (17.36s)
=== RUN   TestCollectionDrop
2022/08/05 01:16:31 In TestCollectionDrop()
2022/08/05 01:16:35 Created the secondary index s1_c1_i1. Waiting for it become active
2022/08/05 01:16:35 Index is 18333642061613002899 now active
2022/08/05 01:16:41 Created the secondary index s1_c1_i2. Waiting for it become active
2022/08/05 01:16:41 Index is 16307561777231111842 now active
2022/08/05 01:16:46 Created the secondary index s2_c2_i1. Waiting for it become active
2022/08/05 01:16:46 Index is 624134080860707413 now active
2022/08/05 01:16:51 Created the secondary index s2_c2_i2. Waiting for it become active
2022/08/05 01:16:51 Index is 18066065133050291454 now active
2022/08/05 01:16:56 Created the secondary index s2_c3_i1. Waiting for it become active
2022/08/05 01:16:56 Index is 12485795215928531679 now active
2022/08/05 01:17:00 Created the secondary index s2_c3_i2. Waiting for it become active
2022/08/05 01:17:00 Index is 7793864368112576204 now active
2022/08/05 01:17:05 Created the secondary index _default__default_i1. Waiting for it become active
2022/08/05 01:17:05 Index is 8596455293465113455 now active
2022/08/05 01:17:09 Created the secondary index _default__default_i2. Waiting for it become active
2022/08/05 01:17:09 Index is 9645137700348878803 now active
2022/08/05 01:17:09 Dropped collection c1 for bucket: default, scope: s1, body: {"uid":"6"}
2022/08/05 01:17:14 Using n1ql client
2022/08/05 01:17:14 Scan failed as expected with error: Index Not Found - cause: GSI index s1_c1_i1 not found.
2022/08/05 01:17:15 Dropped scope s2 for bucket: default, body: {"uid":"7"}
2022/08/05 01:17:20 Using n1ql client
2022-08-05T01:17:20.026+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:17:20.026+05:30 [Info] GSIC[default/default-s2-c1-1659642440020249219] started ...
2022/08/05 01:17:20 Scan failed as expected with error: Index Not Found - cause: GSI index s2_c1_i1 not found.
--- PASS: TestCollectionDrop (48.93s)
=== RUN   TestCollectionDDLWithConcurrentSystemEvents
2022/08/05 01:17:20 Creating scope: sc for bucket: default as it does not exist
2022/08/05 01:17:20 Create scope succeeded for bucket default, scopeName: sc, body: {"uid":"8"} 
2022/08/05 01:17:20 Created collection succeeded for bucket: default, scope: sc, collection: cc, body: {"uid":"9"}
2022/08/05 01:17:34 Created the secondary index sc_cc_i1. Waiting for it become active
2022/08/05 01:17:34 Index is 12532325671466055326 now active
2022/08/05 01:17:36 Build command issued for the deferred indexes [sc_cc_i2]
2022/08/05 01:17:36 Waiting for the index sc_cc_i2 to become active
2022/08/05 01:17:36 Waiting for index 2075698069322621323 to go active ...
2022/08/05 01:17:37 Created collection succeeded for bucket: default, scope: sc, collection: cc_0, body: {"uid":"a"}
2022/08/05 01:17:37 Created collection succeeded for bucket: default, scope: sc, collection: cc_1, body: {"uid":"b"}
2022/08/05 01:17:37 Created collection succeeded for bucket: default, scope: sc, collection: cc_2, body: {"uid":"c"}
2022/08/05 01:17:37 Waiting for index 2075698069322621323 to go active ...
2022/08/05 01:17:38 Created collection succeeded for bucket: default, scope: sc, collection: cc_3, body: {"uid":"d"}
2022/08/05 01:17:38 Created collection succeeded for bucket: default, scope: sc, collection: cc_4, body: {"uid":"e"}
2022/08/05 01:17:38 Created collection succeeded for bucket: default, scope: sc, collection: cc_5, body: {"uid":"f"}
2022/08/05 01:17:38 Waiting for index 2075698069322621323 to go active ...
2022/08/05 01:17:39 Created collection succeeded for bucket: default, scope: sc, collection: cc_6, body: {"uid":"10"}
2022/08/05 01:17:39 Created collection succeeded for bucket: default, scope: sc, collection: cc_7, body: {"uid":"11"}
2022/08/05 01:17:39 Created collection succeeded for bucket: default, scope: sc, collection: cc_8, body: {"uid":"12"}
2022/08/05 01:17:39 Waiting for index 2075698069322621323 to go active ...
2022/08/05 01:17:40 Created collection succeeded for bucket: default, scope: sc, collection: cc_9, body: {"uid":"13"}
2022/08/05 01:17:40 Waiting for index 2075698069322621323 to go active ...
2022/08/05 01:17:41 Waiting for index 2075698069322621323 to go active ...
2022/08/05 01:17:42 Waiting for index 2075698069322621323 to go active ...
2022/08/05 01:17:43 Index is 2075698069322621323 now active
2022/08/05 01:17:43 Using n1ql client
2022-08-05T01:17:43.832+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:17:43.832+05:30 [Info] GSIC[default/default-sc-cc-1659642463829377355] started ...
--- PASS: TestCollectionDDLWithConcurrentSystemEvents (23.81s)
=== RUN   TestCollectionDropWithMultipleBuckets
2022/08/05 01:17:43 In TestCollectionWithDropMultipleBuckets()
2022/08/05 01:17:43 This test will create a collection across multiple buckets and 
2022/08/05 01:17:43 drops a collection on one bucket. Indexer should not drop indexes
2022/08/05 01:17:43 with same CollectionID but different buckets
2022/08/05 01:17:43 Creating test_bucket_1
2022/08/05 01:17:43 Created bucket test_bucket_1, responseBody: 
2022/08/05 01:17:53 Creating test_bucket_2
2022/08/05 01:17:54 Created bucket test_bucket_2, responseBody: 
2022/08/05 01:18:04 Creating collection: test for bucket: test_bucket_1
2022/08/05 01:18:04 Created collection succeeded for bucket: test_bucket_1, scope: _default, collection: test, body: {"uid":"1"}
2022/08/05 01:18:04 Creating collection: test for bucket: test_bucket_2
2022/08/05 01:18:04 Created collection succeeded for bucket: test_bucket_2, scope: _default, collection: test, body: {"uid":"1"}
2022/08/05 01:18:14 Creating Index: idx_1 on scope: _default collection: test for bucket: test_bucket_1
2022/08/05 01:18:17 Created the secondary index idx_1. Waiting for it become active
2022/08/05 01:18:17 Index is 2704846849394439163 now active
2022-08-05T01:18:19.488+05:30 [Error] receiving packet: read tcp 127.0.0.1:38098->127.0.0.1:9107: i/o timeout
2022-08-05T01:18:19.488+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] req(-6449368208735330529) connection "127.0.0.1:38098" response transport failed `read tcp 127.0.0.1:38098->127.0.0.1:9107: i/o timeout`
2022-08-05T01:18:19.498+05:30 [Error] receiving packet: read tcp 127.0.0.1:48762->127.0.0.1:9107: i/o timeout
2022-08-05T01:18:19.498+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] req(-6449368208735330529) connection "127.0.0.1:48762" response transport failed `read tcp 127.0.0.1:48762->127.0.0.1:9107: i/o timeout`
2022-08-05T01:18:19.500+05:30 [Error] receiving packet: read tcp 127.0.0.1:48764->127.0.0.1:9107: i/o timeout
2022-08-05T01:18:19.500+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] req(-6449368208735330529) connection "127.0.0.1:48764" response transport failed `read tcp 127.0.0.1:48764->127.0.0.1:9107: i/o timeout`
2022-08-05T01:18:19.503+05:30 [Error] receiving packet: read tcp 127.0.0.1:48766->127.0.0.1:9107: i/o timeout
2022-08-05T01:18:19.503+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] req(-6449368208735330529) connection "127.0.0.1:48766" response transport failed `read tcp 127.0.0.1:48766->127.0.0.1:9107: i/o timeout`
2022/08/05 01:18:22 Creating Index: idx_1 on scope: _default collection: test for bucket: test_bucket_2
2022/08/05 01:18:25 Created the secondary index idx_1. Waiting for it become active
2022/08/05 01:18:25 Index is 6240670328915896399 now active
2022/08/05 01:18:30 Dropping collection: test for bucket: test_bucket_1
2022/08/05 01:18:31 Dropped collection test for bucket: test_bucket_1, scope: _default, body: {"uid":"2"}
2022/08/05 01:18:33 Scanning index: idx_1, bucket: test_bucket_2
2022/08/05 01:18:33 Using n1ql client
2022-08-05T01:18:33.039+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:18:33.040+05:30 [Info] GSIC[default/test_bucket_2-_default-test-1659642513037498055] started ...
2022/08/05 01:18:33 Deleting bucket: test_bucket_2
2022/08/05 01:18:34 Deleted bucket test_bucket_2, responseBody: 
2022/08/05 01:18:39 Creating test_bucket_2
2022/08/05 01:18:39 Created bucket test_bucket_2, responseBody: 
2022/08/05 01:18:49 Creating collection: test for bucket: test_bucket_2
2022/08/05 01:18:49 Created collection succeeded for bucket: test_bucket_2, scope: _default, collection: test, body: {"uid":"1"}
2022/08/05 01:18:59 Creating Index: idx_1 on scope: _default collection: test for bucket: test_bucket_2
2022/08/05 01:19:04 Build command issued for the deferred indexes [idx_1]
2022/08/05 01:19:04 Waiting for the index idx_1 to become active
2022/08/05 01:19:04 Waiting for index 7019994873248178441 to go active ...
2022/08/05 01:19:05 Waiting for index 7019994873248178441 to go active ...
2022/08/05 01:19:06 Waiting for index 7019994873248178441 to go active ...
2022/08/05 01:19:07 Index is 7019994873248178441 now active
2022/08/05 01:19:07 Scanning index: idx_1, bucket: test_bucket_2
2022/08/05 01:19:07 Using n1ql client
2022/08/05 01:19:09 Deleted bucket test_bucket_1, responseBody: 
2022/08/05 01:19:11 Deleted bucket test_bucket_2, responseBody: 
--- PASS: TestCollectionDropWithMultipleBuckets (92.48s)
=== RUN   TestStringToByteSlice
--- PASS: TestStringToByteSlice (0.00s)
=== RUN   TestStringToByteSlice_Stack
--- PASS: TestStringToByteSlice_Stack (1.34s)
=== RUN   TestByteSliceToString
--- PASS: TestByteSliceToString (0.00s)
=== RUN   TestBytesToString_WithUnusedBytes
--- PASS: TestBytesToString_WithUnusedBytes (0.00s)
=== RUN   TestStringHeadersCompatible
--- PASS: TestStringHeadersCompatible (0.00s)
=== RUN   TestSliceHeadersCompatible
--- PASS: TestSliceHeadersCompatible (0.00s)
=== RUN   TestEphemeralBucketBasic
2022/08/05 01:19:17 In TestEphemeralBuckets()
2022/08/05 01:19:17 In DropAllSecondaryIndexes()
2022/08/05 01:19:17 Index found:  _default__default_i1
2022/08/05 01:19:17 Dropped index _default__default_i1
2022/08/05 01:19:17 Index found:  sc_cc_i2
2022/08/05 01:19:17 Dropped index sc_cc_i2
2022/08/05 01:19:17 Index found:  sc_cc_i1
2022/08/05 01:19:17 Dropped index sc_cc_i1
2022/08/05 01:19:17 Index found:  _default__default_i2
2022/08/05 01:19:17 Dropped index _default__default_i2
2022/08/05 01:19:54 Flushed the bucket default, Response body: 
2022/08/05 01:19:57 Modified parameters of bucket default, responseBody: 
2022/08/05 01:19:57 Created bucket ephemeral1, responseBody: 
2022/08/05 01:19:57 Created bucket ephemeral2, responseBody: 
2022/08/05 01:19:57 Created bucket ephemeral3, responseBody: 
2022/08/05 01:20:12 Generating docs and Populating all the buckets
2022/08/05 01:20:16 Created the secondary index bucket1_age. Waiting for it become active
2022/08/05 01:20:16 Index is 11140223518051022115 now active
2022/08/05 01:20:24 Created the secondary index bucket2_city. Waiting for it become active
2022/08/05 01:20:24 Index is 2382740671981180899 now active
2022/08/05 01:20:30 Created the secondary index bucket3_gender. Waiting for it become active
2022/08/05 01:20:30 Index is 14366216193895812572 now active
2022/08/05 01:20:36 Created the secondary index bucket4_balance. Waiting for it become active
2022/08/05 01:20:36 Index is 617684155596060499 now active
2022/08/05 01:20:39 Using n1ql client
2022/08/05 01:20:39 Expected and Actual scan responses are the same
2022/08/05 01:20:39 Using n1ql client
2022-08-05T01:20:39.701+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:20:39.701+05:30 [Info] GSIC[default/ephemeral1-_default-_default-1659642639698086754] started ...
2022/08/05 01:20:39 Expected and Actual scan responses are the same
2022/08/05 01:20:39 Using n1ql client
2022-08-05T01:20:39.715+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:20:39.715+05:30 [Info] GSIC[default/ephemeral2-_default-_default-1659642639711253261] started ...
2022/08/05 01:20:39 Expected and Actual scan responses are the same
2022/08/05 01:20:39 Using n1ql client
2022-08-05T01:20:39.725+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:20:39.725+05:30 [Info] GSIC[default/ephemeral3-_default-_default-1659642639722194952] started ...
2022/08/05 01:20:39 Expected and Actual scan responses are the same
2022/08/05 01:20:41 Deleted bucket ephemeral1, responseBody: 
2022/08/05 01:20:42 Deleted bucket ephemeral2, responseBody: 
2022/08/05 01:20:43 Deleted bucket ephemeral3, responseBody: 
2022/08/05 01:20:46 Modified parameters of bucket default, responseBody: 
--- PASS: TestEphemeralBucketBasic (104.10s)
=== RUN   TestEphemeralBucketRecovery
2022/08/05 01:21:01 In TestEphemeralBucketRecovery()
2022/08/05 01:21:01 In DropAllSecondaryIndexes()
2022/08/05 01:21:01 Index found:  bucket1_age
2022/08/05 01:21:01 Dropped index bucket1_age
2022/08/05 01:21:37 Flushed the bucket default, Response body: 
2022/08/05 01:21:40 Modified parameters of bucket default, responseBody: 
2022/08/05 01:21:40 Created bucket ephemeral1, responseBody: 
2022/08/05 01:21:55 Generating docs and Populating all the buckets
2022/08/05 01:21:59 Created the secondary index bucket1_age. Waiting for it become active
2022/08/05 01:21:59 Index is 9592776642801916038 now active
2022/08/05 01:22:05 Created the secondary index bucket2_city. Waiting for it become active
2022/08/05 01:22:05 Index is 16179762919794748100 now active
Restarting indexer process ...
2022/08/05 01:22:08 []
2022-08-05T01:22:08.444+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:22:08.444+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:22:08.444+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:22:08.444+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:22:28 Using n1ql client
2022-08-05T01:22:28.395+05:30 [Error] transport error between 127.0.0.1:48768->127.0.0.1:9107: write tcp 127.0.0.1:48768->127.0.0.1:9107: write: broken pipe
2022-08-05T01:22:28.395+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 3840450815267591338 request transport failed `write tcp 127.0.0.1:48768->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:22:28.395+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:22:28.395+05:30 [Error] metadataClient:PickRandom: Replicas - [12881229391332334732], PrunedReplica - map[], FilteredReplica map[]
2022/08/05 01:22:28 Expected and Actual scan responses are the same
2022/08/05 01:22:28 Using n1ql client
2022-08-05T01:22:28.417+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:22:28.469+05:30 [Info] GSIC[default/ephemeral1-_default-_default-1659642748414604765] started ...
2022/08/05 01:22:28 Expected and Actual scan responses are the same
2022/08/05 01:22:30 Deleted bucket ephemeral1, responseBody: 
2022/08/05 01:22:33 Modified parameters of bucket default, responseBody: 
--- PASS: TestEphemeralBucketRecovery (106.43s)
=== RUN   TestEphemeralBucketFlush
2022/08/05 01:22:48 In TestEphemeralBucketFlush()
2022/08/05 01:22:48 In DropAllSecondaryIndexes()
2022/08/05 01:22:48 Index found:  bucket1_age
2022/08/05 01:22:48 Dropped index bucket1_age
2022/08/05 01:23:23 Flushed the bucket default, Response body: 
2022/08/05 01:23:26 Modified parameters of bucket default, responseBody: 
2022/08/05 01:23:26 Created bucket ephemeral1, responseBody: 
2022/08/05 01:23:41 Generating docs and Populating all the buckets
2022/08/05 01:23:45 Created the secondary index bucket1_age. Waiting for it become active
2022/08/05 01:23:45 Index is 6319654207674488497 now active
2022/08/05 01:23:51 Created the secondary index bucket2_city. Waiting for it become active
2022/08/05 01:23:51 Index is 335080071859428298 now active
2022/08/05 01:24:29 Flushed the bucket default, Response body: 
2022/08/05 01:24:32 Flush Enabled on bucket ephemeral1, responseBody: 
2022/08/05 01:25:05 Flushed the bucket ephemeral1, Response body: 
2022/08/05 01:25:05 Using n1ql client
2022/08/05 01:25:05 Using n1ql client
2022-08-05T01:25:05.818+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:25:05.819+05:30 [Info] GSIC[default/ephemeral1-_default-_default-1659642905815645294] started ...
2022/08/05 01:25:06 Deleted bucket ephemeral1, responseBody: 
2022/08/05 01:25:10 Modified parameters of bucket default, responseBody: 
--- PASS: TestEphemeralBucketFlush (156.89s)
=== RUN   TestEphemeralBucketMCDCrash
2022/08/05 01:25:25 In TestEphemeralBucketMCDCrash()
2022/08/05 01:25:25 In DropAllSecondaryIndexes()
2022/08/05 01:25:25 Index found:  bucket1_age
2022/08/05 01:25:25 Dropped index bucket1_age
2022/08/05 01:26:00 Flushed the bucket default, Response body: 
2022/08/05 01:26:03 Modified parameters of bucket default, responseBody: 
2022/08/05 01:26:03 Created bucket ephemeral1, responseBody: 
2022/08/05 01:26:18 Generating docs and Populating all the buckets
2022/08/05 01:26:22 Created the secondary index bucket1_age. Waiting for it become active
2022/08/05 01:26:22 Index is 3927961462526920989 now active
2022/08/05 01:26:28 Created the secondary index bucket2_city. Waiting for it become active
2022/08/05 01:26:28 Index is 13740668352666141333 now active
Restarting memcached process ...
2022/08/05 01:26:31 []
2022/08/05 01:26:51 Using n1ql client
2022/08/05 01:26:51 Expected and Actual scan responses are the same
2022/08/05 01:26:51 Using n1ql client
2022-08-05T01:26:51.476+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2022-08-05T01:26:51.476+05:30 [Info] GSIC[default/ephemeral1-_default-_default-1659643011473905932] started ...
2022/08/05 01:26:52 Deleted bucket ephemeral1, responseBody: 
2022/08/05 01:26:55 Modified parameters of bucket default, responseBody: 
--- PASS: TestEphemeralBucketMCDCrash (105.77s)
=== RUN   TestScheduleIndexBasic
2022/08/05 01:27:10 In TestMultipleDeferredIndexes_BuildTogether()
2022/08/05 01:27:10 In DropAllSecondaryIndexes()
2022/08/05 01:27:10 Index found:  bucket1_age
2022/08/05 01:27:10 Dropped index bucket1_age
2022/08/05 01:27:24 Setting JSON docs in KV
2022/08/05 01:27:40 Changing config key indexer.debug.enableBackgroundIndexCreation to value false
2022/08/05 01:27:40 Creating indexes Asynchronously
2022/08/05 01:27:40 Finding definition IDs for all indexes
2022/08/05 01:27:43 Status of all indexes
2022/08/05 01:27:43 Index id_isActive is in state INDEX_STATE_INITIAL
2022/08/05 01:27:43 Index id_company is in state INDEX_STATE_SCHEDULED
2022/08/05 01:27:43 Changing config key indexer.debug.enableBackgroundIndexCreation to value true
2022/08/05 01:27:43 Waiting for all indexes to become active
2022/08/05 01:27:43 Waiting for index 5838969690265061941 in state INDEX_STATE_INITIAL to go active ...
2022/08/05 01:27:43 Waiting for index 4559012029868720925 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:43 Waiting for index 9593514053971351439 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:43 Waiting for index 17759334403516122881 in state INDEX_STATE_ERROR to go active ...
2022-08-05T01:27:46.435+05:30 [Error] Error in waitForScheduledIndex Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2022/08/05 01:27:46 Waiting for index 5838969690265061941 in state INDEX_STATE_INITIAL to go active ...
2022/08/05 01:27:46 Waiting for index 4559012029868720925 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:46 Waiting for index 9593514053971351439 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:46 Waiting for index 17759334403516122881 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:49 Index 5838969690265061941 is now active
2022/08/05 01:27:49 Waiting for index 4559012029868720925 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:49 Waiting for index 9593514053971351439 in state INDEX_STATE_INITIAL to go active ...
2022/08/05 01:27:49 Waiting for index 17759334403516122881 in state INDEX_STATE_ERROR to go active ...
2022-08-05T01:27:52.285+05:30 [Error] Error in waitForScheduledIndex Index id_gender will retry building in the background for reason: Build Already In Progress. Keyspace default.
2022/08/05 01:27:52 Waiting for index 4559012029868720925 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:52 Waiting for index 9593514053971351439 in state INDEX_STATE_INITIAL to go active ...
2022/08/05 01:27:52 Waiting for index 17759334403516122881 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:55 Waiting for index 4559012029868720925 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:55 Waiting for index 9593514053971351439 in state INDEX_STATE_CATCHUP to go active ...
2022/08/05 01:27:55 Waiting for index 17759334403516122881 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:27:58 Waiting for index 4559012029868720925 in state INDEX_STATE_READY to go active ...
2022/08/05 01:27:58 Index 9593514053971351439 is now active
2022/08/05 01:27:58 Waiting for index 17759334403516122881 in state INDEX_STATE_INITIAL to go active ...
2022-08-05T01:27:58.599+05:30 [Error] Error in waitForScheduledIndex Index id_company will retry building in the background for reason: Build Already In Progress. Keyspace default.
2022/08/05 01:27:58 Error Index id_company will retry building in the background for reason: Build Already In Progress. Keyspace default.
 Observed when creating index
2022/08/05 01:27:58 Error Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
 Observed when creating index
2022/08/05 01:27:58 Error Index id_gender will retry building in the background for reason: Build Already In Progress. Keyspace default.
 Observed when creating index
2022/08/05 01:27:58 Error  Observed when creating index
2022/08/05 01:28:01 Waiting for index 4559012029868720925 in state INDEX_STATE_ERROR to go active ...
2022/08/05 01:28:01 Waiting for index 17759334403516122881 in state INDEX_STATE_INITIAL to go active ...
2022/08/05 01:28:04 Waiting for index 4559012029868720925 in state INDEX_STATE_INITIAL to go active ...
2022/08/05 01:28:04 Index 17759334403516122881 is now active
2022/08/05 01:28:07 Waiting for index 4559012029868720925 in state INDEX_STATE_INITIAL to go active ...
2022/08/05 01:28:10 Waiting for index 4559012029868720925 in state INDEX_STATE_CATCHUP to go active ...
2022/08/05 01:28:13 Index 4559012029868720925 is now active
--- PASS: TestScheduleIndexBasic (62.64s)
=== RUN   TestFlattenArrayIndexTestSetup
2022/08/05 01:28:13 In DropAllSecondaryIndexes()
2022/08/05 01:28:13 Index found:  id_isActive
2022/08/05 01:28:13 Dropped index id_isActive
2022/08/05 01:28:13 Index found:  id_company
2022/08/05 01:28:13 Dropped index id_company
2022/08/05 01:28:13 Index found:  id_age
2022/08/05 01:28:13 Dropped index id_age
2022/08/05 01:28:13 Index found:  id_gender
2022/08/05 01:28:14 Dropped index id_gender
2022/08/05 01:28:49 Flushed the bucket default, Response body: 
--- PASS: TestFlattenArrayIndexTestSetup (40.04s)
=== RUN   TestScanOnFlattenedAraryIndex
2022/08/05 01:28:59 Created the secondary index idx_flatten. Waiting for it become active
2022/08/05 01:28:59 Index is 2803430730342337324 now active
2022/08/05 01:28:59 Using n1ql client
--- PASS: TestScanOnFlattenedAraryIndex (6.68s)
=== RUN   TestGroupAggrFlattenArrayIndex
2022/08/05 01:29:00 In TestGroupAggrArrayIndex()
2022/08/05 01:29:04 Created the secondary index ga_flatten_arr1. Waiting for it become active
2022/08/05 01:29:04 Index is 9319327226106503812 now active
2022/08/05 01:29:09 Created the secondary index ga_flatten_arr2. Waiting for it become active
2022/08/05 01:29:09 Index is 12047638808368576675 now active
2022/08/05 01:29:09 Scenario 1
2022-08-05T01:29:09.011+05:30 [Error] transport error between 127.0.0.1:38090->127.0.0.1:9107: write tcp 127.0.0.1:38090->127.0.0.1:9107: write: broken pipe
2022-08-05T01:29:09.011+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:38090->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:29:09.011+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:29:09.012+05:30 [Error] metadataClient:PickRandom: Replicas - [3765471780234491418], PrunedReplica - map[], FilteredReplica map[]
2022/08/05 01:29:09 Total Scanresults = 636
2022/08/05 01:29:09 Scenario 2
2022/08/05 01:29:09 Total Scanresults = 2765
2022/08/05 01:29:10 Scenario 3
2022/08/05 01:29:10 Total Scanresults = 1
2022/08/05 01:29:10 Scenario 4
2022/08/05 01:29:10 Total Scanresults = 994
2022/08/05 01:29:10 Scenario 5
2022/08/05 01:29:10 Total Scanresults = 2765
2022/08/05 01:29:11 Scenario 6
2022/08/05 01:29:11 Total Scanresults = 1
2022/08/05 01:29:11 Scenario 7
2022/08/05 01:29:11 Total Scanresults = 2887
2022/08/05 01:29:16 Scenario 8
2022/08/05 01:29:16 Total Scanresults = 2765
2022/08/05 01:29:17 Scenario 9
2022/08/05 01:29:17 Total Scanresults = 1
2022/08/05 01:29:17 Scenario 10
2022/08/05 01:29:17 Total Scanresults = 636
2022/08/05 01:29:17 Scenario 11
2022/08/05 01:29:17 Total Scanresults = 1145
2022/08/05 01:29:18 Scenario 12
2022/08/05 01:29:18 Total Scanresults = 1
2022/08/05 01:29:18 Scenario 13
2022/08/05 01:29:23 Total Scanresults = 1
2022/08/05 01:29:23 Count of scanResults is 1
2022/08/05 01:29:23 Value: [2 126]
--- PASS: TestGroupAggrFlattenArrayIndex (23.05s)
=== RUN   TestNullAndMissingValuesFlattenArrayIndex
2022/08/05 01:29:23 In TestNullAndMissingValuesFlattenArrayIndex
2022/08/05 01:29:24 Scenario-1: Scanning for docsWithNullEntries with array as non-leading key
2022/08/05 01:29:24 Using n1ql client
2022/08/05 01:29:24 Scenario-2: Scanning for docsWithMissingEntries with array as non-leading key
2022/08/05 01:29:24 Using n1ql client
2022/08/05 01:29:24 Scenario-3: Scanning for docs with 'missing' entry for first key in array expression with array as non-leading key
2022/08/05 01:29:24 Using n1ql client
2022/08/05 01:29:24 Scenario-4: Scanning for docs with valid entry for first key in array expression with array as non-leading key
2022/08/05 01:29:24 Add docs in docsWithPartialMissingLeadingKeyInArrEntry should be present in results
2022/08/05 01:29:24 Using n1ql client
2022/08/05 01:29:24 Scenario-5: Scanning for docsWithNullEntries with array as leading key
2022/08/05 01:29:24 Using n1ql client
2022/08/05 01:29:24 Scenario-6: Scanning for docsWithMissingEntries with array as leading entry
2022/08/05 01:29:24 Using n1ql client
2022/08/05 01:29:24 Scenario-7: Scanning for docs with 'missing' entry for first key in array expression
2022/08/05 01:29:24 Using n1ql client
2022/08/05 01:29:24 Scenario-9: Scanning for all docs in the index
2022/08/05 01:29:24 Docs in docsWithCompleteMissingLeadingKeyInArrEntry should be present in results
2022/08/05 01:29:24 Using n1ql client
2022/08/05 01:29:24 Scenario-9: Scanning for docs with valid entry for first key in array expression
2022/08/05 01:29:24 Add docs in docsWithPartialMissingLeadingKeyInArrEntry should be present in results
2022/08/05 01:29:24 Using n1ql client
--- PASS: TestNullAndMissingValuesFlattenArrayIndex (0.93s)
=== RUN   TestEmptyArrayFlattenArrayIndex
2022/08/05 01:29:24 In TestEmptyArrayFlattenArrayIndex
2022/08/05 01:29:25 Scenario-1: Scanning for docs with missing entry for first key in array expression
2022/08/05 01:29:25 The docs in `docsWithEmptyArrayEntry` should not be presnt in scanResults
2022/08/05 01:29:25 Using n1ql client
2022/08/05 01:29:25 Scenario-1: Scanning for all docs in the index
2022/08/05 01:29:25 The docs in `docsWithEmptyArrayEntry` should not be presnt in scanResults
2022/08/05 01:29:25 Using n1ql client
--- PASS: TestEmptyArrayFlattenArrayIndex (0.85s)
=== RUN   TestOSOSetup
2022/08/05 01:29:25 In TestOSOSetup()
2022/08/05 01:29:25 In DropAllSecondaryIndexes()
2022/08/05 01:29:25 Index found:  test_oneperprimarykey
2022/08/05 01:29:25 Dropped index test_oneperprimarykey
2022/08/05 01:29:25 Index found:  idx_flatten
2022/08/05 01:29:25 Dropped index idx_flatten
2022/08/05 01:29:25 Index found:  ga_flatten_arr1
2022/08/05 01:29:25 Dropped index ga_flatten_arr1
2022/08/05 01:29:25 Index found:  ga_flatten_arr2
2022/08/05 01:29:25 Dropped index ga_flatten_arr2
2022/08/05 01:29:25 Index found:  #primary
2022/08/05 01:29:25 Dropped index #primary
2022/08/05 01:30:00 Flushed the bucket default, Response body: 
2022/08/05 01:30:01 Populating the default bucket
2022/08/05 01:30:05 Changing config key indexer.build.enableOSO to value true
--- PASS: TestOSOSetup (40.30s)
=== RUN   TestOSOInitBuildDeleteMutation
2022/08/05 01:30:05 In TestOSOInitBuildDeleteMutation()
2022/08/05 01:30:09 Created the secondary index index_p1_oso. Waiting for it become active
2022/08/05 01:30:09 Index is 4056971255912056568 now active
2022/08/05 01:30:17 Created the secondary index index_p_oso. Waiting for it become active
2022/08/05 01:30:17 Index is 10441566824619482314 now active
2022/08/05 01:30:17 Expected and Actual scan responses are the same
2022/08/05 01:30:17 CountRange() expected and actual is:  1797 and 1797
2022/08/05 01:30:17 lookupkey for CountLookup() = Usere1a586b6-e622-4b50-8792-3e75a1a70661
2022/08/05 01:30:17 CountLookup() = 1
--- PASS: TestOSOInitBuildDeleteMutation (12.31s)
=== RUN   TestOSOInitBuildIndexerRestart
2022/08/05 01:30:17 In TestOSOInitBuildIndexerRestart()
2022/08/05 01:30:17 Build command issued for the deferred indexes [5768644732968326879]
2022/08/05 01:30:18 []
2022-08-05T01:30:18.070+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:30:18.071+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:30:18.071+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:30:18.071+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:30:23 Waiting for index 5768644732968326879 to go active ...
2022/08/05 01:30:24 Waiting for index 5768644732968326879 to go active ...
2022/08/05 01:30:25 Waiting for index 5768644732968326879 to go active ...
2022/08/05 01:30:26 Waiting for index 5768644732968326879 to go active ...
2022/08/05 01:30:27 Waiting for index 5768644732968326879 to go active ...
2022/08/05 01:30:28 Index is 5768644732968326879 now active
2022-08-05T01:30:28.009+05:30 [Error] transport error between 127.0.0.1:48538->127.0.0.1:9107: write tcp 127.0.0.1:48538->127.0.0.1:9107: write: broken pipe
2022-08-05T01:30:28.009+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"]  request transport failed `write tcp 127.0.0.1:48538->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:30:28.009+05:30 [Warn] scan failed: requestId  queryport 127.0.0.1:9107 inst 9062628758688973334 partition [0]
2022-08-05T01:30:28.009+05:30 [Warn] Scan failed with error for index 5768644732968326879.  Trying scan again with replica, reqId: :  write tcp 127.0.0.1:48538->127.0.0.1:9107: write: broken pipe from [127.0.0.1:9107] ...
2022/08/05 01:30:28 Expected and Actual scan responses are the same
2022/08/05 01:30:28 CountRange() expected and actual is:  1797 and 1797
2022/08/05 01:30:28 lookupkey for CountLookup() = User4cc7050f-e83b-4a57-8e6c-2576dac8d5b1
2022/08/05 01:30:28 CountLookup() = 1
--- PASS: TestOSOInitBuildIndexerRestart (10.39s)
=== RUN   TestMissingLeadingKeyBasic
2022/08/05 01:30:28 In DropAllSecondaryIndexes()
2022/08/05 01:30:28 Index found:  index_p1_oso
2022/08/05 01:30:28 Dropped index index_p1_oso
2022/08/05 01:30:28 Index found:  index_p_oso
2022/08/05 01:30:28 Dropped index index_p_oso
2022/08/05 01:30:28 Index found:  index_p2_oso
2022/08/05 01:30:28 Dropped index index_p2_oso
2022/08/05 01:31:03 Flushed the bucket default, Response body: 
2022/08/05 01:31:04 Populating the default bucket
--- PASS: TestMissingLeadingKeyBasic (40.01s)
=== RUN   TestMissingLeadingKeyPartitioned
2022/08/05 01:31:08 In DropAllSecondaryIndexes()
2022/08/05 01:31:08 Index found:  idx_vac
2022/08/05 01:31:08 Dropped index idx_vac
--- PASS: TestMissingLeadingKeyPartitioned (3.88s)
=== RUN   TestIdxCorruptBasicSanityMultipleIndices
2022/08/05 01:31:11 In DropAllSecondaryIndexes()
2022/08/05 01:31:11 Index found:  idx_doses_partn
2022/08/05 01:31:12 Dropped index idx_doses_partn
Creating two indices ...
2022/08/05 01:31:26 Created the secondary index corrupt_idx1_age. Waiting for it become active
2022/08/05 01:31:26 Index is 10778545404025501949 now active
2022/08/05 01:31:32 Created the secondary index corrupt_idx2_company. Waiting for it become active
2022/08/05 01:31:32 Index is 6453129543549050974 now active
hosts = [127.0.0.1:9108]
2022/08/05 01:31:32 Corrupting index corrupt_idx1_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx1_age_16314726268281414695_0.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx1_age_16314726268281414695_0.index/snapshot.2022-08-05.013125.914
Restarting indexer process ...
2022/08/05 01:31:37 []
2022-08-05T01:31:37.581+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:31:37.581+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:31:37.582+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:31:37.582+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:31:58 Using n1ql client
2022-08-05T01:31:58.550+05:30 [Error] transport error between 127.0.0.1:34304->127.0.0.1:9107: write tcp 127.0.0.1:34304->127.0.0.1:9107: write: broken pipe
2022-08-05T01:31:58.550+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 3526569674851461356 request transport failed `write tcp 127.0.0.1:34304->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:31:58.551+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:31:58.551+05:30 [Error] metadataClient:PickRandom: Replicas - [13630497906438256819], PrunedReplica - map[], FilteredReplica map[]
2022/08/05 01:31:58 Using n1ql client
--- PASS: TestIdxCorruptBasicSanityMultipleIndices (46.63s)
=== RUN   TestIdxCorruptPartitionedIndex
Creating partitioned index ...
2022/08/05 01:32:03 Created the secondary index corrupt_idx3_age. Waiting for it become active
2022/08/05 01:32:03 Index is 3310233792190144256 now active
hosts = [127.0.0.1:9108]
indexer.numPartitions = 8
Corrupting partn id 1
Getting slicepath for  1
slicePath for partn 1 = /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_1.index
Getting slicepath for  2
slicePath for partn 2 = /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_2.index
Getting slicepath for  3
slicePath for partn 3 = /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_3.index
Getting slicepath for  4
slicePath for partn 4 = /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_4.index
Getting slicepath for  5
slicePath for partn 5 = /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_5.index
Getting slicepath for  6
slicePath for partn 6 = /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_6.index
Getting slicepath for  7
slicePath for partn 7 = /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_7.index
Getting slicepath for  8
slicePath for partn 8 = /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_8.index
2022/08/05 01:32:03 Corrupting index corrupt_idx3_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_1.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_1.index/snapshot.2022-08-05.013201.674
Restarting indexer process ...
2022/08/05 01:32:08 []
2022-08-05T01:32:08.231+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:32:08.231+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:32:08.231+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:32:08.231+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:32:28 Using n1ql client
2022-08-05T01:32:28.202+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8.  Partition with instances 7 
2022-08-05T01:32:28.202+05:30 [Error] metadataClient:PickRandom: Replicas - [5678278080024430362], PrunedReplica - map[], FilteredReplica map[]
2022-08-05T01:32:28.213+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8.  Partition with instances 7 
2022-08-05T01:32:28.213+05:30 [Error] metadataClient:PickRandom: Replicas - [5678278080024430362], PrunedReplica - map[], FilteredReplica map[]
Scan error: All indexer replica is down or unavailable or unable to process request - cause: queryport.client.noHost
Verified single partition corruption
Restarting indexer process ...
2022/08/05 01:32:28 []
2022-08-05T01:32:28.245+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:32:28.245+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:32:28.245+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:32:28.245+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:32:48 Using n1ql client
2022-08-05T01:32:48.230+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8.  Partition with instances 7 
2022-08-05T01:32:48.230+05:30 [Error] metadataClient:PickRandom: Replicas - [5678278080024430362], PrunedReplica - map[], FilteredReplica map[]
2022-08-05T01:32:48.241+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8.  Partition with instances 7 
2022-08-05T01:32:48.241+05:30 [Error] metadataClient:PickRandom: Replicas - [5678278080024430362], PrunedReplica - map[], FilteredReplica map[]
Scan error: All indexer replica is down or unavailable or unable to process request - cause: queryport.client.noHost
Skip corrupting partition 1
2022/08/05 01:32:48 Corrupting index corrupt_idx3_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_2.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_2.index/snapshot.2022-08-05.013201.661
2022/08/05 01:32:53 Corrupting index corrupt_idx3_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_3.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_3.index/snapshot.2022-08-05.013201.665
2022/08/05 01:32:58 Corrupting index corrupt_idx3_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_4.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_4.index/snapshot.2022-08-05.013201.663
2022/08/05 01:33:03 Corrupting index corrupt_idx3_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_5.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_5.index/snapshot.2022-08-05.013201.665
2022/08/05 01:33:08 Corrupting index corrupt_idx3_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_6.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_6.index/snapshot.2022-08-05.013201.661
2022/08/05 01:33:13 Corrupting index corrupt_idx3_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_7.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_7.index/snapshot.2022-08-05.013201.661
2022/08/05 01:33:18 Corrupting index corrupt_idx3_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_8.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx3_age_5678278080024430362_8.index/snapshot.2022-08-05.013201.666
Restarting indexer process ...
2022/08/05 01:33:23 []
2022-08-05T01:33:23.300+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:33:23.300+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:33:23.300+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:33:23.301+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:33:43 Using n1ql client
2022-08-05T01:33:43.284+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8.  Partition with instances 7 
2022-08-05T01:33:43.284+05:30 [Error] metadataClient:PickRandom: Replicas - [5678278080024430362], PrunedReplica - map[], FilteredReplica map[]
2022-08-05T01:33:43.294+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 8.  Partition with instances 7 
2022-08-05T01:33:43.294+05:30 [Error] metadataClient:PickRandom: Replicas - [5678278080024430362], PrunedReplica - map[], FilteredReplica map[]
Scan error: All indexer replica is down or unavailable or unable to process request - cause: queryport.client.noHost
--- PASS: TestIdxCorruptPartitionedIndex (104.73s)
=== RUN   TestIdxCorruptMOITwoSnapsOneCorrupt
2022/08/05 01:33:43 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 20000
Creating an index ...
2022/08/05 01:33:57 Created the secondary index corrupt_idx4_age. Waiting for it become active
2022/08/05 01:33:57 Index is 3527905017636510563 now active
hosts = [127.0.0.1:9108]
Populating the default bucket with more docs
Snapshots:  [/opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx4_age_16067469004795155610_0.index/snapshot.2022-08-05.013357.599 /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx4_age_16067469004795155610_0.index/snapshot.2022-08-05.013417.599]
2022/08/05 01:34:24 Corrupting index corrupt_idx4_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx4_age_16067469004795155610_0.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx4_age_16067469004795155610_0.index/snapshot.2022-08-05.013417.599
Restarting indexer process ...
2022/08/05 01:34:24 []
2022-08-05T01:34:24.103+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:34:24.103+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:34:24.103+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:34:24.104+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:34:44 Using n1ql client
2022-08-05T01:34:44.075+05:30 [Error] transport error between 127.0.0.1:55100->127.0.0.1:9107: write tcp 127.0.0.1:55100->127.0.0.1:9107: write: broken pipe
2022-08-05T01:34:44.075+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -6862120457999391007 request transport failed `write tcp 127.0.0.1:55100->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:34:44.075+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:34:44.075+05:30 [Error] metadataClient:PickRandom: Replicas - [16067469004795155610], PrunedReplica - map[], FilteredReplica map[]
Restarting indexer process ...
2022/08/05 01:34:44 []
2022/08/05 01:35:04 Using n1ql client
2022-08-05T01:35:04.121+05:30 [Error] transport error between 127.0.0.1:33402->127.0.0.1:9107: write tcp 127.0.0.1:33402->127.0.0.1:9107: write: broken pipe
2022-08-05T01:35:04.121+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 5973186945359680180 request transport failed `write tcp 127.0.0.1:33402->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:35:04.121+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:35:04.121+05:30 [Error] metadataClient:PickRandom: Replicas - [16067469004795155610], PrunedReplica - map[], FilteredReplica map[]
--- PASS: TestIdxCorruptMOITwoSnapsOneCorrupt (80.85s)
=== RUN   TestIdxCorruptMOITwoSnapsBothCorrupt
2022/08/05 01:35:04 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 20000
Creating an index ...
2022/08/05 01:35:09 Created the secondary index corrupt_idx5_name. Waiting for it become active
2022/08/05 01:35:09 Index is 15266409097737130361 now active
hosts = [127.0.0.1:9108]
Populating the default bucket with more docs
Snapshots:  [/opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx5_name_9409211560317493688_0.index/snapshot.2022-08-05.013507.828 /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx5_name_9409211560317493688_0.index/snapshot.2022-08-05.013525.003]
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx5_name_9409211560317493688_0.index/snapshot.2022-08-05.013525.003
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx5_name_9409211560317493688_0.index/snapshot.2022-08-05.013507.828
Restarting indexer process ...
2022/08/05 01:35:35 []
2022-08-05T01:35:35.909+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:35:35.909+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:35:35.910+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:35:35.910+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:35:55 Using n1ql client
2022-08-05T01:35:55.888+05:30 [Error] transport error between 127.0.0.1:34232->127.0.0.1:9107: write tcp 127.0.0.1:34232->127.0.0.1:9107: write: broken pipe
2022-08-05T01:35:55.888+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -1363739541825513146 request transport failed `write tcp 127.0.0.1:34232->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:35:55.888+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:35:55.888+05:30 [Error] metadataClient:PickRandom: Replicas - [9409211560317493688], PrunedReplica - map[], FilteredReplica map[]
2022-08-05T01:35:55.902+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] Range(-1363739541825513146) response failed `Index not found`
2022-08-05T01:35:55.902+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:35:55.902+05:30 [Error] metadataClient:PickRandom: Replicas - [9409211560317493688], PrunedReplica - map[], FilteredReplica map[]
Scan error:  Index not found from [127.0.0.1:9107] - cause:  Index not found from [127.0.0.1:9107]
--- PASS: TestIdxCorruptMOITwoSnapsBothCorrupt (51.75s)
=== RUN   TestIdxCorruptBackup
2022/08/05 01:35:56 Changing config key indexer.settings.enable_corrupt_index_backup to value true
Creating index ...
2022/08/05 01:36:11 Created the secondary index corrupt_idx6_age. Waiting for it become active
2022/08/05 01:36:11 Index is 14452840264733447091 now active
hosts = [127.0.0.1:9108]
2022/08/05 01:36:11 Corrupting index corrupt_idx6_age slicePath /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx6_age_2650815642734625307_0.index
snapshot datapath =  /opt/build/ns_server/data/n_1/data/@2i/default_corrupt_idx6_age_2650815642734625307_0.index/snapshot.2022-08-05.013609.834
Restarting indexer process ...
2022/08/05 01:36:16 []
2022-08-05T01:36:16.279+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:36:16.279+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:36:16.279+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:36:16.279+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:36:16.279+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] req(-1363739541825513146) connection "127.0.0.1:36236" closed `EOF`
--- PASS: TestIdxCorruptBackup (40.36s)
=== RUN   TestStatsPersistence
2022/08/05 01:36:36 In TestStatsPersistence()
2022/08/05 01:36:36 In DropAllSecondaryIndexes()
2022/08/05 01:36:36 Index found:  corrupt_idx2_company
2022/08/05 01:36:46 Dropped index corrupt_idx2_company
2022/08/05 01:36:46 Index found:  corrupt_idx4_age
2022/08/05 01:36:46 Dropped index corrupt_idx4_age
2022/08/05 01:36:51 Created the secondary index index_age. Waiting for it become active
2022/08/05 01:36:51 Index is 8191632483631425323 now active
2022/08/05 01:36:57 Created the secondary index index_gender. Waiting for it become active
2022/08/05 01:36:57 Index is 12084936025492807190 now active
2022/08/05 01:37:03 Created the secondary index index_city. Waiting for it become active
2022/08/05 01:37:03 Index is 7078384283232664601 now active
2022/08/05 01:37:07 Created the secondary index p1. Waiting for it become active
2022/08/05 01:37:07 Index is 5288935456528935581 now active
2022/08/05 01:37:07 === Testing for persistence enabled = true, with interval = 5  ===
2022/08/05 01:37:07 Changing config key indexer.statsPersistenceInterval to value 5
2022/08/05 01:37:07 []
2022-08-05T01:37:07.909+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:37:07.909+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:37:07.919+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:37:07.919+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022/08/05 01:37:12 Using n1ql client
2022/08/05 01:37:12 Using n1ql client
2022/08/05 01:37:12 Using n1ql client
2022/08/05 01:37:20 []
2022/08/05 01:37:25 === Testing for persistence enabled = false, with interval = 0  ===
2022/08/05 01:37:25 Changing config key indexer.statsPersistenceInterval to value 0
2022/08/05 01:37:25 []
2022/08/05 01:37:30 Using n1ql client
2022-08-05T01:37:30.297+05:30 [Error] transport error between 127.0.0.1:39404->127.0.0.1:9107: write tcp 127.0.0.1:39404->127.0.0.1:9107: write: broken pipe
2022-08-05T01:37:30.297+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -5427610850640912829 request transport failed `write tcp 127.0.0.1:39404->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:37:30.297+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:37:30.297+05:30 [Error] metadataClient:PickRandom: Replicas - [5743188274134544856], PrunedReplica - map[], FilteredReplica map[]
2022/08/05 01:37:30 Using n1ql client
2022/08/05 01:37:30 Using n1ql client
2022/08/05 01:37:32 []
2022/08/05 01:37:37 === Testing for persistence enabled = true, with interval = 10  ===
2022/08/05 01:37:37 Changing config key indexer.statsPersistenceInterval to value 10
2022/08/05 01:37:37 []
2022/08/05 01:37:42 Using n1ql client
2022-08-05T01:37:42.725+05:30 [Error] transport error between 127.0.0.1:40244->127.0.0.1:9107: write tcp 127.0.0.1:40244->127.0.0.1:9107: write: broken pipe
2022-08-05T01:37:42.725+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] 2472242682246341998 request transport failed `write tcp 127.0.0.1:40244->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:37:42.725+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:37:42.725+05:30 [Error] metadataClient:PickRandom: Replicas - [5743188274134544856], PrunedReplica - map[], FilteredReplica map[]
2022/08/05 01:37:42 Using n1ql client
2022/08/05 01:37:42 Using n1ql client
2022/08/05 01:37:54 []
2022/08/05 01:38:00 === Testing for persistence enabled = true, with interval = 5  ===
2022/08/05 01:38:00 Changing config key indexer.statsPersistenceInterval to value 5
2022/08/05 01:38:00 []
2022/08/05 01:38:05 Using n1ql client
2022-08-05T01:38:05.198+05:30 [Error] transport error between 127.0.0.1:40984->127.0.0.1:9107: write tcp 127.0.0.1:40984->127.0.0.1:9107: write: broken pipe
2022-08-05T01:38:05.198+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -2819491178600433026 request transport failed `write tcp 127.0.0.1:40984->127.0.0.1:9107: write: broken pipe`
2022-08-05T01:38:05.198+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1.  Partition with instances 0 
2022-08-05T01:38:05.198+05:30 [Error] metadataClient:PickRandom: Replicas - [5743188274134544856], PrunedReplica - map[], FilteredReplica map[]
2022/08/05 01:38:05 Using n1ql client
2022/08/05 01:38:05 Using n1ql client
2022/08/05 01:38:12 []
2022-08-05T01:38:12.447+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:38:12.447+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2022-08-05T01:38:12.447+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:38:12.447+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
--- PASS: TestStatsPersistence (101.22s)
=== RUN   TestStats_StorageStatistics
2022/08/05 01:38:17 In TestStats_StorageStatistics()
2022/08/05 01:38:17 Index found:  index_age
2022/08/05 01:38:17 Stats from Index4 StorageStatistics for index index_age are [map[AVG_ITEM_SIZE:98 NUM_ITEMS:11502 PARTITION_ID:0]]
2022/08/05 01:38:17 Index found:  p1
2022/08/05 01:38:17 Stats from Index4 StorageStatistics for index p1 are [map[AVG_ITEM_SIZE:86 NUM_ITEMS:11502 PARTITION_ID:0]]
--- PASS: TestStats_StorageStatistics (0.20s)
PASS
ok  	github.com/couchbase/indexing/secondary/tests/functionaltests	7440.431s
Indexer Go routine dump logged in /opt/build/ns_server/logs/n_1/indexer_functests_pprof.log
curl: /opt/build/install/lib/libcurl.so.4: no version information available (required by curl)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 65273    0 65273    0     0  9385k      0 --:--:-- --:--:-- --:--:-- 10.3M
2022/08/05 01:38:20 In TestMain()
2022-08-05T01:38:20.395+05:30 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9106.  Error = EOF. Kill Pipe.
2022-08-05T01:38:20.395+05:30 [Error] FollowerSyncProxy.receiveAndUpdateAcceptedEpoch(): Error encountered = Server Error : SyncProxy.listen(): channel closed. Terminate
2022-08-05T01:38:20.395+05:30 [Error] WatcherServer.runOnce() : Watcher fail to synchronized with peer 127.0.0.1:9106
2022/08/05 01:38:21 ChangeIndexerSettings: Host  Port 0 Nodes []
2022/08/05 01:38:21 Changing config key indexer.api.enableTestServer to value true
2022/08/05 01:38:21 Error in ChangeIndexerSettings: Post "http://:2/internal/settings": dial tcp :2: connect: connection refused
panic: Error in ChangeIndexerSettings: Post "http://:2/internal/settings": dial tcp :2: connect: connection refused


goroutine 1 [running]:
panic({0xcbf3e0, 0xc000286770})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/panic.go:941 +0x397 fp=0xc00025fd40 sp=0xc00025fc80 pc=0x43a657
log.Panicf({0xe2b966?, 0x1e?}, {0xc00025fe38?, 0x1c?, 0xcb4b20?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/log/log.go:392 +0x67 fp=0xc00025fd88 sp=0xc00025fd40 pc=0x5ba767
github.com/couchbase/indexing/secondary/tests/framework/common.HandleError(...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/framework/common/util.go:76
github.com/couchbase/indexing/secondary/tests/largedatatests.TestMain(0x4450b1?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/largedatatests/common_test.go:52 +0x468 fp=0xc00025fec8 sp=0xc00025fd88 pc=0xc4c0c8
main.main()
	_testmain.go:59 +0x1d3 fp=0xc00025ff80 sp=0xc00025fec8 pc=0xc52193
runtime.main()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:250 +0x212 fp=0xc00025ffe0 sp=0xc00025ff80 pc=0x43d1d2
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00025ffe8 sp=0xc00025ffe0 pc=0x46db21

goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00005cfb0 sp=0xc00005cf90 pc=0x43d596
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:367
runtime.forcegchelper()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:301 +0xad fp=0xc00005cfe0 sp=0xc00005cfb0 pc=0x43d42d
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00005cfe8 sp=0xc00005cfe0 pc=0x46db21
created by runtime.init.6
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:289 +0x25

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00005d790 sp=0xc00005d770 pc=0x43d596
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:367
runtime.bgsweep(0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgcsweep.go:297 +0xd7 fp=0xc00005d7c8 sp=0xc00005d790 pc=0x4286f7
runtime.gcenable.func1()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:177 +0x26 fp=0xc00005d7e0 sp=0xc00005d7c8 pc=0x41e2a6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00005d7e8 sp=0xc00005d7e0 pc=0x46db21
created by runtime.gcenable
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:177 +0x6b

goroutine 4 [GC scavenge wait]:
runtime.gopark(0x1768160?, 0x10000?, 0x0?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00005df20 sp=0xc00005df00 pc=0x43d596
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:367
runtime.bgscavenge(0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgcscavenge.go:364 +0x2a5 fp=0xc00005dfc8 sp=0xc00005df20 pc=0x426505
runtime.gcenable.func2()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:178 +0x26 fp=0xc00005dfe0 sp=0xc00005dfc8 pc=0x41e246
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00005dfe8 sp=0xc00005dfe0 pc=0x46db21
created by runtime.gcenable
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:178 +0xaa

goroutine 18 [finalizer wait]:
runtime.gopark(0x0?, 0xe8f468?, 0x0?, 0x80?, 0x2000000020?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00005c630 sp=0xc00005c610 pc=0x43d596
runtime.goparkunlock(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:367
runtime.runfinq()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mfinal.go:177 +0xb3 fp=0xc00005c7e0 sp=0xc00005c630 pc=0x41d353
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00005c7e8 sp=0xc00005c7e0 pc=0x46db21
created by runtime.createfing
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mfinal.go:157 +0x45

goroutine 20 [select]:
runtime.gopark(0xc000294f98?, 0x2?, 0x47?, 0xd6?, 0xc000294f8c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000294e18 sp=0xc000294df8 pc=0x43d596
runtime.selectgo(0xc000294f98, 0xc000294f88, 0x40aeb9?, 0x0, 0x8?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc000294f58 sp=0xc000294e18 pc=0x44d012
github.com/couchbase/cbauth/cbauthimpl.(*tlsNotifier).loop(0xc0001306f0)
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:396 +0x67 fp=0xc000294fc8 sp=0xc000294f58 pc=0x7788a7
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func2()
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:561 +0x26 fp=0xc000294fe0 sp=0xc000294fc8 pc=0x779526
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000294fe8 sp=0xc000294fe0 pc=0x46db21
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:561 +0x37a

goroutine 21 [select]:
runtime.gopark(0xc000058f98?, 0x2?, 0x0?, 0x0?, 0xc000058f8c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000058e08 sp=0xc000058de8 pc=0x43d596
runtime.selectgo(0xc000058f98, 0xc000058f88, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc000058f48 sp=0xc000058e08 pc=0x44d012
github.com/couchbase/cbauth/cbauthimpl.(*cfgChangeNotifier).loop(0xc000130708)
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:316 +0x85 fp=0xc000058fc8 sp=0xc000058f48 pc=0x7782c5
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func3()
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:562 +0x26 fp=0xc000058fe0 sp=0xc000058fc8 pc=0x7794c6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000058fe8 sp=0xc000058fe0 pc=0x46db21
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
	/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:562 +0x3ca

goroutine 22 [IO wait]:
runtime.gopark(0xc0001969c0?, 0xc00004c500?, 0x70?, 0x38?, 0x483402?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00015b800 sp=0xc00015b7e0 pc=0x43d596
runtime.netpollblock(0xc0000a9000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc00015b838 sp=0xc00015b800 pc=0x436037
internal/poll.runtime_pollWait(0x7ff8c93b2fc8, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/netpoll.go:302 +0x89 fp=0xc00015b858 sp=0xc00015b838 pc=0x468109
internal/poll.(*pollDesc).wait(0xc000032100?, 0xc0000a9000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc00015b880 sp=0xc00015b858 pc=0x4a0d32
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc000032100, {0xc0000a9000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00015b900 sp=0xc00015b880 pc=0x4a209a
net.(*netFD).Read(0xc000032100, {0xc0000a9000?, 0xc0001c1fd0?, 0xc?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/fd_posix.go:55 +0x29 fp=0xc00015b948 sp=0xc00015b900 pc=0x6648e9
net.(*conn).Read(0xc000010018, {0xc0000a9000?, 0x11?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/net.go:183 +0x45 fp=0xc00015b990 sp=0xc00015b948 pc=0x673e05
bufio.(*Reader).Read(0xc000088120, {0xc0004fe001, 0x5ff, 0x452834?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:236 +0x1b4 fp=0xc00015b9c8 sp=0xc00015b990 pc=0x51dc94
github.com/couchbase/cbauth/revrpc.(*minirwc).Read(0x203000?, {0xc0004fe001?, 0x203000?, 0xc0004a6980?})
	/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:102 +0x25 fp=0xc00015b9f8 sp=0xc00015b9c8 pc=0x7b9005
encoding/json.(*Decoder).refill(0xc0004ae500)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/encoding/json/stream.go:165 +0x17f fp=0xc00015ba48 sp=0xc00015b9f8 pc=0x56235f
encoding/json.(*Decoder).readValue(0xc0004ae500)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/encoding/json/stream.go:140 +0xbb fp=0xc00015ba98 sp=0xc00015ba48 pc=0x561f5b
encoding/json.(*Decoder).Decode(0xc0004ae500, {0xcea300, 0xc00043d220})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/encoding/json/stream.go:63 +0x78 fp=0xc00015bac8 sp=0xc00015ba98 pc=0x561bb8
net/rpc/jsonrpc.(*serverCodec).ReadRequestHeader(0xc00043d200, 0xc0004a6980)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/rpc/jsonrpc/server.go:66 +0x85 fp=0xc00015bb08 sp=0xc00015bac8 pc=0x7b8265
github.com/couchbase/cbauth/revrpc.(*jsonServerCodec).ReadRequestHeader(0xc000141a90?, 0x4cbf88?)
	:1 +0x2a fp=0xc00015bb28 sp=0xc00015bb08 pc=0x7bad8a
net/rpc.(*Server).readRequestHeader(0xc000141a90, {0xf775b8, 0xc0001c1f50})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/rpc/server.go:587 +0x66 fp=0xc00015bbf8 sp=0xc00015bb28 pc=0x7b7986
net/rpc.(*Server).readRequest(0x0?, {0xf775b8, 0xc0001c1f50})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/rpc/server.go:547 +0x3b fp=0xc00015bcd0 sp=0xc00015bbf8 pc=0x7b74db
net/rpc.(*Server).ServeCodec(0xc000141a90, {0xf775b8?, 0xc0001c1f50})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/rpc/server.go:462 +0x87 fp=0xc00015bdc8 sp=0xc00015bcd0 pc=0x7b6c07
github.com/couchbase/cbauth/revrpc.(*Service).Run(0xc000059760?, 0xc00006ffa0)
	/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:192 +0x5d9 fp=0xc00015bf38 sp=0xc00015bdc8 pc=0x7b9759
github.com/couchbase/cbauth/revrpc.BabysitService(0x0?, 0x0?, {0xf6e4a0?, 0xc00000e018?})
	/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:288 +0x58 fp=0xc00015bf70 sp=0xc00015bf38 pc=0x7b9e58
github.com/couchbase/cbauth.runRPCForSvc(0x0?, 0xc0001941c0)
	/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:57 +0xbd fp=0xc00015bfc0 sp=0xc00015bf70 pc=0x7c375d
github.com/couchbase/cbauth.startDefault.func1()
	/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:66 +0x25 fp=0xc00015bfe0 sp=0xc00015bfc0 pc=0x7c3a45
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00015bfe8 sp=0xc00015bfe0 pc=0x46db21
created by github.com/couchbase/cbauth.startDefault
	/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:65 +0xf9

goroutine 23 [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000059e78 sp=0xc000059e58 pc=0x43d596
runtime.chanrecv(0xc00043d140, 0xc000059f90, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/chan.go:577 +0x56c fp=0xc000059f08 sp=0xc000059e78 pc=0x40b54c
runtime.chanrecv2(0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/chan.go:445 +0x18 fp=0xc000059f30 sp=0xc000059f08 pc=0x40afb8
github.com/couchbase/goutils/systemeventlog.(*SystemEventLoggerImpl).logEvents(0xc0001cb9d0)
	/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:186 +0xb7 fp=0xc000059fc8 sp=0xc000059f30 pc=0xaedcf7
github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger.func1()
	/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x26 fp=0xc000059fe0 sp=0xc000059fc8 pc=0xaed606
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000059fe8 sp=0xc000059fe0 pc=0x46db21
created by github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger
	/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x1d6

goroutine 47 [select]:
runtime.gopark(0xc00005a750?, 0x2?, 0x0?, 0x30?, 0xc00005a714?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00005a590 sp=0xc00005a570 pc=0x43d596
runtime.selectgo(0xc00005a750, 0xc00005a710, 0xe5b10b?, 0x0, 0xcbe9e0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc00005a6d0 sp=0xc00005a590 pc=0x44d012
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc000126b80, 0xc0001ae380)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1846 +0x238 fp=0xc00005a7c0 sp=0xc00005a6d0 pc=0xc12678
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1821 +0x2a fp=0xc00005a7e0 sp=0xc00005a7c0 pc=0xc122ea
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00005a7e8 sp=0xc00005a7e0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1821 +0x2ed

goroutine 38 [GC worker (idle)]:
runtime.gopark(0x34cf30a61336?, 0x3?, 0xc0?, 0xec?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000234f58 sp=0xc000234f38 pc=0x43d596
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc000234fe0 sp=0xc000234f58 pc=0x420385
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000234fe8 sp=0xc000234fe0 pc=0x46db21
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:1131 +0x25

goroutine 36 [runnable]:
syscall.Syscall(0x0, 0x8, 0xc00023a000, 0x1000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/syscall/asm_linux_amd64.s:20 +0x5 fp=0xc000070b20 sp=0xc000070b18 pc=0x4833c5
syscall.read(0xc000210280?, {0xc00023a000?, 0x44dd00?, 0x46b94e?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/syscall/zsyscall_linux_amd64.go:696 +0x4d fp=0xc000070b78 sp=0xc000070b20 pc=0x48130d
syscall.Read(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/syscall/syscall_unix.go:188
internal/poll.ignoringEINTRIO(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_unix.go:794
internal/poll.(*FD).Read(0xc000210280?, {0xc00023a000?, 0x1000?, 0x1000?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_unix.go:163 +0x285 fp=0xc000070bf8 sp=0xc000070b78 pc=0x4a20c5
net.(*netFD).Read(0xc000210280, {0xc00023a000?, 0x40a9e9?, 0x4?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/fd_posix.go:55 +0x29 fp=0xc000070c40 sp=0xc000070bf8 pc=0x6648e9
net.(*conn).Read(0xc000208030, {0xc00023a000?, 0x0?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/net.go:183 +0x45 fp=0xc000070c88 sp=0xc000070c40 pc=0x673e05
net/http.(*persistConn).Read(0xc000224120, {0xc00023a000?, 0xc00003e0c0?, 0xc000070d30?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1929 +0x4e fp=0xc000070ce8 sp=0xc000070c88 pc=0x764aee
bufio.(*Reader).fill(0xc0002064e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:106 +0x103 fp=0xc000070d20 sp=0xc000070ce8 pc=0x51d6c3
bufio.(*Reader).Peek(0xc0002064e0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:144 +0x5d fp=0xc000070d40 sp=0xc000070d20 pc=0x51d81d
net/http.(*persistConn).readLoop(0xc000224120)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2093 +0x1ac fp=0xc000070fc8 sp=0xc000070d40 pc=0x76590c
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1750 +0x26 fp=0xc000070fe0 sp=0xc000070fc8 pc=0x7640e6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000070fe8 sp=0xc000070fe0 pc=0x46db21
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1750 +0x173e

goroutine 37 [select]:
runtime.gopark(0xc000290f90?, 0x2?, 0xd8?, 0xd?, 0xc000290f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000290d90 sp=0xc000290d70 pc=0x43d596
runtime.selectgo(0xc000290f90, 0xc000290f20, 0xc00020e100?, 0x0, 0xc000284b10?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc000290ed0 sp=0xc000290d90 pc=0x44d012
net/http.(*persistConn).writeLoop(0xc000224120)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000290fc8 sp=0xc000290ed0 pc=0x7675f5
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1751 +0x26 fp=0xc000290fe0 sp=0xc000290fc8 pc=0x764086
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000290fe8 sp=0xc000290fe0 pc=0x46db21
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1751 +0x1791

goroutine 50 [GC worker (idle)]:
runtime.gopark(0xc000058798?, 0xc000058788?, 0xb9?, 0xae?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000058758 sp=0xc000058738 pc=0x43d596
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0000587e0 sp=0xc000058758 pc=0x420385
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0000587e8 sp=0xc0000587e0 pc=0x46db21
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:1131 +0x25

goroutine 5 [GC worker (idle)]:
runtime.gopark(0x34cf30a4110c?, 0x1?, 0x3c?, 0xa2?, 0x1?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000234758 sp=0xc000234738 pc=0x43d596
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0002347e0 sp=0xc000234758 pc=0x420385
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0002347e8 sp=0xc0002347e0 pc=0x46db21
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:1131 +0x25

goroutine 51 [GC worker (idle)]:
runtime.gopark(0x34cf2e8c6efb?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000230758 sp=0xc000230738 pc=0x43d596
runtime.gcBgMarkWorker()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:1207 +0xe5 fp=0xc0002307e0 sp=0xc000230758 pc=0x420385
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0002307e8 sp=0xc0002307e0 pc=0x46db21
created by runtime.gcBgMarkStartWorkers
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/mgc.go:1131 +0x25

goroutine 41 [select]:
runtime.gopark(0xc00005f798?, 0x2?, 0x8?, 0x0?, 0xc00005f78c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00005f618 sp=0xc00005f5f8 pc=0x43d596
runtime.selectgo(0xc00005f798, 0xc00005f788, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc00005f758 sp=0xc00005f618 pc=0x44d012
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc000222190)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2389 +0x92 fp=0xc00005f7c8 sp=0xc00005f758 pc=0xc25a52
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2186 +0x26 fp=0xc00005f7e0 sp=0xc00005f7c8 pc=0xc24386
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00005f7e8 sp=0xc00005f7e0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2186 +0x2e5

goroutine 52 [select]:
runtime.gopark(0xc00041fba0?, 0x3?, 0x6?, 0x30?, 0xc00041fb1a?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00041f978 sp=0xc00041f958 pc=0x43d596
runtime.selectgo(0xc00041fba0, 0xc00041fb14, 0xc0002a7400?, 0x0, 0x45?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc00041fab8 sp=0xc00041f978 pc=0x44d012
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc0001c0460?, {0xe3c826, 0x1b}, 0xc00041fe68, 0xc000214900)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc00041fe40 sp=0xc00041fab8 pc=0x9a71c9
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0xe3c826?, 0x0?}, 0x0?, 0x0?)
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc00041fe88 sp=0xc00041fe40 pc=0x9a7778
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0x0?, {0x0?, 0x0?})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1579 +0xc7 fp=0xc00041ff00 sp=0xc00041fe88 pc=0xaf2c87
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc00041ffa0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc00041ff38 sp=0xc00041ff00 pc=0xabcc83
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1584 +0xdf fp=0xc00041ffe0 sp=0xc00041ff38 pc=0xaf2b3f
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00041ffe8 sp=0xc00041ffe0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1572 +0xaf

goroutine 57 [IO wait]:
runtime.gopark(0xc0002be4e0?, 0xc00004ea00?, 0x10?, 0xca?, 0x483402?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00006c9a0 sp=0xc00006c980 pc=0x43d596
runtime.netpollblock(0xc0002d4000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc00006c9d8 sp=0xc00006c9a0 pc=0x436037
internal/poll.runtime_pollWait(0x7ff8c93b2cf8, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/netpoll.go:302 +0x89 fp=0xc00006c9f8 sp=0xc00006c9d8 pc=0x468109
internal/poll.(*pollDesc).wait(0xc000126100?, 0xc0002d4000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc00006ca20 sp=0xc00006c9f8 pc=0x4a0d32
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc000126100, {0xc0002d4000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00006caa0 sp=0xc00006ca20 pc=0x4a209a
net.(*netFD).Read(0xc000126100, {0xc0002d4000?, 0xc000201230?, 0xc00006cb78?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/fd_posix.go:55 +0x29 fp=0xc00006cae8 sp=0xc00006caa0 pc=0x6648e9
net.(*conn).Read(0xc000288030, {0xc0002d4000?, 0x11d?, 0xc00006cbb8?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/net.go:183 +0x45 fp=0xc00006cb30 sp=0xc00006cae8 pc=0x673e05
net/http.(*persistConn).Read(0xc00009c000, {0xc0002d4000?, 0x181?, 0xc000140360?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1929 +0x4e fp=0xc00006cb90 sp=0xc00006cb30 pc=0x764aee
bufio.(*Reader).fill(0xc00043d3e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:106 +0x103 fp=0xc00006cbc8 sp=0xc00006cb90 pc=0x51d6c3
bufio.(*Reader).ReadSlice(0xc00043d3e0, 0x81?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:371 +0x2f fp=0xc00006cc18 sp=0xc00006cbc8 pc=0x51e2af
net/http/internal.readChunkLine(0x4f4?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc00006cc68 sp=0xc00006cc18 pc=0x702a25
net/http/internal.(*chunkedReader).beginChunk(0xc000284480)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc00006cc98 sp=0xc00006cc68 pc=0x7024a8
net/http/internal.(*chunkedReader).Read(0xc000284480, {0xc0004ff200?, 0x10?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/internal/chunked.go:98 +0x14e fp=0xc00006cd18 sp=0xc00006cc98 pc=0x70276e
net/http.(*body).readLocked(0xc00028c140, {0xc0004ff200?, 0xf7d740?, 0xd6c980?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transfer.go:844 +0x3c fp=0xc00006cd68 sp=0xc00006cd18 pc=0x75971c
net/http.(*body).Read(0x0?, {0xc0004ff200?, 0x54fc1e?, 0x0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transfer.go:836 +0x125 fp=0xc00006cde0 sp=0xc00006cd68 pc=0x7595e5
net/http.(*bodyEOFSignal).Read(0xc00028c180, {0xc0004ff200, 0x600, 0x600})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2774 +0x142 fp=0xc00006ce60 sp=0xc00006cde0 pc=0x769222
encoding/json.(*Decoder).refill(0xc0002dc000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/encoding/json/stream.go:165 +0x17f fp=0xc00006ceb0 sp=0xc00006ce60 pc=0x56235f
encoding/json.(*Decoder).readValue(0xc0002dc000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/encoding/json/stream.go:140 +0xbb fp=0xc00006cf00 sp=0xc00006ceb0 pc=0x561f5b
encoding/json.(*Decoder).Decode(0xc0002dc000, {0xc9bd40, 0xc000140320})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/encoding/json/stream.go:63 +0x78 fp=0xc00006cf30 sp=0xc00006cf00 pc=0x561bb8
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc00006cfe0 sp=0xc00006cf30 pc=0x9a766b
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x46db21
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
	/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb

goroutine 42 [select]:
runtime.gopark(0xc0004baf68?, 0x4?, 0x48?, 0xac?, 0xc0004badb0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc0004bac00 sp=0xc0004babe0 pc=0x43d596
runtime.selectgo(0xc0004baf68, 0xc0004bada8, 0xc00007e000?, 0x0, 0xc0004ae601?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc0004bad40 sp=0xc0004bac00 pc=0x44d012
net/http.(*persistConn).readLoop(0xc0004a85a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2213 +0xda5 fp=0xc0004bafc8 sp=0xc0004bad40 pc=0x766505
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1750 +0x26 fp=0xc0004bafe0 sp=0xc0004bafc8 pc=0x7640e6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0004bafe8 sp=0xc0004bafe0 pc=0x46db21
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1750 +0x173e

goroutine 43 [select]:
runtime.gopark(0xc0004bbf90?, 0x2?, 0xd8?, 0xbd?, 0xc0004bbf24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc0004bbd90 sp=0xc0004bbd70 pc=0x43d596
runtime.selectgo(0xc0004bbf90, 0xc0004bbf20, 0xc00020e7c0?, 0x0, 0xc0002848a0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc0004bbed0 sp=0xc0004bbd90 pc=0x44d012
net/http.(*persistConn).writeLoop(0xc0004a85a0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0004bbfc8 sp=0xc0004bbed0 pc=0x7675f5
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1751 +0x26 fp=0xc0004bbfe0 sp=0xc0004bbfc8 pc=0x764086
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0004bbfe8 sp=0xc0004bbfe0 pc=0x46db21
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1751 +0x1791

goroutine 55 [select]:
runtime.gopark(0xc000291f68?, 0x4?, 0x3?, 0x0?, 0xc000291db0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000291c00 sp=0xc000291be0 pc=0x43d596
runtime.selectgo(0xc000291f68, 0xc000291da8, 0xc00028c140?, 0x0, 0x1?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc000291d40 sp=0xc000291c00 pc=0x44d012
net/http.(*persistConn).readLoop(0xc00009c000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2213 +0xda5 fp=0xc000291fc8 sp=0xc000291d40 pc=0x766505
net/http.(*Transport).dialConn.func5()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1750 +0x26 fp=0xc000291fe0 sp=0xc000291fc8 pc=0x7640e6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000291fe8 sp=0xc000291fe0 pc=0x46db21
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1750 +0x173e

goroutine 56 [select]:
runtime.gopark(0xc000292f90?, 0x2?, 0xd8?, 0x2d?, 0xc000292f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000292d90 sp=0xc000292d70 pc=0x43d596
runtime.selectgo(0xc000292f90, 0xc000292f20, 0xc00028c100?, 0x0, 0xc0002843f0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc000292ed0 sp=0xc000292d90 pc=0x44d012
net/http.(*persistConn).writeLoop(0xc00009c000)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000292fc8 sp=0xc000292ed0 pc=0x7675f5
net/http.(*Transport).dialConn.func6()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1751 +0x26 fp=0xc000292fe0 sp=0xc000292fc8 pc=0x764086
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000292fe8 sp=0xc000292fe0 pc=0x46db21
created by net/http.(*Transport).dialConn
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1751 +0x1791

goroutine 58 [select]:
runtime.gopark(0xc000421f38?, 0x2?, 0xed?, 0x9e?, 0xc000421f24?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000421d58 sp=0xc000421d38 pc=0x43d596
runtime.selectgo(0xc000421f38, 0xc000421f20, 0xc0002da1c0?, 0x0, 0xc0005f62f0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc000421e98 sp=0xc000421d58 pc=0x44d012
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc0001390f0, 0xe}, {0xf709e0, 0xc0002d6240}, {0xf7c898, 0xc0002d6240}, {0xf7c2a0, 0x179f168}, 0xc0002da150, 0xc0002ceb40, ...)
	/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:72 +0x20e fp=0xc000421f68 sp=0xc000421e98 pc=0xb939ee
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4142 +0x9f fp=0xc000421fe0 sp=0xc000421f68 pc=0xbed83f
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000421fe8 sp=0xc000421fe0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4142 +0x1f8

goroutine 46 [select]:
runtime.gopark(0xc00005ef90?, 0x2?, 0x20?, 0x8c?, 0xc00005ef8c?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00005ee18 sp=0xc00005edf8 pc=0x43d596
runtime.selectgo(0xc00005ef90, 0xc00005ef88, 0x1769500?, 0x0, 0xf77468?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc00005ef58 sp=0xc00005ee18 pc=0x44d012
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc000126b80, 0xc0001ae380)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1827 +0x70 fp=0xc00005efc0 sp=0xc00005ef58 pc=0xc123f0
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1820 +0x2a fp=0xc00005efe0 sp=0xc00005efc0 pc=0xc1234a
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00005efe8 sp=0xc00005efe0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1820 +0x28a

goroutine 45 [chan receive]:
runtime.gopark(0xc0001400a8?, 0xc0002bf520?, 0x20?, 0xf?, 0x459d45?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000230ec8 sp=0xc000230ea8 pc=0x43d596
runtime.chanrecv(0xc00043dc20, 0x0, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/chan.go:577 +0x56c fp=0xc000230f58 sp=0xc000230ec8 pc=0x40b54c
runtime.chanrecv1(0xdf8475800?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/chan.go:440 +0x18 fp=0xc000230f80 sp=0xc000230f58 pc=0x40af78
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc0000c02c0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1410 +0x79 fp=0xc000230fc8 sp=0xc000230f80 pc=0xc1e4f9
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:150 +0x26 fp=0xc000230fe0 sp=0xc000230fc8 pc=0xc16e86
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000230fe8 sp=0xc000230fe0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:150 +0x605

goroutine 44 [select]:
runtime.gopark(0xc00041cea8?, 0x6?, 0x68?, 0xcb?, 0xc00041ccbc?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc00041cb20 sp=0xc00041cb00 pc=0x43d596
runtime.selectgo(0xc00041cea8, 0xc00041ccb0, 0xe319c9?, 0x0, 0xc00041cc98?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc00041cc60 sp=0xc00041cb20 pc=0x44d012
net/http.(*persistConn).roundTrip(0xc000224120, 0xc00028c3c0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2620 +0x974 fp=0xc00041cf18 sp=0xc00041cc60 pc=0x7684b4
net/http.(*Transport).roundTrip(0x16ef380, 0xc0001a6900)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:594 +0x7c9 fp=0xc00041d150 sp=0xc00041cf18 pc=0x75bfa9
net/http.(*Transport).RoundTrip(0xc0001a6900?, 0xf6dc20?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/roundtrip.go:17 +0x19 fp=0xc00041d170 sp=0xc00041d150 pc=0x744259
net/http.send(0xc0001a6800, {0xf6dc20, 0x16ef380}, {0xdbb3a0?, 0x48e801?, 0x1768b20?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/client.go:252 +0x5d8 fp=0xc00041d350 sp=0xc00041d170 pc=0x705b78
net/http.(*Client).send(0xc000284a80, 0xc0001a6800, {0x7ff8c8395028?, 0x150?, 0x1768b20?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/client.go:176 +0x9b fp=0xc00041d3c8 sp=0xc00041d350 pc=0x70541b
net/http.(*Client).do(0xc000284a80, 0xc0001a6800)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/client.go:725 +0x8f5 fp=0xc00041d5c8 sp=0xc00041d3c8 pc=0x707855
net/http.(*Client).Do(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/client.go:593
github.com/couchbase/indexing/secondary/security.getWithAuthInternal({0xc0002c4390?, 0x1b?}, 0xc00041d960, {0x0, 0x0}, 0x0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/security/tls.go:669 +0x549 fp=0xc00041d6c8 sp=0xc00041d5c8 pc=0x84c449
github.com/couchbase/indexing/secondary/security.GetWithAuthNonTLS(...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/security/tls.go:604
github.com/couchbase/indexing/secondary/dcp.queryRestAPIOnLocalhost(0xc000298750, {0xe2afec, 0x6}, {0xd307e0?, 0xc000295901?}, {0xc9d4c0, 0xc000126298}, 0xc0002ced20?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:359 +0x1b3 fp=0xc00041d910 sp=0xc00041d6c8 pc=0x86de13
github.com/couchbase/indexing/secondary/dcp.(*Client).parseURLResponse(...)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:530
github.com/couchbase/indexing/secondary/dcp.ConnectWithAuth({0xc0002ced20, 0x3f}, {0xf6d840?, 0xc000280280})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:594 +0x125 fp=0xc00041d988 sp=0xc00041d910 pc=0x86fdc5
github.com/couchbase/indexing/secondary/dcp.Connect({0xc0002ced20, 0x3f})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:600 +0xce fp=0xc00041db20 sp=0xc00041d988 pc=0x86ff6e
github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier({0xc0002ced20, 0x3f}, {0xe2bed7, 0x7}, {0xe2f16e, 0xb})
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:239 +0x1a8 fp=0xc00041dda0 sp=0xc00041db20 pc=0xabf588
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges(0xc0000c02c0)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2071 +0xff fp=0xc00041dfc8 sp=0xc00041dda0 pc=0xc2375f
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func1()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:149 +0x26 fp=0xc00041dfe0 sp=0xc00041dfc8 pc=0xc16ee6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc00041dfe8 sp=0xc00041dfe0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:149 +0x5c5

goroutine 11 [IO wait]:
runtime.gopark(0xc0002bf860?, 0xc00004ea00?, 0x60?, 0x77?, 0x483402?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc0001576f0 sp=0xc0001576d0 pc=0x43d596
runtime.netpollblock(0xc00029e000?, 0x1000?, 0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/netpoll.go:522 +0xf7 fp=0xc000157728 sp=0xc0001576f0 pc=0x436037
internal/poll.runtime_pollWait(0x7ff8c93b2de8, 0x72)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/netpoll.go:302 +0x89 fp=0xc000157748 sp=0xc000157728 pc=0x468109
internal/poll.(*pollDesc).wait(0xc000032300?, 0xc00029e000?, 0x0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_poll_runtime.go:83 +0x32 fp=0xc000157770 sp=0xc000157748 pc=0x4a0d32
internal/poll.(*pollDesc).waitRead(...)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc000032300, {0xc00029e000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0001577f0 sp=0xc000157770 pc=0x4a209a
net.(*netFD).Read(0xc000032300, {0xc00029e000?, 0xc0001578b8?, 0x54ff65?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/fd_posix.go:55 +0x29 fp=0xc000157838 sp=0xc0001577f0 pc=0x6648e9
net.(*conn).Read(0xc000208348, {0xc00029e000?, 0x198?, 0xcad8e0?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/net.go:183 +0x45 fp=0xc000157880 sp=0xc000157838 pc=0x673e05
net/http.(*persistConn).Read(0xc0004a85a0, {0xc00029e000?, 0xc000157910?, 0xc0005ca040?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:1929 +0x4e fp=0xc0001578e0 sp=0xc000157880 pc=0x764aee
bufio.(*Reader).fill(0xc000206b40)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:106 +0x103 fp=0xc000157918 sp=0xc0001578e0 pc=0x51d6c3
bufio.(*Reader).ReadSlice(0xc000206b40, 0x2e?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:371 +0x2f fp=0xc000157968 sp=0xc000157918 pc=0x51e2af
net/http/internal.readChunkLine(0x0?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0001579b8 sp=0xc000157968 pc=0x702a25
net/http/internal.(*chunkedReader).beginChunk(0xc0000941e0)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0001579e8 sp=0xc0001579b8 pc=0x7024a8
net/http/internal.(*chunkedReader).Read(0xc0000941e0, {0xc0002a4000?, 0x0?, 0xf?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/internal/chunked.go:98 +0x14e fp=0xc000157a68 sp=0xc0001579e8 pc=0x70276e
net/http.(*body).readLocked(0xc00007e000, {0xc0002a4000?, 0x0?, 0x1?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transfer.go:844 +0x3c fp=0xc000157ab8 sp=0xc000157a68 pc=0x75971c
net/http.(*body).Read(0xc0005457f5?, {0xc0002a4000?, 0xc000200c00?, 0xc0004dad80?})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transfer.go:836 +0x125 fp=0xc000157b30 sp=0xc000157ab8 pc=0x7595e5
net/http.(*bodyEOFSignal).Read(0xc00007e040, {0xc0002a4000, 0x1000, 0x1000})
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/net/http/transport.go:2774 +0x142 fp=0xc000157bb0 sp=0xc000157b30 pc=0x769222
bufio.(*Reader).fill(0xc000157f58)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:106 +0x103 fp=0xc000157be8 sp=0xc000157bb0 pc=0x51d6c3
bufio.(*Reader).ReadSlice(0xc000157f58, 0x5?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:371 +0x2f fp=0xc000157c38 sp=0xc000157be8 pc=0x51e2af
bufio.(*Reader).collectFragments(0xd9ec20?, 0x8?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:446 +0x74 fp=0xc000157ce8 sp=0xc000157c38 pc=0x51e6f4
bufio.(*Reader).ReadBytes(0xc00043d620?, 0x30?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/bufio/bufio.go:474 +0x1d fp=0xc000157d68 sp=0xc000157ce8 pc=0x51e89d
github.com/couchbase/indexing/secondary/common.(*internalVersionMonitor).waitForChange(0xc0002c4270?, 0x2c?, 0xe50510?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:620 +0x4b fp=0xc000157e18 sp=0xc000157d68 pc=0xab97ab
github.com/couchbase/indexing/secondary/common.(*internalVersionMonitor).notifier(0xc0001ca070)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:709 +0x493 fp=0xc000157fc8 sp=0xc000157e18 pc=0xaba053
github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:232 +0x26 fp=0xc000157fe0 sp=0xc000157fc8 pc=0xab59c6
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc000157fe8 sp=0xc000157fe0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:232 +0x336

goroutine 63 [select]:
runtime.gopark(0xc0002366b8?, 0x2?, 0x0?, 0x0?, 0xc000236690?)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/proc.go:361 +0xd6 fp=0xc000236518 sp=0xc0002364f8 pc=0x43d596
runtime.selectgo(0xc0002366b8, 0xc00023668c, 0x0?, 0x0, 0x0?, 0x1)
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/select.go:328 +0x772 fp=0xc000236658 sp=0xc000236518 pc=0x44d012
github.com/couchbase/indexing/secondary/manager/client.(*watcher).waitForReady(0xc0002d6240, 0xc0002ceb40, 0x0?, 0x0?)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:5828 +0x239 fp=0xc000236720 sp=0xc000236658 pc=0xbf8a39
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).retryHelper(0xc0000c0370, 0x0?, 0x0?, {0xc0001390f0, 0xe}, {0xc0000c4500, 0x1b}, 0x0?, 0xc000286630)
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4076 +0x65 fp=0xc000236788 sp=0xc000236720 pc=0xbed045
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).WatchMetadata.func2()
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:341 +0x46 fp=0xc0002367e0 sp=0xc000236788 pc=0xbd6186
runtime.goexit()
	/home/buildbot/.cbdepscache/exploded/x86_64/go-1.18.3/go/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc0002367e8 sp=0xc0002367e0 pc=0x46db21
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).WatchMetadata
	/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:341 +0x4d4
signal: aborted (core dumped)
FAIL	github.com/couchbase/indexing/secondary/tests/largedatatests	1.121s
Indexer Go routine dump logged in /opt/build/ns_server/logs/n_1/indexer_largedata_pprof.log
curl: /opt/build/install/lib/libcurl.so.4: no version information available (required by curl)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 65273    0 65273    0     0  9614k      0 --:--:-- --:--:-- --:--:-- 10.3M

Integration tests

Disabled integration tests

Testing Failed: Required test failed

Binary file /opt/build/test.log matches
Binary file /opt/build/test.log matches
Version: versions-04.08.2022-22.31.cfg
Build Log: make-04.08.2022-22.31.log
Server Log: logs-04.08.2022-22.31.tar.gz

Finished