Building
Started building at 2023/02/10 16:17:01
Using pegged server, 3620 build
Calculating base
Updating mirror
Basing run on 7.5.0-3620 fe0478147a
Updating tree for run 10.02.2023-16.17
query is at 8a1c256, changes since last good build: none
gometa is at e041ad6, changes since last good build: none
ns_server is at c24130d, changes since last good build: none
couchstore is at d75745b, changes since last good build: none
forestdb is at acba458, changes since last good build: none
kv_engine is at 45f6681, changes since last good build: none
Switching indexing to unstable
indexing is at 79bc5ba, changes since last good build:
79bc5ba4 MB-55502: Implement follower resume state handler
79aaa161 MB-55502: Implement master resume state handler
e242d306 MB-55502: Add resume download token in-mem bookkeeping
a6b52498 MB-55502: Add skeleton for resume observer
b83a0e04 MB-55386: Publish ResumeDownloadTokens to metaKV
ecad30f7 MB-55386: Create resumer via http endpoint based on type
90dd1349 MB-55386: Add skeleton for resumer
0d45be79 MB-55386: Add ResumeDownloadToken
22eeb7bd MB-55505 Change default config for minVbQueueLength
Switching plasma to unstable
plasma is at 2781aab, changes since last good build:
fatal: Invalid revision range f4764e521f59abf12f0a870eadbd03c33c9572e6..HEAD
Switching nitro to unstable
nitro is at d5f5610, changes since last good build: none
Switching gometa to master
gometa is at e041ad6, changes since last good build: none
Switching testrunner to master
Submodule 'gauntlet' (https://github.com/pavithra-mahamani/gauntlet) registered for path 'gauntlet'
Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client'
Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI'
Submodule 'magma_loader/DocLoader' (https://github.com/couchbaselabs/DocLoader.git) registered for path 'magma_loader/DocLoader'
Cloning into '/opt/build/testrunner/gauntlet'...
Cloning into '/opt/build/testrunner/java_sdk_client'...
Cloning into '/opt/build/testrunner/lib/capellaAPI'...
Cloning into '/opt/build/testrunner/magma_loader/DocLoader'...
Submodule path 'gauntlet': checked out '4e2424851a59c6f4b4edfdb7e36fa6a0874d6300'
Submodule path 'java_sdk_client': checked out '5dd338995c16ac2f5b187729e549b28862060732'
Submodule path 'lib/capellaAPI': checked out 'a98c80da07400e94855620675c74008da872586a'
Submodule path 'magma_loader/DocLoader': checked out 'e0d979fdcb9b1918d8e1e3787e0f431c79923758'
testrunner is at 39ffcfe, changes since last good build:
39ffcfe99 MB-55444: Adjust the backup tests to Debian. There might be more changes required
448b45089 fail testcase if dataplane is not provisioned
Pulling in uncommitted change 184416 at refs/changes/16/184416/12
Total 5 (delta 1), reused 1 (delta 1)
[unstable 06608af2] MB-52409 avoid ServiceChangeNotifier teardown
Author: Dhruvil Shah
Date: Mon Jan 2 21:55:32 2023 +0530
1 file changed, 31 insertions(+), 6 deletions(-)
Pulling in uncommitted change 186298 at refs/changes/98/186298/7
Total 5 (delta 4), reused 5 (delta 4)
[unstable 6d5a770e] MB-55489 - resume skeleton
Author: Dhruvil Shah
Date: Tue Feb 7 19:35:55 2023 +0530
1 file changed, 71 insertions(+), 16 deletions(-)
Pulling in uncommitted change 186331 at refs/changes/31/186331/2
Total 7 (delta 6), reused 7 (delta 6)
[unstable d08fb5f5] MB-55473: Pass indexer low watermark to Plasma
Author: jliang00
Date: Tue Feb 7 14:14:07 2023 -0800
2 files changed, 1 insertion(+), 8 deletions(-)
Pulling in uncommitted change 186438 at refs/changes/38/186438/8
Total 6 (delta 1), reused 1 (delta 1)
[unstable d629aa4f] MB-55055: Add throttling stat for bucket
Author: Dhananjay Kshirsagar
Date: Thu Feb 9 00:40:29 2023 +0530
2 files changed, 13 insertions(+)
Pulling in uncommitted change 186517 at refs/changes/17/186517/2
Total 5 (delta 1), reused 1 (delta 1)
[unstable 9dd06d3e] MB-55471 Enable throttling for mutation/scan if CPU > 90% usage
Author: Deepkaran Salooja
Date: Thu Feb 9 15:38:03 2023 -0800
1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 184908 at refs/changes/08/184908/13
Total 7 (delta 6), reused 7 (delta 6)
[unstable 3d45e5c] MB-54924: Compute Minimum and Maximum mutation quota
Author: jliang00
Date: Thu Jan 12 15:02:08 2023 -0800
5 files changed, 301 insertions(+), 119 deletions(-)
Pulling in uncommitted change 186362 at refs/changes/62/186362/2
Total 6 (delta 2), reused 3 (delta 2)
[unstable 30e295c] MB-55477: Remove instance from Controller on Recovery Failure
Author: Saptarshi Sen
Date: Tue Feb 7 16:38:34 2023 -0800
4 files changed, 71 insertions(+), 2 deletions(-)
Pulling in uncommitted change 186363 at refs/changes/63/186363/5
Total 11 (delta 9), reused 11 (delta 9)
[unstable 90e9c83] MB-55477: Use Recovery Controller in recoverFromFullDataScan
Author: Saptarshi Sen
Date: Tue Feb 7 19:23:37 2023 -0800
3 files changed, 45 insertions(+)
Pulling in uncommitted change 186465 at refs/changes/65/186465/2
Total 5 (delta 4), reused 5 (delta 4)
[unstable cba8acc] MB-55505: Log when swapper disabled by controller
Author: jliang00
Date: Wed Feb 8 19:34:57 2023 -0800
3 files changed, 38 insertions(+), 25 deletions(-)
Building community edition
Building cmakefiles and deps [CE]
Building main product [CE]
Build CE finished
BUILD_ENTERPRISE empty. Building enterprise edition
Building Enterprise Edition
Building cmakefiles and deps [EE]
Building main product [EE]
Build EE finished
Testing
Started testing at 2023/02/10 17:10:17
Testing mode: sanity,unit,functional,serverless,integration
Using storage type: memdb
Setting ulimit to 200000
Simple Test
Feb 10 17:15:45 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Feb 10 17:19:37 rebalance_in_with_ops (rebalance.rebalancein.RebalanceInTests) ... ok
Feb 10 17:20:26 do_warmup_100k (memcapable.WarmUpMemcachedTest) ... ok
Feb 10 17:21:57 test_view_ops (view.createdeleteview.CreateDeleteViewTests) ... ok
Feb 10 17:22:40 b" 'stop_on_failure': 'True'}"
Feb 10 17:22:40 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Feb 10 17:22:40 b"{'nodes_in': '3', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 1, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'False', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Feb-10_17-10-41/test_1'}"
Feb 10 17:22:40 b'-->result: '
Feb 10 17:22:40 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 1 , fail 0'
Feb 10 17:22:40 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops,nodes_in=3,bucket_type=ephemeral,replicas=1,items=50000,get-logs-cluster-run=True,doc_ops=create;update;delete'
Feb 10 17:22:40 b"{'nodes_in': '3', 'bucket_type': 'ephemeral', 'replicas': '1', 'items': '50000', 'get-logs-cluster-run': 'True', 'doc_ops': 'create;update;delete', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 2, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Feb-10_17-10-41/test_2'}"
Feb 10 17:22:40 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Feb 10 17:22:40 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t memcapable.WarmUpMemcachedTest.do_warmup_100k,get-logs-cluster-run=True'
Feb 10 17:22:40 b"{'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 3, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Feb-10_17-10-41/test_3'}"
Feb 10 17:22:40 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Feb 10 17:22:40 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Feb 10 17:22:40 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.createdeleteview.CreateDeleteViewTests.test_view_ops,ddoc_ops=create,test_with_view=True,num_ddocs=1,num_views_per_ddoc=10,items=1000,skip_cleanup=False,get-logs-cluster-run=True'
Feb 10 17:22:40 b"{'ddoc_ops': 'create', 'test_with_view': 'True', 'num_ddocs': '1', 'num_views_per_ddoc': '10', 'items': '1000', 'skip_cleanup': 'False', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 4, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Feb-10_17-10-41/test_4'}"
Feb 10 17:22:40 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Feb 10 17:22:40 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Feb 10 17:22:40 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Feb 10 17:32:43 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in,num_nodes_to_add=1,skip_rebalance=true,docs-per-day=1,timeout=1200,get-logs-cluster-run=True'ok
Feb 10 17:33:28 test_simple_dataset_stale_queries_data_modification (view.viewquerytests.ViewQueryTests) ... ok
Feb 10 17:37:14 load_with_ops (xdcr.uniXDCR.unidirectional) ... ok
Feb 10 17:41:12 load_with_failover (xdcr.uniXDCR.unidirectional) ... ok
Feb 10 17:43:55 suite_tearDown (xdcr.uniXDCR.unidirectional) ... ok
Feb 10 17:43:55 b"{'num_nodes_to_add': '1', 'skip_rebalance': 'true', 'docs-per-day': '1', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 5, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Feb-10_17-10-41/test_5'}"
Feb 10 17:43:55 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Feb 10 17:43:55 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Feb 10 17:43:55 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Feb 10 17:43:55 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 1 , fail 0'
Feb 10 17:43:55 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification,num-docs=1000,skip_rebalance=true,timeout=1200,get-logs-cluster-run=True'
Feb 10 17:43:55 b"{'num-docs': '1000', 'skip_rebalance': 'true', 'timeout': '1200', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 6, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Feb-10_17-10-41/test_6'}"
Feb 10 17:43:55 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Feb 10 17:43:55 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Feb 10 17:43:55 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Feb 10 17:43:55 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Feb 10 17:43:55 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_ops,replicas=1,items=10000,value_size=128,ctopology=chain,rdirection=unidirection,doc-ops=update-delete,get-logs-cluster-run=True'
Feb 10 17:43:55 b"{'replicas': '1', 'items': '10000', 'value_size': '128', 'ctopology': 'chain', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 7, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Feb-10_17-10-41/test_7'}"
Feb 10 17:43:55 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Feb 10 17:43:55 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Feb 10 17:43:55 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Feb 10 17:43:55 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Feb 10 17:43:55 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 1 , fail 0'
Feb 10 17:43:55 b'./testrunner -i b/resources/dev-4-nodes-xdcr.ini -p makefile=True,stop_on_failure=True,log_level=CRITICAL -t xdcr.uniXDCR.unidirectional.load_with_failover,replicas=1,items=10000,ctopology=chain,rdirection=unidirection,doc-ops=update-delete,failover=source,get-logs-cluster-run=True'
Feb 10 17:43:55 b"{'replicas': '1', 'items': '10000', 'ctopology': 'chain', 'rdirection': 'unidirection', 'doc-ops': 'update-delete', 'failover': 'source', 'get-logs-cluster-run': 'True', 'ini': 'b/resources/dev-4-nodes-xdcr.ini', 'cluster_name': 'dev-4-nodes-xdcr', 'spec': 'simple', 'conf_file': 'conf/simple.conf', 'makefile': 'True', 'stop_on_failure': 'True', 'log_level': 'CRITICAL', 'num_nodes': 4, 'case_number': 8, 'total_testcases': 8, 'last_case_fail': 'False', 'teardown_run': 'True', 'logs_folder': '/opt/build/testrunner/logs/testrunner-23-Feb-10_17-10-41/test_8'}"
Feb 10 17:43:55 b'summary so far suite rebalance.rebalancein.RebalanceInTests , pass 2 , fail 0'
Feb 10 17:43:55 b'summary so far suite memcapable.WarmUpMemcachedTest , pass 1 , fail 0'
Feb 10 17:43:55 b'summary so far suite view.createdeleteview.CreateDeleteViewTests , pass 1 , fail 0'
Feb 10 17:43:55 b'summary so far suite view.viewquerytests.ViewQueryTests , pass 2 , fail 0'
Feb 10 17:43:55 b'summary so far suite xdcr.uniXDCR.unidirectional , pass 2 , fail 0'
Feb 10 17:43:55 b'Run after suite setup for xdcr.uniXDCR.unidirectional.load_with_failover'
Feb 10 17:43:57 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Feb 10 17:43:57 b"('rebalance.rebalancein.RebalanceInTests.rebalance_in_with_ops', ' pass')"
Feb 10 17:43:57 b"('memcapable.WarmUpMemcachedTest.do_warmup_100k', ' pass')"
Feb 10 17:43:57 b"('view.createdeleteview.CreateDeleteViewTests.test_view_ops', ' pass')"
Feb 10 17:43:57 b"('view.viewquerytests.ViewQueryTests.test_employee_dataset_startkey_endkey_queries_rebalance_in', ' pass')"
Feb 10 17:43:57 b"('view.viewquerytests.ViewQueryTests.test_simple_dataset_stale_queries_data_modification', ' pass')"
Feb 10 17:43:57 b"('xdcr.uniXDCR.unidirectional.load_with_ops', ' pass')"
Feb 10 17:43:57 b"('xdcr.uniXDCR.unidirectional.load_with_failover', ' pass')"
Unit tests
=== RUN TestMerger
--- PASS: TestMerger (0.02s)
=== RUN TestInsert
--- PASS: TestInsert (0.00s)
=== RUN TestInsertPerf
16000000 items took 29.141185679s -> 549051.0982032579 items/s conflicts 31
--- PASS: TestInsertPerf (29.14s)
=== RUN TestGetPerf
16000000 items took 5.420123046s -> 2.951962504210647e+06 items/s
--- PASS: TestGetPerf (6.01s)
=== RUN TestGetRangeSplitItems
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3351,
"memory_used": 37360992,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749144,
"level1": 187776,
"level2": 47222,
"level3": 11903,
"level4": 2974,
"level5": 735,
"level6": 182,
"level7": 48,
"level8": 12,
"level9": 2,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Split range keys [35911 108875 357987 462344 598654 671258 781160]
No of items in each range [35911 72964 249112 104357 136310 72604 109902 218840]
--- PASS: TestGetRangeSplitItems (0.59s)
=== RUN TestBuilder
{
"node_count": 50000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3333,
"memory_used": 1866650912,
"node_allocs": 50000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 37500395,
"level1": 9374070,
"level2": 2344404,
"level3": 586129,
"level4": 146617,
"level5": 36338,
"level6": 9033,
"level7": 2299,
"level8": 539,
"level9": 123,
"level10": 39,
"level11": 9,
"level12": 5,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 7.664776177s to build 50000000 items, 6.5233475e+06 items/sec
Took 404.661896ms to iterate 50000000 items
--- PASS: TestBuilder (8.07s)
=== RUN TestNodeDCAS
--- PASS: TestNodeDCAS (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/memdb/skiplist 44.076s
=== RUN TestInsert
Set IO Concurrency: 716
--- PASS: TestInsert (0.01s)
=== RUN TestInsertPerf
20000000 items took 49.833582835s -> 401335.78326528124 items/s snapshots_created 210 live_snapshots 1
--- PASS: TestInsertPerf (63.23s)
=== RUN TestInsertDuplicates
--- PASS: TestInsertDuplicates (0.40s)
=== RUN TestGetPerf
16000000 items took 11.42587039s -> 1.4003309554432991e+06 items/s
--- PASS: TestGetPerf (12.70s)
=== RUN TestLoadStoreDisk
Inserting 1000000 items took 1.436371219s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 9,
"next_pointers_per_node": 1.3327,
"memory_used": 57323200,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 750244,
"level1": 187501,
"level2": 46818,
"level3": 11557,
"level4": 2875,
"level5": 742,
"level6": 187,
"level7": 55,
"level8": 16,
"level9": 3,
"level10": 2,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
2023-02-10T17:46:17.232+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[51443 82089 195644 116938 98946 72677 72676 21560 142927 28060 38767 78273 0 0 0 0]] total count [1000000] snap count [1000000] size per shard [[411544 656712 1565152 935504 791568 581416 581408 172480 1143416 224480 310136 626184 0 0 0 0]] total size [8000000] memoryInUse [57323200]
Storing to disk took 323.048841ms
Loading from disk took 278.622854ms
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3333,
"memory_used": 57332992,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749853,
"level1": 187650,
"level2": 47008,
"level3": 11561,
"level4": 2982,
"level5": 713,
"level6": 177,
"level7": 41,
"level8": 14,
"level9": 1,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestLoadStoreDisk (3.47s)
=== RUN TestConcurrentLoadCloseFragmentation
Done Inserting 2000000 items
frag = NaN%
2023-02-10T17:46:23.216+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[5259 36375 378223 67449 342795 89243 47102 153113 249225 33212 115951 125656 63941 111017 126864 54575]] total count [2000000] snap count [2000000] size per shard [[42072 291000 3025784 539592 2742360 713944 376816 1224904 1993800 265696 927608 1005248 511528 888136 1014912 436600]] total size [16000000] memoryInUse [114727440]
Done Storing to disk
frag = NaN%
Done Loading from disk
Done Closing
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentation (6.60s)
=== RUN TestConcurrentLoadCloseFragmentationSmall
Done Inserting 10 items
frag = NaN%
2023-02-10T17:46:25.414+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationSmall (0.10s)
=== RUN TestConcurrentLoadCloseFragmentationEmpty
Done Inserting 0 items
frag = NaN%
2023-02-10T17:46:25.503+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total count [0] snap count [0] size per shard [[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]] total size [0] memoryInUse [0]
Done Storing to disk
frag = NaN%
Done Closing
Done Loading from disk
frag = NaN%
--- PASS: TestConcurrentLoadCloseFragmentationEmpty (0.09s)
=== RUN TestConcurrentCloseSingleNode
A
--- PASS: TestConcurrentCloseSingleNode (0.00s)
=== RUN TestStoreDiskShutdown
Inserting 1000000 items took 1.473061505s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 6,
"next_pointers_per_node": 1.3344,
"memory_used": 57351184,
"node_allocs": 1000003,
"node_frees": 0,
"level_node_distribution":{
"level0": 749118,
"level1": 188259,
"level2": 46898,
"level3": 11797,
"level4": 2954,
"level5": 735,
"level6": 179,
"level7": 46,
"level8": 11,
"level9": 2,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
snap count = 1000000
Prepare returns error: MemDB instance has been shutdown
--- PASS: TestStoreDiskShutdown (2.23s)
=== RUN TestDelete
{
"node_count": 10,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.4000,
"memory_used": 604,
"node_allocs": 10,
"node_frees": 0,
"level_node_distribution":{
"level0": 7,
"level1": 2,
"level2": 1,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
{
"node_count": 10,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3000,
"memory_used": 588,
"node_allocs": 20,
"node_frees": 10,
"level_node_distribution":{
"level0": 7,
"level1": 3,
"level2": 0,
"level3": 0,
"level4": 0,
"level5": 0,
"level6": 0,
"level7": 0,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
--- PASS: TestDelete (1.00s)
=== RUN TestGCPerf
final_node_count = 16000, average_live_node_count = 68720, wait_time_for_collection = 10ms
--- PASS: TestGCPerf (34.29s)
=== RUN TestMemoryInUse
ItemsCount: 5000, MemoryInUse: 296880, NodesCount: 5000
ItemsCount: 0, MemoryInUse: 80, NodesCount: 0
--- PASS: TestMemoryInUse (1.01s)
=== RUN TestFullScan
Inserting 1600000 items took 2.524725912s
{
"node_count": 1600000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 17,
"next_pointers_per_node": 1.3335,
"memory_used": 91737132,
"node_allocs": 1599999,
"node_frees": 0,
"level_node_distribution":{
"level0": 1199763,
"level1": 300169,
"level2": 75061,
"level3": 18851,
"level4": 4574,
"level5": 1177,
"level6": 312,
"level7": 73,
"level8": 15,
"level9": 4,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Full iteration of 1600000 items took 297.408782ms
--- PASS: TestFullScan (4.04s)
=== RUN TestVisitor
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3322,
"memory_used": 57315184,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 750533,
"level1": 187220,
"level2": 46871,
"level3": 11483,
"level4": 2962,
"level5": 722,
"level6": 154,
"level7": 40,
"level8": 10,
"level9": 4,
"level10": 1,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Took 83.165123ms to iterate 1000000 items, 1.2024271e+07 items/s
shard - 0 count = 14057, range: 0-14056
shard - 1 count = 26645, range: 14057-40701
shard - 2 count = 68013, range: 40702-108714
shard - 3 count = 21230, range: 108715-129944
shard - 4 count = 29517, range: 129945-159461
shard - 5 count = 65503, range: 159462-224964
shard - 6 count = 22210, range: 224965-247174
shard - 7 count = 11357, range: 247175-258531
shard - 8 count = 40608, range: 258532-299139
shard - 9 count = 60608, range: 299140-359747
shard - 10 count = 36764, range: 359748-396511
shard - 11 count = 30934, range: 396512-427445
shard - 12 count = 39713, range: 427446-467158
shard - 13 count = 51099, range: 467159-518257
shard - 14 count = 24356, range: 518258-542613
shard - 15 count = 2810, range: 542614-545423
shard - 16 count = 27161, range: 545424-572584
shard - 17 count = 27875, range: 572585-600459
shard - 18 count = 17584, range: 600460-618043
shard - 19 count = 64427, range: 618044-682470
shard - 20 count = 28608, range: 682471-711078
shard - 21 count = 46933, range: 711079-758011
shard - 22 count = 9484, range: 758012-767495
shard - 23 count = 30047, range: 767496-797542
shard - 24 count = 15530, range: 797543-813072
shard - 25 count = 93818, range: 813073-906890
shard - 26 count = 48902, range: 906891-955792
shard - 27 count = 6694, range: 955793-962486
shard - 28 count = 37513, range: 962487-999999
shard - 29 count = 0, range: 0-0
shard - 30 count = 0, range: 0-0
shard - 31 count = 0, range: 0-0
--- PASS: TestVisitor (1.79s)
=== RUN TestVisitorError
--- PASS: TestVisitorError (0.15s)
=== RUN TestLoadDeltaStoreDisk
snap count = 1000000
2023-02-10T17:47:13.804+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[0 0 0 0 0 0 0 92651 74573 122387 146310 245368 62374 106720 56894 73878]] total count [981155] snap count [1000000] size per shard [[0 0 0 0 0 0 0 741208 596584 979096 1170480 1962944 498992 853760 455152 591024]] total size [7849240] memoryInUse [123665600]
Storing to disk took 15.300238874s
Loading from disk took 1.09271226s
{
"node_count": 1000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 0,
"next_pointers_per_node": 1.3342,
"memory_used": 57347760,
"node_allocs": 1000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 749675,
"level1": 187407,
"level2": 47290,
"level3": 11599,
"level4": 3001,
"level5": 798,
"level6": 166,
"level7": 54,
"level8": 7,
"level9": 3,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Restored 18845
RestoredFailed 399134
--- PASS: TestLoadDeltaStoreDisk (18.27s)
=== RUN TestExecuteConcurrGCWorkers
--- PASS: TestExecuteConcurrGCWorkers (0.68s)
=== RUN TestCloseWithActiveIterators
--- PASS: TestCloseWithActiveIterators (6.44s)
=== RUN TestDiskCorruption
Inserting 100000 items took 101.756676ms
{
"node_count": 100000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 2,
"next_pointers_per_node": 1.3325,
"memory_used": 5731900,
"node_allocs": 100043,
"node_frees": 0,
"level_node_distribution":{
"level0": 74960,
"level1": 18857,
"level2": 4651,
"level3": 1150,
"level4": 292,
"level5": 73,
"level6": 14,
"level7": 3,
"level8": 0,
"level9": 0,
"level10": 0,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
2023-02-10T17:47:35.634+05:30 [Info] MemDB::StoreToDisk: Done dir [db.dump] disk snapshot - count per shard [[4603 7767 8554 4345 3543 4962 3910 3783 9300 9252 3588 3872 4279 2986 5415 19841]] total count [100000] snap count [100000] size per shard [[36824 62136 68432 34760 28344 39696 31280 30264 74400 74016 28704 30976 34232 23888 43320 158728]] total size [800000] memoryInUse [5731900]
Storing to disk took 120.043513ms
Loading from disk took 438.997821ms
--- PASS: TestDiskCorruption (0.72s)
=== RUN TestSnapshotStats
--- PASS: TestSnapshotStats (0.00s)
=== RUN TestInsertDeleteConcurrent
total items in snapshot: 8016929 items deleted: 1983071
{
"node_count": 8016929,
"soft_deletes": 0,
"read_conflicts": 3352,
"insert_conflicts": 29,
"next_pointers_per_node": 1.3337,
"memory_used": 459690228,
"node_allocs": 10000000,
"node_frees": 10000002,
"level_node_distribution":{
"level0": 6010106,
"level1": 1504802,
"level2": 376701,
"level3": 94190,
"level4": 23358,
"level5": 5857,
"level6": 1450,
"level7": 338,
"level8": 89,
"level9": 29,
"level10": 9,
"level11": 0,
"level12": 0,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
allocs: 20000002 frees: 20000002
--- PASS: TestInsertDeleteConcurrent (19.68s)
=== RUN TestNodeList
--- PASS: TestNodeList (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/memdb 177.174s
=== RUN TestInteger
--- PASS: TestInteger (0.00s)
=== RUN TestSmallDecimal
--- PASS: TestSmallDecimal (0.00s)
=== RUN TestLargeDecimal
--- PASS: TestLargeDecimal (0.00s)
=== RUN TestFloat
--- PASS: TestFloat (0.00s)
=== RUN TestSuffixCoding
--- PASS: TestSuffixCoding (0.00s)
=== RUN TestCodecLength
--- PASS: TestCodecLength (0.00s)
=== RUN TestSpecialString
--- PASS: TestSpecialString (0.00s)
=== RUN TestCodecNoLength
--- PASS: TestCodecNoLength (0.00s)
=== RUN TestCodecJSON
--- PASS: TestCodecJSON (0.00s)
=== RUN TestReference
--- PASS: TestReference (0.00s)
=== RUN TestN1QLEncode
--- PASS: TestN1QLEncode (0.00s)
=== RUN TestArrayExplodeJoin
--- PASS: TestArrayExplodeJoin (0.00s)
=== RUN TestN1QLDecode
--- PASS: TestN1QLDecode (0.00s)
=== RUN TestN1QLDecode2
--- PASS: TestN1QLDecode2 (0.00s)
=== RUN TestArrayExplodeJoin2
--- PASS: TestArrayExplodeJoin2 (0.00s)
=== RUN TestMB28956
--- PASS: TestMB28956 (0.00s)
=== RUN TestFixEncodedInt
--- PASS: TestFixEncodedInt (0.00s)
=== RUN TestN1QLDecodeLargeInt64
--- PASS: TestN1QLDecodeLargeInt64 (0.00s)
=== RUN TestMixedModeFixEncodedInt
TESTING [4111686018427387900, -8223372036854775808, 822337203685477618]
PASS
TESTING [0]
PASS
TESTING [0.0]
PASS
TESTING [0.0000]
PASS
TESTING [0.0000000]
PASS
TESTING [-0]
PASS
TESTING [-0.0]
PASS
TESTING [-0.0000]
PASS
TESTING [-0.0000000]
PASS
TESTING [1]
PASS
TESTING [20]
PASS
TESTING [3456]
PASS
TESTING [7645000]
PASS
TESTING [9223372036854775807]
PASS
TESTING [9223372036854775806]
PASS
TESTING [9223372036854775808]
PASS
TESTING [92233720368547758071234000]
PASS
TESTING [92233720368547758071234987437653]
PASS
TESTING [12300000000000000000000000000000056]
PASS
TESTING [12300000000000000000000000000000000]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [12300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [210690]
PASS
TESTING [90000]
PASS
TESTING [123000000]
PASS
TESTING [3.60e2]
PASS
TESTING [36e2]
PASS
TESTING [1.9999999999e10]
PASS
TESTING [1.99999e10]
PASS
TESTING [1.99999e5]
PASS
TESTING [0.00000000000012e15]
PASS
TESTING [7.64507352e8]
PASS
TESTING [9.2233720368547758071234987437653e31]
PASS
TESTING [2650e-1]
PASS
TESTING [26500e-1]
PASS
TESTING [-1]
PASS
TESTING [-20]
PASS
TESTING [-3456]
PASS
TESTING [-7645000]
PASS
TESTING [-9223372036854775808]
PASS
TESTING [-9223372036854775807]
PASS
TESTING [-9223372036854775806]
PASS
TESTING [-9223372036854775809]
PASS
TESTING [-92233720368547758071234000]
PASS
TESTING [-92233720368547758071234987437653]
PASS
TESTING [-12300000000000000000000000000000056]
PASS
TESTING [-12300000000000000000000000000000000]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000056]
PASS
TESTING [-123000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000]
PASS
TESTING [-210690]
PASS
TESTING [-90000]
PASS
TESTING [-123000000]
PASS
TESTING [-3.60e2]
PASS
TESTING [-36e2]
PASS
TESTING [-1.9999999999e10]
PASS
TESTING [-1.99999e10]
PASS
TESTING [-1.99999e5]
PASS
TESTING [-0.00000000000012e15]
PASS
TESTING [-2650e-1]
PASS
TESTING [-26500e-1]
PASS
TESTING [0.03]
PASS
TESTING [198.60]
PASS
TESTING [2000045.178]
PASS
TESTING [1.7976931348623157e+308]
PASS
TESTING [0.000000000000000000890]
PASS
TESTING [257953786.9864236576]
PASS
TESTING [257953786.9864236576e8]
PASS
TESTING [36.912e3]
PASS
TESTING [2761.67e0]
PASS
TESTING [2761.67e00]
PASS
TESTING [2761.67e000]
PASS
TESTING [7676546.67e-3]
PASS
TESTING [-0.03]
PASS
TESTING [-198.60]
PASS
TESTING [-2000045.178]
PASS
TESTING [-1.7976931348623157e+308]
PASS
TESTING [-0.000000000000000000890]
PASS
TESTING [-257953786.9864236576]
PASS
TESTING [-257953786.9864236576e8]
PASS
TESTING [-36.912e3]
PASS
TESTING [-2761.67e0]
PASS
TESTING [-2761.67e00]
PASS
TESTING [-2761.67e000]
PASS
TESTING [-7676546.67e-3]
PASS
--- PASS: TestMixedModeFixEncodedInt (0.01s)
=== RUN TestCodecDesc
--- PASS: TestCodecDesc (0.00s)
=== RUN TestCodecDescPropLen
--- PASS: TestCodecDescPropLen (0.00s)
=== RUN TestCodecDescSplChar
--- PASS: TestCodecDescSplChar (0.00s)
PASS
ok github.com/couchbase/indexing/secondary/collatejson 0.036s
=== RUN TestForestDBIterator
2023-02-10T17:48:10.884+05:30 [INFO][FDB] Forestdb blockcache size 134217728 initialized in 4965 us
2023-02-10T17:48:10.885+05:30 [INFO][FDB] Forestdb opened database file test
2023-02-10T17:48:10.889+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIterator (0.01s)
=== RUN TestForestDBIteratorSeek
2023-02-10T17:48:10.889+05:30 [INFO][FDB] Forestdb opened database file test
2023-02-10T17:48:10.891+05:30 [INFO][FDB] Forestdb closed database file test
--- PASS: TestForestDBIteratorSeek (0.00s)
=== RUN TestPrimaryIndexEntry
--- PASS: TestPrimaryIndexEntry (0.00s)
=== RUN TestSecondaryIndexEntry
--- PASS: TestSecondaryIndexEntry (0.00s)
=== RUN TestPrimaryIndexEntryMatch
--- PASS: TestPrimaryIndexEntryMatch (0.00s)
=== RUN TestSecondaryIndexEntryMatch
--- PASS: TestSecondaryIndexEntryMatch (0.00s)
=== RUN TestLongDocIdEntry
--- PASS: TestLongDocIdEntry (0.00s)
=== RUN TestMemDBInsertionPerf
Maximum number of file descriptors = 200000
Set IO Concurrency: 7200
Initial build: 10000000 items took 42.471908277s -> 235449.7456243412 items/s
Incr build: 10000000 items took 3m5.707867274s -> 53848.014878366164 items/s
Main Index: {
"node_count": 18000000,
"soft_deletes": 0,
"read_conflicts": 0,
"insert_conflicts": 2,
"next_pointers_per_node": 1.3333,
"memory_used": 1695887724,
"node_allocs": 18000000,
"node_frees": 0,
"level_node_distribution":{
"level0": 13500190,
"level1": 3375550,
"level2": 843073,
"level3": 210794,
"level4": 52734,
"level5": 13348,
"level6": 3245,
"level7": 782,
"level8": 221,
"level9": 42,
"level10": 17,
"level11": 3,
"level12": 1,
"level13": 0,
"level14": 0,
"level15": 0,
"level16": 0,
"level17": 0,
"level18": 0,
"level19": 0,
"level20": 0,
"level21": 0,
"level22": 0,
"level23": 0,
"level24": 0,
"level25": 0,
"level26": 0,
"level27": 0,
"level28": 0,
"level29": 0,
"level30": 0,
"level31": 0,
"level32": 0
}
}
Back Index 0 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 1 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 2 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 3 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 4 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 5 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 6 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 7 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 8 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 9 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 10 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 11 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 12 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 13 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 14 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
Back Index 15 : {
"FastHTCount": 625000,
"SlowHTCount": 0,
"Conflicts": 0,
"MemoryInUse": 26250000
}
--- PASS: TestMemDBInsertionPerf (228.18s)
=== RUN TestBasicsA
--- PASS: TestBasicsA (0.00s)
=== RUN TestSizeA
--- PASS: TestSizeA (0.00s)
=== RUN TestSizeWithFreelistA
--- PASS: TestSizeWithFreelistA (0.00s)
=== RUN TestDequeueUptoSeqnoA
--- PASS: TestDequeueUptoSeqnoA (0.10s)
=== RUN TestDequeueA
--- PASS: TestDequeueA (1.21s)
=== RUN TestMultipleVbucketsA
--- PASS: TestMultipleVbucketsA (0.00s)
=== RUN TestDequeueUptoFreelistA
--- PASS: TestDequeueUptoFreelistA (0.00s)
=== RUN TestDequeueUptoFreelistMultVbA
--- PASS: TestDequeueUptoFreelistMultVbA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA
--- PASS: TestConcurrentEnqueueDequeueA (0.00s)
=== RUN TestConcurrentEnqueueDequeueA1
--- PASS: TestConcurrentEnqueueDequeueA1 (10.01s)
=== RUN TestEnqueueAppCh
--- PASS: TestEnqueueAppCh (2.00s)
=== RUN TestDequeueN
--- PASS: TestDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN
--- PASS: TestConcurrentEnqueueDequeueN (0.00s)
=== RUN TestConcurrentEnqueueDequeueN1
--- PASS: TestConcurrentEnqueueDequeueN1 (10.01s)
PASS
ok github.com/couchbase/indexing/secondary/indexer 252.301s
=== RUN TestConnPoolBasicSanity
2023-02-10T17:52:26.487+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 3 overflow 6 low WM 3 relConn batch size 1 ...
2023-02-10T17:52:26.695+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-02-10T17:52:27.488+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnPoolBasicSanity (5.00s)
=== RUN TestConnRelease
2023-02-10T17:52:31.489+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Waiting for connections to get released
Waiting for more connections to get released
Waiting for further more connections to get released
2023-02-10T17:53:11.250+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-02-10T17:53:11.506+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestConnRelease (43.76s)
=== RUN TestLongevity
2023-02-10T17:53:15.252+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Releasing 1 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 0 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 4 conns.
Getting 1 conns.
Releasing 2 conns.
Getting 4 conns.
Releasing 3 conns.
Getting 4 conns.
Releasing 1 conns.
Getting 0 conns.
Releasing 2 conns.
Getting 1 conns.
Releasing 0 conns.
Getting 1 conns.
Releasing 3 conns.
Getting 3 conns.
Releasing 2 conns.
Getting 2 conns.
Releasing 2 conns.
Getting 3 conns.
Releasing 0 conns.
Getting 0 conns.
2023-02-10T17:53:53.766+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-02-10T17:53:54.269+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLongevity (42.51s)
=== RUN TestSustainedHighConns
2023-02-10T17:53:57.767+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 500 overflow 10 low WM 40 relConn batch size 10 ...
Allocating 16 Connections
cp.curActConns = 0
Returning 3 Connections
cp.curActConns = 11
Returning 2 Connections
cp.curActConns = 11
Allocating 6 Connections
Returning 4 Connections
cp.curActConns = 13
Returning 1 Connections
Allocating 12 Connections
cp.curActConns = 22
Returning 1 Connections
cp.curActConns = 23
Allocating 10 Connections
Returning 1 Connections
cp.curActConns = 32
Returning 3 Connections
Allocating 15 Connections
cp.curActConns = 33
Returning 4 Connections
cp.curActConns = 40
Returning 3 Connections
Allocating 8 Connections
cp.curActConns = 44
Returning 2 Connections
cp.curActConns = 43
Allocating 3 Connections
Returning 4 Connections
cp.curActConns = 42
Allocating 9 Connections
Returning 3 Connections
cp.curActConns = 48
Returning 2 Connections
Allocating 21 Connections
cp.curActConns = 55
Returning 4 Connections
cp.curActConns = 63
Returning 4 Connections
Allocating 0 Connections
cp.curActConns = 59
Returning 0 Connections
Allocating 13 Connections
cp.curActConns = 66
Returning 3 Connections
cp.curActConns = 69
Returning 3 Connections
Allocating 5 Connections
cp.curActConns = 71
Returning 1 Connections
Allocating 10 Connections
cp.curActConns = 77
Returning 0 Connections
cp.curActConns = 80
Returning 1 Connections
Allocating 16 Connections
cp.curActConns = 89
Returning 3 Connections
cp.curActConns = 92
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 93
Returning 3 Connections
Allocating 21 Connections
cp.curActConns = 100
Returning 3 Connections
cp.curActConns = 108
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 109
Returning 3 Connections
Allocating 22 Connections
cp.curActConns = 112
Returning 4 Connections
cp.curActConns = 124
Returning 2 Connections
Allocating 13 Connections
cp.curActConns = 124
Returning 1 Connections
cp.curActConns = 134
Returning 0 Connections
Allocating 23 Connections
cp.curActConns = 136
Returning 3 Connections
cp.curActConns = 148
Returning 2 Connections
cp.curActConns = 152
Returning 3 Connections
Allocating 16 Connections
cp.curActConns = 160
Returning 4 Connections
cp.curActConns = 161
Allocating 8 Connections
Returning 3 Connections
cp.curActConns = 166
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 167
Returning 3 Connections
Allocating 11 Connections
cp.curActConns = 172
Returning 1 Connections
cp.curActConns = 174
Returning 2 Connections
Allocating 15 Connections
cp.curActConns = 184
Returning 3 Connections
cp.curActConns = 184
Allocating 2 Connections
Returning 3 Connections
cp.curActConns = 183
Allocating 5 Connections
Returning 3 Connections
cp.curActConns = 185
Allocating 0 Connections
Returning 1 Connections
cp.curActConns = 184
Returning 0 Connections
Allocating 7 Connections
cp.curActConns = 191
Returning 2 Connections
Allocating 10 Connections
cp.curActConns = 196
Returning 0 Connections
cp.curActConns = 199
Returning 0 Connections
Allocating 15 Connections
cp.curActConns = 208
Returning 2 Connections
cp.curActConns = 212
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 212
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 213
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 211
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 211
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 214
Returning 1 Connections
Allocating 2 Connections
cp.curActConns = 215
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 218
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 217
Returning 3 Connections
Allocating 1 Connections
cp.curActConns = 215
Returning 4 Connections
Allocating 1 Connections
cp.curActConns = 212
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 210
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 210
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 212
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 212
Returning 4 Connections
Allocating 3 Connections
cp.curActConns = 211
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 209
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 209
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 212
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 213
Returning 1 Connections
Allocating 1 Connections
cp.curActConns = 213
Returning 0 Connections
Allocating 1 Connections
cp.curActConns = 214
Returning 4 Connections
Allocating 4 Connections
cp.curActConns = 214
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 217
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 216
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 217
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 216
Returning 3 Connections
Allocating 4 Connections
cp.curActConns = 217
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 218
Returning 2 Connections
Allocating 3 Connections
cp.curActConns = 219
Returning 3 Connections
Allocating 3 Connections
cp.curActConns = 219
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 218
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 218
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 216
Returning 2 Connections
Allocating 0 Connections
cp.curActConns = 214
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 217
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 220
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 220
Returning 0 Connections
cp.curActConns = 224
Returning 3 Connections
Allocating 0 Connections
cp.curActConns = 221
Returning 4 Connections
Allocating 2 Connections
cp.curActConns = 219
Returning 0 Connections
Allocating 0 Connections
cp.curActConns = 219
Returning 2 Connections
Allocating 4 Connections
cp.curActConns = 221
Returning 0 Connections
Allocating 3 Connections
cp.curActConns = 224
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 223
Returning 1 Connections
Allocating 0 Connections
cp.curActConns = 222
Returning 1 Connections
Allocating 4 Connections
cp.curActConns = 225
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 224
Returning 2 Connections
Allocating 1 Connections
cp.curActConns = 223
Returning 0 Connections
Allocating 4 Connections
cp.curActConns = 227
Returning 2 Connections
Allocating 2 Connections
cp.curActConns = 227
Retuning from startDeallocatorRoutine
Retuning from startAllocatorRoutine
2023-02-10T17:54:52.839+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-02-10T17:54:53.801+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestSustainedHighConns (59.07s)
=== RUN TestLowWM
2023-02-10T17:54:56.840+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 20 overflow 5 low WM 10 relConn batch size 2 ...
2023-02-10T17:55:56.855+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-02-10T17:56:56.871+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] active conns 0, free conns 10
2023-02-10T17:57:02.353+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-02-10T17:57:02.873+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestLowWM (129.52s)
=== RUN TestTotalConns
2023-02-10T17:57:06.355+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 120 overflow 5 low WM 10 relConn batch size 10 ...
2023-02-10T17:57:20.552+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-02-10T17:57:21.361+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestTotalConns (18.20s)
=== RUN TestUpdateTickRate
2023-02-10T17:57:24.555+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] started poolsize 40 overflow 5 low WM 2 relConn batch size 2 ...
2023-02-10T17:57:45.404+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] ... stopped
2023-02-10T17:57:45.566+05:30 [Info] [Queryport-connpool:127.0.0.1:15151] Stopping releaseConnsRoutine
--- PASS: TestUpdateTickRate (24.85s)
PASS
ok github.com/couchbase/indexing/secondary/queryport/client 322.974s
Starting server: attempt 1
Functional tests
2023/02/10 18:00:01 In TestMain()
2023/02/10 18:00:01 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2023/02/10 18:00:01 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2023/02/10 18:00:02 Initialising web UI on node: 127.0.0.1:9000
2023/02/10 18:00:02 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2023/02/10 18:00:03 Setting data quota of 1500M and Index quota of 1500M
2023/02/10 18:00:04 Adding node: https://127.0.0.1:19001 with role: kv,index to the cluster
2023/02/10 18:00:18 AddNode: Successfully added node: 127.0.0.1:9001 (role kv,index), response: {"otpNode":"n_1@127.0.0.1"}
2023/02/10 18:00:23 Rebalance progress: 0
2023/02/10 18:00:28 Rebalance progress: 0
2023/02/10 18:00:33 Rebalance progress: 100
2023/02/10 18:00:38 Created bucket default, responseBody:
2023/02/10 18:00:43 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/02/10 18:00:43 Successfully initialised cluster
2023/02/10 18:00:43 Cluster status: map[127.0.0.1:9001:[index kv] 172.31.5.112:9000:[kv n1ql]]
2023/02/10 18:00:43 Changing config key queryport.client.settings.backfillLimit to value 0
2023/02/10 18:00:43 Changing config key queryport.client.log_level to value Warn
2023/02/10 18:00:44 Changing config key indexer.api.enableTestServer to value true
2023/02/10 18:00:44 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2023/02/10 18:00:44 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2023/02/10 18:00:44 Changing config key indexer.settings.log_level to value info
2023/02/10 18:00:44 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2023/02/10 18:00:44 Using memory_optimized for creating indexes
2023/02/10 18:00:44 Changing config key indexer.settings.storage_mode to value memory_optimized
2023/02/10 18:00:49 Data file exists. Skipping download
2023/02/10 18:00:49 Data file exists. Skipping download
2023/02/10 18:00:51 In DropAllSecondaryIndexes()
2023/02/10 18:00:51 Emptying the default bucket
2023/02/10 18:00:54 Flush Enabled on bucket default, responseBody:
2023/02/10 18:01:32 Flushed the bucket default, Response body:
2023/02/10 18:01:32 Create Index On the empty default Bucket()
2023/02/10 18:01:35 Created the secondary index index_eyeColor. Waiting for it become active
2023/02/10 18:01:35 Index is 7622243638427336112 now active
2023/02/10 18:01:35 Populating the default bucket
=== RUN TestScanAfterBucketPopulate
2023/02/10 18:01:44 In TestScanAfterBucketPopulate()
2023/02/10 18:01:44 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/02/10 18:01:44 Using n1ql client
2023-02-10T18:01:45.002+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2023/02/10 18:01:45 Expected and Actual scan responses are the same
--- PASS: TestScanAfterBucketPopulate (0.11s)
=== RUN TestRestartNilSnapshot
2023/02/10 18:01:45 In TestRestartNilSnapshot()
2023/02/10 18:01:49 Created the secondary index idx_age. Waiting for it become active
2023/02/10 18:01:49 Index is 8801592034163123166 now active
2023/02/10 18:01:49 Restarting indexer process ...
2023/02/10 18:01:49 []
2023-02-10T18:01:49.235+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-02-10T18:01:49.239+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/02/10 18:05:09 Using n1ql client
2023-02-10T18:05:09.186+05:30 [Error] transport error between 127.0.0.1:54126->127.0.0.1:9107: write tcp 127.0.0.1:54126->127.0.0.1:9107: write: broken pipe
2023-02-10T18:05:09.186+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -4002901634067412288 request transport failed `write tcp 127.0.0.1:54126->127.0.0.1:9107: write: broken pipe`
2023-02-10T18:05:09.186+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-02-10T18:05:09.186+05:30 [Error] metadataClient:PickRandom: Replicas - [12813288822831900215], PrunedReplica - map[], FilteredReplica map[]
2023/02/10 18:05:09 Expected and Actual scan responses are the same
--- PASS: TestRestartNilSnapshot (204.13s)
=== RUN TestThreeIndexCreates
2023/02/10 18:05:09 In TestThreeIndexCreates()
2023/02/10 18:05:13 Created the secondary index index_balance. Waiting for it become active
2023/02/10 18:05:13 Index is 17353179121976095927 now active
2023/02/10 18:05:13 Create docs mutations
2023/02/10 18:05:13 Using n1ql client
2023/02/10 18:05:13 Expected and Actual scan responses are the same
2023/02/10 18:05:19 Created the secondary index index_email. Waiting for it become active
2023/02/10 18:05:19 Index is 16178370404415815858 now active
2023/02/10 18:05:19 Create docs mutations
2023/02/10 18:05:19 Using n1ql client
2023/02/10 18:05:19 Expected and Actual scan responses are the same
2023/02/10 18:05:25 Created the secondary index index_pin. Waiting for it become active
2023/02/10 18:05:25 Index is 11792502458389444747 now active
2023/02/10 18:05:25 Delete docs mutations
2023/02/10 18:05:26 Using n1ql client
2023/02/10 18:05:26 Expected and Actual scan responses are the same
--- PASS: TestThreeIndexCreates (17.03s)
=== RUN TestMultipleIndexCreatesDropsWithMutations
2023/02/10 18:05:26 In TestThreeIndexCreates()
2023/02/10 18:05:32 Created the secondary index index_state. Waiting for it become active
2023/02/10 18:05:32 Index is 8324363886095155727 now active
2023/02/10 18:05:32 Create docs mutations
2023/02/10 18:05:32 Using n1ql client
2023/02/10 18:05:32 Expected and Actual scan responses are the same
2023/02/10 18:05:38 Created the secondary index index_registered. Waiting for it become active
2023/02/10 18:05:38 Index is 9712038584876180576 now active
2023/02/10 18:05:38 Create docs mutations
2023/02/10 18:05:38 Using n1ql client
2023/02/10 18:05:38 Expected and Actual scan responses are the same
2023/02/10 18:05:45 Created the secondary index index_gender. Waiting for it become active
2023/02/10 18:05:45 Index is 13644943141644942695 now active
2023/02/10 18:05:45 Create docs mutations
2023/02/10 18:05:45 Using n1ql client
2023/02/10 18:05:45 Expected and Actual scan responses are the same
2023/02/10 18:05:45 Dropping the secondary index index_registered
2023/02/10 18:05:45 Index dropped
2023/02/10 18:05:45 Create docs mutations
2023/02/10 18:05:45 Delete docs mutations
2023/02/10 18:05:45 Using n1ql client
2023/02/10 18:05:45 Expected and Actual scan responses are the same
2023/02/10 18:05:52 Created the secondary index index_longitude. Waiting for it become active
2023/02/10 18:05:52 Index is 7830726190666406829 now active
2023/02/10 18:05:52 Create docs mutations
2023/02/10 18:05:52 Using n1ql client
2023/02/10 18:05:52 Expected and Actual scan responses are the same
--- PASS: TestMultipleIndexCreatesDropsWithMutations (26.17s)
=== RUN TestCreateDropScan
2023/02/10 18:05:52 In TestCreateDropScan()
2023/02/10 18:05:58 Created the secondary index index_cd. Waiting for it become active
2023/02/10 18:05:58 Index is 10852805223198173722 now active
2023/02/10 18:05:58 Using n1ql client
2023/02/10 18:05:58 Expected and Actual scan responses are the same
2023/02/10 18:05:58 Dropping the secondary index index_cd
2023/02/10 18:05:58 Index dropped
2023/02/10 18:05:58 Using n1ql client
2023/02/10 18:05:58 Scan failed as expected with error: Index Not Found - cause: GSI index index_cd not found.
--- PASS: TestCreateDropScan (6.25s)
=== RUN TestCreateDropCreate
2023/02/10 18:05:58 In TestCreateDropCreate()
2023/02/10 18:06:04 Created the secondary index index_cdc. Waiting for it become active
2023/02/10 18:06:04 Index is 9843305759892413988 now active
2023/02/10 18:06:04 Using n1ql client
2023/02/10 18:06:04 Expected and Actual scan responses are the same
2023/02/10 18:06:04 Dropping the secondary index index_cdc
2023/02/10 18:06:04 Index dropped
2023/02/10 18:06:04 Using n1ql client
2023/02/10 18:06:04 Scan 2 failed as expected with error: Index Not Found - cause: GSI index index_cdc not found.
2023/02/10 18:06:10 Created the secondary index index_cdc. Waiting for it become active
2023/02/10 18:06:10 Index is 1137395161119184496 now active
2023/02/10 18:06:10 Using n1ql client
2023/02/10 18:06:11 Expected and Actual scan responses are the same
2023/02/10 18:06:11 (Inclusion 1) Lengths of expected and actual scan results are 5073 and 5073. Num of docs in bucket = 10402
2023/02/10 18:06:11 Using n1ql client
2023/02/10 18:06:11 Expected and Actual scan responses are the same
2023/02/10 18:06:11 (Inclusion 3) Lengths of expected and actual scan results are 5073 and 5073. Num of docs in bucket = 10402
--- PASS: TestCreateDropCreate (12.48s)
=== RUN TestCreate2Drop1Scan2
2023/02/10 18:06:11 In TestCreate2Drop1Scan2()
2023/02/10 18:06:17 Created the secondary index index_i1. Waiting for it become active
2023/02/10 18:06:17 Index is 16670386320582390406 now active
2023/02/10 18:06:23 Created the secondary index index_i2. Waiting for it become active
2023/02/10 18:06:23 Index is 9652342754458519354 now active
2023/02/10 18:06:23 Using n1ql client
2023/02/10 18:06:23 Expected and Actual scan responses are the same
2023/02/10 18:06:23 Using n1ql client
2023/02/10 18:06:23 Expected and Actual scan responses are the same
2023/02/10 18:06:23 Dropping the secondary index index_i1
2023/02/10 18:06:23 Index dropped
2023/02/10 18:06:23 Using n1ql client
2023/02/10 18:06:23 Expected and Actual scan responses are the same
--- PASS: TestCreate2Drop1Scan2 (12.37s)
=== RUN TestIndexNameCaseSensitivity
2023/02/10 18:06:23 In TestIndexNameCaseSensitivity()
2023/02/10 18:06:29 Created the secondary index index_age. Waiting for it become active
2023/02/10 18:06:29 Index is 1710835041898764895 now active
2023/02/10 18:06:29 Using n1ql client
2023/02/10 18:06:29 Expected and Actual scan responses are the same
2023/02/10 18:06:29 Using n1ql client
2023/02/10 18:06:29 Scan failed as expected with error: Index Not Found - cause: GSI index index_Age not found.
--- PASS: TestIndexNameCaseSensitivity (6.03s)
=== RUN TestCreateDuplicateIndex
2023/02/10 18:06:29 In TestCreateDuplicateIndex()
2023/02/10 18:06:35 Created the secondary index index_di1. Waiting for it become active
2023/02/10 18:06:35 Index is 253973273507120613 now active
2023/02/10 18:06:35 Index found: index_di1
2023/02/10 18:06:35 Create failed as expected with error: Index index_di1 already exists.
--- PASS: TestCreateDuplicateIndex (6.10s)
=== RUN TestDropNonExistingIndex
2023/02/10 18:06:35 In TestDropNonExistingIndex()
2023/02/10 18:06:35 Dropping the secondary index 123456
2023/02/10 18:06:35 Index drop failed as expected with error: Index does not exist.
--- PASS: TestDropNonExistingIndex (0.05s)
=== RUN TestCreateIndexNonExistentBucket
2023/02/10 18:06:35 In TestCreateIndexNonExistentBucket()
2023-02-10T18:06:36.231+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-02-10T18:06:47.234+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023/02/10 18:06:47 Index create failed as expected with error: [Bucket Not Found] Bucket BlahBucket does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- PASS: TestCreateIndexNonExistentBucket (11.51s)
=== RUN TestScanWithNoTimeout
2023/02/10 18:06:47 Create an index on empty bucket, populate the bucket and Run a scan on the index
2023/02/10 18:06:47 Changing config key indexer.settings.scan_timeout to value 0
2023/02/10 18:06:47 Using n1ql client
2023/02/10 18:06:47 Expected and Actual scan responses are the same
--- PASS: TestScanWithNoTimeout (0.38s)
=== RUN TestIndexingOnBinaryBucketMeta
2023/02/10 18:06:47 In TestIndexingOnBinaryBucketMeta()
2023/02/10 18:06:47 1. Populate a bucekt with binary docs and create indexs on the `id`, `cas` and `expiration` fields of Metadata
2023/02/10 18:06:47 2. Validate the test by comparing the items_count of indexes and the number of docs in the bucket for each of the fields
2023/02/10 18:06:50 Modified parameters of bucket default, responseBody:
2023/02/10 18:06:50 Created bucket binaryBucket, responseBody:
2023/02/10 18:07:09 Created the secondary index index_binary_meta_id. Waiting for it become active
2023/02/10 18:07:09 Index is 6407276331296920209 now active
2023/02/10 18:07:14 items_count stat is 10 for index index_binary_meta_id
2023/02/10 18:07:14 Dropping the secondary index index_binary_meta_id
2023/02/10 18:07:14 Index dropped
2023/02/10 18:07:17 Created the secondary index index_binary_meta_cas. Waiting for it become active
2023/02/10 18:07:17 Index is 13564003329101590008 now active
2023/02/10 18:07:22 items_count stat is 10 for index index_binary_meta_cas
2023/02/10 18:07:22 Dropping the secondary index index_binary_meta_cas
2023/02/10 18:07:22 Index dropped
2023/02/10 18:07:25 Created the secondary index index_binary_meta_expiration. Waiting for it become active
2023/02/10 18:07:25 Index is 11552016457155399205 now active
2023/02/10 18:07:30 items_count stat is 10 for index index_binary_meta_expiration
2023/02/10 18:07:30 Dropping the secondary index index_binary_meta_expiration
2023/02/10 18:07:30 Index dropped
2023/02/10 18:07:32 Deleted bucket binaryBucket, responseBody:
2023/02/10 18:07:35 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnBinaryBucketMeta (62.95s)
=== RUN TestRetainDeleteXATTRBinaryDocs
2023/02/10 18:07:50 In TestRetainDeleteXATTRBinaryDocs()
2023/02/10 18:07:50 1. Populate a bucket with binary docs having system XATTRS
2023/02/10 18:07:50 2. Create index on the system XATTRS with "retain_deleted_xattr" attribute set to true
2023/02/10 18:07:50 3. Delete the documents in the bucket
2023/02/10 18:07:50 4. Query for the meta() information in the source bucket. The total number of results should be equivalent to the number of documents in the bucket before deletion of documents
2023/02/10 18:07:53 Modified parameters of bucket default, responseBody:
2023/02/10 18:07:53 Created bucket binaryBucket, responseBody:
2023/02/10 18:08:12 Created the secondary index index_system_xattr. Waiting for it become active
2023/02/10 18:08:12 Index is 10477134111145748679 now active
2023/02/10 18:08:17 Deleted all the documents in the bucket: binaryBucket successfully
2023/02/10 18:08:20 Deleted bucket binaryBucket, responseBody:
2023/02/10 18:08:23 Modified parameters of bucket default, responseBody:
--- PASS: TestRetainDeleteXATTRBinaryDocs (47.59s)
=== RUN TestIndexingOnXATTRs
2023/02/10 18:08:38 In TestIndexingOnXATTRs()
2023/02/10 18:08:41 Modified parameters of bucket default, responseBody:
2023/02/10 18:08:41 Created bucket bucket_xattrs, responseBody:
2023/02/10 18:09:00 Created the secondary index index_sync_rev. Waiting for it become active
2023/02/10 18:09:00 Index is 12673408529123789323 now active
2023/02/10 18:09:07 Created the secondary index index_sync_channels. Waiting for it become active
2023/02/10 18:09:07 Index is 13719840635601776546 now active
2023/02/10 18:09:13 Created the secondary index index_sync_sequence. Waiting for it become active
2023/02/10 18:09:13 Index is 3289389747493537107 now active
2023/02/10 18:09:18 items_count stat is 100 for index index_sync_rev
2023/02/10 18:09:18 items_count stat is 100 for index index_sync_channels
2023/02/10 18:09:18 items_count stat is 100 for index index_sync_sequence
2023/02/10 18:09:18 Using n1ql client
2023-02-10T18:09:18.609+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2023-02-10T18:09:18.612+05:30 [Info] GSIC[default/bucket_xattrs-_default-_default-1676032758607810019] started ...
2023/02/10 18:09:18 Dropping the secondary index index_sync_rev
2023/02/10 18:09:18 Index dropped
2023/02/10 18:09:18 Using n1ql client
2023/02/10 18:09:18 Dropping the secondary index index_sync_channels
2023/02/10 18:09:18 Index dropped
2023/02/10 18:09:18 Using n1ql client
2023/02/10 18:09:18 Dropping the secondary index index_sync_sequence
2023/02/10 18:09:18 Index dropped
2023/02/10 18:09:21 Deleted bucket bucket_xattrs, responseBody:
2023/02/10 18:09:24 Modified parameters of bucket default, responseBody:
--- PASS: TestIndexingOnXATTRs (61.06s)
=== RUN TestSimpleIndex_FloatDataType
2023/02/10 18:09:39 In TestSimpleIndex_FloatDataType()
2023/02/10 18:09:39 Index found: index_age
2023/02/10 18:09:39 Using n1ql client
2023/02/10 18:09:39 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FloatDataType (0.02s)
=== RUN TestSimpleIndex_StringDataType
2023/02/10 18:09:39 In TestSimpleIndex_StringDataType()
2023/02/10 18:09:43 Created the secondary index index_company. Waiting for it become active
2023/02/10 18:09:43 Index is 4103830514024218053 now active
2023/02/10 18:09:43 Using n1ql client
2023/02/10 18:09:43 Expected and Actual scan responses are the same
2023/02/10 18:09:43 Using n1ql client
2023/02/10 18:09:43 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_StringDataType (4.64s)
=== RUN TestSimpleIndex_FieldValueCaseSensitivity
2023/02/10 18:09:43 In TestSimpleIndex_StringCaseSensitivity()
2023/02/10 18:09:43 Index found: index_company
2023/02/10 18:09:43 Using n1ql client
2023/02/10 18:09:43 Expected and Actual scan responses are the same
2023/02/10 18:09:43 Using n1ql client
2023/02/10 18:09:43 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_FieldValueCaseSensitivity (0.07s)
=== RUN TestSimpleIndex_BoolDataType
2023/02/10 18:09:43 In TestSimpleIndex_BoolDataType()
2023/02/10 18:09:50 Created the secondary index index_isActive. Waiting for it become active
2023/02/10 18:09:50 Index is 17150275152709090732 now active
2023/02/10 18:09:50 Using n1ql client
2023/02/10 18:09:50 Expected and Actual scan responses are the same
--- PASS: TestSimpleIndex_BoolDataType (6.38s)
=== RUN TestBasicLookup
2023/02/10 18:09:50 In TestBasicLookup()
2023/02/10 18:09:50 Index found: index_company
2023/02/10 18:09:50 Using n1ql client
2023/02/10 18:09:50 Expected and Actual scan responses are the same
--- PASS: TestBasicLookup (0.01s)
=== RUN TestIndexOnNonExistentField
2023/02/10 18:09:50 In TestIndexOnNonExistentField()
2023/02/10 18:09:56 Created the secondary index index_height. Waiting for it become active
2023/02/10 18:09:56 Index is 6637408728466557990 now active
2023/02/10 18:09:56 Using n1ql client
2023/02/10 18:09:56 Expected and Actual scan responses are the same
--- PASS: TestIndexOnNonExistentField (6.32s)
=== RUN TestIndexPartiallyMissingField
2023/02/10 18:09:56 In TestIndexPartiallyMissingField()
2023/02/10 18:10:03 Created the secondary index index_nationality. Waiting for it become active
2023/02/10 18:10:03 Index is 7614293460889402904 now active
2023/02/10 18:10:03 Using n1ql client
2023/02/10 18:10:03 Expected and Actual scan responses are the same
--- PASS: TestIndexPartiallyMissingField (6.53s)
=== RUN TestScanNonMatchingDatatype
2023/02/10 18:10:03 In TestScanNonMatchingDatatype()
2023/02/10 18:10:03 Index found: index_age
2023/02/10 18:10:03 Using n1ql client
2023/02/10 18:10:03 Expected and Actual scan responses are the same
--- PASS: TestScanNonMatchingDatatype (0.02s)
=== RUN TestInclusionNeither
2023/02/10 18:10:03 In TestInclusionNeither()
2023/02/10 18:10:03 Index found: index_age
2023/02/10 18:10:03 Using n1ql client
2023/02/10 18:10:03 Expected and Actual scan responses are the same
--- PASS: TestInclusionNeither (0.04s)
=== RUN TestInclusionLow
2023/02/10 18:10:03 In TestInclusionLow()
2023/02/10 18:10:03 Index found: index_age
2023/02/10 18:10:03 Using n1ql client
2023/02/10 18:10:03 Expected and Actual scan responses are the same
--- PASS: TestInclusionLow (0.02s)
=== RUN TestInclusionHigh
2023/02/10 18:10:03 In TestInclusionHigh()
2023/02/10 18:10:03 Index found: index_age
2023/02/10 18:10:03 Using n1ql client
2023/02/10 18:10:03 Expected and Actual scan responses are the same
--- PASS: TestInclusionHigh (0.02s)
=== RUN TestInclusionBoth
2023/02/10 18:10:03 In TestInclusionBoth()
2023/02/10 18:10:03 Index found: index_age
2023/02/10 18:10:03 Using n1ql client
2023/02/10 18:10:03 Expected and Actual scan responses are the same
--- PASS: TestInclusionBoth (0.07s)
=== RUN TestNestedIndex_String
2023/02/10 18:10:03 In TestNestedIndex_String()
2023/02/10 18:10:09 Created the secondary index index_streetname. Waiting for it become active
2023/02/10 18:10:09 Index is 9474025556480250127 now active
2023/02/10 18:10:09 Using n1ql client
2023/02/10 18:10:09 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_String (6.28s)
=== RUN TestNestedIndex_Float
2023/02/10 18:10:09 In TestNestedIndex_Float()
2023/02/10 18:10:16 Created the secondary index index_floor. Waiting for it become active
2023/02/10 18:10:16 Index is 5034060937609482076 now active
2023/02/10 18:10:16 Using n1ql client
2023/02/10 18:10:16 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Float (6.52s)
=== RUN TestNestedIndex_Bool
2023/02/10 18:10:16 In TestNestedIndex_Bool()
2023/02/10 18:10:22 Created the secondary index index_isresidential. Waiting for it become active
2023/02/10 18:10:22 Index is 13400569596877442349 now active
2023/02/10 18:10:22 Using n1ql client
2023/02/10 18:10:22 Expected and Actual scan responses are the same
--- PASS: TestNestedIndex_Bool (6.54s)
=== RUN TestLookupJsonObject
2023/02/10 18:10:22 In TestLookupJsonObject()
2023/02/10 18:10:29 Created the secondary index index_streetaddress. Waiting for it become active
2023/02/10 18:10:29 Index is 12536321845208270103 now active
2023/02/10 18:10:29 Using n1ql client
2023/02/10 18:10:29 Count of docScanResults is 1
2023/02/10 18:10:29 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/02/10 18:10:29 Count of scanResults is 1
2023/02/10 18:10:29 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/02/10 18:10:29 Expected and Actual scan responses are the same
--- PASS: TestLookupJsonObject (6.61s)
=== RUN TestLookupObjDifferentOrdering
2023/02/10 18:10:29 In TestLookupObjDifferentOrdering()
2023/02/10 18:10:29 Index found: index_streetaddress
2023/02/10 18:10:29 Using n1ql client
2023/02/10 18:10:29 Count of docScanResults is 1
2023/02/10 18:10:29 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/02/10 18:10:29 Count of scanResults is 1
2023/02/10 18:10:29 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/02/10 18:10:29 Expected and Actual scan responses are the same
--- PASS: TestLookupObjDifferentOrdering (0.02s)
=== RUN TestRangeJsonObject
2023/02/10 18:10:29 In TestRangeJsonObject()
2023/02/10 18:10:29 Index found: index_streetaddress
2023/02/10 18:10:29 Using n1ql client
2023/02/10 18:10:29 Count of scanResults is 2
2023/02/10 18:10:29 Key: string Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: value.Values [{"buildingname":"Rosewood Gardens","doornumber":"514","floor":2,"streetname":"Karweg Place"}] false
2023/02/10 18:10:29 Key: string User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: value.Values [{"buildingname":"Sterling Heights","doornumber":"12B","floor":5,"streetname":"Hill Street"}] false
2023/02/10 18:10:29 Count of docScanResults is 2
2023/02/10 18:10:29 Key: User3bf51f08-0bac-4c03-bcec-5c255cbdde2c Value: [map[buildingname:Sterling Heights doornumber:12B floor:5 streetname:Hill Street]]
2023/02/10 18:10:29 Key: Userbb48952f-f8d1-4e04-a0e1-96b9019706fb Value: [map[buildingname:Rosewood Gardens doornumber:514 floor:2 streetname:Karweg Place]]
2023/02/10 18:10:29 Expected and Actual scan responses are the same
--- PASS: TestRangeJsonObject (0.00s)
=== RUN TestLookupFloatDiffForms
2023/02/10 18:10:29 In TestLookupFloatDiffForms()
2023/02/10 18:10:35 Created the secondary index index_latitude. Waiting for it become active
2023/02/10 18:10:35 Index is 11529018493610532775 now active
2023/02/10 18:10:35 Scan 1
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 2
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 3
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 4
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 5
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 6
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
--- PASS: TestLookupFloatDiffForms (6.54s)
=== RUN TestRangeFloatInclVariations
2023/02/10 18:10:35 In TestRangeFloatInclVariations()
2023/02/10 18:10:35 Index found: index_latitude
2023/02/10 18:10:35 Scan 1
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 2
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 3
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 4
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 5
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
2023/02/10 18:10:35 Scan 6
2023/02/10 18:10:35 Using n1ql client
2023/02/10 18:10:35 Expected and Actual scan responses are the same
--- PASS: TestRangeFloatInclVariations (0.02s)
=== RUN TestScanAll
2023/02/10 18:10:35 In TestScanAll()
2023/02/10 18:10:42 Created the secondary index index_name. Waiting for it become active
2023/02/10 18:10:42 Index is 8320550706685881124 now active
2023/02/10 18:10:42 Length of docScanResults = 10502
2023/02/10 18:10:42 Using n1ql client
2023/02/10 18:10:42 Length of scanResults = 10502
2023/02/10 18:10:42 Expected and Actual scan responses are the same
--- PASS: TestScanAll (6.55s)
=== RUN TestScanAllNestedField
2023/02/10 18:10:42 In TestScanAllNestedField()
2023/02/10 18:10:42 Index found: index_streetname
2023/02/10 18:10:42 Length of docScanResults = 2
2023/02/10 18:10:42 Using n1ql client
2023/02/10 18:10:42 Length of scanResults = 2
2023/02/10 18:10:42 Expected and Actual scan responses are the same
--- PASS: TestScanAllNestedField (0.01s)
=== RUN TestBasicPrimaryIndex
2023/02/10 18:10:42 In TestBasicPrimaryIndex()
2023/02/10 18:10:49 Created the secondary index index_p1. Waiting for it become active
2023/02/10 18:10:49 Index is 2609520643295598259 now active
2023-02-10T18:10:49.459+05:30 [Error] transport error between 127.0.0.1:53442->127.0.0.1:9107: write tcp 127.0.0.1:53442->127.0.0.1:9107: write: broken pipe
2023-02-10T18:10:49.459+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] request transport failed `write tcp 127.0.0.1:53442->127.0.0.1:9107: write: broken pipe`
2023-02-10T18:10:49.459+05:30 [Error] metadataClient:PickRandom: Fail to find indexer for all index partitions. Num partition 1. Partition with instances 0
2023-02-10T18:10:49.459+05:30 [Error] metadataClient:PickRandom: Replicas - [815242974429835324], PrunedReplica - map[], FilteredReplica map[]
2023/02/10 18:10:49 Expected and Actual scan responses are the same
2023/02/10 18:10:49 CountRange() expected and actual is: 1906 and 1906
2023/02/10 18:10:49 lookupkey for CountLookup() = Usercc17fe74-233d-417c-a1d9-cdc71956a6a2
2023/02/10 18:10:49 CountLookup() = 1
--- PASS: TestBasicPrimaryIndex (7.12s)
=== RUN TestBasicNullDataType
2023/02/10 18:10:49 In TestBasicNullDataType()
2023/02/10 18:10:49 Index found: index_email
2023/02/10 18:10:49 Using n1ql client
2023/02/10 18:10:49 Expected and Actual scan responses are the same
--- PASS: TestBasicNullDataType (0.01s)
=== RUN TestBasicArrayDataType_ScanAll
2023/02/10 18:10:49 In TestBasicArrayDataType_ScanAll()
2023/02/10 18:10:56 Created the secondary index index_tags. Waiting for it become active
2023/02/10 18:10:56 Index is 4046615925088586295 now active
2023/02/10 18:10:56 Using n1ql client
2023/02/10 18:10:56 Expected and Actual scan responses are the same
--- PASS: TestBasicArrayDataType_ScanAll (6.90s)
=== RUN TestBasicArrayDataType_Lookup
2023/02/10 18:10:56 In TestBasicArrayDataType_Lookup()
2023/02/10 18:10:58 Index found: index_tags
2023/02/10 18:10:58 Count of scanResults is 1
2023/02/10 18:10:58 Key: string Usere46cea01-38f6-4e7b-92e5-69d64668ae75 Value: value.Values [["reprehenderit","tempor","officia","exercitation","labore","sunt","tempor"]] false
--- PASS: TestBasicArrayDataType_Lookup (2.00s)
=== RUN TestArrayDataType_LookupMissingArrayValue
2023/02/10 18:10:58 In TestArrayDataType_LookupMissingArrayValue()
2023/02/10 18:10:58 Index found: index_tags
2023/02/10 18:10:58 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupMissingArrayValue (0.00s)
=== RUN TestArrayDataType_LookupWrongOrder
2023/02/10 18:10:58 In TestArrayDataType_LookupWrongOrder()
2023/02/10 18:10:58 Index found: index_tags
2023/02/10 18:10:58 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupWrongOrder (0.00s)
=== RUN TestArrayDataType_LookupSubset
2023/02/10 18:10:58 In TestArrayDataType_LookupSubset()
2023/02/10 18:10:58 Index found: index_tags
2023/02/10 18:10:58 Count of scanResults is 0
--- PASS: TestArrayDataType_LookupSubset (0.00s)
=== RUN TestScanLimitParameter
2023/02/10 18:10:58 In TestScanLimitParameter()
2023/02/10 18:10:58 Index found: index_age
2023/02/10 18:10:58 Using n1ql client
2023/02/10 18:10:58 Using n1ql client
--- PASS: TestScanLimitParameter (0.01s)
=== RUN TestCountRange
2023/02/10 18:10:58 In TestRangeCount()
2023/02/10 18:10:58 Index found: index_age
2023/02/10 18:10:58 Count of expected and actual Range is: 2410 and 2410
2023/02/10 18:10:58 Count of expected and actual Range is: 10002 and 10002
2023/02/10 18:10:58 Count of expected and actual Range are: 0 and 0
2023/02/10 18:10:58 Count of expected and actual Range are: 483 and 483
2023/02/10 18:10:58 Testing CountRange() for key <= val
2023/02/10 18:10:58 Count of expected and actual CountRange for key <= 30 are: 5227 and 5227
2023/02/10 18:10:58 Testing CountRange() for key >= val
2023/02/10 18:10:58 Count of expected and actual CountRange for key >= 25 are: 7667 and 7667
2023/02/10 18:10:58 Testing CountRange() for null < key <= val
2023/02/10 18:10:58 Count of expected and actual CountRange for key > null && key <= 30 are: 5227 and 5227
2023/02/10 18:10:58 Testing CountRange() for val <= key < null
2023/02/10 18:10:58 Count of expected and actual CountRange for key >= 25 && key < null are: 0 and 0
2023/02/10 18:10:58 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountRange (0.05s)
=== RUN TestCountLookup
2023/02/10 18:10:58 In TestCountLookup()
2023/02/10 18:10:58 Index found: index_age
2023/02/10 18:10:58 Count of expected and actual Range are: 502 and 502
2023/02/10 18:10:58 Count of expected and actual Range are: 0 and 0
--- PASS: TestCountLookup (0.01s)
=== RUN TestRangeStatistics
2023/02/10 18:10:58 In TestRangeCount()
2023/02/10 18:10:58 Index found: index_age
--- PASS: TestRangeStatistics (0.00s)
=== RUN TestIndexCreateWithWhere
2023/02/10 18:10:58 In TestIndexCreateWithWhere()
2023/02/10 18:11:03 Created the secondary index index_ageabove30. Waiting for it become active
2023/02/10 18:11:03 Index is 9501433678209687712 now active
2023/02/10 18:11:03 Using n1ql client
2023/02/10 18:11:03 Expected and Actual scan responses are the same
2023/02/10 18:11:03 Lengths of expected and actual scanReuslts are: 4292 and 4292
2023/02/10 18:11:09 Created the secondary index index_ageteens. Waiting for it become active
2023/02/10 18:11:09 Index is 5169901889418567816 now active
2023/02/10 18:11:09 Using n1ql client
2023/02/10 18:11:09 Expected and Actual scan responses are the same
2023/02/10 18:11:09 Lengths of expected and actual scanReuslts are: 0 and 0
2023/02/10 18:11:16 Created the secondary index index_age35to45. Waiting for it become active
2023/02/10 18:11:16 Index is 17391760570630449132 now active
2023/02/10 18:11:16 Using n1ql client
2023/02/10 18:11:16 Expected and Actual scan responses are the same
2023/02/10 18:11:16 Lengths of expected and actual scanReuslts are: 2893 and 2893
--- PASS: TestIndexCreateWithWhere (17.68s)
=== RUN TestDeferredIndexCreate
2023/02/10 18:11:16 In TestDeferredIndexCreate()
2023/02/10 18:11:16 Created the index index_deferred in deferred mode. Index state is INDEX_STATE_READY
2023/02/10 18:11:18 Build the deferred index index_deferred. Waiting for the index to become active
2023/02/10 18:11:18 Waiting for index 7752123512481383500 to go active ...
2023/02/10 18:11:19 Waiting for index 7752123512481383500 to go active ...
2023/02/10 18:11:20 Waiting for index 7752123512481383500 to go active ...
2023/02/10 18:11:21 Waiting for index 7752123512481383500 to go active ...
2023/02/10 18:11:22 Waiting for index 7752123512481383500 to go active ...
2023/02/10 18:11:23 Index is 7752123512481383500 now active
2023/02/10 18:11:23 Using n1ql client
2023/02/10 18:11:23 Expected and Actual scan responses are the same
--- PASS: TestDeferredIndexCreate (7.13s)
=== RUN TestCompositeIndex_NumAndString
2023/02/10 18:11:23 In TestCompositeIndex()
2023/02/10 18:11:29 Created the secondary index index_composite1. Waiting for it become active
2023/02/10 18:11:29 Index is 148148517094980632 now active
2023/02/10 18:11:29 Using n1ql client
2023/02/10 18:11:30 Using n1ql client
2023/02/10 18:11:30 Using n1ql client
2023/02/10 18:11:30 Expected and Actual scan responses are the same
--- PASS: TestCompositeIndex_NumAndString (6.67s)
=== RUN TestCompositeIndex_TwoNumberFields
2023/02/10 18:11:30 In TestCompositeIndex()
2023/02/10 18:11:36 Created the secondary index index_composite2. Waiting for it become active
2023/02/10 18:11:36 Index is 10896701371753707419 now active
2023/02/10 18:11:36 Using n1ql client
--- PASS: TestCompositeIndex_TwoNumberFields (6.60s)
=== RUN TestNumbers_Int64_Float64
2023/02/10 18:11:36 In TestNumbers_Int64_Float64()
2023/02/10 18:11:43 Created the secondary index idx_numbertest. Waiting for it become active
2023/02/10 18:11:43 Index is 2029525188152386767 now active
2023/02/10 18:11:43
==== Int64 test #0
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Int64 test #1
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Int64 test #2
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Int64 test #3
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Int64 test #4
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Int64 test #5
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Int64 test #6
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Int64 test #7
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Int64 test #8
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Float64 test #0
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Float64 test #1
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Float64 test #2
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
2023/02/10 18:11:43
==== Float64 test #3
2023/02/10 18:11:43 Using n1ql client
2023/02/10 18:11:43 Expected and Actual scan responses are the same
--- PASS: TestNumbers_Int64_Float64 (7.32s)
=== RUN TestRestartIndexer
2023/02/10 18:11:43 In TestRestartIndexer()
2023/02/10 18:11:43 []
2023-02-10T18:11:43.996+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023-02-10T18:11:43.997+05:30 [Error] WatcherServer.runOnce() : Watcher terminated unexpectedly.
2023/02/10 18:12:03 Using n1ql client
2023-02-10T18:12:03.984+05:30 [Error] transport error between 127.0.0.1:55888->127.0.0.1:9107: write tcp 127.0.0.1:55888->127.0.0.1:9107: write: broken pipe
2023-02-10T18:12:03.984+05:30 [Error] [GsiScanClient:"127.0.0.1:9107"] -4056457680702138549 request transport failed `write tcp 127.0.0.1:55888->127.0.0.1:9107: write: broken pipe`
2023/02/10 18:12:04 Len of expected and actual scan results are : 10002 and 10002
2023/02/10 18:12:04 Expected and Actual scan responses are the same
--- PASS: TestRestartIndexer (20.09s)
=== RUN TestCreateDocsMutation
2023/02/10 18:12:04 In TestCreateDocsMutation()
2023/02/10 18:12:04 Index found: index_age
2023/02/10 18:12:04 Using n1ql client
2023/02/10 18:12:04 Len of expected and actual scan results are : 10002 and 10002
2023/02/10 18:12:04 Expected and Actual scan responses are the same
2023/02/10 18:12:04 Using n1ql client
2023/02/10 18:12:04 Index Scan after mutations took 44.927992ms
2023/02/10 18:12:04 Len of expected and actual scan results are : 10102 and 10102
2023/02/10 18:12:04 Expected and Actual scan responses are the same
--- PASS: TestCreateDocsMutation (0.34s)
=== RUN TestRestartProjector
2023/02/10 18:12:04 In TestRestartProjector()
2023/02/10 18:12:04 []
2023/02/10 18:12:24 Using n1ql client
2023/02/10 18:12:24 Len of expected and actual scan results are : 10102 and 10102
2023/02/10 18:12:24 Expected and Actual scan responses are the same
--- PASS: TestRestartProjector (20.08s)
=== RUN TestDeleteDocsMutation
2023/02/10 18:12:24 In TestDeleteDocsMutation()
2023/02/10 18:12:24 Index found: index_age
2023/02/10 18:12:24 Using n1ql client
2023/02/10 18:12:24 Len of expected and actual scan results are : 10102 and 10102
2023/02/10 18:12:24 Expected and Actual scan responses are the same
2023/02/10 18:12:24 Using n1ql client
2023/02/10 18:12:24 Index Scan after mutations took 35.172265ms
2023/02/10 18:12:24 Len of expected and actual scan results are : 9902 and 9902
2023/02/10 18:12:24 Expected and Actual scan responses are the same
--- PASS: TestDeleteDocsMutation (0.36s)
=== RUN TestUpdateDocsMutation
2023/02/10 18:12:24 In TestUpdateDocsMutation()
2023/02/10 18:12:24 Index found: index_age
2023/02/10 18:12:24 Using n1ql client
2023/02/10 18:12:24 Len of expected and actual scan results are : 9435 and 9435
2023/02/10 18:12:24 Expected and Actual scan responses are the same
2023/02/10 18:12:24 Num of keysFromMutDocs: 100
2023/02/10 18:12:24 Updating number of documents: 99
2023/02/10 18:12:25 Using n1ql client
2023/02/10 18:12:25 Index Scan after mutations took 94.767274ms
2023/02/10 18:12:25 Len of expected and actual scan results are : 9436 and 9436
2023/02/10 18:12:25 Expected and Actual scan responses are the same
--- PASS: TestUpdateDocsMutation (0.39s)
=== RUN TestLargeMutations
2023/02/10 18:12:25 In TestLargeMutations()
2023/02/10 18:12:25 In DropAllSecondaryIndexes()
2023/02/10 18:12:25 Index found: index_isActive
2023/02/10 18:12:25 Dropped index index_isActive
2023/02/10 18:12:25 Index found: idx_age
2023/02/10 18:12:25 Dropped index idx_age
2023/02/10 18:12:25 Index found: index_pin
2023/02/10 18:12:25 Dropped index index_pin
2023/02/10 18:12:25 Index found: index_cdc
2023/02/10 18:12:25 Dropped index index_cdc
2023/02/10 18:12:25 Index found: idx_numbertest
2023/02/10 18:12:25 Dropped index idx_numbertest
2023/02/10 18:12:25 Index found: index_longitude
2023/02/10 18:12:25 Dropped index index_longitude
2023/02/10 18:12:25 Index found: index_state
2023/02/10 18:12:25 Dropped index index_state
2023/02/10 18:12:25 Index found: index_streetaddress
2023/02/10 18:12:25 Dropped index index_streetaddress
2023/02/10 18:12:25 Index found: index_balance
2023/02/10 18:12:25 Dropped index index_balance
2023/02/10 18:12:25 Index found: index_ageteens
2023/02/10 18:12:26 Dropped index index_ageteens
2023/02/10 18:12:26 Index found: index_streetname
2023/02/10 18:12:26 Dropped index index_streetname
2023/02/10 18:12:26 Index found: index_i2
2023/02/10 18:12:26 Dropped index index_i2
2023/02/10 18:12:26 Index found: index_isresidential
2023/02/10 18:12:26 Dropped index index_isresidential
2023/02/10 18:12:26 Index found: index_di1
2023/02/10 18:12:26 Dropped index index_di1
2023/02/10 18:12:26 Index found: index_p1
2023/02/10 18:12:26 Dropped index index_p1
2023/02/10 18:12:26 Index found: index_height
2023/02/10 18:12:26 Dropped index index_height
2023/02/10 18:12:26 Index found: index_age
2023/02/10 18:12:26 Dropped index index_age
2023/02/10 18:12:26 Index found: index_name
2023/02/10 18:12:26 Dropped index index_name
2023/02/10 18:12:26 Index found: index_nationality
2023/02/10 18:12:26 Dropped index index_nationality
2023/02/10 18:12:26 Index found: index_floor
2023/02/10 18:12:26 Dropped index index_floor
2023/02/10 18:12:26 Index found: index_composite1
2023/02/10 18:12:26 Dropped index index_composite1
2023/02/10 18:12:26 Index found: index_eyeColor
2023/02/10 18:12:26 Dropped index index_eyeColor
2023/02/10 18:12:26 Index found: index_tags
2023/02/10 18:12:27 Dropped index index_tags
2023/02/10 18:12:27 Index found: index_email
2023/02/10 18:12:27 Dropped index index_email
2023/02/10 18:12:27 Index found: index_age35to45
2023/02/10 18:12:27 Dropped index index_age35to45
2023/02/10 18:12:27 Index found: index_ageabove30
2023/02/10 18:12:27 Dropped index index_ageabove30
2023/02/10 18:12:27 Index found: index_deferred
2023/02/10 18:12:27 Dropped index index_deferred
2023/02/10 18:12:27 Index found: index_company
2023/02/10 18:12:27 Dropped index index_company
2023/02/10 18:12:27 Index found: index_composite2
2023/02/10 18:12:27 Dropped index index_composite2
2023/02/10 18:12:27 Index found: index_gender
2023/02/10 18:12:27 Dropped index index_gender
2023/02/10 18:12:27 Index found: index_latitude
2023/02/10 18:12:27 Dropped index index_latitude
2023/02/10 18:12:47 Created the secondary index indexmut_1. Waiting for it become active
2023/02/10 18:12:47 Index is 3796466113826430126 now active
2023/02/10 18:12:47 Using n1ql client
2023/02/10 18:12:48 Expected and Actual scan responses are the same
2023/02/10 18:12:48 Len of expected and actual scan results are : 29902 and 29902
2023/02/10 18:12:48 ITERATION 0
2023/02/10 18:13:06 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:13:06 Index is 17620576214336227598 now active
2023/02/10 18:13:06 Using n1ql client
2023/02/10 18:13:06 Expected and Actual scan responses are the same
2023/02/10 18:13:06 Len of expected and actual scan results are : 39902 and 39902
2023/02/10 18:13:06 Using n1ql client
2023/02/10 18:13:06 Expected and Actual scan responses are the same
2023/02/10 18:13:06 Len of expected and actual scan results are : 39902 and 39902
2023/02/10 18:13:06 Dropping the secondary index indexmut_2
2023/02/10 18:13:06 Index dropped
2023/02/10 18:13:06 ITERATION 1
2023/02/10 18:13:24 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:13:24 Index is 3915630557426286072 now active
2023/02/10 18:13:24 Using n1ql client
2023/02/10 18:13:24 Expected and Actual scan responses are the same
2023/02/10 18:13:24 Len of expected and actual scan results are : 49902 and 49902
2023/02/10 18:13:24 Using n1ql client
2023/02/10 18:13:25 Expected and Actual scan responses are the same
2023/02/10 18:13:25 Len of expected and actual scan results are : 49902 and 49902
2023/02/10 18:13:25 Dropping the secondary index indexmut_2
2023/02/10 18:13:25 Index dropped
2023/02/10 18:13:25 ITERATION 2
2023/02/10 18:13:42 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:13:42 Index is 17727818973067436633 now active
2023/02/10 18:13:42 Using n1ql client
2023/02/10 18:13:43 Expected and Actual scan responses are the same
2023/02/10 18:13:43 Len of expected and actual scan results are : 59902 and 59902
2023/02/10 18:13:43 Using n1ql client
2023/02/10 18:13:44 Expected and Actual scan responses are the same
2023/02/10 18:13:44 Len of expected and actual scan results are : 59902 and 59902
2023/02/10 18:13:44 Dropping the secondary index indexmut_2
2023/02/10 18:13:44 Index dropped
2023/02/10 18:13:44 ITERATION 3
2023/02/10 18:14:02 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:14:02 Index is 16928849683380131783 now active
2023/02/10 18:14:02 Using n1ql client
2023/02/10 18:14:03 Expected and Actual scan responses are the same
2023/02/10 18:14:03 Len of expected and actual scan results are : 69902 and 69902
2023/02/10 18:14:03 Using n1ql client
2023/02/10 18:14:03 Expected and Actual scan responses are the same
2023/02/10 18:14:03 Len of expected and actual scan results are : 69902 and 69902
2023/02/10 18:14:03 Dropping the secondary index indexmut_2
2023/02/10 18:14:04 Index dropped
2023/02/10 18:14:04 ITERATION 4
2023/02/10 18:14:23 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:14:23 Index is 9507886415778755869 now active
2023/02/10 18:14:23 Using n1ql client
2023/02/10 18:14:24 Expected and Actual scan responses are the same
2023/02/10 18:14:24 Len of expected and actual scan results are : 79902 and 79902
2023/02/10 18:14:24 Using n1ql client
2023/02/10 18:14:25 Expected and Actual scan responses are the same
2023/02/10 18:14:25 Len of expected and actual scan results are : 79902 and 79902
2023/02/10 18:14:25 Dropping the secondary index indexmut_2
2023/02/10 18:14:25 Index dropped
2023/02/10 18:14:25 ITERATION 5
2023/02/10 18:14:47 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:14:47 Index is 1411558577566933803 now active
2023/02/10 18:14:47 Using n1ql client
2023/02/10 18:14:48 Expected and Actual scan responses are the same
2023/02/10 18:14:48 Len of expected and actual scan results are : 89902 and 89902
2023/02/10 18:14:48 Using n1ql client
2023/02/10 18:14:49 Expected and Actual scan responses are the same
2023/02/10 18:14:49 Len of expected and actual scan results are : 89902 and 89902
2023/02/10 18:14:49 Dropping the secondary index indexmut_2
2023/02/10 18:14:49 Index dropped
2023/02/10 18:14:49 ITERATION 6
2023/02/10 18:15:09 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:15:09 Index is 6320343972035433326 now active
2023/02/10 18:15:09 Using n1ql client
2023/02/10 18:15:09 Expected and Actual scan responses are the same
2023/02/10 18:15:09 Len of expected and actual scan results are : 99902 and 99902
2023/02/10 18:15:10 Using n1ql client
2023/02/10 18:15:10 Expected and Actual scan responses are the same
2023/02/10 18:15:10 Len of expected and actual scan results are : 99902 and 99902
2023/02/10 18:15:10 Dropping the secondary index indexmut_2
2023/02/10 18:15:10 Index dropped
2023/02/10 18:15:10 ITERATION 7
2023/02/10 18:15:30 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:15:30 Index is 8876743065091505696 now active
2023/02/10 18:15:31 Using n1ql client
2023/02/10 18:15:31 Expected and Actual scan responses are the same
2023/02/10 18:15:31 Len of expected and actual scan results are : 109902 and 109902
2023/02/10 18:15:32 Using n1ql client
2023/02/10 18:15:33 Expected and Actual scan responses are the same
2023/02/10 18:15:33 Len of expected and actual scan results are : 109902 and 109902
2023/02/10 18:15:33 Dropping the secondary index indexmut_2
2023/02/10 18:15:33 Index dropped
2023/02/10 18:15:33 ITERATION 8
2023/02/10 18:15:55 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:15:55 Index is 15270264038210141092 now active
2023/02/10 18:15:55 Using n1ql client
2023/02/10 18:15:57 Expected and Actual scan responses are the same
2023/02/10 18:15:57 Len of expected and actual scan results are : 119902 and 119902
2023/02/10 18:15:57 Using n1ql client
2023/02/10 18:15:59 Expected and Actual scan responses are the same
2023/02/10 18:15:59 Len of expected and actual scan results are : 119902 and 119902
2023/02/10 18:15:59 Dropping the secondary index indexmut_2
2023/02/10 18:15:59 Index dropped
2023/02/10 18:15:59 ITERATION 9
2023/02/10 18:16:20 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:16:20 Index is 10248270370569560525 now active
2023/02/10 18:16:20 Using n1ql client
2023/02/10 18:16:21 Expected and Actual scan responses are the same
2023/02/10 18:16:21 Len of expected and actual scan results are : 129902 and 129902
2023/02/10 18:16:22 Using n1ql client
2023/02/10 18:16:23 Expected and Actual scan responses are the same
2023/02/10 18:16:23 Len of expected and actual scan results are : 129902 and 129902
2023/02/10 18:16:23 Dropping the secondary index indexmut_2
2023/02/10 18:16:23 Index dropped
2023/02/10 18:16:23 ITERATION 10
2023/02/10 18:16:44 Created the secondary index indexmut_2. Waiting for it become active
2023/02/10 18:16:44 Index is 14240212366844650358 now active
2023/02/10 18:16:45 Using n1ql client
2023/02/10 18:16:46 Expected and Actual scan responses are the same
2023/02/10 18:16:46 Len of expected and actual scan results are : 139902 and 139902
2023/02/10 18:16:47 Using n1ql client
2023/02/10 18:16:47 Expected and Actual scan responses are the same
2023/02/10 18:16:47 Len of expected and actual scan results are : 139902 and 139902
2023/02/10 18:16:47 Dropping the secondary index indexmut_2
2023/02/10 18:16:48 Index dropped
--- PASS: TestLargeMutations (262.82s)
=== RUN TestPlanner
2023/02/10 18:16:48 In TestPlanner()
2023/02/10 18:16:48 -------------------------------------------
2023/02/10 18:16:48 initial placement - 20-50M, 10 index, 3 replica, 2x
2023-02-10T18:16:48.041+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:48.046+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-02-10T18:16:48.046+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-02-10T18:16:48.046+05:30 [Info] Refreshing indexer list due to cluster changes or auto-refresh.
2023-02-10T18:16:48.046+05:30 [Info] Refreshed Indexer List: [127.0.0.1:9106]
2023-02-10T18:16:48.049+05:30 [Info] switched currmeta from 477 -> 478 force true
2023-02-10T18:16:48.050+05:30 [Info] switched currmeta from 482 -> 482 force true
2023-02-10T18:16:48.089+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:48.089+05:30 [Info] Score: 0.022724061443925664
2023-02-10T18:16:48.089+05:30 [Info] Memory Quota: 65366397604 (60.8772G)
2023-02-10T18:16:48.089+05:30 [Info] CPU Quota: 12
2023-02-10T18:16:48.089+05:30 [Info] Indexer Memory Mean 40054255411 (37.3034G)
2023-02-10T18:16:48.089+05:30 [Info] Indexer Memory Deviation 1820390722 (1.69537G) (4.54%)
2023-02-10T18:16:48.089+05:30 [Info] Indexer Memory Utilization 0.6128
2023-02-10T18:16:48.089+05:30 [Info] Indexer CPU Mean 12.1421
2023-02-10T18:16:48.089+05:30 [Info] Indexer CPU Deviation 2.90 (23.91%)
2023-02-10T18:16:48.089+05:30 [Info] Indexer CPU Utilization 1.0118
2023-02-10T18:16:48.089+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:48.089+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:48.089+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:48.090+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:48.090+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:48.090+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:48.090+05:30 [Info] Indexer Data Size Mean 40054255411 (37.3034G)
2023-02-10T18:16:48.090+05:30 [Info] Indexer Data Size Deviation 1820390722 (1.69537G) (4.54%)
2023-02-10T18:16:48.090+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:48.090+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:48.090+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:48.090+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:48 -------------------------------------------
2023/02/10 18:16:48 initial placement - 20-50M, 30 index, 3 replica, 2x
2023-02-10T18:16:48.090+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:49.028+05:30 [Info] Score: 0.03150117791267791
2023-02-10T18:16:49.028+05:30 [Info] Memory Quota: 66707367584 (62.1261G)
2023-02-10T18:16:49.028+05:30 [Info] CPU Quota: 12
2023-02-10T18:16:49.028+05:30 [Info] Indexer Memory Mean 42139408702 (39.2454G)
2023-02-10T18:16:49.029+05:30 [Info] Indexer Memory Deviation 2654882021 (2.47255G) (6.30%)
2023-02-10T18:16:49.029+05:30 [Info] Indexer Memory Utilization 0.6317
2023-02-10T18:16:49.029+05:30 [Info] Indexer CPU Mean 12.6357
2023-02-10T18:16:49.029+05:30 [Info] Indexer CPU Deviation 2.39 (18.93%)
2023-02-10T18:16:49.029+05:30 [Info] Indexer CPU Utilization 1.0530
2023-02-10T18:16:49.029+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:49.029+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:49.029+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:49.029+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:49.029+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:49.029+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:49.029+05:30 [Info] Indexer Data Size Mean 42139408702 (39.2454G)
2023-02-10T18:16:49.029+05:30 [Info] Indexer Data Size Deviation 2654882021 (2.47255G) (6.30%)
2023-02-10T18:16:49.029+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:49.029+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:49.029+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:49.029+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:49 -------------------------------------------
2023/02/10 18:16:49 initial placement - 20-50M, 30 index, 3 replica, 4x
2023-02-10T18:16:49.029+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:49.380+05:30 [Info] Score: 0.014278538346188906
2023-02-10T18:16:49.380+05:30 [Info] Memory Quota: 131741093340 (122.693G)
2023-02-10T18:16:49.380+05:30 [Info] CPU Quota: 24
2023-02-10T18:16:49.380+05:30 [Info] Indexer Memory Mean 83696211662 (77.9482G)
2023-02-10T18:16:49.380+05:30 [Info] Indexer Memory Deviation 2390119135 (2.22597G) (2.86%)
2023-02-10T18:16:49.380+05:30 [Info] Indexer Memory Utilization 0.6353
2023-02-10T18:16:49.380+05:30 [Info] Indexer CPU Mean 23.5536
2023-02-10T18:16:49.380+05:30 [Info] Indexer CPU Deviation 4.22 (17.93%)
2023-02-10T18:16:49.380+05:30 [Info] Indexer CPU Utilization 0.9814
2023-02-10T18:16:49.380+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:49.380+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:49.380+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:49.380+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:49.380+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:49.380+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:49.380+05:30 [Info] Indexer Data Size Mean 83696211662 (77.9482G)
2023-02-10T18:16:49.380+05:30 [Info] Indexer Data Size Deviation 2390119135 (2.22597G) (2.86%)
2023-02-10T18:16:49.380+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:49.380+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:49.380+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:49.380+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:49 -------------------------------------------
2023/02/10 18:16:49 initial placement - 200-500M, 10 index, 3 replica, 2x
2023-02-10T18:16:49.382+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:49.449+05:30 [Info] Score: 0.038438712856658945
2023-02-10T18:16:49.449+05:30 [Info] Memory Quota: 478642194746 (445.77G)
2023-02-10T18:16:49.449+05:30 [Info] CPU Quota: 12
2023-02-10T18:16:49.449+05:30 [Info] Indexer Memory Mean 344821355211 (321.14G)
2023-02-10T18:16:49.449+05:30 [Info] Indexer Memory Deviation 26508978119 (24.6884G) (7.69%)
2023-02-10T18:16:49.449+05:30 [Info] Indexer Memory Utilization 0.7204
2023-02-10T18:16:49.449+05:30 [Info] Indexer CPU Mean 10.5619
2023-02-10T18:16:49.449+05:30 [Info] Indexer CPU Deviation 2.74 (25.99%)
2023-02-10T18:16:49.449+05:30 [Info] Indexer CPU Utilization 0.8802
2023-02-10T18:16:49.449+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:49.449+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:49.449+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:49.449+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:49.449+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:49.449+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:49.449+05:30 [Info] Indexer Data Size Mean 344821355211 (321.14G)
2023-02-10T18:16:49.449+05:30 [Info] Indexer Data Size Deviation 26508978119 (24.6884G) (7.69%)
2023-02-10T18:16:49.449+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:49.449+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:49.449+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:49.449+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:49 -------------------------------------------
2023/02/10 18:16:49 initial placement - 200-500M, 30 index, 3 replica, 2x
2023-02-10T18:16:49.451+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:50.967+05:30 [Info] Score: 0.022538008538760382
2023-02-10T18:16:50.967+05:30 [Info] Memory Quota: 508076279728 (473.183G)
2023-02-10T18:16:50.967+05:30 [Info] CPU Quota: 12
2023-02-10T18:16:50.968+05:30 [Info] Indexer Memory Mean 398491447820 (371.124G)
2023-02-10T18:16:50.968+05:30 [Info] Indexer Memory Deviation 17962407307 (16.7288G) (4.51%)
2023-02-10T18:16:50.968+05:30 [Info] Indexer Memory Utilization 0.7843
2023-02-10T18:16:50.968+05:30 [Info] Indexer CPU Mean 11.0903
2023-02-10T18:16:50.968+05:30 [Info] Indexer CPU Deviation 2.76 (24.89%)
2023-02-10T18:16:50.968+05:30 [Info] Indexer CPU Utilization 0.9242
2023-02-10T18:16:50.968+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:50.968+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:50.968+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:50.968+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:50.968+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:50.968+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:50.968+05:30 [Info] Indexer Data Size Mean 398491447820 (371.124G)
2023-02-10T18:16:50.968+05:30 [Info] Indexer Data Size Deviation 17962407307 (16.7288G) (4.51%)
2023-02-10T18:16:50.969+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:50.969+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:50.969+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:50.969+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:50 -------------------------------------------
2023/02/10 18:16:50 initial placement - mixed small/medium, 30 index, 3 replica, 1.5/4x
2023-02-10T18:16:50.969+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:51.745+05:30 [Info] Score: 0.009427486801933149
2023-02-10T18:16:51.745+05:30 [Info] Memory Quota: 429790106190 (400.273G)
2023-02-10T18:16:51.745+05:30 [Info] CPU Quota: 16
2023-02-10T18:16:51.745+05:30 [Info] Indexer Memory Mean 338853654921 (315.582G)
2023-02-10T18:16:51.745+05:30 [Info] Indexer Memory Deviation 6389076719 (5.95029G) (1.89%)
2023-02-10T18:16:51.745+05:30 [Info] Indexer Memory Utilization 0.7884
2023-02-10T18:16:51.745+05:30 [Info] Indexer CPU Mean 12.4804
2023-02-10T18:16:51.745+05:30 [Info] Indexer CPU Deviation 7.24 (58.00%)
2023-02-10T18:16:51.745+05:30 [Info] Indexer CPU Utilization 0.7800
2023-02-10T18:16:51.746+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:51.746+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:51.746+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:51.746+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:51.746+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:51.746+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:51.746+05:30 [Info] Indexer Data Size Mean 338853654921 (315.582G)
2023-02-10T18:16:51.746+05:30 [Info] Indexer Data Size Deviation 6389076719 (5.95029G) (1.89%)
2023-02-10T18:16:51.746+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:51.746+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:51.746+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:51.746+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:51 -------------------------------------------
2023/02/10 18:16:51 initial placement - mixed all, 30 index, 3 replica, 1.5/4x
2023-02-10T18:16:51.747+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:52.314+05:30 [Info] Score: 0.01101720607254487
2023-02-10T18:16:52.314+05:30 [Info] Memory Quota: 384091718155 (357.713G)
2023-02-10T18:16:52.314+05:30 [Info] CPU Quota: 20
2023-02-10T18:16:52.314+05:30 [Info] Indexer Memory Mean 304639614402 (283.718G)
2023-02-10T18:16:52.314+05:30 [Info] Indexer Memory Deviation 6712554819 (6.25155G) (2.20%)
2023-02-10T18:16:52.314+05:30 [Info] Indexer Memory Utilization 0.7931
2023-02-10T18:16:52.314+05:30 [Info] Indexer CPU Mean 10.3498
2023-02-10T18:16:52.314+05:30 [Info] Indexer CPU Deviation 5.05 (48.83%)
2023-02-10T18:16:52.314+05:30 [Info] Indexer CPU Utilization 0.5175
2023-02-10T18:16:52.314+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:52.314+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:52.314+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:52.314+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.314+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:52.315+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.315+05:30 [Info] Indexer Data Size Mean 304639614402 (283.718G)
2023-02-10T18:16:52.315+05:30 [Info] Indexer Data Size Deviation 6712554819 (6.25155G) (2.20%)
2023-02-10T18:16:52.315+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:52.315+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:52.315+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:52.315+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:52 -------------------------------------------
2023/02/10 18:16:52 initial placement - 6 2M index, 1 replica, 2x
2023-02-10T18:16:52.330+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:52.348+05:30 [Info] Score: 0
2023-02-10T18:16:52.348+05:30 [Info] Memory Quota: 4848128000 (4.51517G)
2023-02-10T18:16:52.348+05:30 [Info] CPU Quota: 2
2023-02-10T18:16:52.348+05:30 [Info] Indexer Memory Mean 2080000000 (1.93715G)
2023-02-10T18:16:52.349+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:52.349+05:30 [Info] Indexer Memory Utilization 0.4290
2023-02-10T18:16:52.349+05:30 [Info] Indexer CPU Mean 1.2000
2023-02-10T18:16:52.349+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:52.349+05:30 [Info] Indexer CPU Utilization 0.6000
2023-02-10T18:16:52.349+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:52.349+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:52.349+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:52.349+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.349+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:52.349+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.349+05:30 [Info] Indexer Data Size Mean 2080000000 (1.93715G)
2023-02-10T18:16:52.349+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:52.349+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:52.349+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:52.349+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:52.349+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:52 -------------------------------------------
2023/02/10 18:16:52 initial placement - 5 20M primary index, 2 replica, 2x
2023-02-10T18:16:52.360+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:52.422+05:30 [Info] Score: 0
2023-02-10T18:16:52.422+05:30 [Info] Memory Quota: 14310128000 (13.3273G)
2023-02-10T18:16:52.422+05:30 [Info] CPU Quota: 2
2023-02-10T18:16:52.422+05:30 [Info] Indexer Memory Mean 10960000000 (10.2073G)
2023-02-10T18:16:52.422+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:52.422+05:30 [Info] Indexer Memory Utilization 0.7659
2023-02-10T18:16:52.422+05:30 [Info] Indexer CPU Mean 1.2000
2023-02-10T18:16:52.422+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:52.422+05:30 [Info] Indexer CPU Utilization 0.6000
2023-02-10T18:16:52.423+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:52.423+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:52.423+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:52.423+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.423+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:52.423+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.423+05:30 [Info] Indexer Data Size Mean 10960000000 (10.2073G)
2023-02-10T18:16:52.423+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:52.423+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:52.423+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:52.423+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:52.423+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:52 -------------------------------------------
2023/02/10 18:16:52 initial placement - 5 20M array index, 2 replica, 2x
2023-02-10T18:16:52.435+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:52.492+05:30 [Info] Score: 0
2023-02-10T18:16:52.492+05:30 [Info] Memory Quota: 237416768000 (221.112G)
2023-02-10T18:16:52.492+05:30 [Info] CPU Quota: 2
2023-02-10T18:16:52.492+05:30 [Info] Indexer Memory Mean 191440000000 (178.292G)
2023-02-10T18:16:52.492+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:52.492+05:30 [Info] Indexer Memory Utilization 0.8063
2023-02-10T18:16:52.492+05:30 [Info] Indexer CPU Mean 1.2000
2023-02-10T18:16:52.492+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:52.492+05:30 [Info] Indexer CPU Utilization 0.6000
2023-02-10T18:16:52.492+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:52.492+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:52.492+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:52.492+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.492+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:52.492+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.492+05:30 [Info] Indexer Data Size Mean 191440000000 (178.292G)
2023-02-10T18:16:52.492+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:52.492+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:52.492+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:52.492+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:52.492+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:52 -------------------------------------------
2023/02/10 18:16:52 initial placement - 3 replica constraint, 2 index, 2x
2023-02-10T18:16:52.498+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:52.549+05:30 [Info] Score: 0
2023-02-10T18:16:52.549+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-02-10T18:16:52.549+05:30 [Info] CPU Quota: 2
2023-02-10T18:16:52.549+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-02-10T18:16:52.549+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:52.549+05:30 [Info] Indexer Memory Utilization 0.0049
2023-02-10T18:16:52.549+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:52.549+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:52.549+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:52.549+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:52.549+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:52.549+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:52.549+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.549+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:52.549+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.549+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-02-10T18:16:52.549+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:52.549+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:52.549+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:52.549+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:52.549+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:52 -------------------------------------------
2023/02/10 18:16:52 incr placement - 20-50M, 5 2M index, 1 replica, 1x
2023-02-10T18:16:52.564+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0248096220246746
2023-02-10T18:16:52.755+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:52.755+05:30 [Info] Score: 0.007189938568471697
2023-02-10T18:16:52.755+05:30 [Info] Memory Quota: 125233041042 (116.632G)
2023-02-10T18:16:52.755+05:30 [Info] CPU Quota: 27
2023-02-10T18:16:52.755+05:30 [Info] Indexer Memory Mean 71117238485 (66.2331G)
2023-02-10T18:16:52.755+05:30 [Info] Indexer Memory Deviation 1022657151 (975.282M) (1.44%)
2023-02-10T18:16:52.755+05:30 [Info] Indexer Memory Utilization 0.5679
2023-02-10T18:16:52.755+05:30 [Info] Indexer CPU Mean 20.1734
2023-02-10T18:16:52.755+05:30 [Info] Indexer CPU Deviation 1.87 (9.29%)
2023-02-10T18:16:52.755+05:30 [Info] Indexer CPU Utilization 0.7472
2023-02-10T18:16:52.755+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:52.755+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:52.755+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:52.755+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.755+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:52.755+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:52.755+05:30 [Info] Indexer Data Size Mean 71117238485 (66.2331G)
2023-02-10T18:16:52.755+05:30 [Info] Indexer Data Size Deviation 1022657151 (975.282M) (1.44%)
2023-02-10T18:16:52.755+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:52.755+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:52.755+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:52.755+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:52 -------------------------------------------
2023/02/10 18:16:52 incr placement - mixed small/medium, 6 2M index, 1 replica, 1x
2023-02-10T18:16:52.775+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.0025160353829157497
2023-02-10T18:16:53.107+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:53.107+05:30 [Info] Score: 0.00043718596495524715
2023-02-10T18:16:53.107+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-02-10T18:16:53.107+05:30 [Info] CPU Quota: 20
2023-02-10T18:16:53.107+05:30 [Info] Indexer Memory Mean 393025602195 (366.034G)
2023-02-10T18:16:53.107+05:30 [Info] Indexer Memory Deviation 343650554 (327.731M) (0.09%)
2023-02-10T18:16:53.107+05:30 [Info] Indexer Memory Utilization 0.7321
2023-02-10T18:16:53.107+05:30 [Info] Indexer CPU Mean 14.2305
2023-02-10T18:16:53.107+05:30 [Info] Indexer CPU Deviation 0.95 (6.65%)
2023-02-10T18:16:53.107+05:30 [Info] Indexer CPU Utilization 0.7115
2023-02-10T18:16:53.107+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:53.107+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:53.107+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:53.107+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.107+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:53.107+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.107+05:30 [Info] Indexer Data Size Mean 393025602195 (366.034G)
2023-02-10T18:16:53.107+05:30 [Info] Indexer Data Size Deviation 343650554 (327.731M) (0.09%)
2023-02-10T18:16:53.107+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:53.107+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:53.107+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:53.107+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:53 -------------------------------------------
2023/02/10 18:16:53 incr placement - 3 server group, 3 replica, 1x
2023-02-10T18:16:53.110+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.816496580927726
2023-02-10T18:16:53.137+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:53.137+05:30 [Info] Score: 0
2023-02-10T18:16:53.137+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-02-10T18:16:53.137+05:30 [Info] CPU Quota: 16
2023-02-10T18:16:53.137+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-02-10T18:16:53.137+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:53.137+05:30 [Info] Indexer Memory Utilization 0.0049
2023-02-10T18:16:53.137+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:53.137+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:53.137+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:53.137+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:53.137+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:53.137+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:53.137+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.137+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:53.137+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.137+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-02-10T18:16:53.137+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:53.137+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:53.137+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:53.137+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:53.137+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:53 -------------------------------------------
2023/02/10 18:16:53 incr placement - 2 server group, 3 replica, 1x
2023-02-10T18:16:53.139+05:30 [Warn] Index has more replica than server group. Index=index1 0 Bucket=bucket2 Scope= Collection=
2023-02-10T18:16:53.139+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 1) Bucket=bucket2 Scope= Collection=
2023-02-10T18:16:53.139+05:30 [Warn] Index has more replica than server group. Index=index1 0 (replica 2) Bucket=bucket2 Scope= Collection=
2023-02-10T18:16:53.139+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:53.152+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:53.152+05:30 [Info] Score: 0
2023-02-10T18:16:53.152+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-02-10T18:16:53.152+05:30 [Info] CPU Quota: 16
2023-02-10T18:16:53.152+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-02-10T18:16:53.152+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:53.152+05:30 [Info] Indexer Memory Utilization 0.0049
2023-02-10T18:16:53.153+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:53.153+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:53.153+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:53.153+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:53.153+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:53.153+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:53.153+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.153+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:53.153+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.153+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-02-10T18:16:53.153+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:53.153+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:53.153+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:53.153+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:53.153+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:53 -------------------------------------------
2023/02/10 18:16:53 rebalance - 20-50M, 90 index, 20% shuffle, 1x, utilization 90%+
2023-02-10T18:16:53.155+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3364654756269713
2023-02-10T18:16:53.155+05:30 [Info] Planner::initial temperature: initial resource variation 0.3364654756269713 temp 0.03364654756269713
2023-02-10T18:16:53.322+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:53.322+05:30 [Info] Score: 0.20400227273773588
2023-02-10T18:16:53.322+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-02-10T18:16:53.322+05:30 [Info] CPU Quota: 30
2023-02-10T18:16:53.322+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-02-10T18:16:53.322+05:30 [Info] Indexer Memory Deviation 2282988144 (2.1262G) (2.57%)
2023-02-10T18:16:53.322+05:30 [Info] Indexer Memory Utilization 0.6367
2023-02-10T18:16:53.322+05:30 [Info] Indexer CPU Mean 24.0538
2023-02-10T18:16:53.322+05:30 [Info] Indexer CPU Deviation 2.61 (10.85%)
2023-02-10T18:16:53.322+05:30 [Info] Indexer CPU Utilization 0.8018
2023-02-10T18:16:53.322+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:53.322+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:53.322+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:53.322+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.322+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:53.322+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.322+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-02-10T18:16:53.322+05:30 [Info] Indexer Data Size Deviation 2282988144 (2.1262G) (2.57%)
2023-02-10T18:16:53.322+05:30 [Info] Total Index Data (from non-deleted node) 993.273G
2023-02-10T18:16:53.322+05:30 [Info] Index Data Moved (exclude new node) 404.278G (40.70%)
2023-02-10T18:16:53.322+05:30 [Info] No. Index (from non-deleted node) 90
2023-02-10T18:16:53.322+05:30 [Info] No. Index Moved (exclude new node) 34 (37.78%)
2023/02/10 18:16:53 -------------------------------------------
2023/02/10 18:16:53 rebalance - mixed small/medium, 90 index, 20% shuffle, 1x
2023-02-10T18:16:53.324+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3306029224259924
2023-02-10T18:16:53.324+05:30 [Info] Planner::initial temperature: initial resource variation 0.3306029224259924 temp 0.03306029224259924
2023-02-10T18:16:53.530+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:53.530+05:30 [Info] Score: 0.22847605286606387
2023-02-10T18:16:53.530+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-02-10T18:16:53.530+05:30 [Info] CPU Quota: 20
2023-02-10T18:16:53.530+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-02-10T18:16:53.530+05:30 [Info] Indexer Memory Deviation 23485528591 (21.8726G) (5.98%)
2023-02-10T18:16:53.530+05:30 [Info] Indexer Memory Utilization 0.7311
2023-02-10T18:16:53.530+05:30 [Info] Indexer CPU Mean 13.9305
2023-02-10T18:16:53.530+05:30 [Info] Indexer CPU Deviation 2.31 (16.61%)
2023-02-10T18:16:53.530+05:30 [Info] Indexer CPU Utilization 0.6965
2023-02-10T18:16:53.530+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:53.530+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:53.530+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:53.530+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.530+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:53.530+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.530+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-02-10T18:16:53.530+05:30 [Info] Indexer Data Size Deviation 23485528591 (21.8726G) (5.98%)
2023-02-10T18:16:53.530+05:30 [Info] Total Index Data (from non-deleted node) 4.28378T
2023-02-10T18:16:53.530+05:30 [Info] Index Data Moved (exclude new node) 2.38132T (55.59%)
2023-02-10T18:16:53.530+05:30 [Info] No. Index (from non-deleted node) 90
2023-02-10T18:16:53.530+05:30 [Info] No. Index Moved (exclude new node) 26 (28.89%)
2023/02/10 18:16:53 -------------------------------------------
2023/02/10 18:16:53 rebalance - travel sample, 10% shuffle, 1x
2023-02-10T18:16:53.531+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.08263955061545106
2023-02-10T18:16:53.531+05:30 [Info] Planner::initial temperature: initial resource variation 0.08263955061545106 temp 0.008263955061545106
2023-02-10T18:16:53.538+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:53.538+05:30 [Info] Score: 0.020659887653862764
2023-02-10T18:16:53.538+05:30 [Info] Memory Quota: 536870912 (512M)
2023-02-10T18:16:53.538+05:30 [Info] CPU Quota: 8
2023-02-10T18:16:53.538+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-02-10T18:16:53.538+05:30 [Info] Indexer Memory Deviation 1446451 (1.37944M) (8.26%)
2023-02-10T18:16:53.538+05:30 [Info] Indexer Memory Utilization 0.0326
2023-02-10T18:16:53.538+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:53.538+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:53.538+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:53.538+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:53.538+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:53.538+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:53.538+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.538+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:53.538+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.538+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-02-10T18:16:53.538+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:53.538+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:53.538+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:53.538+05:30 [Info] No. Index (from non-deleted node) 10
2023-02-10T18:16:53.538+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:53 -------------------------------------------
2023/02/10 18:16:53 rebalance - 20-50M, 90 index, swap 2, 1x
2023-02-10T18:16:53.540+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4095843409677649
2023-02-10T18:16:53.540+05:30 [Info] Planner::initial temperature: initial resource variation 0.4095843409677649 temp 0.04095843409677649
2023-02-10T18:16:53.727+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:53.727+05:30 [Info] Score: 0.013249662202348415
2023-02-10T18:16:53.727+05:30 [Info] Memory Quota: 139586437120 (130G)
2023-02-10T18:16:53.727+05:30 [Info] CPU Quota: 30
2023-02-10T18:16:53.727+05:30 [Info] Indexer Memory Mean 88876568718 (82.7728G)
2023-02-10T18:16:53.727+05:30 [Info] Indexer Memory Deviation 2355169026 (2.19342G) (2.65%)
2023-02-10T18:16:53.727+05:30 [Info] Indexer Memory Utilization 0.6367
2023-02-10T18:16:53.727+05:30 [Info] Indexer CPU Mean 24.0538
2023-02-10T18:16:53.727+05:30 [Info] Indexer CPU Deviation 0.99 (4.13%)
2023-02-10T18:16:53.727+05:30 [Info] Indexer CPU Utilization 0.8018
2023-02-10T18:16:53.727+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:53.727+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:53.728+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:53.728+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.728+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:53.728+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.728+05:30 [Info] Indexer Data Size Mean 88876568718 (82.7728G)
2023-02-10T18:16:53.728+05:30 [Info] Indexer Data Size Deviation 2355169026 (2.19342G) (2.65%)
2023-02-10T18:16:53.728+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:53.728+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:53.728+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:53.728+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:53 -------------------------------------------
2023/02/10 18:16:53 rebalance - mixed small/medium, 90 index, swap 2, 1x
2023-02-10T18:16:53.729+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.4082556623939647
2023-02-10T18:16:53.729+05:30 [Info] Planner::initial temperature: initial resource variation 0.4082556623939647 temp 0.040825566239396475
2023-02-10T18:16:53.904+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:53.905+05:30 [Info] Score: 0.0015787809205773126
2023-02-10T18:16:53.905+05:30 [Info] Memory Quota: 536870912000 (500G)
2023-02-10T18:16:53.905+05:30 [Info] CPU Quota: 20
2023-02-10T18:16:53.905+05:30 [Info] Indexer Memory Mean 392505602195 (365.549G)
2023-02-10T18:16:53.905+05:30 [Info] Indexer Memory Deviation 1239360711 (1.15424G) (0.32%)
2023-02-10T18:16:53.905+05:30 [Info] Indexer Memory Utilization 0.7311
2023-02-10T18:16:53.905+05:30 [Info] Indexer CPU Mean 13.9305
2023-02-10T18:16:53.905+05:30 [Info] Indexer CPU Deviation 1.99 (14.31%)
2023-02-10T18:16:53.905+05:30 [Info] Indexer CPU Utilization 0.6965
2023-02-10T18:16:53.905+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:53.905+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:53.905+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:53.905+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.905+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:53.905+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:53.905+05:30 [Info] Indexer Data Size Mean 392505602195 (365.549G)
2023-02-10T18:16:53.905+05:30 [Info] Indexer Data Size Deviation 1239360711 (1.15424G) (0.32%)
2023-02-10T18:16:53.905+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:53.905+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:53.905+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:53.905+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:53 -------------------------------------------
2023/02/10 18:16:53 rebalance - travel sample, swap 2, 1x
2023-02-10T18:16:53.905+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1.0086622738872069
2023-02-10T18:16:53.905+05:30 [Info] Planner::initial temperature: initial resource variation 1.0086622738872069 temp 0.1008662273887207
2023-02-10T18:16:54.039+05:30 [Info] Score: 0.00031929273712825843
2023-02-10T18:16:54.039+05:30 [Info] Memory Quota: 536870912 (512M)
2023-02-10T18:16:54.039+05:30 [Info] CPU Quota: 8
2023-02-10T18:16:54.039+05:30 [Info] Indexer Memory Mean 17503138 (16.6923M)
2023-02-10T18:16:54.039+05:30 [Info] Indexer Memory Deviation 22354 (21.8301K) (0.13%)
2023-02-10T18:16:54.039+05:30 [Info] Indexer Memory Utilization 0.0326
2023-02-10T18:16:54.039+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:54.039+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:54.039+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:54.039+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:54.039+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:54.039+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:54.039+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.039+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:54.039+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.039+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-02-10T18:16:54.039+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.039+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:54.039+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:54.039+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:54.039+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:54 -------------------------------------------
2023/02/10 18:16:54 rebalance - 8 identical index, add 4, 1x
2023-02-10T18:16:54.040+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 1
2023-02-10T18:16:54.040+05:30 [Info] Planner::initial temperature: initial resource variation 1 temp 0.1
2023-02-10T18:16:54.056+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:54.056+05:30 [Info] Score: 0.125
2023-02-10T18:16:54.056+05:30 [Info] Memory Quota: 530294000 (505.728M)
2023-02-10T18:16:54.056+05:30 [Info] CPU Quota: 2
2023-02-10T18:16:54.056+05:30 [Info] Indexer Memory Mean 2600000 (2.47955M)
2023-02-10T18:16:54.056+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.056+05:30 [Info] Indexer Memory Utilization 0.0049
2023-02-10T18:16:54.056+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:54.056+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:54.056+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:54.056+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:54.056+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:54.056+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:54.056+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.056+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:54.056+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.056+05:30 [Info] Indexer Data Size Mean 2600000 (2.47955M)
2023-02-10T18:16:54.056+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.056+05:30 [Info] Total Index Data (from non-deleted node) 19.8364M
2023-02-10T18:16:54.056+05:30 [Info] Index Data Moved (exclude new node) 4.95911M (25.00%)
2023-02-10T18:16:54.056+05:30 [Info] No. Index (from non-deleted node) 8
2023-02-10T18:16:54.056+05:30 [Info] No. Index Moved (exclude new node) 2 (25.00%)
2023/02/10 18:16:54 -------------------------------------------
2023/02/10 18:16:54 rebalance - 8 identical index, delete 2, 2x
2023-02-10T18:16:54.057+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:54.057+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023-02-10T18:16:54.100+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:54.100+05:30 [Info] Score: 0
2023-02-10T18:16:54.101+05:30 [Info] Memory Quota: 1060588000 (1011.46M)
2023-02-10T18:16:54.101+05:30 [Info] CPU Quota: 4
2023-02-10T18:16:54.101+05:30 [Info] Indexer Memory Mean 10400000 (9.91821M)
2023-02-10T18:16:54.101+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] Indexer Memory Utilization 0.0098
2023-02-10T18:16:54.101+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:54.101+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:54.101+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:54.101+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:54.101+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:54.101+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] Indexer Data Size Mean 10400000 (9.91821M)
2023-02-10T18:16:54.101+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:54.101+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:54.101+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:54 -------------------------------------------
2023/02/10 18:16:54 rebalance - drop replcia - 3 replica, 3 zone, delete 1, 2x
2023-02-10T18:16:54.101+05:30 [Warn] There is more replica than available nodes. Will not move index replica (default,,,country) from ejected node 127.0.0.1:9003
2023-02-10T18:16:54.101+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-02-10T18:16:54.101+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-02-10T18:16:54.101+05:30 [Info] Score: 0
2023-02-10T18:16:54.101+05:30 [Info] Memory Quota: 536870912 (512M)
2023-02-10T18:16:54.101+05:30 [Info] CPU Quota: 16
2023-02-10T18:16:54.101+05:30 [Info] Indexer Memory Mean 0 (0)
2023-02-10T18:16:54.101+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] Indexer Memory Utilization 0.0000
2023-02-10T18:16:54.101+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:54.101+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:54.101+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:54.102+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:54.102+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:54 -------------------------------------------
2023/02/10 18:16:54 rebalance - rebuid replica - 3 replica, 3 zone, add 1, delete 1, 1x
2023-02-10T18:16:54.102+05:30 [Info] Planner::planSingleRun Initial variance of the solution: NaN
2023-02-10T18:16:54.102+05:30 [Info] Planner::initial temperature: initial resource variation NaN temp NaN
2023-02-10T18:16:54.102+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-02-10T18:16:54.102+05:30 [Info] Score: 0
2023-02-10T18:16:54.102+05:30 [Info] Memory Quota: 268435456 (256M)
2023-02-10T18:16:54.102+05:30 [Info] CPU Quota: 8
2023-02-10T18:16:54.102+05:30 [Info] Indexer Memory Mean 0 (0)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Memory Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Memory Utilization 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer CPU Mean 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer CPU Deviation 0.00 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Indexer CPU Utilization 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer IO Mean 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer IO Deviation 0.00 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Drain Rate Mean 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer Drain Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Scan Rate Mean 0.0000
2023-02-10T18:16:54.102+05:30 [Info] Indexer Scan Rate Deviation 0.00 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Data Size Mean 0 (0)
2023-02-10T18:16:54.102+05:30 [Info] Indexer Data Size Deviation 0 (0) (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] Total Index Data (from non-deleted node) 0
2023-02-10T18:16:54.102+05:30 [Info] Index Data Moved (exclude new node) 0 (0.00%)
2023-02-10T18:16:54.102+05:30 [Info] No. Index (from non-deleted node) 0
2023-02-10T18:16:54.102+05:30 [Info] No. Index Moved (exclude new node) 0 (0.00%)
2023/02/10 18:16:54 -------------------------------------------
2023/02/10 18:16:54 Minimum memory test 1: min memory = 0
2023-02-10T18:16:54.103+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-02-10T18:16:54.103+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-02-10T18:16:54.107+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/02/10 18:16:54 -------------------------------------------
2023/02/10 18:16:54 Minimum memory test 2: min memory > quota
2023-02-10T18:16:54.107+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-02-10T18:16:54.107+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-02-10T18:16:54.107+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=4us
2023-02-10T18:16:54.107+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-02-10T18:16:54.108+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/02/10 18:16:55 -------------------------------------------
2023/02/10 18:16:55 Minimum memory test 3: min memory < quota
2023-02-10T18:16:55.119+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-02-10T18:16:55.119+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Minimum memory test 4: replica repair with min memory > quota
2023-02-10T18:16:56.104+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2023-02-10T18:16:56.104+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=9us
2023-02-10T18:16:56.104+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-02-10T18:16:56.104+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=4us
2023-02-10T18:16:56.105+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-02-10T18:16:56.105+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-02-10T18:16:56.105+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-02-10T18:16:56.105+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:56.105+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=238us
2023-02-10T18:16:56.105+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-02-10T18:16:56.105+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-02-10T18:16:56.105+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-02-10T18:16:56.105+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:56.105+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=190us
2023-02-10T18:16:56.105+05:30 [Info] Cannot rebuild lost replica due to resource constraint in cluster. Will not rebuild lost replica.
2023-02-10T18:16:56.105+05:30 [Warn]
MemoryQuota: 200
CpuQuota: 8
--- Violations for index (mem 130, cpu 0) at node 127.0.0.1:9003
Cannot move to 127.0.0.1:9001: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
Cannot move to 127.0.0.1:9002: ReplicaViolation (free mem 1.67772e+07T, free cpu 8)
2023-02-10T18:16:56.105+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0
2023-02-10T18:16:56.105+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0 is less than threshold: 0. No nodes have been added or deleted and there are no violations observed
2023-02-10T18:16:56.105+05:30 [Info] Planner::initial temperature: initial resource variation 0 temp 1e-05
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Minimum memory test 5: replica repair with min memory < quota
2023-02-10T18:16:56.105+05:30 [Info] Rebuilding lost replica for (default,,,country,0)
2023-02-10T18:16:56.106+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3535533905932738
2023-02-10T18:16:56.106+05:30 [Info] Planner::initial temperature: initial resource variation 0.3535533905932738 temp 0.03535533905932738
2023-02-10T18:16:56.128+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Minimum memory test 6: rebalance with min memory > quota
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=5us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=4us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=3us
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Minimum memory test 7: rebalance-out with min memory > quota
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=4us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=7us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=3us
2023-02-10T18:16:56.129+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-02-10T18:16:56.130+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.25
2023-02-10T18:16:56.130+05:30 [Info] Planner::initial temperature: initial resource variation 0.25 temp 0.025
2023-02-10T18:16:56.130+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Minimum memory test 8: plan with min memory > quota
2023-02-10T18:16:56.133+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.041666666666666664
2023-02-10T18:16:56.133+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-02-10T18:16:56.133+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:56.133+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=896us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=8us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=6us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=5us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=5us
2023-02-10T18:16:56.134+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-02-10T18:16:56.134+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.041666666666666664
2023-02-10T18:16:56.134+05:30 [Info] Planner::finalizing the solution as final solution is found.
2023-02-10T18:16:56.134+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Minimum memory test 9: single node rebalance with min memory > quota
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=5us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=6us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=5us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=5us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=5us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=5us
2023-02-10T18:16:56.134+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=6us
2023-02-10T18:16:56.135+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=7us
2023-02-10T18:16:56.135+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=5us
2023-02-10T18:16:56.135+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=5us
2023-02-10T18:16:56.135+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=6us
2023-02-10T18:16:56.135+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=5us
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Minimum memory test 10: plan with partitioned index on empty cluster
2023-02-10T18:16:56.137+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.7071067811865476
2023-02-10T18:16:56.174+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 iterationTest :: Remove one node - failure
2023-02-10T18:16:56.175+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.27629882753902435
2023-02-10T18:16:56.257+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:56.258+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.258+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.258+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.258+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.258+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12706710002290494).
2023-02-10T18:16:56.258+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=1. Elapsed Time=489us
2023-02-10T18:16:56.258+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.258+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.258+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.258+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.258+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.17065714960820624).
2023-02-10T18:16:56.259+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=2. Elapsed Time=483us
2023-02-10T18:16:56.259+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.259+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.259+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.259+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.259+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.14743462274581434).
2023-02-10T18:16:56.259+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=3. Elapsed Time=462us
2023-02-10T18:16:56.259+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.259+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.259+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.259+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.260+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12721080291210876).
2023-02-10T18:16:56.260+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=4. Elapsed Time=484us
2023-02-10T18:16:56.260+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.260+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.260+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.260+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.260+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.15218408424147115).
2023-02-10T18:16:56.260+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=5. Elapsed Time=492us
2023-02-10T18:16:56.260+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.260+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.260+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.261+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.261+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.18720986220611963).
2023-02-10T18:16:56.261+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=6. Elapsed Time=446us
2023-02-10T18:16:56.261+05:30 [Warn] Unable to find a solution with resource constraint. Relax resource constraint check.
2023-02-10T18:16:56.261+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.261+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.261+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.261+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.261+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.21716030077138665).
2023-02-10T18:16:56.261+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=7. Elapsed Time=460us
2023-02-10T18:16:56.261+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.261+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.261+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.262+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.262+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.0880834718387577).
2023-02-10T18:16:56.262+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=8. Elapsed Time=489us
2023-02-10T18:16:56.262+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.262+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.262+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.262+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.262+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.1431157768588981).
2023-02-10T18:16:56.262+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=9. Elapsed Time=469us
2023-02-10T18:16:56.262+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.262+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.263+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.263+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.263+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.14696357868034485).
2023-02-10T18:16:56.263+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=10. Elapsed Time=510us
2023-02-10T18:16:56.263+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.263+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.263+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.263+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.263+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.12050295873104479).
2023-02-10T18:16:56.263+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=11. Elapsed Time=471us
2023-02-10T18:16:56.263+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.012480286057078911
2023-02-10T18:16:56.264+05:30 [Info] Planner::initial temperature: initial resource variation 0.012480286057078911 temp 0.03375197139429211
2023-02-10T18:16:56.264+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.264+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (2, 2) exceeded.
2023-02-10T18:16:56.264+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.18579746146972115).
2023-02-10T18:16:56.264+05:30 [Info] Planner::Fail to create plan satisfying constraint. Re-planning. Num of Try=12. Elapsed Time=466us
2023-02-10T18:16:56.264+05:30 [Error]
MemoryQuota: 5302940000000
CpuQuota: 5
--- Violations for index <16054716119702948838, bucket1, , > (mem 20.1196G, cpu 2.9604) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
--- Violations for index <8443234831542720503, bucket1, , > (mem 16.822G, cpu 3.77124) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
--- Violations for index <16585907212910861918, bucket1, , > (mem 13.6088G, cpu 1.1304) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
--- Violations for index <10579567467753631711, bucket1, , > (mem 12.7276G, cpu 2.60332) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
--- Violations for index <2149578488656820228, bucket1, , > (mem 11.3685G, cpu 3.3526800000000003) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
--- Violations for index <17153339957427920500, bucket1, , > (mem 12.8716G, cpu 2.3396) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
--- Violations for index <9055475447853418592, bucket1, , > (mem 12.7285G, cpu 3.7611600000000003) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
--- Violations for index <525757437720354929, bucket1, , > (mem 7.45378G, cpu 1.86132) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
--- Violations for index <13932114656230220981, bucket1, , > (mem 6.03221G, cpu 1.07928) at node 127.0.0.1:9001
Can move to 127.0.0.1:9002: NoViolation (free mem 4.64604T, free cpu -34.68584)
Can move to 127.0.0.1:9003: NoViolation (free mem 4.65718T, free cpu -17.992759999999997)
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 iterationTest :: Remove one node - success
2023-02-10T18:16:56.264+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.10424335819431081
2023-02-10T18:16:56.354+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:56.355+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.002465199951119976
2023-02-10T18:16:56.355+05:30 [Info] Planner::initial temperature: initial resource variation 0.002465199951119976 temp 0.024753480004888
2023-02-10T18:16:56.355+05:30 [Info] Planner::Running more iterations than 1 because of deleted nodes.
2023-02-10T18:16:56.355+05:30 [Info] Planner::Finished planner run after 10 iterations.
2023-02-10T18:16:56.355+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.022693135484772205).
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 iterationTest :: Index rebuild - success
2023-02-10T18:16:56.357+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i22,1)
2023-02-10T18:16:56.357+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i0,1)
2023-02-10T18:16:56.357+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i5,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i10,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i13,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i15,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i18,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i28,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i2,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i4,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i8,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i11,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i24,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i26,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i6,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i12,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i14,1)
2023-02-10T18:16:56.358+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i20,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i23,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i27,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i1,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i3,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i17,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i19,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i21,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i25,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i29,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i7,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i9,1)
2023-02-10T18:16:56.359+05:30 [Info] Rebuilding lost replica for (default,_default,_default,i16,1)
2023-02-10T18:16:56.360+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.5773502691896258
2023-02-10T18:16:56.360+05:30 [Info] Planner::planSingleRun Skip running planner as current solution resource variation: 0.5773502691896258 is less than threshold: 0.8. No nodes have been added or deleted and there are no violations observed
2023-02-10T18:16:56.360+05:30 [Info] Planner::initial temperature: initial resource variation 0.5773502691896258 temp 0.02226497308103742
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 iterationTest :: Index rebuild - initial placement - success
2023-02-10T18:16:56.361+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1)
2023-02-10T18:16:56.361+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1)
2023-02-10T18:16:56.361+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1)
2023-02-10T18:16:56.361+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.6236095644623236
2023-02-10T18:16:56.361+05:30 [Info] Planner::initial temperature: initial resource variation 0.6236095644623236 temp 0.03663904355376764
2023-02-10T18:16:56.361+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-02-10T18:16:56.361+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:56.361+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.6236095644623236).
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 iterationTest :: Index rebuild - initial placement - numReplica > numSG - success
2023-02-10T18:16:56.361+05:30 [Info] Rebuilding lost replica for (default,,,idx1,1)
2023-02-10T18:16:56.362+05:30 [Info] Rebuilding lost replica for (default,,,idx1,2)
2023-02-10T18:16:56.362+05:30 [Info] Rebuilding lost replica for (default,,,idx2,1)
2023-02-10T18:16:56.362+05:30 [Info] Rebuilding lost replica for (default,,,idx2,2)
2023-02-10T18:16:56.362+05:30 [Info] Rebuilding lost replica for (default,,,idx3,1)
2023-02-10T18:16:56.362+05:30 [Info] Rebuilding lost replica for (default,,,idx3,2)
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 2) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 2) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx3 0 Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 1) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx1 0 (replica 2) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx2 0 (replica 1) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx1 0 Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx2 0 Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Warn] Index has more replica than server group. Index=idx3 0 (replica 1) Bucket=default Scope= Collection=
2023-02-10T18:16:56.362+05:30 [Info] Planner::planSingleRun Initial variance of the solution: 0.3333333333333333
2023-02-10T18:16:56.362+05:30 [Info] Planner::initial temperature: initial resource variation 0.3333333333333333 temp 0.06566666666666668
2023-02-10T18:16:56.362+05:30 [Info] Planner::stop planner iter per temp as maxIterPerTemp limit (0, 0) exceeded.
2023-02-10T18:16:56.362+05:30 [Info] Planner::finalizing the solution as there are no more valid index movements.
2023-02-10T18:16:56.362+05:30 [Info] Planner::finalizing the solution as the current resource variation is under control (0.3333333333333333).
--- PASS: TestPlanner (8.32s)
=== RUN TestGreedyPlanner
2023/02/10 18:16:56 In TestGreedyPlanner()
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 3 empty nodes - 1 SG
2023-02-10T18:16:56.365+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 2 empty nodes, 1 non-empty node - 1 SG
2023-02-10T18:16:56.367+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 1 empty node, 2 non-empty nodes - 1 SG
2023-02-10T18:16:56.369+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 3 non-empty nodes - 1 SG
2023-02-10T18:16:56.372+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 1 Replica - 3 empty nodes - 1 SG
2023-02-10T18:16:56.375+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 1 SG
2023-02-10T18:16:56.377+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 1 SG
2023-02-10T18:16:56.380+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 1 Replica - 3 non-empty nodes - 1 SG
2023-02-10T18:16:56.382+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 2 Replica - 3 empty nodes - 1 SG
2023-02-10T18:16:56.385+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 2 Replica - 3 non-empty nodes - 1 SG
2023-02-10T18:16:56.388+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 1 Replica - 2 empty nodes, 1 non-empty node - 2 SG
2023-02-10T18:16:56.392+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 1 Replica - 1 empty node, 2 non-empty nodes - 2 SG
2023-02-10T18:16:56.395+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Index With 1 Replica - 3 non-empty nodes - 2 SG
2023-02-10T18:16:56.399+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Equivalent Index Without any replica - 3 non-empty nodes - 1 SG
2023-02-10T18:16:56.402+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Skip least loaded node
2023-02-10T18:16:56.407+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Equivalent Index With 1 Replica - 3 non-empty nodes - 1 SG - Use least loaded node
2023-02-10T18:16:56.410+05:30 [Info] Using greedy index placement for index 987654
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place 60 index instaces on 3 empty nodes - 1 SG
2023-02-10T18:16:56.412+05:30 [Info] Using greedy index placement for index 1000987654
2023-02-10T18:16:56.414+05:30 [Info] Using greedy index placement for index 1001987654
2023-02-10T18:16:56.417+05:30 [Info] Using greedy index placement for index 1002987654
2023-02-10T18:16:56.419+05:30 [Info] Using greedy index placement for index 1003987654
2023-02-10T18:16:56.421+05:30 [Info] Using greedy index placement for index 1004987654
2023-02-10T18:16:56.423+05:30 [Info] Using greedy index placement for index 1005987654
2023-02-10T18:16:56.425+05:30 [Info] Using greedy index placement for index 1006987654
2023-02-10T18:16:56.428+05:30 [Info] Using greedy index placement for index 1007987654
2023-02-10T18:16:56.430+05:30 [Info] Using greedy index placement for index 1008987654
2023-02-10T18:16:56.432+05:30 [Info] Using greedy index placement for index 1009987654
2023-02-10T18:16:56.434+05:30 [Info] Using greedy index placement for index 1010987654
2023-02-10T18:16:56.436+05:30 [Info] Using greedy index placement for index 1011987654
2023-02-10T18:16:56.438+05:30 [Info] Using greedy index placement for index 1012987654
2023-02-10T18:16:56.440+05:30 [Info] Using greedy index placement for index 1013987654
2023-02-10T18:16:56.443+05:30 [Info] Using greedy index placement for index 1014987654
2023-02-10T18:16:56.445+05:30 [Info] Using greedy index placement for index 1015987654
2023-02-10T18:16:56.447+05:30 [Info] Using greedy index placement for index 1016987654
2023-02-10T18:16:56.449+05:30 [Info] Using greedy index placement for index 1017987654
2023-02-10T18:16:56.451+05:30 [Info] Using greedy index placement for index 1018987654
2023-02-10T18:16:56.453+05:30 [Info] Using greedy index placement for index 1019987654
2023-02-10T18:16:56.455+05:30 [Info] Using greedy index placement for index 1020987654
2023-02-10T18:16:56.456+05:30 [Info] Using greedy index placement for index 1021987654
2023-02-10T18:16:56.458+05:30 [Info] Using greedy index placement for index 1022987654
2023-02-10T18:16:56.460+05:30 [Info] Using greedy index placement for index 1023987654
2023-02-10T18:16:56.461+05:30 [Info] Using greedy index placement for index 1024987654
2023-02-10T18:16:56.463+05:30 [Info] Using greedy index placement for index 1025987654
2023-02-10T18:16:56.465+05:30 [Info] Using greedy index placement for index 1026987654
2023-02-10T18:16:56.467+05:30 [Info] Using greedy index placement for index 1027987654
2023-02-10T18:16:56.468+05:30 [Info] Using greedy index placement for index 1028987654
2023-02-10T18:16:56.470+05:30 [Info] Using greedy index placement for index 1029987654
2023-02-10T18:16:56.472+05:30 [Info] Using greedy index placement for index 1030987654
2023-02-10T18:16:56.474+05:30 [Info] Using greedy index placement for index 1031987654
2023-02-10T18:16:56.476+05:30 [Info] Using greedy index placement for index 1032987654
2023-02-10T18:16:56.477+05:30 [Info] Using greedy index placement for index 1033987654
2023-02-10T18:16:56.479+05:30 [Info] Using greedy index placement for index 1034987654
2023-02-10T18:16:56.481+05:30 [Info] Using greedy index placement for index 1035987654
2023-02-10T18:16:56.483+05:30 [Info] Using greedy index placement for index 1036987654
2023-02-10T18:16:56.485+05:30 [Info] Using greedy index placement for index 1037987654
2023-02-10T18:16:56.486+05:30 [Info] Using greedy index placement for index 1038987654
2023-02-10T18:16:56.488+05:30 [Info] Using greedy index placement for index 1039987654
2023-02-10T18:16:56.490+05:30 [Info] Using greedy index placement for index 1040987654
2023-02-10T18:16:56.492+05:30 [Info] Using greedy index placement for index 1041987654
2023-02-10T18:16:56.493+05:30 [Info] Using greedy index placement for index 1042987654
2023-02-10T18:16:56.495+05:30 [Info] Using greedy index placement for index 1043987654
2023-02-10T18:16:56.497+05:30 [Info] Using greedy index placement for index 1044987654
2023-02-10T18:16:56.499+05:30 [Info] Using greedy index placement for index 1045987654
2023-02-10T18:16:56.501+05:30 [Info] Using greedy index placement for index 1046987654
2023-02-10T18:16:56.503+05:30 [Info] Using greedy index placement for index 1047987654
2023-02-10T18:16:56.505+05:30 [Info] Using greedy index placement for index 1048987654
2023-02-10T18:16:56.507+05:30 [Info] Using greedy index placement for index 1049987654
2023-02-10T18:16:56.508+05:30 [Info] Using greedy index placement for index 1050987654
2023-02-10T18:16:56.510+05:30 [Info] Using greedy index placement for index 1051987654
2023-02-10T18:16:56.512+05:30 [Info] Using greedy index placement for index 1052987654
2023-02-10T18:16:56.514+05:30 [Info] Using greedy index placement for index 1053987654
2023-02-10T18:16:56.516+05:30 [Info] Using greedy index placement for index 1054987654
2023-02-10T18:16:56.517+05:30 [Info] Using greedy index placement for index 1055987654
2023-02-10T18:16:56.519+05:30 [Info] Using greedy index placement for index 1056987654
2023-02-10T18:16:56.521+05:30 [Info] Using greedy index placement for index 1057987654
2023-02-10T18:16:56.523+05:30 [Info] Using greedy index placement for index 1058987654
2023-02-10T18:16:56.525+05:30 [Info] Using greedy index placement for index 1059987654
2023-02-10T18:16:56.525+05:30 [Info] Actual variance of deferred index count across nodes is 0
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place 60 index instaces on 1 empty and 1 10 percent filled node - 1 SG
2023-02-10T18:16:56.528+05:30 [Info] Using greedy index placement for index 1000987654
2023-02-10T18:16:56.529+05:30 [Info] Using greedy index placement for index 1001987654
2023-02-10T18:16:56.531+05:30 [Info] Using greedy index placement for index 1002987654
2023-02-10T18:16:56.533+05:30 [Info] Using greedy index placement for index 1003987654
2023-02-10T18:16:56.535+05:30 [Info] Using greedy index placement for index 1004987654
2023-02-10T18:16:56.537+05:30 [Info] Using greedy index placement for index 1005987654
2023-02-10T18:16:56.538+05:30 [Info] Using greedy index placement for index 1006987654
2023-02-10T18:16:56.540+05:30 [Info] Using greedy index placement for index 1007987654
2023-02-10T18:16:56.542+05:30 [Info] Using greedy index placement for index 1008987654
2023-02-10T18:16:56.543+05:30 [Info] Using greedy index placement for index 1009987654
2023-02-10T18:16:56.545+05:30 [Info] Using greedy index placement for index 1010987654
2023-02-10T18:16:56.547+05:30 [Info] Using greedy index placement for index 1011987654
2023-02-10T18:16:56.549+05:30 [Info] Using greedy index placement for index 1012987654
2023-02-10T18:16:56.550+05:30 [Info] Using greedy index placement for index 1013987654
2023-02-10T18:16:56.552+05:30 [Info] Using greedy index placement for index 1014987654
2023-02-10T18:16:56.554+05:30 [Info] Using greedy index placement for index 1015987654
2023-02-10T18:16:56.555+05:30 [Info] Using greedy index placement for index 1016987654
2023-02-10T18:16:56.557+05:30 [Info] Using greedy index placement for index 1017987654
2023-02-10T18:16:56.559+05:30 [Info] Using greedy index placement for index 1018987654
2023-02-10T18:16:56.561+05:30 [Info] Using greedy index placement for index 1019987654
2023-02-10T18:16:56.563+05:30 [Info] Using greedy index placement for index 1020987654
2023-02-10T18:16:56.565+05:30 [Info] Using greedy index placement for index 1021987654
2023-02-10T18:16:56.566+05:30 [Info] Using greedy index placement for index 1022987654
2023-02-10T18:16:56.568+05:30 [Info] Using greedy index placement for index 1023987654
2023-02-10T18:16:56.570+05:30 [Info] Using greedy index placement for index 1024987654
2023-02-10T18:16:56.571+05:30 [Info] Using greedy index placement for index 1025987654
2023-02-10T18:16:56.573+05:30 [Info] Using greedy index placement for index 1026987654
2023-02-10T18:16:56.575+05:30 [Info] Using greedy index placement for index 1027987654
2023-02-10T18:16:56.577+05:30 [Info] Using greedy index placement for index 1028987654
2023-02-10T18:16:56.578+05:30 [Info] Using greedy index placement for index 1029987654
2023-02-10T18:16:56.580+05:30 [Info] Using greedy index placement for index 1030987654
2023-02-10T18:16:56.582+05:30 [Info] Using greedy index placement for index 1031987654
2023-02-10T18:16:56.584+05:30 [Info] Using greedy index placement for index 1032987654
2023-02-10T18:16:56.585+05:30 [Info] Using greedy index placement for index 1033987654
2023-02-10T18:16:56.587+05:30 [Info] Using greedy index placement for index 1034987654
2023-02-10T18:16:56.589+05:30 [Info] Using greedy index placement for index 1035987654
2023-02-10T18:16:56.592+05:30 [Info] Using greedy index placement for index 1036987654
2023-02-10T18:16:56.596+05:30 [Info] Using greedy index placement for index 1037987654
2023-02-10T18:16:56.598+05:30 [Info] Using greedy index placement for index 1038987654
2023-02-10T18:16:56.600+05:30 [Info] Using greedy index placement for index 1039987654
2023-02-10T18:16:56.602+05:30 [Info] Using greedy index placement for index 1040987654
2023-02-10T18:16:56.604+05:30 [Info] Using greedy index placement for index 1041987654
2023-02-10T18:16:56.606+05:30 [Info] Using greedy index placement for index 1042987654
2023-02-10T18:16:56.608+05:30 [Info] Using greedy index placement for index 1043987654
2023-02-10T18:16:56.610+05:30 [Info] Using greedy index placement for index 1044987654
2023-02-10T18:16:56.612+05:30 [Info] Using greedy index placement for index 1045987654
2023-02-10T18:16:56.614+05:30 [Info] Using greedy index placement for index 1046987654
2023-02-10T18:16:56.616+05:30 [Info] Using greedy index placement for index 1047987654
2023-02-10T18:16:56.618+05:30 [Info] Using greedy index placement for index 1048987654
2023-02-10T18:16:56.621+05:30 [Info] Using greedy index placement for index 1049987654
2023-02-10T18:16:56.623+05:30 [Info] Using greedy index placement for index 1050987654
2023-02-10T18:16:56.625+05:30 [Info] Using greedy index placement for index 1051987654
2023-02-10T18:16:56.627+05:30 [Info] Using greedy index placement for index 1052987654
2023-02-10T18:16:56.629+05:30 [Info] Using greedy index placement for index 1053987654
2023-02-10T18:16:56.631+05:30 [Info] Using greedy index placement for index 1054987654
2023-02-10T18:16:56.633+05:30 [Info] Using greedy index placement for index 1055987654
2023-02-10T18:16:56.635+05:30 [Info] Using greedy index placement for index 1056987654
2023-02-10T18:16:56.637+05:30 [Info] Using greedy index placement for index 1057987654
2023-02-10T18:16:56.639+05:30 [Info] Using greedy index placement for index 1058987654
2023-02-10T18:16:56.641+05:30 [Info] Using greedy index placement for index 1059987654
2023-02-10T18:16:56.641+05:30 [Info] Actual variance of deferred index count across nodes is 8
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place 60 index instaces on 1 empty and 1 30 percent filled node - 1 SG
2023-02-10T18:16:56.643+05:30 [Info] Using greedy index placement for index 1000987654
2023-02-10T18:16:56.645+05:30 [Info] Using greedy index placement for index 1001987654
2023-02-10T18:16:56.647+05:30 [Info] Using greedy index placement for index 1002987654
2023-02-10T18:16:56.649+05:30 [Info] Using greedy index placement for index 1003987654
2023-02-10T18:16:56.650+05:30 [Info] Using greedy index placement for index 1004987654
2023-02-10T18:16:56.652+05:30 [Info] Using greedy index placement for index 1005987654
2023-02-10T18:16:56.654+05:30 [Info] Using greedy index placement for index 1006987654
2023-02-10T18:16:56.656+05:30 [Info] Using greedy index placement for index 1007987654
2023-02-10T18:16:56.657+05:30 [Info] Using greedy index placement for index 1008987654
2023-02-10T18:16:56.659+05:30 [Info] Using greedy index placement for index 1009987654
2023-02-10T18:16:56.661+05:30 [Info] Using greedy index placement for index 1010987654
2023-02-10T18:16:56.663+05:30 [Info] Using greedy index placement for index 1011987654
2023-02-10T18:16:56.665+05:30 [Info] Using greedy index placement for index 1012987654
2023-02-10T18:16:56.667+05:30 [Info] Using greedy index placement for index 1013987654
2023-02-10T18:16:56.668+05:30 [Info] Using greedy index placement for index 1014987654
2023-02-10T18:16:56.670+05:30 [Info] Using greedy index placement for index 1015987654
2023-02-10T18:16:56.672+05:30 [Info] Using greedy index placement for index 1016987654
2023-02-10T18:16:56.674+05:30 [Info] Using greedy index placement for index 1017987654
2023-02-10T18:16:56.676+05:30 [Info] Using greedy index placement for index 1018987654
2023-02-10T18:16:56.677+05:30 [Info] Using greedy index placement for index 1019987654
2023-02-10T18:16:56.679+05:30 [Info] Using greedy index placement for index 1020987654
2023-02-10T18:16:56.681+05:30 [Info] Using greedy index placement for index 1021987654
2023-02-10T18:16:56.683+05:30 [Info] Using greedy index placement for index 1022987654
2023-02-10T18:16:56.684+05:30 [Info] Using greedy index placement for index 1023987654
2023-02-10T18:16:56.686+05:30 [Info] Using greedy index placement for index 1024987654
2023-02-10T18:16:56.688+05:30 [Info] Using greedy index placement for index 1025987654
2023-02-10T18:16:56.690+05:30 [Info] Using greedy index placement for index 1026987654
2023-02-10T18:16:56.691+05:30 [Info] Using greedy index placement for index 1027987654
2023-02-10T18:16:56.693+05:30 [Info] Using greedy index placement for index 1028987654
2023-02-10T18:16:56.695+05:30 [Info] Using greedy index placement for index 1029987654
2023-02-10T18:16:56.697+05:30 [Info] Using greedy index placement for index 1030987654
2023-02-10T18:16:56.698+05:30 [Info] Using greedy index placement for index 1031987654
2023-02-10T18:16:56.700+05:30 [Info] Using greedy index placement for index 1032987654
2023-02-10T18:16:56.702+05:30 [Info] Using greedy index placement for index 1033987654
2023-02-10T18:16:56.703+05:30 [Info] Using greedy index placement for index 1034987654
2023-02-10T18:16:56.705+05:30 [Info] Using greedy index placement for index 1035987654
2023-02-10T18:16:56.707+05:30 [Info] Using greedy index placement for index 1036987654
2023-02-10T18:16:56.709+05:30 [Info] Using greedy index placement for index 1037987654
2023-02-10T18:16:56.710+05:30 [Info] Using greedy index placement for index 1038987654
2023-02-10T18:16:56.712+05:30 [Info] Using greedy index placement for index 1039987654
2023-02-10T18:16:56.714+05:30 [Info] Using greedy index placement for index 1040987654
2023-02-10T18:16:56.716+05:30 [Info] Using greedy index placement for index 1041987654
2023-02-10T18:16:56.717+05:30 [Info] Using greedy index placement for index 1042987654
2023-02-10T18:16:56.719+05:30 [Info] Using greedy index placement for index 1043987654
2023-02-10T18:16:56.721+05:30 [Info] Using greedy index placement for index 1044987654
2023-02-10T18:16:56.722+05:30 [Info] Using greedy index placement for index 1045987654
2023-02-10T18:16:56.724+05:30 [Info] Using greedy index placement for index 1046987654
2023-02-10T18:16:56.726+05:30 [Info] Using greedy index placement for index 1047987654
2023-02-10T18:16:56.728+05:30 [Info] Using greedy index placement for index 1048987654
2023-02-10T18:16:56.730+05:30 [Info] Using greedy index placement for index 1049987654
2023-02-10T18:16:56.731+05:30 [Info] Using greedy index placement for index 1050987654
2023-02-10T18:16:56.733+05:30 [Info] Using greedy index placement for index 1051987654
2023-02-10T18:16:56.735+05:30 [Info] Using greedy index placement for index 1052987654
2023-02-10T18:16:56.737+05:30 [Info] Using greedy index placement for index 1053987654
2023-02-10T18:16:56.738+05:30 [Info] Using greedy index placement for index 1054987654
2023-02-10T18:16:56.740+05:30 [Info] Using greedy index placement for index 1055987654
2023-02-10T18:16:56.742+05:30 [Info] Using greedy index placement for index 1056987654
2023-02-10T18:16:56.744+05:30 [Info] Using greedy index placement for index 1057987654
2023-02-10T18:16:56.746+05:30 [Info] Using greedy index placement for index 1058987654
2023-02-10T18:16:56.748+05:30 [Info] Using greedy index placement for index 1059987654
2023-02-10T18:16:56.748+05:30 [Info] Actual variance of deferred index count across nodes is 98
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place 5 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-02-10T18:16:56.750+05:30 [Info] Using greedy index placement for index 1000987654
2023-02-10T18:16:56.752+05:30 [Info] Using greedy index placement for index 1001987654
2023-02-10T18:16:56.753+05:30 [Info] Using greedy index placement for index 1002987654
2023-02-10T18:16:56.755+05:30 [Info] Using greedy index placement for index 1003987654
2023-02-10T18:16:56.757+05:30 [Info] Using greedy index placement for index 1004987654
2023-02-10T18:16:56.757+05:30 [Info] Actual variance of deferred index count across nodes is 4.5
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place 60 index instaces on 1 empty and 1 60 percent filled node - 1 SG
2023-02-10T18:16:56.759+05:30 [Info] Using greedy index placement for index 1000987654
2023-02-10T18:16:56.760+05:30 [Info] Using greedy index placement for index 1001987654
2023-02-10T18:16:56.762+05:30 [Info] Using greedy index placement for index 1002987654
2023-02-10T18:16:56.764+05:30 [Info] Using greedy index placement for index 1003987654
2023-02-10T18:16:56.766+05:30 [Info] Using greedy index placement for index 1004987654
2023-02-10T18:16:56.767+05:30 [Info] Using greedy index placement for index 1005987654
2023-02-10T18:16:56.769+05:30 [Info] Using greedy index placement for index 1006987654
2023-02-10T18:16:56.771+05:30 [Info] Using greedy index placement for index 1007987654
2023-02-10T18:16:56.772+05:30 [Info] Using greedy index placement for index 1008987654
2023-02-10T18:16:56.774+05:30 [Info] Using greedy index placement for index 1009987654
2023-02-10T18:16:56.776+05:30 [Info] Using greedy index placement for index 1010987654
2023-02-10T18:16:56.778+05:30 [Info] Using greedy index placement for index 1011987654
2023-02-10T18:16:56.779+05:30 [Info] Using greedy index placement for index 1012987654
2023-02-10T18:16:56.781+05:30 [Info] Using greedy index placement for index 1013987654
2023-02-10T18:16:56.783+05:30 [Info] Using greedy index placement for index 1014987654
2023-02-10T18:16:56.785+05:30 [Info] Using greedy index placement for index 1015987654
2023-02-10T18:16:56.786+05:30 [Info] Using greedy index placement for index 1016987654
2023-02-10T18:16:56.788+05:30 [Info] Using greedy index placement for index 1017987654
2023-02-10T18:16:56.790+05:30 [Info] Using greedy index placement for index 1018987654
2023-02-10T18:16:56.792+05:30 [Info] Using greedy index placement for index 1019987654
2023-02-10T18:16:56.793+05:30 [Info] Using greedy index placement for index 1020987654
2023-02-10T18:16:56.795+05:30 [Info] Using greedy index placement for index 1021987654
2023-02-10T18:16:56.797+05:30 [Info] Using greedy index placement for index 1022987654
2023-02-10T18:16:56.798+05:30 [Info] Using greedy index placement for index 1023987654
2023-02-10T18:16:56.800+05:30 [Info] Using greedy index placement for index 1024987654
2023-02-10T18:16:56.802+05:30 [Info] Using greedy index placement for index 1025987654
2023-02-10T18:16:56.803+05:30 [Info] Using greedy index placement for index 1026987654
2023-02-10T18:16:56.805+05:30 [Info] Using greedy index placement for index 1027987654
2023-02-10T18:16:56.807+05:30 [Info] Using greedy index placement for index 1028987654
2023-02-10T18:16:56.808+05:30 [Info] Using greedy index placement for index 1029987654
2023-02-10T18:16:56.810+05:30 [Info] Using greedy index placement for index 1030987654
2023-02-10T18:16:56.812+05:30 [Info] Using greedy index placement for index 1031987654
2023-02-10T18:16:56.814+05:30 [Info] Using greedy index placement for index 1032987654
2023-02-10T18:16:56.816+05:30 [Info] Using greedy index placement for index 1033987654
2023-02-10T18:16:56.818+05:30 [Info] Using greedy index placement for index 1034987654
2023-02-10T18:16:56.819+05:30 [Info] Using greedy index placement for index 1035987654
2023-02-10T18:16:56.821+05:30 [Info] Using greedy index placement for index 1036987654
2023-02-10T18:16:56.823+05:30 [Info] Using greedy index placement for index 1037987654
2023-02-10T18:16:56.825+05:30 [Info] Using greedy index placement for index 1038987654
2023-02-10T18:16:56.827+05:30 [Info] Using greedy index placement for index 1039987654
2023-02-10T18:16:56.829+05:30 [Info] Using greedy index placement for index 1040987654
2023-02-10T18:16:56.831+05:30 [Info] Using greedy index placement for index 1041987654
2023-02-10T18:16:56.833+05:30 [Info] Using greedy index placement for index 1042987654
2023-02-10T18:16:56.835+05:30 [Info] Using greedy index placement for index 1043987654
2023-02-10T18:16:56.837+05:30 [Info] Using greedy index placement for index 1044987654
2023-02-10T18:16:56.839+05:30 [Info] Using greedy index placement for index 1045987654
2023-02-10T18:16:56.841+05:30 [Info] Using greedy index placement for index 1046987654
2023-02-10T18:16:56.842+05:30 [Info] Using greedy index placement for index 1047987654
2023-02-10T18:16:56.844+05:30 [Info] Using greedy index placement for index 1048987654
2023-02-10T18:16:56.846+05:30 [Info] Using greedy index placement for index 1049987654
2023-02-10T18:16:56.848+05:30 [Info] Using greedy index placement for index 1050987654
2023-02-10T18:16:56.850+05:30 [Info] Using greedy index placement for index 1051987654
2023-02-10T18:16:56.852+05:30 [Info] Using greedy index placement for index 1052987654
2023-02-10T18:16:56.854+05:30 [Info] Using greedy index placement for index 1053987654
2023-02-10T18:16:56.856+05:30 [Info] Using greedy index placement for index 1054987654
2023-02-10T18:16:56.858+05:30 [Info] Using greedy index placement for index 1055987654
2023-02-10T18:16:56.860+05:30 [Info] Using greedy index placement for index 1056987654
2023-02-10T18:16:56.862+05:30 [Info] Using greedy index placement for index 1057987654
2023-02-10T18:16:56.863+05:30 [Info] Using greedy index placement for index 1058987654
2023-02-10T18:16:56.865+05:30 [Info] Using greedy index placement for index 1059987654
2023-02-10T18:16:56.865+05:30 [Info] Actual variance of deferred index count across nodes is 648
--- PASS: TestGreedyPlanner (0.50s)
=== RUN TestTenantAwarePlanner
2023/02/10 18:16:56 In TestTenantAwarePlanner()
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 1 empty node - 1 SG
2023-02-10T18:16:56.866+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-02-10T18:16:56.866+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-02-10T18:16:56.866+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 4 empty nodes - 2 SG
2023-02-10T18:16:56.869+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9003 127.0.0.1:9002]]
2023-02-10T18:16:56.869+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-02-10T18:16:56.869+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9003 127.0.0.1:9002]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 1 node - 1 SG
2023-02-10T18:16:56.871+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.871+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001]]
2023-02-10T18:16:56.871+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-02-10T18:16:56.871+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 2 nodes - 1 SG
2023-02-10T18:16:56.873+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.873+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.873+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-02-10T18:16:56.873+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001]
2023-02-10T18:16:56.873+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(a)
2023-02-10T18:16:56.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.876+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.876+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9002] [127.0.0.1:9004 127.0.0.1:9003]]
2023-02-10T18:16:56.876+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9002]
2023-02-10T18:16:56.876+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9002]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(b)
2023-02-10T18:16:56.878+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.878+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000
2023-02-10T18:16:56.878+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9002]]
2023-02-10T18:16:56.878+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.878+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity(c)
2023-02-10T18:16:56.880+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.880+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.880+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.880+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 1000
2023-02-10T18:16:56.880+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-02-10T18:16:56.880+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.880+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9001 127.0.0.1:9004]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Memory Above LWM
2023-02-10T18:16:56.883+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.883+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000
2023-02-10T18:16:56.883+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.883+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000
2023-02-10T18:16:56.883+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.883+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.883+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity Units Above LWM
2023-02-10T18:16:56.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5000
2023-02-10T18:16:56.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.885+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5000
2023-02-10T18:16:56.885+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.885+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.885+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9002 127.0.0.1:9005]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(a)
2023-02-10T18:16:56.887+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.887+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000
2023-02-10T18:16:56.887+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.887+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000
2023-02-10T18:16:56.887+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.887+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-02-10T18:16:56.887+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 6 nodes - 3 SG - Tenant Affinity New Tenant(b)
2023-02-10T18:16:56.889+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.889+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000
2023-02-10T18:16:56.889+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.889+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000
2023-02-10T18:16:56.889+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.889+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-02-10T18:16:56.889+05:30 [Info] Planner::executeTenantAwarePlan Found Result [127.0.0.1:9006 127.0.0.1:9003]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 2 empty nodes - 1 SG
2023-02-10T18:16:56.891+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002]]
2023-02-10T18:16:56.891+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-02-10T18:16:56.891+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9002]
2023-02-10T18:16:56.891+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9001]
2023-02-10T18:16:56.891+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Unable to find any valid SubCluster
2023/02/10 18:16:56 Expected error Planner not able to find any node for placement - Unable to find any valid SubCluster
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Memory HWM
2023-02-10T18:16:56.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000
2023-02-10T18:16:56.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.892+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 900000000 Units 1000
2023-02-10T18:16:56.892+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-02-10T18:16:56.892+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.892+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2023/02/10 18:16:56 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 4 nodes - 2 SG - Tenant Affinity Above Units HWM
2023-02-10T18:16:56.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 8000
2023-02-10T18:16:56.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg3 Memory 300000000 Units 8000
2023-02-10T18:16:56.893+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9003]]
2023-02-10T18:16:56.893+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.893+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket1 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - Tenant SubCluster Above High Usage Threshold
2023/02/10 18:16:56 Expected error Planner not able to find any node for placement - Tenant SubCluster Above High Usage Threshold
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Memory Above LWM
2023-02-10T18:16:56.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 680000000 Units 1000
2023-02-10T18:16:56.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 700000000 Units 1000
2023-02-10T18:16:56.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 680000000 Units 1000
2023-02-10T18:16:56.893+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 700000000 Units 1000
2023-02-10T18:16:56.893+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.893+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-02-10T18:16:56.893+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2023/02/10 18:16:56 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Place Single Index Instance - 6 nodes - 3 SG - New Tenant Units Above LWM
2023-02-10T18:16:56.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000
2023-02-10T18:16:56.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 5500
2023-02-10T18:16:56.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000
2023-02-10T18:16:56.894+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 5500
2023-02-10T18:16:56.894+05:30 [Info] Planner::executeTenantAwarePlan Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.894+05:30 [Info] Planner::executeTenantAwarePlan Found Candidate Based on Tenant Affinity []
2023-02-10T18:16:56.894+05:30 [Info] Planner::executeTenantAwarePlan Found no matching candidate for tenant &{idx1 bucket7 987654 false [name1] false false false false 0 0 [] 2 [] false 0 0 0 0 0 0 0 0}. Error - No SubCluster Below Low Usage Threshold
2023/02/10 18:16:56 Expected error Planner not able to find any node for placement - No SubCluster Below Low Usage Threshold
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 3 SG, 1 empty, 1 Memory Above HWM
2023-02-10T18:16:56.895+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 1000
2023-02-10T18:16:56.895+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 1000
2023-02-10T18:16:56.895+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.895+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 1000
2023-02-10T18:16:56.895+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.896+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.896+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.896+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500
2023-02-10T18:16:56.896+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.896+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 400000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 3 SG, 1 empty, 1 Units Above HWM
2023-02-10T18:16:56.897+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 8000
2023-02-10T18:16:56.897+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 400000000 Units 1000
2023-02-10T18:16:56.897+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 8000
2023-02-10T18:16:56.897+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 400000000 Units 1000
2023-02-10T18:16:56.897+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.897+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.897+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.897+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000
2023-02-10T18:16:56.897+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.897+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 3 SG, 1 empty, Both Memory/Units Above HWM
2023-02-10T18:16:56.898+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2023-02-10T18:16:56.898+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.898+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2023-02-10T18:16:56.898+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000
2023-02-10T18:16:56.898+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.898+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.898+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.898+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.898+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-02-10T18:16:56.898+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.898+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.898+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 3 SG, Multiple tenants to move, single source, multiple destination
2023-02-10T18:16:56.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2023-02-10T18:16:56.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2023-02-10T18:16:56.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2023-02-10T18:16:56.899+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2023-02-10T18:16:56.899+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.899+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.899+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.899+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000
2023-02-10T18:16:56.899+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000
2023-02-10T18:16:56.899+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.899+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 4000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.899+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 400000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 3 SG, Multiple tenants to move, no nodes below LWM
2023-02-10T18:16:56.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 300000000 Units 5000
2023-02-10T18:16:56.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000
2023-02-10T18:16:56.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 700000000 Units 3000
2023-02-10T18:16:56.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 300000000 Units 5000
2023-02-10T18:16:56.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000
2023-02-10T18:16:56.900+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 700000000 Units 3000
2023-02-10T18:16:56.900+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.900+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.900+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.900+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-02-10T18:16:56.900+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-02-10T18:16:56.900+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-02-10T18:16:56.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.901+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.901+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.901+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000
2023-02-10T18:16:56.902+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.902+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.902+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.902+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.902+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.902+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.902+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.902+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.902+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(non-uniform memory/units usage)
2023-02-10T18:16:56.903+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.903+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.903+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.903+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.903+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.903+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-02-10T18:16:56.903+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.903+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.903+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.903+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.903+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.903+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.903+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.903+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.904+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 3 SG, Single Large Tenant, Nothing to move
2023-02-10T18:16:56.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 1000
2023-02-10T18:16:56.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 2000
2023-02-10T18:16:56.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 1000
2023-02-10T18:16:56.904+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 2000
2023-02-10T18:16:56.904+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.904+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.904+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.904+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000
2023-02-10T18:16:56.904+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.904+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 200000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Multiple tenants to move, multiple source, multiple destination(zero usage tenants)
2023-02-10T18:16:56.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.906+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.906+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.906+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 3 SG, 1 Partial Subcluster
2023-02-10T18:16:56.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2023-02-10T18:16:56.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 900000000 Units 3000
2023-02-10T18:16:56.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.908+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 900000000 Units 3000
2023-02-10T18:16:56.908+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003]]
2023-02-10T18:16:56.908+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.908+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.908+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.908+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500
2023-02-10T18:16:56.908+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500
2023-02-10T18:16:56.908+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9003]
2023-02-10T18:16:56.908+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.908+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 300000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.908+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket1 MemoryUsage 200000000 UnitsUsage 500 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Replica Repair - 4 SG, Missing Replicas for multiple tenants in SG
2023-02-10T18:16:56.909+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2023-02-10T18:16:56.909+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.909+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.909+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.909+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.909+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.909+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.909+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-02-10T18:16:56.909+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-02-10T18:16:56.909+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-02-10T18:16:56.909+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-02-10T18:16:56.909+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over
2023-02-10T18:16:56.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2023-02-10T18:16:56.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.910+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.910+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-02-10T18:16:56.910+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9004
2023-02-10T18:16:56.910+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-02-10T18:16:56.910+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9004
2023-02-10T18:16:56.910+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-02-10T18:16:56.910+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx1,1) on 127.0.0.1:9005
2023-02-10T18:16:56.910+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.910+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Replica Repair - 4 SG, Missing Replicas, Buddy Node Failed over, No replacement
2023-02-10T18:16:56.911+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2023-02-10T18:16:56.911+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.911+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.911+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.911+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.911+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.911+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9001] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.911+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Replica Repair - 4 SG, Missing Replicas, one replica missing with pendingDelete true
2023-02-10T18:16:56.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 100000000 Units 1000
2023-02-10T18:16:56.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.912+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.912+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.912+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9004
2023-02-10T18:16:56.912+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9001
2023-02-10T18:16:56.912+05:30 [Info] Planner::findMissingReplicaForIndexerNode Skipping Replica Repair for 88883:81813:0. PendingDelete true
2023-02-10T18:16:56.912+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket8,,,idx2,1) on 127.0.0.1:9005
2023-02-10T18:16:56.912+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Replica Repair - 2 SG, Missing Replicas with Nodes over HWM
2023-02-10T18:16:56.913+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 7000
2023-02-10T18:16:56.913+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 500
2023-02-10T18:16:56.913+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 7000
2023-02-10T18:16:56.913+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.913+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket9,,,idx2,1) on 127.0.0.1:9005
2023-02-10T18:16:56.913+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.913+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.913+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800
2023-02-10T18:16:56.913+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700
2023-02-10T18:16:56.913+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500
2023-02-10T18:16:56.913+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000
2023-02-10T18:16:56.914+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.914+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 800 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.914+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 700 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.914+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 500 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.914+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 1000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes
2023-02-10T18:16:56.915+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9004]
2023-02-10T18:16:56.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9004]
2023-02-10T18:16:56.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9001]
2023-02-10T18:16:56.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006 127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.915+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9008 127.0.0.1:9006 127.0.0.1:9007]
2023-02-10T18:16:56.915+05:30 [Info] Moving index 7777:7171:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-02-10T18:16:56.915+05:30 [Info] Moving index 8888:8181:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-02-10T18:16:56.915+05:30 [Info] Moving index 9999:9191:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-02-10T18:16:56.915+05:30 [Info] Moving index 101010:101101:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-02-10T18:16:56.915+05:30 [Info] Moving index 111111:112112:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-02-10T18:16:56.915+05:30 [Info] Moving index 121212:121121:0 from source 127.0.0.1:9002 to dest 127.0.0.1:9003
2023-02-10T18:16:56.915+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.915+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.915+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.915+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.915+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.915+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.915+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-02-10T18:16:56.915+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-02-10T18:16:56.915+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.915+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000
2023-02-10T18:16:56.915+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.915+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 1100000000 Units 8100
2023-02-10T18:16:56.915+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008] [127.0.0.1:9003 127.0.0.1:9005] [127.0.0.1:9006] [127.0.0.1:9007]]
2023-02-10T18:16:56.915+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9006] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.915+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.915+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Swap Rebalance - 4 SG, Swap 1 node each from 2 SG with 2 new nodes(different SG)
2023-02-10T18:16:56.916+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004 127.0.0.1:9005]
2023-02-10T18:16:56.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004 127.0.0.1:9005]
2023-02-10T18:16:56.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-02-10T18:16:56.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.916+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.917+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.917+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.917+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.917+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.917+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.917+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.917+05:30 [Info] Moving index 7777:17171:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-02-10T18:16:56.917+05:30 [Info] Moving index 8888:18181:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-02-10T18:16:56.917+05:30 [Info] Moving index 9999:19191:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-02-10T18:16:56.917+05:30 [Info] Moving index 101010:1101101:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-02-10T18:16:56.917+05:30 [Info] Moving index 111111:1112112:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-02-10T18:16:56.917+05:30 [Info] Moving index 121212:1121121:0 from source 127.0.0.1:9005 to dest 127.0.0.1:9003
2023-02-10T18:16:56.917+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-02-10T18:16:56.917+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-02-10T18:16:56.917+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.917+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.917+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 1000000000 Units 7000
2023-02-10T18:16:56.917+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000
2023-02-10T18:16:56.917+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.917+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.917+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9003] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.917+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Swap Rebalance - 4 SG, Swap 1 SG with 2 new nodes
2023-02-10T18:16:56.918+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.918+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.918+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-02-10T18:16:56.918+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.918+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.918+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-02-10T18:16:56.918+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-02-10T18:16:56.918+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-02-10T18:16:56.918+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-02-10T18:16:56.918+05:30 [Info] Moving index 5555:5151:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-02-10T18:16:56.918+05:30 [Info] Moving index 6666:6161:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9003
2023-02-10T18:16:56.918+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.918+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.918+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.918+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.918+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.918+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.918+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-02-10T18:16:56.918+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-02-10T18:16:56.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000
2023-02-10T18:16:56.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.918+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.918+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.918+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Swap Rebalance - 4 SG, Swap 1 node with 2 new nodes
2023-02-10T18:16:56.919+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-02-10T18:16:56.919+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-02-10T18:16:56.919+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-02-10T18:16:56.919+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008 127.0.0.1:9006]
2023-02-10T18:16:56.920+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9006 127.0.0.1:9003 127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.920+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.920+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.920+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.920+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.920+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.920+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9006
2023-02-10T18:16:56.920+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-02-10T18:16:56.920+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.920+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.920+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.920+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 900000000 Units 8000
2023-02-10T18:16:56.920+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003] [127.0.0.1:9008] [127.0.0.1:9007]]
2023-02-10T18:16:56.920+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.920+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9008] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.920+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9007] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.920+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Swap Rebalance - 4 SG, Swap 1 empty node with 2 new nodes
2023-02-10T18:16:56.921+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-02-10T18:16:56.921+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-02-10T18:16:56.921+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.921+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.921+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9006] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9003]]
2023-02-10T18:16:56.921+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket1,,,idx1,1) on 127.0.0.1:9006
2023-02-10T18:16:56.921+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9006
2023-02-10T18:16:56.921+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket3,,,idx1,1) on 127.0.0.1:9006
2023-02-10T18:16:56.921+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9006
2023-02-10T18:16:56.921+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9006
2023-02-10T18:16:56.921+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket6,,,idx2,1) on 127.0.0.1:9006
2023-02-10T18:16:56.921+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9003] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.921+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Swap Rebalance - 1 SG, Swap 1 node - Failed swap rebalance
2023-02-10T18:16:56.922+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-02-10T18:16:56.922+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-02-10T18:16:56.922+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-02-10T18:16:56.922+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.922+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-02-10T18:16:56.922+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.922+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.922+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 200000000 Units 100
2023-02-10T18:16:56.922+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9008 as replacement node for deleted node 127.0.0.1:9004.
2023-02-10T18:16:56.922+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.922+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.922+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.922+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.922+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 600000000 Units 4000
2023-02-10T18:16:56.922+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.922+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg3 Memory 500000000 Units 4100
2023-02-10T18:16:56.922+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9008]]
2023-02-10T18:16:56.922+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Swap Rebalance - 1 SG, Swap 2 node - server group mismatch
2023-02-10T18:16:56.923+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9002]
2023-02-10T18:16:56.923+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9002]
2023-02-10T18:16:56.923+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9002 127.0.0.1:9001]
2023-02-10T18:16:56.923+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9003 127.0.0.1:9004]
2023/02/10 18:16:56 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 subcluster, Enough Capacity
2023-02-10T18:16:56.924+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.924+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.924+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.925+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 350000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 250000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.925+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 0 Units 0
2023-02-10T18:16:56.925+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 600000000 Units 4500
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 600000000 Units 4500
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 600000000 Units 4100
2023-02-10T18:16:56.925+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 600000000 Units 4100
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.925+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity
2023-02-10T18:16:56.926+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2023-02-10T18:16:56.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2023-02-10T18:16:56.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.926+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.926+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.926+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 on any target
2023-02-10T18:16:56.926+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 on any target
2023-02-10T18:16:56.926+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 on any target
2023-02-10T18:16:56.926+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.926+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.926+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/02/10 18:16:56 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 node, Pair node not deleted(Failed swap rebalance of 1 node)
2023-02-10T18:16:56.928+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001]
2023-02-10T18:16:56.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001]
2023-02-10T18:16:56.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004]
2023-02-10T18:16:56.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.928+05:30 [Info] Planner::moveTenantsFromDeletedNodes Considering 127.0.0.1:9009 as replacement node for deleted node 127.0.0.1:9001.
2023-02-10T18:16:56.928+05:30 [Info] Moving index 1111:1212:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-02-10T18:16:56.928+05:30 [Info] Moving index 2222:2121:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-02-10T18:16:56.928+05:30 [Info] Moving index 3333:3131:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-02-10T18:16:56.928+05:30 [Info] Moving index 4444:4141:0 from source 127.0.0.1:9001 to dest 127.0.0.1:9009
2023-02-10T18:16:56.928+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9001 SG sg1 Memory 600000000 Units 4000
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.928+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9009 SG sg1 Memory 500000000 Units 4100
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9004 127.0.0.1:9009] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9004 127.0.0.1:9009]]
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9009]
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.928+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9003 127.0.0.1:9006] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket10 MemoryUsage 200000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket7 MemoryUsage 25000000 UnitsUsage 500 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket9 MemoryUsage 100000000 UnitsUsage 700 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket15 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket8 MemoryUsage 75000000 UnitsUsage 1000 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket17 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket16 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.928+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket14 MemoryUsage 0 UnitsUsage 0 can be placed on [127.0.0.1:9003 127.0.0.1:9006]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 node, Pair node already deleted
2023-02-10T18:16:56.929+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002]
2023-02-10T18:16:56.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002]
2023-02-10T18:16:56.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes []
2023-02-10T18:16:56.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-02-10T18:16:56.929+05:30 [Info] Planner::moveTenantsFromDeletedNodes Pair node not found for deleted node 127.0.0.1:9002.
2023-02-10T18:16:56.929+05:30 [Error] Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/02/10 18:16:56 Expected error Planner - Pair node for 127.0.0.1:9002 not found. Provide additional node as replacement.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 subcluster, empty nodes
2023-02-10T18:16:56.930+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9005 127.0.0.1:9007 127.0.0.1:9008]
2023-02-10T18:16:56.930+05:30 [Info] Planner::moveTenantsFromDeletedNodes No non-empty deleted nodes found.
2023-02-10T18:16:56.930+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023-02-10T18:16:56.930+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.930+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000
2023-02-10T18:16:56.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 800000000 Units 7000
2023-02-10T18:16:56.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2023-02-10T18:16:56.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000
2023-02-10T18:16:56.930+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2023-02-10T18:16:56.930+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.930+05:30 [Info] Planner::repairMissingReplica Found SubCluster [127.0.0.1:9002] with len 1. Skipping replica repair attempt.
2023-02-10T18:16:56.930+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 subcluster, Deleted Nodes more than added nodes
2023-02-10T18:16:56.931+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.931+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.931+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-02-10T18:16:56.931+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-02-10T18:16:56.931+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 1
2023-02-10T18:16:56.931+05:30 [Error] Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/02/10 18:16:56 Expected error Planner - Number of non-empty deleted nodes cannot be greater than number of added nodes.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 node, Add 1 node in, server group mismatch
2023-02-10T18:16:56.932+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9006]
2023-02-10T18:16:56.932+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9006]
2023-02-10T18:16:56.932+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9003]
2023-02-10T18:16:56.932+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9007]
2023/02/10 18:16:56 Expected error Planner - Unable to satisfy server group constraint while replacing removed nodes with new nodes.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 node, Pair node exists
2023-02-10T18:16:56.932+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9004]
2023-02-10T18:16:56.932+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-02-10T18:16:56.932+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-02-10T18:16:56.932+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.932+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 1 is more than num new/empty nodes 0
2023-02-10T18:16:56.932+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.932+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.932+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 500
2023-02-10T18:16:56.932+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.932+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.932+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2023-02-10T18:16:56.932+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.932+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.932+05:30 [Info] Planner::moveTenantsFromDeletedNodes No replacement node found for deleted node 127.0.0.1:9004.
2023-02-10T18:16:56.932+05:30 [Error] Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/02/10 18:16:56 Expected error Planner - Removing node 127.0.0.1:9004 will result in losing indexes. Provide additional node as replacement.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 subcluster, No nodes under LWM
2023-02-10T18:16:56.933+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket5 MemoryUsage 300000000 UnitsUsage 2000
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket6 MemoryUsage 300000000 UnitsUsage 2000
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 120000000 UnitsUsage 1500
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket3 MemoryUsage 80000000 UnitsUsage 1200
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 70000000 UnitsUsage 800
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 30000000 UnitsUsage 500
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket17 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket14 MemoryUsage 0 UnitsUsage 0
2023-02-10T18:16:56.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.933+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.933+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-02-10T18:16:56.933+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/02/10 18:16:56 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 4 SG, Move out 1 subcluster, Not Enough Capacity, Partial Subcluster
2023-02-10T18:16:56.934+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.934+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.934+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9004 127.0.0.1:9001]
2023-02-10T18:16:56.934+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.934+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-02-10T18:16:56.934+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.934+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket1 MemoryUsage 100000000 UnitsUsage 500
2023-02-10T18:16:56.934+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 500
2023-02-10T18:16:56.934+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9001 SG sg1 Memory 200000000 Units 1000
2023-02-10T18:16:56.934+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.934+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9004 SG sg2 Memory 200000000 Units 1000
2023-02-10T18:16:56.934+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.934+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 500
2023-02-10T18:16:56.934+05:30 [Info] Planner::filterPartialSubClusters Filter partial subcluster [127.0.0.1:9006]
2023-02-10T18:16:56.934+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-02-10T18:16:56.934+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/02/10 18:16:56 Expected error Planner - Not enough capacity to place indexes of deleted nodes.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 2 SG, Move out 1 non-empty and 1 empty node
2023-02-10T18:16:56.935+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9007 127.0.0.1:9004]
2023-02-10T18:16:56.935+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9004]
2023-02-10T18:16:56.935+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9001]
2023-02-10T18:16:56.935+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes [127.0.0.1:9008]
2023-02-10T18:16:56.935+05:30 [Info] Planner::moveTenantsFromDeletedNodes selected newNodes for swap [127.0.0.1:9008]
2023-02-10T18:16:56.935+05:30 [Info] Moving index 1111:11212:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.935+05:30 [Info] Moving index 2222:22121:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.935+05:30 [Info] Moving index 3333:33131:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.935+05:30 [Info] Moving index 4444:44141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.935+05:30 [Info] Moving index 5555:55151:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.935+05:30 [Info] Moving index 6666:66161:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.935+05:30 [Info] Moving index 171717:1171171:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.935+05:30 [Info] Moving index 141414:1141141:0 from source 127.0.0.1:9004 to dest 127.0.0.1:9008
2023-02-10T18:16:56.935+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9007 SG sg1 Memory 0 Units 0
2023-02-10T18:16:56.935+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9004 SG sg2 Memory 0 Units 0
2023-02-10T18:16:56.935+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 800000000 Units 8000
2023-02-10T18:16:56.935+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000
2023-02-10T18:16:56.935+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9008 127.0.0.1:9001]]
2023-02-10T18:16:56.935+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM
2023-02-10T18:16:56.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2023-02-10T18:16:56.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2023-02-10T18:16:56.936+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.936+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.936+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.936+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.936+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-02-10T18:16:56.936+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.936+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.936+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-02-10T18:16:56.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000
2023-02-10T18:16:56.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-02-10T18:16:56.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000
2023-02-10T18:16:56.936+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-02-10T18:16:56.936+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.936+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 2 Subclusters, 1 below LWM, 1 above HWM
2023-02-10T18:16:56.937+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2023-02-10T18:16:56.937+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.937+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2023-02-10T18:16:56.937+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000
2023-02-10T18:16:56.937+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.937+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.937+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.937+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.937+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-02-10T18:16:56.937+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.937+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.937+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-02-10T18:16:56.937+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000
2023-02-10T18:16:56.937+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 600000000 Units 4000
2023-02-10T18:16:56.937+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000
2023-02-10T18:16:56.937+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 600000000 Units 4000
2023-02-10T18:16:56.937+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.937+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 3 Subclusters, 1 empty, 1 Above HWM, 1 below LWM
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 300000000 Units 1000
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 300000000 Units 1000
2023-02-10T18:16:56.938+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.938+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.938+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.938+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.938+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-02-10T18:16:56.938+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.938+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.938+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000
2023-02-10T18:16:56.938+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-02-10T18:16:56.938+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.938+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.938+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.938+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.938+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.938+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.939+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-02-10T18:16:56.939+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.939+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.939+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.939+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 500000000 Units 3000
2023-02-10T18:16:56.939+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-02-10T18:16:56.939+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2023-02-10T18:16:56.939+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 500000000 Units 3000
2023-02-10T18:16:56.939+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-02-10T18:16:56.939+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-02-10T18:16:56.939+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 2 Subclusters, 1 above LWM/below HWM, 1 empty
2023-02-10T18:16:56.939+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000
2023-02-10T18:16:56.939+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000
2023-02-10T18:16:56.939+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.939+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 2 Subclusters, Both above LWM/below HWM
2023-02-10T18:16:56.940+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000
2023-02-10T18:16:56.940+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500
2023-02-10T18:16:56.940+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000
2023-02-10T18:16:56.940+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500
2023-02-10T18:16:56.940+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.940+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-02-10T18:16:56.940+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 700000000 Units 5000
2023-02-10T18:16:56.940+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 650000000 Units 4500
2023-02-10T18:16:56.940+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 700000000 Units 5000
2023-02-10T18:16:56.940+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 650000000 Units 4500
2023-02-10T18:16:56.940+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.940+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM (partial replica repair)
2023-02-10T18:16:56.941+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 9000
2023-02-10T18:16:56.941+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 550000000 Units 5500
2023-02-10T18:16:56.941+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.941+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-02-10T18:16:56.941+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-02-10T18:16:56.941+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.941+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.941+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.941+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-02-10T18:16:56.941+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.941+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.941+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-02-10T18:16:56.941+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000
2023-02-10T18:16:56.941+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-02-10T18:16:56.941+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000
2023-02-10T18:16:56.941+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-02-10T18:16:56.941+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.942+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 2 Subclusters, 1 empty, 1 Above HWM(full replica repair)
2023-02-10T18:16:56.942+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 9000
2023-02-10T18:16:56.942+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9004 127.0.0.1:9001] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.942+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx1,1) on 127.0.0.1:9001
2023-02-10T18:16:56.942+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket2,,,idx2,1) on 127.0.0.1:9001
2023-02-10T18:16:56.942+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx1,1) on 127.0.0.1:9001
2023-02-10T18:16:56.942+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,1) on 127.0.0.1:9001
2023-02-10T18:16:56.942+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx1,1) on 127.0.0.1:9001
2023-02-10T18:16:56.942+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,1) on 127.0.0.1:9001
2023-02-10T18:16:56.942+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9004 127.0.0.1:9001]]
2023-02-10T18:16:56.942+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9004 127.0.0.1:9001]
2023-02-10T18:16:56.942+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.942+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000
2023-02-10T18:16:56.942+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.942+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.942+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9004 TenantId bucket2 MemoryUsage 200000000 UnitsUsage 2000 on any target
2023-02-10T18:16:56.942+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 600000000 Units 6000
2023-02-10T18:16:56.942+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 300000000 Units 3000
2023-02-10T18:16:56.942+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 600000000 Units 6000
2023-02-10T18:16:56.942+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 300000000 Units 3000
2023-02-10T18:16:56.942+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.942+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9003 127.0.0.1:9006]]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 ScaleIn- 2 Subclusters, Both below LWM, Positive Case
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2023-02-10T18:16:56.943+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.943+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2023-02-10T18:16:56.943+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.943+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.943+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.943+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.943+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.943+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.943+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-02-10T18:16:56.943+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9003 127.0.0.1:9006]
2023-02-10T18:16:56.943+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9003 SG sg1 Memory 100000000 Units 2000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2023-02-10T18:16:56.943+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9006 SG sg3 Memory 100000000 Units 2000
2023-02-10T18:16:56.943+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005]]
2023-02-10T18:16:56.943+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9003 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 2000 can be placed on [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.943+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9003 SG sg1 Memory 0 Units 0
2023-02-10T18:16:56.943+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9006 SG sg3 Memory 0 Units 0
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 ScaleIn- 2 Subclusters, One below LWM/ 1 Empty
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 200000000 Units 1000
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 200000000 Units 1000
2023-02-10T18:16:56.944+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.944+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. No ScaleIn.
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.944+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.944+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.944+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.944+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.944+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-02-10T18:16:56.944+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.944+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.944+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2023-02-10T18:16:56.944+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000
2023-02-10T18:16:56.945+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.945+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.945+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.945+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.945+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-02-10T18:16:56.945+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.945+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-02-10T18:16:56.945+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.945+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000
2023-02-10T18:16:56.945+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM []
2023-02-10T18:16:56.945+05:30 [Error] Planner - Not enough capacity to place indexes of deleted nodes.
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 ScaleIn- 3 Subclusters, One above HWM, one below LWM and 1 Empty. ScaleIn.
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 800000000 Units 8000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 800000000 Units 8000
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.945+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.945+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.945+05:30 [Info] Planner::executeTenantAwareRebal TenantsToBeMoved from source [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.945+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000
2023-02-10T18:16:56.945+05:30 [Info] Planner::executeTenantAwareRebal TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000
2023-02-10T18:16:56.945+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters Below LWM [[127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.945+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket4 MemoryUsage 300000000 UnitsUsage 3000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.945+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9001 TenantId bucket2 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023-02-10T18:16:56.945+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000
2023-02-10T18:16:56.946+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.946+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.946+05:30 [Info] Planner::findPlacementForDeletedNodes Deleted Nodes [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.946+05:30 [Info] Planner::moveTenantsFromDeletedNodes nonEmptyDeletedNodes [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.946+05:30 [Info] Planner::moveTenantsFromDeletedNodes pairForDeletedNodes [127.0.0.1:9005 127.0.0.1:9002]
2023-02-10T18:16:56.946+05:30 [Info] Planner::moveTenantsFromDeletedNodes newNodes []
2023-02-10T18:16:56.946+05:30 [Info] Planner::moveTenantsFromDeletedNodes Num deleted nodes 2 is more than num new/empty nodes 0
2023-02-10T18:16:56.946+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantsToBeMoved from source [127.0.0.1:9002 127.0.0.1:9005]
2023-02-10T18:16:56.946+05:30 [Info] Planner::moveTenantsFromDeletedNodes TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9002 SG sg2 Memory 100000000 Units 1000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9003 SG sg1 Memory 400000000 Units 4000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 400000000 Units 4000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Skip Deleted Index Node 127.0.0.1:9005 SG sg3 Memory 100000000 Units 1000
2023-02-10T18:16:56.946+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9006 SG sg3 Memory 400000000 Units 4000
2023-02-10T18:16:56.946+05:30 [Info] Planner::moveTenantsFromDeletedNodes Found SubClusters Below LWM [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9003 127.0.0.1:9006]]
2023-02-10T18:16:56.946+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9002 TenantId bucket3 MemoryUsage 100000000 UnitsUsage 1000 can be placed on [127.0.0.1:9001 127.0.0.1:9004]
2023-02-10T18:16:56.946+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9002 SG sg2 Memory 0 Units 0
2023-02-10T18:16:56.946+05:30 [Info] Planner::findPlacementForDeletedNodes Remove Deleted Node from solution 127.0.0.1:9005 SG sg3 Memory 0 Units 0
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Rebalance - 1 Subcluster, Below HWM (partial replica repair)
2023-02-10T18:16:56.947+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800
2023-02-10T18:16:56.947+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 350000000 Units 500
2023-02-10T18:16:56.947+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.947+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket4,,,idx2,0) on 127.0.0.1:9004
2023-02-10T18:16:56.947+05:30 [Info] Planner::placeMissingReplicaOnTarget Rebuilding lost replica for (bucket5,,,idx2,0) on 127.0.0.1:9004
2023-02-10T18:16:56.947+05:30 [Info] Planner::executeTenantAwareRebal Found SubClusters above HWM []
2023-02-10T18:16:56.947+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 500000000 Units 800
2023-02-10T18:16:56.947+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 500000000 Units 800
2023-02-10T18:16:56.947+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004]]
2023-02-10T18:16:56.947+05:30 [Info] Planner::evaluateSolutionForScaleIn Found SubClusters below LWM [[127.0.0.1:9001 127.0.0.1:9004]]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Resume - 1 tenant, Empty node in cluster.
2023-02-10T18:16:56.948+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-02-10T18:16:56.948+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.948+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.948+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.948+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.948+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.948+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.948+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.948+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-02-10T18:16:56.948+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008] [127.0.0.1:9006 127.0.0.1:9003]]
2023-02-10T18:16:56.948+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9006 127.0.0.1:9003]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Resume - 1 tenant, No empty node in cluster.
2023-02-10T18:16:56.950+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-02-10T18:16:56.950+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.950+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.950+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.950+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.950+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.950+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.950+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.950+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-02-10T18:16:56.950+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.950+05:30 [Info] Planner::findTenantPlacement TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250 can be placed on [127.0.0.1:9007 127.0.0.1:9008]
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Resume - 1 tenant, No node below LWM in the cluster.
2023-02-10T18:16:56.951+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-02-10T18:16:56.952+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.952+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.952+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.952+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.952+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 5000
2023-02-10T18:16:56.952+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 5000
2023-02-10T18:16:56.952+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.952+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 250000000 UnitsUsage 250
2023-02-10T18:16:56.952+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM []
2023/02/10 18:16:56 Expected error No SubCluster Below Low Usage Threshold
2023/02/10 18:16:56 -------------------------------------------
2023/02/10 18:16:56 Resume - 1 tenant, Not enough capacity in the cluster.
2023-02-10T18:16:56.953+05:30 [Info] Planner::executeTenantAwarePlanForResume Resume Nodes [127.0.0.1:9011 127.0.0.1:9012]
2023-02-10T18:16:56.953+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9001 SG sg1 Memory 900000000 Units 8000
2023-02-10T18:16:56.953+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9002 SG sg2 Memory 1000000000 Units 7000
2023-02-10T18:16:56.953+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9004 SG sg2 Memory 900000000 Units 8000
2023-02-10T18:16:56.953+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9005 SG sg3 Memory 1000000000 Units 7000
2023-02-10T18:16:56.953+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9007 SG sg1 Memory 200000000 Units 100
2023-02-10T18:16:56.953+05:30 [Info] Planner::groupIndexNodesIntoSubClusters Index Node 127.0.0.1:9008 SG sg2 Memory 200000000 Units 100
2023-02-10T18:16:56.953+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters [[127.0.0.1:9001 127.0.0.1:9004] [127.0.0.1:9002 127.0.0.1:9005] [127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.953+05:30 [Info] Planner::executeTenantAwarePlanForResume TenantToBeResumed TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250
2023-02-10T18:16:56.953+05:30 [Info] Planner::executeTenantAwarePlanForResume Found SubClusters Below LWM [[127.0.0.1:9007 127.0.0.1:9008]]
2023-02-10T18:16:56.953+05:30 [Info] Planner::moveTenantsToLowUsageSubCluster Unable to place TenantUsage - SourceId 127.0.0.1:9011 TenantId resume_tenant_a MemoryUsage 700000000 UnitsUsage 250 on any target
2023/02/10 18:16:56 Expected error Not Enough Capacity To Place Tenant
--- PASS: TestTenantAwarePlanner (0.09s)
=== RUN TestRestfulAPI
2023/02/10 18:16:56 In TestRestfulAPI()
2023/02/10 18:16:56 In DropAllSecondaryIndexes()
2023/02/10 18:16:56 Index found: indexmut_1
2023/02/10 18:16:57 Dropped index indexmut_1
2023/02/10 18:16:57 Setting JSON docs in KV
2023/02/10 18:16:57 GET all indexes
2023/02/10 18:16:58 200 OK
2023/02/10 18:16:58 FOUND indexes: []
2023/02/10 18:16:58 DROP index: badindexid
2023/02/10 18:16:58 status: 400 Bad Request
2023/02/10 18:16:58 DROP index: 23544142
2023/02/10 18:16:58 status: 500 Internal Server Error
2023/02/10 18:16:58 TEST: malformed body
2023/02/10 18:16:58 400 Bad Request "invalid request body ({name:), unmarshal failed invalid character 'n' looking for beginning of object key string"
2023/02/10 18:16:58 TEST: missing field ``name``
2023/02/10 18:16:58 400 Bad Request "missing field name"
2023/02/10 18:16:58 TEST: empty field ``name``
2023/02/10 18:16:58 400 Bad Request "empty field name"
2023/02/10 18:16:58 TEST: missing field ``bucket``
2023/02/10 18:16:58 400 Bad Request "missing field bucket"
2023/02/10 18:16:58 TEST: empty field ``bucket``
2023/02/10 18:16:58 400 Bad Request "empty field bucket"
2023/02/10 18:16:58 TEST: missing field ``secExprs``
2023/02/10 18:16:58 400 Bad Request "missing field secExprs"
2023/02/10 18:16:58 TEST: empty field ``secExprs``
2023/02/10 18:16:58 400 Bad Request "empty field secExprs"
2023/02/10 18:16:58 TEST: incomplete field ``desc``
2023/02/10 18:16:58 400 Bad Request "incomplete desc information [true]"
2023/02/10 18:16:58 TEST: invalid field ``desc``
2023/02/10 18:16:58 400 Bad Request "incomplete desc information [1]"
2023/02/10 18:16:58
2023/02/10 18:16:58 CREATE INDEX: idx1
2023/02/10 18:17:08 status : 201 Created
2023/02/10 18:17:08 {"id": "15876288431353129097"}
2023/02/10 18:17:08 CREATE INDEX: idx2 (defer)
2023/02/10 18:17:08 status : 201 Created
2023/02/10 18:17:08 {"id": "17880489292662154803"}
2023/02/10 18:17:08 CREATE INDEX: idx3 (defer)
2023/02/10 18:17:08 status : 201 Created
2023/02/10 18:17:08 {"id": "6164895319299696912"}
2023/02/10 18:17:08 CREATE INDEX: idx4 (defer)
2023/02/10 18:17:08 status : 201 Created
2023/02/10 18:17:08 {"id": "14209703128356922926"}
2023/02/10 18:17:08 CREATE INDEX: idx5
2023/02/10 18:17:21 status : 201 Created
2023/02/10 18:17:21 {"id": "2166314576240742885"}
2023/02/10 18:17:21 BUILD single deferred index
2023/02/10 18:17:21 202 Accepted
2023/02/10 18:17:21 GET all indexes
2023/02/10 18:17:21 200 OK
2023/02/10 18:17:21 index idx1 in INDEX_STATE_ACTIVE
2023/02/10 18:17:21 GET all indexes
2023/02/10 18:17:21 200 OK
2023/02/10 18:17:21 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:22 GET all indexes
2023/02/10 18:17:22 200 OK
2023/02/10 18:17:22 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:23 GET all indexes
2023/02/10 18:17:23 200 OK
2023/02/10 18:17:23 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:24 GET all indexes
2023/02/10 18:17:24 200 OK
2023/02/10 18:17:24 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:25 GET all indexes
2023/02/10 18:17:26 200 OK
2023/02/10 18:17:26 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:27 GET all indexes
2023/02/10 18:17:27 200 OK
2023/02/10 18:17:27 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:28 GET all indexes
2023/02/10 18:17:28 200 OK
2023/02/10 18:17:28 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:29 GET all indexes
2023/02/10 18:17:29 200 OK
2023/02/10 18:17:29 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:30 GET all indexes
2023/02/10 18:17:30 200 OK
2023/02/10 18:17:30 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:31 GET all indexes
2023/02/10 18:17:31 200 OK
2023/02/10 18:17:31 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:32 GET all indexes
2023/02/10 18:17:32 200 OK
2023/02/10 18:17:32 index idx2 in INDEX_STATE_INITIAL
2023/02/10 18:17:33 GET all indexes
2023/02/10 18:17:33 200 OK
2023/02/10 18:17:33 index idx2 in INDEX_STATE_CATCHUP
2023/02/10 18:17:34 GET all indexes
2023/02/10 18:17:34 200 OK
2023/02/10 18:17:34 index idx2 in INDEX_STATE_ACTIVE
2023/02/10 18:17:34 BUILD many deferred index
2023/02/10 18:17:34 202 Accepted
2023/02/10 18:17:34 GET all indexes
2023/02/10 18:17:34 200 OK
2023/02/10 18:17:34 index idx1 in INDEX_STATE_ACTIVE
2023/02/10 18:17:34 GET all indexes
2023/02/10 18:17:34 200 OK
2023/02/10 18:17:34 index idx2 in INDEX_STATE_ACTIVE
2023/02/10 18:17:34 GET all indexes
2023/02/10 18:17:34 200 OK
2023/02/10 18:17:34 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:35 GET all indexes
2023/02/10 18:17:35 200 OK
2023/02/10 18:17:35 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:36 GET all indexes
2023/02/10 18:17:36 200 OK
2023/02/10 18:17:36 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:37 GET all indexes
2023/02/10 18:17:37 200 OK
2023/02/10 18:17:37 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:38 GET all indexes
2023/02/10 18:17:38 200 OK
2023/02/10 18:17:38 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:39 GET all indexes
2023/02/10 18:17:39 200 OK
2023/02/10 18:17:39 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:40 GET all indexes
2023/02/10 18:17:40 200 OK
2023/02/10 18:17:40 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:41 GET all indexes
2023/02/10 18:17:41 200 OK
2023/02/10 18:17:41 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:42 GET all indexes
2023/02/10 18:17:42 200 OK
2023/02/10 18:17:42 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:43 GET all indexes
2023/02/10 18:17:43 200 OK
2023/02/10 18:17:43 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:44 GET all indexes
2023/02/10 18:17:44 200 OK
2023/02/10 18:17:44 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:45 GET all indexes
2023/02/10 18:17:46 200 OK
2023/02/10 18:17:46 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:47 GET all indexes
2023/02/10 18:17:47 200 OK
2023/02/10 18:17:47 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:48 GET all indexes
2023/02/10 18:17:48 200 OK
2023/02/10 18:17:48 index idx3 in INDEX_STATE_INITIAL
2023/02/10 18:17:49 GET all indexes
2023/02/10 18:17:49 200 OK
2023/02/10 18:17:49 index idx3 in INDEX_STATE_CATCHUP
2023/02/10 18:17:50 GET all indexes
2023/02/10 18:17:50 200 OK
2023/02/10 18:17:50 index idx3 in INDEX_STATE_ACTIVE
2023/02/10 18:17:50 GET all indexes
2023/02/10 18:17:50 200 OK
2023/02/10 18:17:50 index idx4 in INDEX_STATE_ACTIVE
2023/02/10 18:17:50 GET all indexes
2023/02/10 18:17:50 200 OK
2023/02/10 18:17:50 index idx5 in INDEX_STATE_ACTIVE
2023/02/10 18:17:50 GET all indexes
2023/02/10 18:17:50 200 OK
2023/02/10 18:17:50 CREATED indexes: [15876288431353129097 17880489292662154803 6164895319299696912 14209703128356922926 2166314576240742885]
2023/02/10 18:17:50
2023/02/10 18:17:50 LOOKUP missing index
2023/02/10 18:17:50 status : 404 Not Found
2023/02/10 18:17:50 LOOKUP Pyongyang
2023/02/10 18:17:50 status : 200 OK
2023/02/10 18:17:50 number of entries 554
2023/02/10 18:17:50 Expected and Actual scan responses are the same
2023/02/10 18:17:50 LOOKUP with stale as false
2023/02/10 18:17:50 status : 200 OK
2023/02/10 18:17:50 number of entries 554
2023/02/10 18:17:50 Expected and Actual scan responses are the same
2023/02/10 18:17:50 LOOKUP with Rome
2023/02/10 18:17:50 status : 200 OK
2023/02/10 18:17:50 number of entries 540
2023/02/10 18:17:50 Expected and Actual scan responses are the same
2023/02/10 18:17:50 RANGE missing index
2023/02/10 18:17:50 Status : 404 Not Found
2023/02/10 18:17:50 RANGE cities - none
2023/02/10 18:17:50 Status : 200 OK
2023/02/10 18:17:55 number of entries 140902
2023/02/10 18:17:56 Expected and Actual scan responses are the same
2023/02/10 18:17:56 RANGE cities -low
2023/02/10 18:17:56 Status : 200 OK
2023/02/10 18:18:00 number of entries 140902
2023/02/10 18:18:02 Expected and Actual scan responses are the same
2023/02/10 18:18:02 RANGE cities -high
2023/02/10 18:18:02 Status : 200 OK
2023/02/10 18:18:06 number of entries 140902
2023/02/10 18:18:07 Expected and Actual scan responses are the same
2023/02/10 18:18:07 RANGE cities - both
2023/02/10 18:18:07 Status : 200 OK
2023/02/10 18:18:11 number of entries 140902
2023/02/10 18:18:12 Expected and Actual scan responses are the same
2023/02/10 18:18:12 RANGE missing cities
2023/02/10 18:18:12 Status : 200 OK
2023/02/10 18:18:12 number of entries 0
2023/02/10 18:18:13 Expected and Actual scan responses are the same
2023/02/10 18:18:13
2023/02/10 18:18:13 SCANALL missing index
2023/02/10 18:18:13 {"limit":1000000,"stale":"ok"}
2023/02/10 18:18:13 Status : 404 Not Found
2023/02/10 18:18:13 SCANALL stale ok
2023/02/10 18:18:13 {"limit":1000000,"stale":"ok"}
2023/02/10 18:18:13 Status : 200 OK
2023/02/10 18:18:18 number of entries 140902
2023/02/10 18:18:18 Expected and Actual scan responses are the same
2023/02/10 18:18:18 SCANALL stale false
2023/02/10 18:18:19 {"limit":1000000,"stale":"false"}
2023/02/10 18:18:19 Status : 200 OK
2023/02/10 18:18:23 number of entries 140902
2023/02/10 18:18:24 Expected and Actual scan responses are the same
2023/02/10 18:18:24
2023/02/10 18:18:24 COUNT missing index
2023/02/10 18:18:24 Status : 404 Not Found
2023/02/10 18:18:24 COUNT cities - none
2023/02/10 18:18:24 Status : 200 OK
2023/02/10 18:18:24 number of entries 140902
2023/02/10 18:18:24 COUNT cities -low
2023/02/10 18:18:24 Status : 200 OK
2023/02/10 18:18:24 number of entries 140902
2023/02/10 18:18:24 COUNT cities -high
2023/02/10 18:18:24 Status : 200 OK
2023/02/10 18:18:24 number of entries 140902
2023/02/10 18:18:25 COUNT cities - both
2023/02/10 18:18:25 Status : 200 OK
2023/02/10 18:18:25 number of entries 140902
2023/02/10 18:18:25 COUNT missing cities
2023/02/10 18:18:25 Status : 200 OK
2023/02/10 18:18:25 number of entries 0
2023/02/10 18:18:25
2023/02/10 18:18:27 STATS: Testing URLs with valid authentication
2023/02/10 18:18:27 STATS: Testing URLs with invalid authentication
2023/02/10 18:18:27 STATS: Testing invalid URLs
2023/02/10 18:18:27 STATS: Testing unsupported methods
2023/02/10 18:18:27
--- PASS: TestRestfulAPI (90.56s)
=== RUN TestStatIndexInstFilter
2023/02/10 18:18:27 CREATE INDEX: statIdx1
2023/02/10 18:18:38 status : 201 Created
2023/02/10 18:18:38 {"id": "5129904523871108635"}
2023/02/10 18:18:38 CREATE INDEX: statIdx2
2023/02/10 18:18:51 status : 201 Created
2023/02/10 18:18:51 {"id": "1671995898288603606"}
2023/02/10 18:18:51 Instance Id for statIdx2 is 18053041444545769090, common.IndexInstId
--- PASS: TestStatIndexInstFilter (24.40s)
=== RUN TestBucketDefaultDelete
2023/02/10 18:18:54 Deleted bucket default, responseBody:
2023/02/10 18:19:09 Created bucket default, responseBody:
2023/02/10 18:19:25 Populating the default bucket
2023/02/10 18:19:33 Using n1ql client
2023-02-10T18:19:33.864+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2023-02-10T18:19:33.864+05:30 [Info] GSIC[default/default-_default-_default-1676033373862226702] started ...
2023/02/10 18:19:33 Scan failed as expected with error: Index Not Found - cause: GSI index index_isActive not found.
2023/02/10 18:19:33 Populating the default bucket after it was deleted
2023/02/10 18:19:43 Created the secondary index index_isActive. Waiting for it become active
2023/02/10 18:19:43 Index is 5379127011237711939 now active
2023/02/10 18:19:43 Using n1ql client
2023/02/10 18:19:43 Expected and Actual scan responses are the same
--- PASS: TestBucketDefaultDelete (51.99s)
=== RUN TestMixedDatatypesScanAll
2023/02/10 18:19:43 In TestMixedDatatypesScanAll()
2023/02/10 18:19:43 Before test begin: Length of kv docs is 10002
2023/02/10 18:19:43 In DropAllSecondaryIndexes()
2023/02/10 18:19:43 Index found: index_isActive
2023/02/10 18:19:43 Dropped index index_isActive
2023/02/10 18:19:44 Number of number fields is: 266
2023/02/10 18:19:44 Number of string fields is: 239
2023/02/10 18:19:44 Number of json fields is: 251
2023/02/10 18:19:44 Number of true bool fields is: 120
2023/02/10 18:19:44 Number of false bool fields is: 124
2023/02/10 18:19:44 After generate docs: Length of kv docs is 11002
2023/02/10 18:19:44 Setting mixed datatypes JSON docs in KV
2023/02/10 18:19:49 Created the secondary index index_mixeddt. Waiting for it become active
2023/02/10 18:19:49 Index is 416985498431108619 now active
2023/02/10 18:19:49 Using n1ql client
2023/02/10 18:19:49 Expected and Actual scan responses are the same
2023/02/10 18:19:49 Lengths of expected and actual scan results are: 1000 and 1000
2023/02/10 18:19:49 End: Length of kv docs is 11002
--- PASS: TestMixedDatatypesScanAll (5.74s)
=== RUN TestMixedDatatypesRange_Float
2023/02/10 18:19:49 In TestMixedDatatypesRange_Float()
2023/02/10 18:19:49 In DropAllSecondaryIndexes()
2023/02/10 18:19:49 Index found: index_mixeddt
2023/02/10 18:19:49 Dropped index index_mixeddt
2023/02/10 18:19:49 Number of number fields is: 249
2023/02/10 18:19:49 Number of string fields is: 231
2023/02/10 18:19:49 Number of json fields is: 267
2023/02/10 18:19:49 Number of true bool fields is: 130
2023/02/10 18:19:49 Number of false bool fields is: 123
2023/02/10 18:19:49 Setting mixed datatypes JSON docs in KV
2023/02/10 18:19:56 Created the secondary index index_mixeddt. Waiting for it become active
2023/02/10 18:19:56 Index is 4761538110920523219 now active
2023/02/10 18:19:56 Using n1ql client
2023/02/10 18:19:56 Expected and Actual scan responses are the same
2023/02/10 18:19:56 Lengths of expected and actual scan results are: 24 and 24
2023/02/10 18:19:56 Using n1ql client
2023/02/10 18:19:56 Expected and Actual scan responses are the same
2023/02/10 18:19:56 Lengths of expected and actual scan results are: 2 and 2
2023/02/10 18:19:56 Length of kv docs is 12002
--- PASS: TestMixedDatatypesRange_Float (6.63s)
=== RUN TestMixedDatatypesRange_String
2023/02/10 18:19:56 In TestMixedDatatypesRange_String()
2023/02/10 18:19:56 In DropAllSecondaryIndexes()
2023/02/10 18:19:56 Index found: index_mixeddt
2023/02/10 18:19:56 Dropped index index_mixeddt
2023/02/10 18:19:56 Number of number fields is: 229
2023/02/10 18:19:56 Number of string fields is: 261
2023/02/10 18:19:56 Number of json fields is: 261
2023/02/10 18:19:56 Number of true bool fields is: 141
2023/02/10 18:19:56 Number of false bool fields is: 108
2023/02/10 18:19:56 Setting mixed datatypes JSON docs in KV
2023/02/10 18:20:02 Created the secondary index index_mixeddt. Waiting for it become active
2023/02/10 18:20:02 Index is 5825856431041333856 now active
2023/02/10 18:20:02 Using n1ql client
2023/02/10 18:20:02 Expected and Actual scan responses are the same
2023/02/10 18:20:02 Lengths of expected and actual scan results are: 221 and 221
2023/02/10 18:20:02 Length of kv docs is 13002
--- PASS: TestMixedDatatypesRange_String (6.61s)
=== RUN TestMixedDatatypesRange_Json
2023/02/10 18:20:02 In TestMixedDatatypesRange_Json()
2023/02/10 18:20:02 In DropAllSecondaryIndexes()
2023/02/10 18:20:02 Index found: index_mixeddt
2023/02/10 18:20:02 Dropped index index_mixeddt
2023/02/10 18:20:03 Number of number fields is: 263
2023/02/10 18:20:03 Number of string fields is: 238
2023/02/10 18:20:03 Number of json fields is: 253
2023/02/10 18:20:03 Number of true bool fields is: 118
2023/02/10 18:20:03 Number of false bool fields is: 128
2023/02/10 18:20:03 Setting mixed datatypes JSON docs in KV
2023/02/10 18:20:08 Created the secondary index index_mixeddt. Waiting for it become active
2023/02/10 18:20:08 Index is 8035528576402064104 now active
2023/02/10 18:20:08 Using n1ql client
2023/02/10 18:20:08 Expected and Actual scan responses are the same
2023/02/10 18:20:08 Lengths of expected and actual scan results are: 781 and 781
2023/02/10 18:20:08 Length of kv docs is 14002
--- PASS: TestMixedDatatypesRange_Json (5.83s)
=== RUN TestMixedDatatypesScan_Bool
2023/02/10 18:20:08 In TestMixedDatatypesScan_Bool()
2023/02/10 18:20:08 In DropAllSecondaryIndexes()
2023/02/10 18:20:08 Index found: index_mixeddt
2023/02/10 18:20:08 Dropped index index_mixeddt
2023/02/10 18:20:08 Number of number fields is: 256
2023/02/10 18:20:08 Number of string fields is: 252
2023/02/10 18:20:08 Number of json fields is: 264
2023/02/10 18:20:08 Number of true bool fields is: 120
2023/02/10 18:20:08 Number of false bool fields is: 108
2023/02/10 18:20:08 Setting mixed datatypes JSON docs in KV
2023/02/10 18:20:14 Created the secondary index index_mixeddt. Waiting for it become active
2023/02/10 18:20:14 Index is 13401369222568949436 now active
2023/02/10 18:20:14 Using n1ql client
2023/02/10 18:20:14 Expected and Actual scan responses are the same
2023/02/10 18:20:14 Lengths of expected and actual scan results are: 509 and 509
2023/02/10 18:20:14 Using n1ql client
2023/02/10 18:20:14 Expected and Actual scan responses are the same
2023/02/10 18:20:14 Lengths of expected and actual scan results are: 467 and 467
2023/02/10 18:20:14 Length of kv docs is 15002
--- PASS: TestMixedDatatypesScan_Bool (6.20s)
=== RUN TestLargeSecondaryKeyLength
2023/02/10 18:20:14 In TestLargeSecondaryKeyLength()
2023/02/10 18:20:14 In DropAllSecondaryIndexes()
2023/02/10 18:20:14 Index found: index_mixeddt
2023/02/10 18:20:15 Dropped index index_mixeddt
2023/02/10 18:20:15 Setting JSON docs in KV
2023/02/10 18:20:21 Created the secondary index index_LongSecField. Waiting for it become active
2023/02/10 18:20:21 Index is 7666138685470013849 now active
2023/02/10 18:20:21 Using n1ql client
2023/02/10 18:20:21 ScanAll: Lengths of expected and actual scan results are: 1000 and 1000
2023/02/10 18:20:21 Expected and Actual scan responses are the same
2023/02/10 18:20:21 Using n1ql client
2023/02/10 18:20:21 Range: Lengths of expected and actual scan results are: 809 and 809
2023/02/10 18:20:21 Expected and Actual scan responses are the same
2023/02/10 18:20:21 End: Length of kv docs is 16002
--- PASS: TestLargeSecondaryKeyLength (6.28s)
=== RUN TestLargePrimaryKeyLength
2023/02/10 18:20:21 In TestLargePrimaryKeyLength()
2023/02/10 18:20:21 In DropAllSecondaryIndexes()
2023/02/10 18:20:21 Index found: index_LongSecField
2023/02/10 18:20:21 Dropped index index_LongSecField
2023/02/10 18:20:21 Setting JSON docs in KV
2023/02/10 18:20:27 Created the secondary index index_LongPrimaryField. Waiting for it become active
2023/02/10 18:20:27 Index is 6683671606384088814 now active
2023/02/10 18:20:27 Using n1ql client
2023/02/10 18:20:27 Lengths of num of docs and scanResults are: 17002 and 17002
2023/02/10 18:20:27 End: Length of kv docs is 17002
--- PASS: TestLargePrimaryKeyLength (6.09s)
=== RUN TestUpdateMutations_DeleteField
2023/02/10 18:20:27 In TestUpdateMutations_DeleteField()
2023/02/10 18:20:27 Setting JSON docs in KV
2023/02/10 18:20:34 Created the secondary index index_bal. Waiting for it become active
2023/02/10 18:20:34 Index is 1657405554734626818 now active
2023/02/10 18:20:34 Using n1ql client
2023/02/10 18:20:35 Expected and Actual scan responses are the same
2023/02/10 18:20:35 Using n1ql client
2023/02/10 18:20:35 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DeleteField (8.17s)
=== RUN TestUpdateMutations_AddField
2023/02/10 18:20:35 In TestUpdateMutations_AddField()
2023/02/10 18:20:35 Setting JSON docs in KV
2023/02/10 18:20:42 Created the secondary index index_newField. Waiting for it become active
2023/02/10 18:20:42 Index is 16526165489914750333 now active
2023/02/10 18:20:42 Using n1ql client
2023/02/10 18:20:42 Count of scan results before add field mutations: 0
2023/02/10 18:20:42 Expected and Actual scan responses are the same
2023/02/10 18:20:43 Using n1ql client
2023/02/10 18:20:43 Count of scan results after add field mutations: 300
2023/02/10 18:20:43 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_AddField (7.73s)
=== RUN TestUpdateMutations_DataTypeChange
2023/02/10 18:20:43 In TestUpdateMutations_DataTypeChange()
2023/02/10 18:20:43 Setting JSON docs in KV
2023/02/10 18:20:51 Created the secondary index index_isUserActive. Waiting for it become active
2023/02/10 18:20:51 Index is 17613732698490688720 now active
2023/02/10 18:20:51 Using n1ql client
2023/02/10 18:20:51 Expected and Actual scan responses are the same
2023/02/10 18:20:52 Using n1ql client
2023/02/10 18:20:52 Expected and Actual scan responses are the same
2023/02/10 18:20:52 Using n1ql client
2023/02/10 18:20:52 Expected and Actual scan responses are the same
2023/02/10 18:20:52 Using n1ql client
2023/02/10 18:20:52 Expected and Actual scan responses are the same
--- PASS: TestUpdateMutations_DataTypeChange (9.01s)
=== RUN TestMultipleBuckets
2023/02/10 18:20:52 In TestMultipleBuckets()
2023/02/10 18:20:52 In DropAllSecondaryIndexes()
2023/02/10 18:20:52 Index found: index_newField
2023/02/10 18:20:52 Dropped index index_newField
2023/02/10 18:20:52 Index found: index_LongPrimaryField
2023/02/10 18:20:52 Dropped index index_LongPrimaryField
2023/02/10 18:20:52 Index found: index_bal
2023/02/10 18:20:52 Dropped index index_bal
2023/02/10 18:20:52 Index found: index_isUserActive
2023/02/10 18:20:52 Dropped index index_isUserActive
2023/02/10 18:21:30 Flushed the bucket default, Response body:
2023/02/10 18:21:33 Modified parameters of bucket default, responseBody:
2023/02/10 18:21:33 Created bucket testbucket2, responseBody:
2023/02/10 18:21:33 Created bucket testbucket3, responseBody:
2023/02/10 18:21:33 Created bucket testbucket4, responseBody:
2023/02/10 18:21:48 Generating docs and Populating all the buckets
2023/02/10 18:21:52 Created the secondary index bucket1_age. Waiting for it become active
2023/02/10 18:21:52 Index is 16360760573110284577 now active
2023/02/10 18:21:58 Created the secondary index bucket2_city. Waiting for it become active
2023/02/10 18:21:58 Index is 14378567059378122115 now active
2023/02/10 18:22:04 Created the secondary index bucket3_gender. Waiting for it become active
2023/02/10 18:22:04 Index is 4385771083639294841 now active
2023/02/10 18:22:11 Created the secondary index bucket4_balance. Waiting for it become active
2023/02/10 18:22:11 Index is 12926956761219904717 now active
2023/02/10 18:22:14 Using n1ql client
2023/02/10 18:22:14 Expected and Actual scan responses are the same
2023/02/10 18:22:14 Using n1ql client
2023-02-10T18:22:14.299+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2023-02-10T18:22:14.300+05:30 [Info] GSIC[default/testbucket2-_default-_default-1676033534288004128] started ...
2023/02/10 18:22:14 Expected and Actual scan responses are the same
2023/02/10 18:22:14 Using n1ql client
2023-02-10T18:22:14.346+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2023-02-10T18:22:14.348+05:30 [Info] GSIC[default/testbucket3-_default-_default-1676033534342476790] started ...
2023/02/10 18:22:14 Expected and Actual scan responses are the same
2023/02/10 18:22:14 Using n1ql client
2023-02-10T18:22:14.358+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2023-02-10T18:22:14.358+05:30 [Info] GSIC[default/testbucket4-_default-_default-1676033534355297001] started ...
2023/02/10 18:22:14 Expected and Actual scan responses are the same
2023/02/10 18:22:16 Deleted bucket testbucket2, responseBody:
2023/02/10 18:22:18 Deleted bucket testbucket3, responseBody:
2023/02/10 18:22:20 Deleted bucket testbucket4, responseBody:
2023/02/10 18:22:23 Modified parameters of bucket default, responseBody:
--- PASS: TestMultipleBuckets (106.62s)
=== RUN TestBucketFlush
2023/02/10 18:22:38 In TestBucketFlush()
2023/02/10 18:22:38 In DropAllSecondaryIndexes()
2023/02/10 18:22:38 Index found: bucket2_city
2023/02/10 18:22:38 Dropped index bucket2_city
2023/02/10 18:22:38 Index found: bucket4_balance
2023/02/10 18:22:39 Dropped index bucket4_balance
2023/02/10 18:22:39 Index found: bucket1_age
2023/02/10 18:22:39 Dropped index bucket1_age
2023/02/10 18:22:39 Index found: bucket3_gender
2023/02/10 18:22:39 Dropped index bucket3_gender
2023/02/10 18:23:17 Flushed the bucket default, Response body:
2023/02/10 18:23:21 Created the secondary index index_age. Waiting for it become active
2023/02/10 18:23:21 Index is 9093577821473021738 now active
2023/02/10 18:23:21 Using n1ql client
2023/02/10 18:23:21 Expected and Actual scan responses are the same
2023/02/10 18:23:28 Created the secondary index index_gender. Waiting for it become active
2023/02/10 18:23:28 Index is 11403121053100649853 now active
2023/02/10 18:23:28 Using n1ql client
2023/02/10 18:23:28 Expected and Actual scan responses are the same
2023/02/10 18:23:34 Created the secondary index index_city. Waiting for it become active
2023/02/10 18:23:34 Index is 7963633185527138332 now active
2023/02/10 18:23:34 Using n1ql client
2023/02/10 18:23:34 Expected and Actual scan responses are the same
2023/02/10 18:24:12 Flushed the bucket default, Response body:
2023/02/10 18:24:12 TestBucketFlush:: Flushed the bucket
2023/02/10 18:24:12 Using n1ql client
2023/02/10 18:24:12 Using n1ql client
2023/02/10 18:24:12 Using n1ql client
--- PASS: TestBucketFlush (93.37s)
=== RUN TestLargeDocumentSize
2023/02/10 18:24:12 In TestLargeDocumentSize()
2023/02/10 18:24:12 Data file exists. Skipping download
2023/02/10 18:24:12 Length of docs and largeDocs = 200 and 200
2023/02/10 18:24:16 Created the secondary index index_userscreenname. Waiting for it become active
2023/02/10 18:24:16 Index is 17417273550397661114 now active
2023/02/10 18:24:16 Using n1ql client
2023/02/10 18:24:17 Expected and Actual scan responses are the same
--- PASS: TestLargeDocumentSize (5.46s)
=== RUN TestFieldsWithSpecialCharacters
2023/02/10 18:24:17 In TestFieldsWithSpecialCharacters()
2023/02/10 18:24:22 Created the secondary index index_specialchar. Waiting for it become active
2023/02/10 18:24:22 Index is 17427004396168296045 now active
2023/02/10 18:24:22 Looking up for value ƒŠ©2®§©
2023/02/10 18:24:22 Using n1ql client
2023/02/10 18:24:22 Expected and Actual scan responses are the same
--- PASS: TestFieldsWithSpecialCharacters (5.17s)
=== RUN TestLargeKeyLookup
2023/02/10 18:24:22 In TestLargeKeyLookup()
2023/02/10 18:24:29 Created the secondary index index_largeKeyLookup. Waiting for it become active
2023/02/10 18:24:29 Index is 7860962044304651373 now active
2023/02/10 18:24:29 Looking up for a large key
2023/02/10 18:24:29 Using n1ql client
2023/02/10 18:24:29 Expected and Actual scan responses are the same
--- PASS: TestLargeKeyLookup (6.42s)
=== RUN TestIndexNameValidation
2023/02/10 18:24:29 In TestIndexNameValidation()
2023/02/10 18:24:29 Setting JSON docs in KV
2023/02/10 18:24:30 Creation of index with invalid name ÌñÐÉx&(abc_% failed as expected
2023/02/10 18:24:35 Created the secondary index #primary-Index_test. Waiting for it become active
2023/02/10 18:24:35 Index is 5878784902325344371 now active
2023/02/10 18:24:35 Using n1ql client
2023/02/10 18:24:35 Expected and Actual scan responses are the same
--- PASS: TestIndexNameValidation (6.61s)
=== RUN TestSameFieldNameAtDifferentLevels
2023/02/10 18:24:35 In TestSameFieldNameAtDifferentLevels()
2023/02/10 18:24:36 Setting JSON docs in KV
2023/02/10 18:24:42 Created the secondary index cityindex. Waiting for it become active
2023/02/10 18:24:42 Index is 1284109725418083550 now active
2023/02/10 18:24:42 Using n1ql client
2023/02/10 18:24:42 Expected and Actual scan responses are the same
--- PASS: TestSameFieldNameAtDifferentLevels (6.86s)
=== RUN TestSameIndexNameInTwoBuckets
2023/02/10 18:24:42 In TestSameIndexNameInTwoBuckets()
2023/02/10 18:24:42 In DropAllSecondaryIndexes()
2023/02/10 18:24:42 Index found: index_userscreenname
2023/02/10 18:24:42 Dropped index index_userscreenname
2023/02/10 18:24:42 Index found: index_city
2023/02/10 18:24:42 Dropped index index_city
2023/02/10 18:24:42 Index found: index_gender
2023/02/10 18:24:43 Dropped index index_gender
2023/02/10 18:24:43 Index found: index_largeKeyLookup
2023/02/10 18:24:43 Dropped index index_largeKeyLookup
2023/02/10 18:24:43 Index found: cityindex
2023/02/10 18:24:43 Dropped index cityindex
2023/02/10 18:24:43 Index found: index_specialchar
2023/02/10 18:24:43 Dropped index index_specialchar
2023/02/10 18:24:43 Index found: #primary-Index_test
2023/02/10 18:24:43 Dropped index #primary-Index_test
2023/02/10 18:24:43 Index found: index_age
2023/02/10 18:24:43 Dropped index index_age
2023/02/10 18:25:21 Flushed the bucket default, Response body:
2023/02/10 18:25:24 Modified parameters of bucket default, responseBody:
2023/02/10 18:25:24 Created bucket buck2, responseBody:
2023/02/10 18:25:39 Generating docs and Populating all the buckets
2023/02/10 18:25:43 Created the secondary index b_idx. Waiting for it become active
2023/02/10 18:25:43 Index is 15070335378256578837 now active
2023-02-10T18:25:46.192+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket buck2 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-02-10T18:25:57.195+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket buck2 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
common_test.go:173: Error in creating the index: [Bucket Not Found] Bucket buck2 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- FAIL: TestSameIndexNameInTwoBuckets (74.47s)
=== RUN TestLargeKeysSplChars
2023/02/10 18:25:57 In TestLargeKeysSplChars()
2023/02/10 18:26:06 Created the secondary index idspl1. Waiting for it become active
2023/02/10 18:26:06 Index is 13925092800506286975 now active
2023/02/10 18:26:14 Created the secondary index idspl2. Waiting for it become active
2023/02/10 18:26:14 Index is 4927648279410829162 now active
2023/02/10 18:26:21 Created the secondary index idspl3. Waiting for it become active
2023/02/10 18:26:21 Index is 4224823549733358963 now active
2023/02/10 18:26:21 Using n1ql client
2023/02/10 18:26:21 Expected scan count 1100 does not match actual scan count 100
common_test.go:173: Error in scan 1: result validation: Expected scan count 1100 does not match actual scan count 100
--- FAIL: TestLargeKeysSplChars (24.20s)
=== RUN TestVeryLargeIndexKey
2023/02/10 18:26:21 In DropAllSecondaryIndexes()
2023/02/10 18:26:21 Index found: idspl3
2023/02/10 18:26:21 Dropped index idspl3
2023/02/10 18:26:21 Index found: b_idx
2023/02/10 18:26:21 Dropped index b_idx
2023/02/10 18:26:21 Index found: idspl2
2023/02/10 18:26:21 Dropped index idspl2
2023/02/10 18:26:21 Index found: idspl1
2023/02/10 18:26:21 Dropped index idspl1
2023/02/10 18:26:59 Flushed the bucket default, Response body:
2023/02/10 18:26:59 TestVeryLargeIndexKey:: Flushed the bucket
2023/02/10 18:26:59 clusterconfig.KVAddress = 127.0.0.1:9000
2023/02/10 18:27:04 Created the secondary index i1. Waiting for it become active
2023/02/10 18:27:04 Index is 7793934230019395825 now active
2023/02/10 18:27:04 Using n1ql client
2023/02/10 18:27:04 Expected and Actual scan responses are the same
2023/02/10 18:27:11 Created the secondary index i2. Waiting for it become active
2023/02/10 18:27:11 Index is 17628332315857380986 now active
2023/02/10 18:27:11 Using n1ql client
2023/02/10 18:27:12 Expected and Actual scan responses are the same
2023/02/10 18:27:12 In DropAllSecondaryIndexes()
2023/02/10 18:27:12 Index found: i1
2023/02/10 18:27:12 Dropped index i1
2023/02/10 18:27:12 Index found: i2
2023/02/10 18:27:12 Dropped index i2
2023/02/10 18:27:50 Flushed the bucket default, Response body:
--- PASS: TestVeryLargeIndexKey (89.07s)
=== RUN TestTempBufScanResult
2023/02/10 18:27:50 In DropAllSecondaryIndexes()
2023/02/10 18:28:28 Flushed the bucket default, Response body:
2023/02/10 18:28:28 TestTempBufScanResult:: Flushed the bucket
2023/02/10 18:28:31 Created the secondary index index_idxKey. Waiting for it become active
2023/02/10 18:28:31 Index is 14172952841025310166 now active
2023/02/10 18:28:31 Using n1ql client
2023/02/10 18:28:32 Expected and Actual scan responses are the same
2023/02/10 18:28:32 In DropAllSecondaryIndexes()
2023/02/10 18:28:32 Index found: index_idxKey
2023/02/10 18:28:32 Dropped index index_idxKey
2023/02/10 18:29:10 Flushed the bucket default, Response body:
--- PASS: TestTempBufScanResult (80.35s)
=== RUN TestBuildDeferredAnotherBuilding
2023/02/10 18:29:10 In TestBuildDeferredAnotherBuilding()
2023/02/10 18:29:10 In DropAllSecondaryIndexes()
2023/02/10 18:29:56 Setting JSON docs in KV
2023/02/10 18:32:04 Build the deferred index id_age1. Waiting for the index to become active
2023/02/10 18:32:04 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:05 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:06 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:07 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:08 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:09 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:10 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:11 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:12 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:13 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:14 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:15 Waiting for index 14864415430798651590 to go active ...
2023/02/10 18:32:16 Index is 14864415430798651590 now active
2023/02/10 18:32:16 Build command issued for the deferred indexes [14342298397980179776]
2023/02/10 18:32:18 Build index failed as expected: Build index fails. Index id_age will retry building in the background for reason: Build Already In Progress. Keyspace default.
2023/02/10 18:32:18 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:19 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:20 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:21 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:22 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:23 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:24 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:25 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:26 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:27 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:28 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:29 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:30 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:31 Waiting for index 14342298397980179776 to go active ...
2023/02/10 18:32:32 Index is 14342298397980179776 now active
2023/02/10 18:32:32 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:33 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:34 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:35 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:36 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:37 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:38 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:39 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:40 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:41 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:42 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:43 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:44 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:45 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:46 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:47 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:48 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:49 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:50 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:51 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:52 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:53 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:54 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:55 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:56 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:57 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:58 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:32:59 Waiting for index 16723283244323206299 to go active ...
2023/02/10 18:33:00 Index is 16723283244323206299 now active
2023/02/10 18:33:01 Using n1ql client
2023/02/10 18:33:01 Expected and Actual scan responses are the same
2023/02/10 18:33:01 Using n1ql client
2023/02/10 18:33:02 Expected and Actual scan responses are the same
--- PASS: TestBuildDeferredAnotherBuilding (231.61s)
=== RUN TestMultipleBucketsDeferredBuild
2023/02/10 18:33:02 In TestMultipleBucketsDeferredBuild()
2023/02/10 18:33:02 In DropAllSecondaryIndexes()
2023/02/10 18:33:02 Index found: id_age1
2023/02/10 18:33:02 Dropped index id_age1
2023/02/10 18:33:02 Index found: id_age
2023/02/10 18:33:02 Dropped index id_age
2023/02/10 18:33:02 Index found: id_company
2023/02/10 18:33:02 Dropped index id_company
2023/02/10 18:33:39 Flushed the bucket default, Response body:
2023/02/10 18:33:42 Modified parameters of bucket default, responseBody:
2023/02/10 18:33:42 http://127.0.0.1:9000/pools/default/buckets/defertest_buck2
2023/02/10 18:33:42 &{DELETE http://127.0.0.1:9000/pools/default/buckets/defertest_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 18:33:42 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:03:42 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc04fb26a00 31 [] false false map[] 0xc002ac2100 }
2023/02/10 18:33:42 DeleteBucket failed for bucket defertest_buck2
2023/02/10 18:33:42 Deleted bucket defertest_buck2, responseBody: Requested resource not found.
2023/02/10 18:33:42 Created bucket defertest_buck2, responseBody:
2023/02/10 18:33:57 Setting JSON docs in KV
2023/02/10 18:35:17 Build command issued for the deferred indexes [696068142439998757]
2023/02/10 18:35:19 Build command issued for the deferred indexes [15991181378743232996 9177743090396503867]
2023/02/10 18:35:19 Index state of 9177743090396503867 is INDEX_STATE_READY
2023/02/10 18:35:19 Waiting for index 696068142439998757 to go active ...
2023/02/10 18:35:20 Waiting for index 696068142439998757 to go active ...
2023/02/10 18:35:21 Waiting for index 696068142439998757 to go active ...
2023/02/10 18:35:22 Waiting for index 696068142439998757 to go active ...
2023/02/10 18:35:23 Waiting for index 696068142439998757 to go active ...
2023/02/10 18:35:24 Waiting for index 696068142439998757 to go active ...
2023/02/10 18:35:25 Waiting for index 696068142439998757 to go active ...
2023/02/10 18:35:26 Waiting for index 696068142439998757 to go active ...
2023/02/10 18:35:27 Index is 696068142439998757 now active
2023/02/10 18:35:27 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:28 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:29 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:30 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:31 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:32 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:33 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:34 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:35 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:36 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:37 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:38 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:39 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:40 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:41 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:42 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:43 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:44 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:45 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:46 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:47 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:48 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:49 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:50 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:51 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:52 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:53 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:54 Waiting for index 15991181378743232996 to go active ...
2023/02/10 18:35:55 Index is 15991181378743232996 now active
2023/02/10 18:35:55 Using n1ql client
2023/02/10 18:35:55 Expected and Actual scan responses are the same
2023/02/10 18:35:55 Using n1ql client
2023/02/10 18:35:55 Expected and Actual scan responses are the same
2023/02/10 18:35:55 Using n1ql client
2023-02-10T18:35:55.314+05:30 [Info] GsiClient::UpdateUsecjson: using collatejson as data format between indexer and GsiClient
2023-02-10T18:35:55.314+05:30 [Info] GSIC[default/defertest_buck2-_default-_default-1676034355311968540] started ...
2023/02/10 18:35:55 Expected and Actual scan responses are the same
2023/02/10 18:35:55 http://127.0.0.1:9000/pools/default/buckets/default
2023/02/10 18:35:55 &{POST http://127.0.0.1:9000/pools/default/buckets/default HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] {0xc02413fee0} 0x763200 28 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 18:35:55 &{400 Bad Request 400 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[388] Content-Type:[application/json] Date:[Fri, 10 Feb 2023 13:05:55 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc007fd03c0 388 [] false false map[] 0xc006cbdc00 }
2023/02/10 18:35:55 EditBucket failed for bucket default
2023/02/10 18:35:58 Modified parameters of bucket default, responseBody: {"errors":{"ramQuota":"RAM quota specified is too large to be provisioned into this cluster."},"summaries":{"ramSummary":{"total":3145728000,"otherBuckets":1073741824,"nodesCount":2,"perNodeMegs":1024,"thisAlloc":2147483648,"thisUsed":133372944,"free":-75497472},"hddSummary":{"total":78981824512,"otherData":51812891168,"otherBuckets":164468272,"thisUsed":150644736,"free":27004465072}}}
2023/02/10 18:36:00 Deleted bucket defertest_buck2, responseBody:
--- PASS: TestMultipleBucketsDeferredBuild (183.05s)
=== RUN TestCreateDropCreateDeferredIndex
2023/02/10 18:36:05 In TestCreateDropCreateDeferredIndex()
2023/02/10 18:36:05 In DropAllSecondaryIndexes()
2023/02/10 18:36:05 Index found: buck1_id1
2023/02/10 18:36:05 Dropped index buck1_id1
2023/02/10 18:36:05 Index found: buck1_id2
2023/02/10 18:36:05 Dropped index buck1_id2
2023/02/10 18:36:05 Index found: buck2_id3
2023/02/10 18:36:05 Dropped index buck2_id3
2023/02/10 18:36:08 Setting JSON docs in KV
2023/02/10 18:36:21 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:36:21 Index is 1311485917214854113 now active
2023/02/10 18:36:22 Dropping the secondary index id_age
2023/02/10 18:36:22 Index dropped
2023/02/10 18:36:26 Setting JSON docs in KV
2023/02/10 18:36:34 Using n1ql client
2023/02/10 18:36:34 Expected and Actual scan responses are the same
--- PASS: TestCreateDropCreateDeferredIndex (29.45s)
=== RUN TestMultipleDeferredIndexes_BuildTogether
2023/02/10 18:36:34 In TestMultipleDeferredIndexes_BuildTogether()
2023/02/10 18:36:34 In DropAllSecondaryIndexes()
2023/02/10 18:36:34 Index found: id_company
2023/02/10 18:36:35 Dropped index id_company
2023/02/10 18:36:37 Setting JSON docs in KV
2023/02/10 18:36:55 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:36:55 Index is 2753997436257842746 now active
2023/02/10 18:36:57 Build command issued for the deferred indexes [id_age id_gender id_isActive], bucket: default, scope: _default, coll: _default
2023/02/10 18:36:57 Waiting for the index id_age to become active
2023/02/10 18:36:57 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:36:58 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:36:59 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:00 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:01 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:02 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:03 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:04 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:05 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:06 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:07 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:08 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:09 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:10 Waiting for index 6893172013764902436 to go active ...
2023/02/10 18:37:11 Index is 6893172013764902436 now active
2023/02/10 18:37:11 Waiting for the index id_gender to become active
2023/02/10 18:37:11 Index is 5140393509606320535 now active
2023/02/10 18:37:11 Waiting for the index id_isActive to become active
2023/02/10 18:37:11 Index is 209246654302779500 now active
2023/02/10 18:37:11 Using n1ql client
2023/02/10 18:37:11 Expected and Actual scan responses are the same
2023/02/10 18:37:13 Setting JSON docs in KV
2023/02/10 18:37:23 Using n1ql client
2023/02/10 18:37:23 Expected and Actual scan responses are the same
2023/02/10 18:37:23 Using n1ql client
2023/02/10 18:37:23 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildTogether (48.92s)
=== RUN TestMultipleDeferredIndexes_BuildOneByOne
2023/02/10 18:37:23 In TestMultipleDeferredIndexes_BuildOneByOne()
2023/02/10 18:37:23 In DropAllSecondaryIndexes()
2023/02/10 18:37:23 Index found: id_gender
2023/02/10 18:37:23 Dropped index id_gender
2023/02/10 18:37:23 Index found: id_isActive
2023/02/10 18:37:24 Dropped index id_isActive
2023/02/10 18:37:24 Index found: id_age
2023/02/10 18:37:24 Dropped index id_age
2023/02/10 18:37:24 Index found: id_company
2023/02/10 18:37:24 Dropped index id_company
2023/02/10 18:37:26 Setting JSON docs in KV
2023/02/10 18:37:41 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:37:41 Index is 13987232124279143335 now active
2023/02/10 18:37:42 Build command issued for the deferred indexes [id_age], bucket: default, scope: _default, coll: _default
2023/02/10 18:37:42 Waiting for the index id_age to become active
2023/02/10 18:37:42 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:43 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:44 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:45 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:46 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:47 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:48 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:49 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:50 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:51 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:52 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:53 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:54 Waiting for index 3622081858143871208 to go active ...
2023/02/10 18:37:55 Index is 3622081858143871208 now active
2023/02/10 18:37:55 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/02/10 18:37:55 Waiting for the index id_gender to become active
2023/02/10 18:37:55 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:37:56 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:37:57 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:37:58 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:37:59 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:38:00 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:38:01 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:38:02 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:38:03 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:38:04 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:38:05 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:38:06 Waiting for index 14490969365734326902 to go active ...
2023/02/10 18:38:07 Index is 14490969365734326902 now active
2023/02/10 18:38:07 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/02/10 18:38:07 Waiting for the index id_isActive to become active
2023/02/10 18:38:07 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:08 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:09 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:10 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:11 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:12 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:13 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:14 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:15 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:16 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:17 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:18 Waiting for index 18196465952131405503 to go active ...
2023/02/10 18:38:19 Index is 18196465952131405503 now active
2023/02/10 18:38:19 Using n1ql client
2023/02/10 18:38:19 Expected and Actual scan responses are the same
2023/02/10 18:38:22 Setting JSON docs in KV
2023/02/10 18:38:31 Using n1ql client
2023/02/10 18:38:32 Expected and Actual scan responses are the same
2023/02/10 18:38:32 Using n1ql client
2023/02/10 18:38:32 Expected and Actual scan responses are the same
--- PASS: TestMultipleDeferredIndexes_BuildOneByOne (68.97s)
=== RUN TestDropDeferredIndexWhileOthersBuilding
2023/02/10 18:38:32 In TestDropDeferredIndexWhileOthersBuilding()
2023/02/10 18:38:32 In DropAllSecondaryIndexes()
2023/02/10 18:38:32 Index found: id_age
2023/02/10 18:38:32 Dropped index id_age
2023/02/10 18:38:32 Index found: id_company
2023/02/10 18:38:33 Dropped index id_company
2023/02/10 18:38:33 Index found: id_gender
2023/02/10 18:38:33 Dropped index id_gender
2023/02/10 18:38:33 Index found: id_isActive
2023/02/10 18:38:33 Dropped index id_isActive
2023/02/10 18:38:35 Setting JSON docs in KV
2023/02/10 18:38:53 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:38:53 Index is 15585833110829602857 now active
2023/02/10 18:38:55 Build command issued for the deferred indexes [6098357803924865754 13012372589894919513]
2023/02/10 18:38:57 Dropping the secondary index id_isActive
2023/02/10 18:38:58 Index dropped
2023/02/10 18:38:58 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:38:59 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:00 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:01 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:02 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:03 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:04 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:05 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:06 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:07 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:08 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:09 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:10 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:11 Waiting for index 6098357803924865754 to go active ...
2023/02/10 18:39:12 Index is 6098357803924865754 now active
2023/02/10 18:39:12 Index is 13012372589894919513 now active
2023/02/10 18:39:13 Using n1ql client
2023/02/10 18:39:13 Expected and Actual scan responses are the same
2023/02/10 18:39:13 Using n1ql client
2023/02/10 18:39:13 Expected and Actual scan responses are the same
2023/02/10 18:39:15 Setting JSON docs in KV
2023/02/10 18:39:24 Using n1ql client
2023/02/10 18:39:25 Expected and Actual scan responses are the same
--- PASS: TestDropDeferredIndexWhileOthersBuilding (52.27s)
=== RUN TestDropBuildingDeferredIndex
2023/02/10 18:39:25 In TestDropBuildingDeferredIndex()
2023/02/10 18:39:25 In DropAllSecondaryIndexes()
2023/02/10 18:39:25 Index found: id_age
2023/02/10 18:39:25 Dropped index id_age
2023/02/10 18:39:25 Index found: id_company
2023/02/10 18:39:25 Dropped index id_company
2023/02/10 18:39:25 Index found: id_gender
2023/02/10 18:39:25 Dropped index id_gender
2023/02/10 18:39:28 Setting JSON docs in KV
2023/02/10 18:39:34 Build command issued for the deferred indexes [9698817274038014633 18315899135176887589]
2023/02/10 18:39:35 Dropping the secondary index id_age
2023/02/10 18:39:35 Index dropped
2023/02/10 18:39:35 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:36 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:37 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:38 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:39 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:40 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:41 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:42 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:43 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:44 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:45 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:46 Waiting for index 9698817274038014633 to go active ...
2023/02/10 18:39:47 Index is 9698817274038014633 now active
2023/02/10 18:39:47 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/02/10 18:39:47 Waiting for the index id_gender to become active
2023/02/10 18:39:47 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:48 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:49 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:50 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:51 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:52 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:53 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:54 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:55 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:56 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:57 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:58 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:39:59 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:40:00 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:40:01 Waiting for index 15005159787788725976 to go active ...
2023/02/10 18:40:02 Index is 15005159787788725976 now active
2023/02/10 18:40:03 Using n1ql client
2023/02/10 18:40:03 Expected and Actual scan responses are the same
2023/02/10 18:40:03 Using n1ql client
2023/02/10 18:40:04 Expected and Actual scan responses are the same
2023/02/10 18:40:06 Setting JSON docs in KV
2023/02/10 18:40:15 Using n1ql client
2023/02/10 18:40:16 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingDeferredIndex (51.72s)
=== RUN TestDropMultipleBuildingDeferredIndexes
2023/02/10 18:40:16 In TestDropMultipleBuildingDeferredIndexes()
2023/02/10 18:40:16 In DropAllSecondaryIndexes()
2023/02/10 18:40:16 Index found: id_company
2023/02/10 18:40:16 Dropped index id_company
2023/02/10 18:40:16 Index found: id_gender
2023/02/10 18:40:17 Dropped index id_gender
2023/02/10 18:40:26 Setting JSON docs in KV
2023/02/10 18:41:01 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:41:01 Index is 907510404778655447 now active
2023/02/10 18:41:02 Build command issued for the deferred indexes [15769323322029165253 11163661441751586544]
2023/02/10 18:41:03 Dropping the secondary index id_age
2023/02/10 18:41:03 Index dropped
2023/02/10 18:41:03 Dropping the secondary index id_gender
2023/02/10 18:41:18 Index dropped
2023/02/10 18:41:18 Build command issued for the deferred indexes [id_isActive], bucket: default, scope: _default, coll: _default
2023/02/10 18:41:18 Waiting for the index id_isActive to become active
2023/02/10 18:41:18 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:19 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:20 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:21 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:22 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:23 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:24 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:25 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:26 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:27 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:28 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:29 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:30 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:31 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:32 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:33 Waiting for index 16020483412894850492 to go active ...
2023/02/10 18:41:34 Index is 16020483412894850492 now active
2023/02/10 18:41:44 Using n1ql client
2023/02/10 18:41:46 Expected and Actual scan responses are the same
2023/02/10 18:41:46 Number of docScanResults and scanResults = 180000 and 180000
2023/02/10 18:41:46 Using n1ql client
2023/02/10 18:41:48 Expected and Actual scan responses are the same
2023/02/10 18:41:48 Number of docScanResults and scanResults = 180000 and 180000
--- PASS: TestDropMultipleBuildingDeferredIndexes (91.44s)
=== RUN TestDropOneIndexSecondDeferBuilding
2023/02/10 18:41:48 In TestDropOneIndexSecondDeferBuilding()
2023/02/10 18:41:48 In DropAllSecondaryIndexes()
2023/02/10 18:41:48 Index found: id_company
2023/02/10 18:41:48 Dropped index id_company
2023/02/10 18:41:48 Index found: id_isActive
2023/02/10 18:41:48 Dropped index id_isActive
2023/02/10 18:41:51 Setting JSON docs in KV
2023/02/10 18:41:56 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/02/10 18:41:56 Waiting for the index id_company to become active
2023/02/10 18:41:56 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:41:57 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:41:58 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:41:59 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:00 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:01 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:02 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:03 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:04 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:05 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:06 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:07 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:08 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:09 Waiting for index 10809087936971107268 to go active ...
2023/02/10 18:42:10 Index is 10809087936971107268 now active
2023/02/10 18:42:11 Build command issued for the deferred indexes [4216138912288149703]
2023/02/10 18:42:12 Dropping the secondary index id_company
2023/02/10 18:42:12 Index dropped
2023/02/10 18:42:18 Setting JSON docs in KV
2023/02/10 18:42:35 Index is 4216138912288149703 now active
2023/02/10 18:42:35 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/02/10 18:42:35 Waiting for the index id_gender to become active
2023/02/10 18:42:35 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:36 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:37 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:38 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:39 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:40 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:41 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:42 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:43 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:44 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:45 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:46 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:47 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:48 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:49 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:50 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:51 Waiting for index 6326275168131681876 to go active ...
2023/02/10 18:42:52 Index is 6326275168131681876 now active
2023/02/10 18:42:52 Using n1ql client
2023/02/10 18:42:53 Expected and Actual scan responses are the same
2023/02/10 18:42:53 Using n1ql client
2023/02/10 18:42:55 Expected and Actual scan responses are the same
--- PASS: TestDropOneIndexSecondDeferBuilding (67.32s)
=== RUN TestDropSecondIndexSecondDeferBuilding
2023/02/10 18:42:55 In TestDropSecondIndexSecondDeferBuilding()
2023/02/10 18:42:55 In DropAllSecondaryIndexes()
2023/02/10 18:42:55 Index found: id_age
2023/02/10 18:42:55 Dropped index id_age
2023/02/10 18:42:55 Index found: id_gender
2023/02/10 18:42:55 Dropped index id_gender
2023/02/10 18:42:58 Setting JSON docs in KV
2023/02/10 18:43:04 Build command issued for the deferred indexes [id_company], bucket: default, scope: _default, coll: _default
2023/02/10 18:43:04 Waiting for the index id_company to become active
2023/02/10 18:43:04 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:05 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:06 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:07 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:08 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:09 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:10 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:11 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:12 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:13 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:14 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:15 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:16 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:17 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:18 Waiting for index 6570599714380037439 to go active ...
2023/02/10 18:43:19 Index is 6570599714380037439 now active
2023/02/10 18:43:20 Build command issued for the deferred indexes [15557855346080587523]
2023/02/10 18:43:21 Dropping the secondary index id_age
2023/02/10 18:43:21 Index dropped
2023/02/10 18:43:24 Setting JSON docs in KV
2023/02/10 18:43:33 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/02/10 18:43:33 Waiting for the index id_gender to become active
2023/02/10 18:43:33 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:34 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:35 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:36 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:37 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:38 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:39 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:40 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:41 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:42 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:43 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:44 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:45 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:46 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:47 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:48 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:49 Waiting for index 15715706590281964622 to go active ...
2023/02/10 18:43:50 Index is 15715706590281964622 now active
2023/02/10 18:43:50 Using n1ql client
2023/02/10 18:43:50 Expected and Actual scan responses are the same
2023/02/10 18:43:50 Using n1ql client
2023/02/10 18:43:52 Expected and Actual scan responses are the same
--- PASS: TestDropSecondIndexSecondDeferBuilding (56.78s)
=== RUN TestCreateAfterDropWhileIndexBuilding
2023/02/10 18:43:52 In TestCreateAfterDropWhileIndexBuilding()
2023/02/10 18:43:52 In DropAllSecondaryIndexes()
2023/02/10 18:43:52 Index found: id_company
2023/02/10 18:43:52 Dropped index id_company
2023/02/10 18:43:52 Index found: id_gender
2023/02/10 18:43:52 Dropped index id_gender
2023/02/10 18:44:15 Setting JSON docs in KV
2023/02/10 18:45:19 Build command issued for the deferred indexes [8504044546557438738]
2023/02/10 18:45:20 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:21 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:22 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:23 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:24 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:25 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:26 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:27 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:28 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:29 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:30 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:31 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:32 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:33 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:34 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:35 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:36 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:37 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:38 Waiting for index 8504044546557438738 to go active ...
2023/02/10 18:45:39 Index is 8504044546557438738 now active
2023/02/10 18:45:39 Build command issued for the deferred indexes [13213856934674286407]
2023/02/10 18:45:40 Dropping the secondary index id_company
2023/02/10 18:45:40 Index dropped
2023/02/10 18:45:40 Dropping the secondary index id_age
2023/02/10 18:45:41 Index dropped
2023/02/10 18:45:49 Build command issued for the deferred indexes [id_gender], bucket: default, scope: _default, coll: _default
2023/02/10 18:45:49 Waiting for the index id_gender to become active
2023/02/10 18:45:49 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:50 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:51 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:52 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:53 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:54 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:55 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:56 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:57 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:58 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:45:59 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:00 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:01 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:02 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:03 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:04 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:05 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:06 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:07 Waiting for index 7118362770318752620 to go active ...
2023/02/10 18:46:08 Index is 7118362770318752620 now active
2023/02/10 18:46:09 Index is 7118362770318752620 now active
2023/02/10 18:46:10 Using n1ql client
2023/02/10 18:46:11 Expected and Actual scan responses are the same
--- PASS: TestCreateAfterDropWhileIndexBuilding (139.50s)
=== RUN TestDropBuildingIndex1
2023/02/10 18:46:11 In TestDropBuildingIndex1()
2023/02/10 18:46:11 In DropAllSecondaryIndexes()
2023/02/10 18:46:11 Index found: id_gender
2023/02/10 18:46:11 Dropped index id_gender
2023/02/10 18:46:16 Setting JSON docs in KV
2023/02/10 18:46:53 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:46:53 Index is 12604740225185760525 now active
2023/02/10 18:47:17 Dropping the secondary index id_age
2023/02/10 18:47:17 Index dropped
2023/02/10 18:47:39 Created the secondary index id_age. Waiting for it become active
2023/02/10 18:47:39 Index is 14615175813039007613 now active
2023/02/10 18:47:41 Setting JSON docs in KV
2023/02/10 18:47:51 Using n1ql client
2023/02/10 18:47:51 Expected and Actual scan responses are the same
2023/02/10 18:47:52 Using n1ql client
2023/02/10 18:47:52 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex1 (100.81s)
=== RUN TestDropBuildingIndex2
2023/02/10 18:47:52 In TestDropBuildingIndex2()
2023/02/10 18:47:52 In DropAllSecondaryIndexes()
2023/02/10 18:47:52 Index found: id_company
2023/02/10 18:47:52 Dropped index id_company
2023/02/10 18:47:52 Index found: id_age
2023/02/10 18:47:52 Dropped index id_age
2023/02/10 18:47:57 Setting JSON docs in KV
2023/02/10 18:48:37 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:48:37 Index is 3789804894290066162 now active
2023/02/10 18:49:04 Dropping the secondary index id_company
2023/02/10 18:49:04 Index dropped
2023/02/10 18:49:04 Index is 1776717227518860255 now active
2023/02/10 18:49:26 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:49:26 Index is 16981129365822705707 now active
2023/02/10 18:49:29 Setting JSON docs in KV
2023/02/10 18:49:39 Using n1ql client
2023/02/10 18:49:39 Expected and Actual scan responses are the same
2023/02/10 18:49:39 Using n1ql client
2023/02/10 18:49:40 Expected and Actual scan responses are the same
--- PASS: TestDropBuildingIndex2 (107.72s)
=== RUN TestDropIndexWithDataLoad
2023/02/10 18:49:40 In TestDropIndexWithDataLoad()
2023/02/10 18:49:40 In DropAllSecondaryIndexes()
2023/02/10 18:49:40 Index found: id_company
2023/02/10 18:49:40 Dropped index id_company
2023/02/10 18:49:40 Index found: id_age
2023/02/10 18:49:40 Dropped index id_age
2023/02/10 18:49:42 Setting JSON docs in KV
2023/02/10 18:50:11 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:50:11 Index is 9056096424246649193 now active
2023/02/10 18:50:36 Created the secondary index id_age. Waiting for it become active
2023/02/10 18:50:36 Index is 10858760731565183325 now active
2023/02/10 18:51:01 Created the secondary index id_gender. Waiting for it become active
2023/02/10 18:51:01 Index is 22611801978758593 now active
2023/02/10 18:51:26 Created the secondary index id_isActive. Waiting for it become active
2023/02/10 18:51:26 Index is 3630099584985306324 now active
2023/02/10 18:51:33 Setting JSON docs in KV
2023/02/10 18:51:33 In LoadKVBucket
2023/02/10 18:51:33 Bucket name = default
2023/02/10 18:51:33 In DropIndexWhileKVLoad
2023/02/10 18:51:34 Dropping the secondary index id_company
2023/02/10 18:51:34 Index dropped
2023/02/10 18:52:05 Using n1ql client
2023/02/10 18:52:06 Expected and Actual scan responses are the same
2023/02/10 18:52:06 Number of docScanResults and scanResults = 96712 and 96712
2023/02/10 18:52:07 Using n1ql client
2023/02/10 18:52:10 Expected and Actual scan responses are the same
2023/02/10 18:52:10 Number of docScanResults and scanResults = 420000 and 420000
--- PASS: TestDropIndexWithDataLoad (149.90s)
=== RUN TestDropAllIndexesWithDataLoad
2023/02/10 18:52:10 In TestDropAllIndexesWithDataLoad()
2023/02/10 18:52:10 In DropAllSecondaryIndexes()
2023/02/10 18:52:10 Index found: id_gender
2023/02/10 18:52:10 Dropped index id_gender
2023/02/10 18:52:10 Index found: id_age
2023/02/10 18:52:10 Dropped index id_age
2023/02/10 18:52:10 Index found: id_isActive
2023/02/10 18:52:10 Dropped index id_isActive
2023/02/10 18:52:12 Setting JSON docs in KV
2023/02/10 18:52:48 Created the secondary index id_company. Waiting for it become active
2023/02/10 18:52:48 Index is 13248821487150536464 now active
2023/02/10 18:53:16 Created the secondary index id_age. Waiting for it become active
2023/02/10 18:53:16 Index is 873462258887200529 now active
2023/02/10 18:53:42 Created the secondary index id_gender. Waiting for it become active
2023/02/10 18:53:42 Index is 7441163749002114307 now active
2023/02/10 18:54:09 Created the secondary index id_isActive. Waiting for it become active
2023/02/10 18:54:09 Index is 11019912448470573871 now active
2023/02/10 18:54:16 Setting JSON docs in KV
2023/02/10 18:54:16 In LoadKVBucket
2023/02/10 18:54:16 Bucket name = default
2023/02/10 18:54:16 In DropIndexWhileKVLoad
2023/02/10 18:54:16 In DropIndexWhileKVLoad
2023/02/10 18:54:16 In DropIndexWhileKVLoad
2023/02/10 18:54:16 In DropIndexWhileKVLoad
2023/02/10 18:54:17 Dropping the secondary index id_company
2023/02/10 18:54:17 Dropping the secondary index id_age
2023/02/10 18:54:17 Dropping the secondary index id_gender
2023/02/10 18:54:17 Dropping the secondary index id_isActive
2023/02/10 18:54:17 Index dropped
2023/02/10 18:54:17 Index dropped
2023/02/10 18:54:18 Index dropped
2023/02/10 18:54:18 Index dropped
2023/02/10 18:54:37 Using n1ql client
2023/02/10 18:54:37 Scan failed as expected with error: Index Not Found - cause: GSI index id_company not found.
--- PASS: TestDropAllIndexesWithDataLoad (146.92s)
=== RUN TestCreateBucket_AnotherIndexBuilding
2023/02/10 18:54:37 In TestCreateBucket_AnotherIndexBuilding()
2023/02/10 18:54:37 In DropAllSecondaryIndexes()
2023/02/10 18:55:15 Flushed the bucket default, Response body:
2023/02/10 18:55:18 Modified parameters of bucket default, responseBody:
2023/02/10 18:55:18 http://127.0.0.1:9000/pools/default/buckets/multi_buck2
2023/02/10 18:55:18 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multi_buck2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 18:55:18 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:25:17 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc009d872c0 31 [] false false map[] 0xc00abee100 }
2023/02/10 18:55:18 DeleteBucket failed for bucket multi_buck2
2023/02/10 18:55:18 Deleted bucket multi_buck2, responseBody: Requested resource not found.
2023/02/10 18:55:33 Setting JSON docs in KV
2023/02/10 18:57:47 Created bucket multi_buck2, responseBody:
2023-02-10T18:58:08.235+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket multi_buck2 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-02-10T18:58:19.238+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket multi_buck2 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
common_test.go:173: Error in creating the index1: [Bucket Not Found] Bucket multi_buck2 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- FAIL: TestCreateBucket_AnotherIndexBuilding (222.03s)
=== RUN TestDropBucket2Index_Bucket1IndexBuilding
2023/02/10 18:58:19 In TestDropBucket2Index_Bucket1IndexBuilding()
2023/02/10 18:58:19 In DropAllSecondaryIndexes()
2023/02/10 18:58:19 Index found: buck1_idx
2023/02/10 18:58:19 Dropped index buck1_idx
2023/02/10 18:58:56 Flushed the bucket default, Response body:
2023/02/10 18:58:59 Modified parameters of bucket default, responseBody:
2023/02/10 18:58:59 http://127.0.0.1:9000/pools/default/buckets/multibucket_test3
2023/02/10 18:58:59 &{DELETE http://127.0.0.1:9000/pools/default/buckets/multibucket_test3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 18:58:59 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:28:59 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0173f4700 31 [] false false map[] 0xc002c70000 }
2023/02/10 18:58:59 DeleteBucket failed for bucket multibucket_test3
2023/02/10 18:58:59 Deleted bucket multibucket_test3, responseBody: Requested resource not found.
2023/02/10 18:59:00 Created bucket multibucket_test3, responseBody:
2023/02/10 18:59:15 Setting JSON docs in KV
2023-02-10T19:00:18.121+05:30 [Error] Encountered error during create index. Error: [Bucket Not Found] Bucket multibucket_test3 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
2023-02-10T19:00:29.124+05:30 [Error] Fail to create index: [Bucket Not Found] Bucket multibucket_test3 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
common_test.go:173: Error in creating the index2: [Bucket Not Found] Bucket multibucket_test3 does not exist or temporarily unavailable for creating new index. Please retry the operation at a later time.
--- FAIL: TestDropBucket2Index_Bucket1IndexBuilding (129.89s)
=== RUN TestDeleteBucketWhileInitialIndexBuild
2023/02/10 19:00:29 In TestDeleteBucketWhileInitialIndexBuild()
2023/02/10 19:00:29 ============== DBG: Drop all indexes in all buckets
2023/02/10 19:00:29 In DropAllSecondaryIndexes()
2023/02/10 19:00:29 ============== DBG: Delete bucket default
2023/02/10 19:00:30 Deleted bucket default, responseBody:
2023/02/10 19:00:30 ============== DBG: Create bucket default
2023/02/10 19:00:30 Created bucket default, responseBody:
2023/02/10 19:00:33 Flush Enabled on bucket default, responseBody:
2023/02/10 19:01:07 Flushed the bucket default, Response body:
2023/02/10 19:01:07 ============== DBG: Delete bucket testbucket2
2023/02/10 19:01:07 http://127.0.0.1:9000/pools/default/buckets/testbucket2
2023/02/10 19:01:07 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket2 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:01:07 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:31:06 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc012a91440 31 [] false false map[] 0xc00ac74100 }
2023/02/10 19:01:07 DeleteBucket failed for bucket testbucket2
2023/02/10 19:01:07 Deleted bucket testbucket2, responseBody: Requested resource not found.
2023/02/10 19:01:07 ============== DBG: Create bucket testbucket2
2023/02/10 19:01:07 Created bucket testbucket2, responseBody:
2023/02/10 19:01:10 Flush Enabled on bucket testbucket2, responseBody:
2023/02/10 19:01:43 Flushed the bucket testbucket2, Response body:
2023/02/10 19:01:43 ============== DBG: Delete bucket testbucket3
2023/02/10 19:01:43 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2023/02/10 19:01:43 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:01:43 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:31:43 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc012a918c0 31 [] false false map[] 0xc002ac2100 }
2023/02/10 19:01:43 DeleteBucket failed for bucket testbucket3
2023/02/10 19:01:43 Deleted bucket testbucket3, responseBody: Requested resource not found.
2023/02/10 19:01:43 ============== DBG: Create bucket testbucket3
2023/02/10 19:01:43 http://127.0.0.1:9000/pools/default/buckets
2023/02/10 19:01:43 &{POST http://127.0.0.1:9000/pools/default/buckets HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] {0xc0000578c0} 0x763200 62 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:01:43 &{400 Bad Request 400 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[370] Content-Type:[application/json] Date:[Fri, 10 Feb 2023 13:31:43 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc0002190c0 370 [] false false map[] 0xc00ac74100 }
2023/02/10 19:01:43 CreateBucket failed for bucket testbucket3
2023/02/10 19:01:43 Created bucket testbucket3, responseBody: {"errors":{"ramQuota":"RAM quota specified is too large to be provisioned into this cluster."},"summaries":{"ramSummary":{"total":3145728000,"otherBuckets":2684354560,"nodesCount":2,"perNodeMegs":256,"thisAlloc":536870912,"thisUsed":0,"free":-75497472},"hddSummary":{"total":78981824512,"otherData":52000049696,"otherBuckets":127954480,"thisUsed":0,"free":26853820336}}}
2023/02/10 19:01:43 http://127.0.0.1:9000/pools/default/buckets/testbucket3
2023/02/10 19:01:43 &{POST http://127.0.0.1:9000/pools/default/buckets/testbucket3 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] {0xc02150d640} 0x763200 31 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:01:43 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:31:43 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc012a91a40 31 [] true false map[] 0xc002ac2300 }
2023/02/10 19:01:43 EnableBucketFlush failed for bucket testbucket3
2023/02/10 19:01:46 Flush Enabled on bucket testbucket3, responseBody: Requested resource not found.
2023/02/10 19:01:46 http://127.0.0.1:9000/pools/default/buckets/testbucket3/controller/doFlush
2023/02/10 19:01:46 &{POST http://127.0.0.1:9000/pools/default/buckets/testbucket3/controller/doFlush HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:01:46 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:31:46 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc01a0f07c0 31 [] false false map[] 0xc00ac75b00 }
2023/02/10 19:01:46 Flush Bucket failed for bucket testbucket3
2023/02/10 19:02:16 Flushed the bucket testbucket3, Response body: Requested resource not found.
2023/02/10 19:02:16 ============== DBG: Delete bucket testbucket4
2023/02/10 19:02:16 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/02/10 19:02:16 &{DELETE http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:02:16 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:32:16 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc005da99c0 31 [] false false map[] 0xc0020f8500 }
2023/02/10 19:02:16 DeleteBucket failed for bucket testbucket4
2023/02/10 19:02:16 Deleted bucket testbucket4, responseBody: Requested resource not found.
2023/02/10 19:02:16 ============== DBG: Create bucket testbucket4
2023/02/10 19:02:17 http://127.0.0.1:9000/pools/default/buckets
2023/02/10 19:02:17 &{POST http://127.0.0.1:9000/pools/default/buckets HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] {0xc0078314c0} 0x763200 62 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:02:17 &{400 Bad Request 400 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[370] Content-Type:[application/json] Date:[Fri, 10 Feb 2023 13:32:16 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc01665ab80 370 [] false false map[] 0xc002c70200 }
2023/02/10 19:02:17 CreateBucket failed for bucket testbucket4
2023/02/10 19:02:17 Created bucket testbucket4, responseBody: {"errors":{"ramQuota":"RAM quota specified is too large to be provisioned into this cluster."},"summaries":{"ramSummary":{"total":3145728000,"otherBuckets":2684354560,"nodesCount":2,"perNodeMegs":256,"thisAlloc":536870912,"thisUsed":0,"free":-75497472},"hddSummary":{"total":78981824512,"otherData":52000049696,"otherBuckets":127954480,"thisUsed":0,"free":26853820336}}}
2023/02/10 19:02:17 http://127.0.0.1:9000/pools/default/buckets/testbucket4
2023/02/10 19:02:17 &{POST http://127.0.0.1:9000/pools/default/buckets/testbucket4 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] {0xc000056f80} 0x763200 31 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:02:17 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:32:16 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc01665ad00 31 [] true false map[] 0xc0020f8900 }
2023/02/10 19:02:17 EnableBucketFlush failed for bucket testbucket4
2023/02/10 19:02:20 Flush Enabled on bucket testbucket4, responseBody: Requested resource not found.
2023/02/10 19:02:20 http://127.0.0.1:9000/pools/default/buckets/testbucket4/controller/doFlush
2023/02/10 19:02:20 &{POST http://127.0.0.1:9000/pools/default/buckets/testbucket4/controller/doFlush HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc000138000}
2023/02/10 19:02:20 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:32:19 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc01a0f02c0 31 [] false false map[] 0xc0020f8e00 }
2023/02/10 19:02:20 Flush Bucket failed for bucket testbucket4
2023/02/10 19:02:50 Flushed the bucket testbucket4, Response body: Requested resource not found.
2023/02/10 19:03:05 Generating docs and Populating all the buckets
2023/02/10 19:03:05 ============== DBG: Creating docs in bucket default
2023/02/10 19:03:06 ============== DBG: Creating index bucket1_age in bucket default
2023/02/10 19:03:10 Created the secondary index bucket1_age. Waiting for it become active
2023/02/10 19:03:10 Index is 13252174990662150970 now active
2023/02/10 19:03:10 ============== DBG: Creating index bucket1_gender in bucket default
2023/02/10 19:03:16 Created the secondary index bucket1_gender. Waiting for it become active
2023/02/10 19:03:16 Index is 3371787588612370933 now active
2023/02/10 19:03:17 ============== DBG: Creating docs in bucket testbucket2
2023/02/10 19:03:17 ============== DBG: Creating index bucket2_city in bucket testbucket2
2023/02/10 19:03:22 Created the secondary index bucket2_city. Waiting for it become active
2023/02/10 19:03:22 Index is 1457110605606674956 now active
2023/02/10 19:03:22 ============== DBG: Creating index bucket2_company in bucket testbucket2
2023/02/10 19:03:29 Created the secondary index bucket2_company. Waiting for it become active
2023/02/10 19:03:29 Index is 14878846222098649479 now active
2023/02/10 19:03:29 ============== DBG: Creating docs in bucket testbucket3
2023/02/10 19:03:29 bucket: No bucket named testbucket3
--- FAIL: TestDeleteBucketWhileInitialIndexBuild (180.68s)
panic: bucket: No bucket named testbucket3
[recovered]
panic: bucket: No bucket named testbucket3
goroutine 16613 [running]:
panic({0xf23b80, 0xc03961aa10})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/panic.go:987 +0x3ba fp=0xc002d4b6b0 sp=0xc002d4b5f0 pc=0x43d3ba
testing.tRunner.func1.2({0xf23b80, 0xc03961aa10})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1396 +0x24e fp=0xc002d4b760 sp=0xc002d4b6b0 pc=0x5212ee
testing.tRunner.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1399 +0x39f fp=0xc002d4b8c8 sp=0xc002d4b760 pc=0x520d7f
runtime.deferCallSave(0xc002d4b998, 0xc002d4bf90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/panic.go:796 +0x88 fp=0xc002d4b8d8 sp=0xc002d4b8c8 pc=0x43cfa8
runtime.runOpenDeferFrame(0xc037cc0140?, 0xc037cc0190)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/panic.go:769 +0x1a5 fp=0xc002d4b920 sp=0xc002d4b8d8 pc=0x43cdc5
panic({0xf23b80, 0xc03961aa10})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/panic.go:884 +0x212 fp=0xc002d4b9e0 sp=0xc002d4b920 pc=0x43d212
log.Panicf({0x10d69eb?, 0x6?}, {0xc002d4baa0?, 0x7?, 0x10dca68?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/log/log.go:395 +0x67 fp=0xc002d4ba28 sp=0xc002d4b9e0 pc=0x5d58e7
github.com/couchbase/indexing/secondary/tests/framework/common.HandleError(...)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/framework/common/util.go:77
github.com/couchbase/indexing/secondary/tests/framework/kvutility.SetKeyValues(0x110e8f0?, {0x10dca68, 0xb}, {0x0, 0x0}, {0xc000139b50, 0xe})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/framework/kvutility/kvdataoperations.go:35 +0x225 fp=0xc002d4bb98 sp=0xc002d4ba28 pc=0xbf3a05
github.com/couchbase/indexing/secondary/tests/functionaltests.TestDeleteBucketWhileInitialIndexBuild(0xc0a4446340)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/functionaltests/set07_system_test.go:1182 +0x73c fp=0xc002d4bf70 sp=0xc002d4bb98 pc=0xe2579c
testing.tRunner(0xc0a4446340, 0x1156a98)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1446 +0x10b fp=0xc002d4bfc0 sp=0xc002d4bf70 pc=0x52092b
testing.(*T).Run.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1493 +0x2a fp=0xc002d4bfe0 sp=0xc002d4bfc0 pc=0x5217ca
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002d4bfe8 sp=0xc002d4bfe0 pc=0x471ba1
created by testing.(*T).Run
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1493 +0x35f
goroutine 1 [chan receive, 3 minutes]:
runtime.gopark(0x1?, 0xc000157898?, 0xff?, 0x32?, 0xc000157848?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000157818 sp=0xc0001577f8 pc=0x4404d6
runtime.chanrecv(0xc00ab6e770, 0xc000157917, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0001578a8 sp=0xc000157818 pc=0x40c87b
runtime.chanrecv1(0x1102eb0?, 0x1102eb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc0001578d0 sp=0xc0001578a8 pc=0x40c378
testing.(*T).Run(0xc00791e000, {0x1102eb0?, 0x520305?}, 0x1156a98)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1494 +0x37a fp=0xc000157970 sp=0xc0001578d0 pc=0x52171a
testing.runTests.func1(0xc007c43c80?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1846 +0x6e fp=0xc0001579c0 sp=0xc000157970 pc=0x52366e
testing.tRunner(0xc00791e000, 0xc000157ac8)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1446 +0x10b fp=0xc000157a10 sp=0xc0001579c0 pc=0x52092b
testing.runTests(0xc0004b10e0?, {0x1b54640, 0xda, 0xda}, {0xc000157b00?, 0xc000157b10?, 0x1bd1e00?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1844 +0x456 fp=0xc000157af8 sp=0xc000157a10 pc=0x523516
testing.(*M).Run(0xc0004b10e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1726 +0x5d9 fp=0xc000157cf0 sp=0xc000157af8 pc=0x521ff9
github.com/couchbase/indexing/secondary/tests/functionaltests.TestMain(0xffffffffffffffff?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/functionaltests/common_test.go:168 +0x1276 fp=0xc000157ec8 sp=0xc000157cf0 pc=0xdc19f6
main.main()
_testmain.go:483 +0x1d3 fp=0xc000157f80 sp=0xc000157ec8 pc=0xe9dab3
runtime.main()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:250 +0x212 fp=0xc000157fe0 sp=0xc000157f80 pc=0x440112
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000157fe8 sp=0xc000157fe0 pc=0x471ba1
goroutine 2 [force gc (idle), 59 minutes]:
runtime.gopark(0x1c1af0ba8212?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006afb0 sp=0xc00006af90 pc=0x4404d6
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.forcegchelper()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:302 +0xad fp=0xc00006afe0 sp=0xc00006afb0 pc=0x44036d
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006afe8 sp=0xc00006afe0 pc=0x471ba1
created by runtime.init.6
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:290 +0x25
goroutine 18 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000066790 sp=0xc000066770 pc=0x4404d6
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.bgsweep(0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgcsweep.go:297 +0xd7 fp=0xc0000667c8 sp=0xc000066790 pc=0x42ad37
runtime.gcenable.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:178 +0x26 fp=0xc0000667e0 sp=0xc0000667c8 pc=0x41f9a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000667e8 sp=0xc0000667e0 pc=0x471ba1
created by runtime.gcenable
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:178 +0x6b
goroutine 19 [GC scavenge wait]:
runtime.gopark(0x1f428a5d94b4?, 0x134821?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000066f70 sp=0xc000066f50 pc=0x4404d6
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.(*scavengerState).park(0x1bd1f00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgcscavenge.go:389 +0x53 fp=0xc000066fa0 sp=0xc000066f70 pc=0x428d93
runtime.bgscavenge(0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgcscavenge.go:622 +0x65 fp=0xc000066fc8 sp=0xc000066fa0 pc=0x429385
runtime.gcenable.func2()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:179 +0x26 fp=0xc000066fe0 sp=0xc000066fc8 pc=0x41f946
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000066fe8 sp=0xc000066fe0 pc=0x471ba1
created by runtime.gcenable
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:179 +0xaa
goroutine 20 [finalizer wait]:
runtime.gopark(0x0?, 0x11567e0?, 0x20?, 0x0?, 0x1000000010?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006a628 sp=0xc00006a608 pc=0x4404d6
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.runfinq()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mfinal.go:180 +0x10f fp=0xc00006a7e0 sp=0xc00006a628 pc=0x41eaaf
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006a7e8 sp=0xc00006a7e0 pc=0x471ba1
created by runtime.createfing
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mfinal.go:157 +0x45
goroutine 72 [select, 62 minutes]:
runtime.gopark(0xc000159d88?, 0x2?, 0x4b?, 0xce?, 0xc000159c84?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000159af0 sp=0xc000159ad0 pc=0x4404d6
runtime.selectgo(0xc000159d88, 0xc000159c80, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000159c30 sp=0xc000159af0 pc=0x45035c
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint(0x0?, {0xc00026a000, 0x17}, 0xc0002fc060, 0xc0002fc048, 0xc000254000)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:503 +0x6da fp=0xc000159ed8 sp=0xc000159c30 pc=0x8452da
github.com/couchbase/indexing/secondary/dcp.(*Client).RunObservePool(0xc0000ba000?, {0x10d73b5?, 0x0?}, 0x0?, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:395 +0xb2 fp=0xc000159f40 sp=0xc000159ed8 pc=0x844412
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunPoolObserver(0xc0000ba000)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:150 +0x5c fp=0xc000159fc8 sp=0xc000159f40 pc=0xb4043c
github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:281 +0x26 fp=0xc000159fe0 sp=0xc000159fc8 pc=0xb41a06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000159fe8 sp=0xc000159fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:281 +0x50a
goroutine 22 [select, 63 minutes]:
runtime.gopark(0xc000067f98?, 0x2?, 0x0?, 0x0?, 0xc000067f84?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000067e10 sp=0xc000067df0 pc=0x4404d6
runtime.selectgo(0xc000067f98, 0xc000067f80, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000067f50 sp=0xc000067e10 pc=0x45035c
github.com/couchbase/cbauth/cbauthimpl.(*tlsNotifier).loop(0xc0001326d8)
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:405 +0x67 fp=0xc000067fc8 sp=0xc000067f50 pc=0x7a3827
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func2()
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:565 +0x26 fp=0xc000067fe0 sp=0xc000067fc8 pc=0x7a4486
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x471ba1
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:565 +0x385
goroutine 23 [select, 63 minutes]:
runtime.gopark(0xc000068798?, 0x2?, 0x0?, 0x0?, 0xc00006878c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000068608 sp=0xc0000685e8 pc=0x4404d6
runtime.selectgo(0xc000068798, 0xc000068788, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000068748 sp=0xc000068608 pc=0x45035c
github.com/couchbase/cbauth/cbauthimpl.(*cfgChangeNotifier).loop(0xc0001326f0)
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:325 +0x85 fp=0xc0000687c8 sp=0xc000068748 pc=0x7a3285
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func3()
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:566 +0x26 fp=0xc0000687e0 sp=0xc0000687c8 pc=0x7a4426
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x471ba1
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:566 +0x3d6
goroutine 24 [IO wait, 2 minutes]:
runtime.gopark(0xc00045ecb8?, 0xb?, 0x0?, 0x0?, 0x6?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000c1780 sp=0xc0000c1760 pc=0x4404d6
runtime.netpollblock(0x484d05?, 0x24c000?, 0xc0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0000c17b8 sp=0xc0000c1780 pc=0x438cb7
internal/poll.runtime_pollWait(0x7f61a8115028, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0000c17d8 sp=0xc0000c17b8 pc=0x46c0c9
internal/poll.(*pollDesc).wait(0xc00029c000?, 0xc0002a9000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0000c1800 sp=0xc0000c17d8 pc=0x4a5f32
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00029c000, {0xc0002a9000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0000c1880 sp=0xc0000c1800 pc=0x4a729a
net.(*netFD).Read(0xc00029c000, {0xc0002a9000?, 0xc0000c1918?, 0x5695ff?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0000c18c8 sp=0xc0000c1880 pc=0x684429
net.(*conn).Read(0xc000288020, {0xc0002a9000?, 0x56a716?, 0xf28c40?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0000c1910 sp=0xc0000c18c8 pc=0x6946a5
bufio.(*Reader).Read(0xc0002801e0, {0xc000244001, 0x5ff, 0x455c54?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc0000c1948 sp=0xc0000c1910 pc=0x526cfb
github.com/couchbase/cbauth/revrpc.(*minirwc).Read(0x1?, {0xc000244001?, 0x8?, 0x20?})
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:103 +0x25 fp=0xc0000c1978 sp=0xc0000c1948 pc=0x80be45
encoding/json.(*Decoder).refill(0xc000240000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0000c19c8 sp=0xc0000c1978 pc=0x57c668
encoding/json.(*Decoder).readValue(0xc000240000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0000c1a18 sp=0xc0000c19c8 pc=0x57c25b
encoding/json.(*Decoder).Decode(0xc000240000, {0xf58460, 0xc0002380e0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0000c1a48 sp=0xc0000c1a18 pc=0x57be98
net/rpc/jsonrpc.(*serverCodec).ReadRequestHeader(0xc0002380c0, 0xc000214060)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/rpc/jsonrpc/server.go:66 +0x85 fp=0xc0000c1a88 sp=0xc0000c1a48 pc=0x80b0a5
github.com/couchbase/cbauth/revrpc.(*jsonServerCodec).ReadRequestHeader(0xc000236000?, 0xc0000c1b38?)
:1 +0x2a fp=0xc0000c1aa8 sp=0xc0000c1a88 pc=0x80e1ca
net/rpc.(*Server).readRequestHeader(0xc000236000, {0x128ae00, 0xc00020e110})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/rpc/server.go:588 +0x66 fp=0xc0000c1b78 sp=0xc0000c1aa8 pc=0x809686
net/rpc.(*Server).readRequest(0x0?, {0x128ae00, 0xc00020e110})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/rpc/server.go:548 +0x3b fp=0xc0000c1c50 sp=0xc0000c1b78 pc=0x8091db
net/rpc.(*Server).ServeCodec(0xc000236000, {0x128ae00?, 0xc00020e110})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/rpc/server.go:463 +0x87 fp=0xc0000c1d48 sp=0xc0000c1c50 pc=0x808727
github.com/couchbase/cbauth/revrpc.(*Service).Run(0xc000068f60?, 0xc000155fa0)
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:236 +0x77f fp=0xc0000c1f38 sp=0xc0000c1d48 pc=0x80cb7f
github.com/couchbase/cbauth/revrpc.BabysitService(0x0?, 0x0?, {0x1280000?, 0xc000284018?})
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:335 +0x58 fp=0xc0000c1f70 sp=0xc0000c1f38 pc=0x80d218
github.com/couchbase/cbauth.runRPCForSvc(0x0?, 0xc00018e1c0)
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:57 +0xbd fp=0xc0000c1fc0 sp=0xc0000c1f70 pc=0x81779d
github.com/couchbase/cbauth.startDefault.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:66 +0x25 fp=0xc0000c1fe0 sp=0xc0000c1fc0 pc=0x817a85
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000c1fe8 sp=0xc0000c1fe0 pc=0x471ba1
created by github.com/couchbase/cbauth.startDefault
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:65 +0xf9
goroutine 25 [chan receive, 3 minutes]:
runtime.gopark(0xc000280240?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000696f8 sp=0xc0000696d8 pc=0x4404d6
runtime.chanrecv(0xc000412f00, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000069788 sp=0xc0000696f8 pc=0x40c87b
runtime.chanrecv1(0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc0000697b0 sp=0xc000069788 pc=0x40c378
github.com/couchbase/regulator/utils/logging.duplicateFlushLoop()
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:253 +0x25 fp=0xc0000697d0 sp=0xc0000697b0 pc=0xa2dbc5
github.com/couchbase/regulator/utils/logging.init.0.func1()
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:49 +0x25 fp=0xc0000697e0 sp=0xc0000697d0 pc=0xa30365
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000697e8 sp=0xc0000697e0 pc=0x471ba1
created by github.com/couchbase/regulator/utils/logging.init.0
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:49 +0x7e
goroutine 49 [select, 62 minutes]:
runtime.gopark(0xc000269f90?, 0x2?, 0xd8?, 0x9d?, 0xc000269f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000269d90 sp=0xc000269d70 pc=0x4404d6
runtime.selectgo(0xc000269f90, 0xc000269f20, 0xc00062c000?, 0x0, 0xc0004c3a70?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000269ed0 sp=0xc000269d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0002d85a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000269fc8 sp=0xc000269ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000269fe0 sp=0xc000269fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000269fe8 sp=0xc000269fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 7 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f101906b021?, 0x3?, 0x71?, 0xb3?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006b750 sp=0xc00006b730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006b7e0 sp=0xc00006b750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006b7e8 sp=0xc00006b7e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 116 [select, 62 minutes]:
runtime.gopark(0xc0002dcf68?, 0x4?, 0x4b?, 0xce?, 0xc0002dcdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002dcc00 sp=0xc0002dcbe0 pc=0x4404d6
runtime.selectgo(0xc0002dcf68, 0xc0002dcda8, 0xc00062c140?, 0x0, 0x7f61d0fc4a01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0002dcd40 sp=0xc0002dcc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0000b2120)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0002dcfc8 sp=0xc0002dcd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0002dcfe0 sp=0xc0002dcfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002dcfe8 sp=0xc0002dcfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 46 [select, 62 minutes]:
runtime.gopark(0xc000078f90?, 0x2?, 0xd8?, 0x8d?, 0xc000078f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000078d90 sp=0xc000078d70 pc=0x4404d6
runtime.selectgo(0xc000078f90, 0xc000078f20, 0xc0000b83c0?, 0x0, 0xc000125680?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000078ed0 sp=0xc000078d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0004aeb40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000078fc8 sp=0xc000078ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000078fe0 sp=0xc000078fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000078fe8 sp=0xc000078fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 737 [GC worker (idle)]:
runtime.gopark(0x1f4287fe60c5?, 0x1?, 0xf2?, 0x27?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aca2f50 sp=0xc00aca2f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00aca2fe0 sp=0xc00aca2f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aca2fe8 sp=0xc00aca2fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 52 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f101905159f?, 0x3?, 0xd1?, 0x6?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000069f50 sp=0xc000069f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc000069fe0 sp=0xc000069f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 53 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1019183bbb?, 0x3?, 0xc6?, 0xfa?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000068f50 sp=0xc000068f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc000068fe0 sp=0xc000068f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000068fe8 sp=0xc000068fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 8 [GC worker (idle)]:
runtime.gopark(0x1c09cc0?, 0x1?, 0x19?, 0x50?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006bf50 sp=0xc00006bf30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006bfe0 sp=0xc00006bf50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006bfe8 sp=0xc00006bfe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 16 [select]:
runtime.gopark(0xc0000c3ba0?, 0x3?, 0x6?, 0x30?, 0xc0000c3b1a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000c3978 sp=0xc0000c3958 pc=0x4404d6
runtime.selectgo(0xc0000c3ba0, 0xc0000c3b14, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000c3ab8 sp=0xc0000c3978 pc=0x45035c
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc0001a64c0?, {0x10f0835, 0x1b}, 0xc0000c3e68, 0xc0000543c0)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc0000c3e40 sp=0xc0000c3ab8 pc=0xa21589
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x10f0835?, 0x0?}, 0x0?, 0x0?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc0000c3e88 sp=0xc0000c3e40 pc=0xa21b18
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0x0?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1607 +0xc7 fp=0xc0000c3f00 sp=0xc0000c3e88 pc=0xc02087
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc0000c3fa0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc0000c3f38 sp=0xc0000c3f00 pc=0xb3e4e3
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1612 +0xdf fp=0xc0000c3fe0 sp=0xc0000c3f38 pc=0xc01f3f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000c3fe8 sp=0xc0000c3fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1600 +0xaf
goroutine 15 [chan receive, 63 minutes]:
runtime.gopark(0x0?, 0x762380?, 0x47?, 0x75?, 0xc0002a4200?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e7678 sp=0xc0000e7658 pc=0x4404d6
runtime.chanrecv(0xc00009bbc0, 0xc0000e7790, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0000e7708 sp=0xc0000e7678 pc=0x40c87b
runtime.chanrecv2(0xc000046797?, 0x16?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc0000e7730 sp=0xc0000e7708 pc=0x40c3b8
github.com/couchbase/goutils/systemeventlog.(*SystemEventLoggerImpl).logEvents(0xc0002588c0)
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:186 +0xb7 fp=0xc0000e77c8 sp=0xc0000e7730 pc=0xbfd0b7
github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger.func1()
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x26 fp=0xc0000e77e0 sp=0xc0000e77c8 pc=0xbfc9c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e77e8 sp=0xc0000e77e0 pc=0x471ba1
created by github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x1d6
goroutine 100 [select]:
runtime.gopark(0xc0025ddf68?, 0x5?, 0xc0?, 0xac?, 0xc0025dddf6?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000bdc60 sp=0xc0000bdc40 pc=0x4404d6
runtime.selectgo(0xc0000bdf68, 0xc0025dddec, 0x10d73b5?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000bdda0 sp=0xc0000bdc60 pc=0x45035c
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges(0xc0000220b0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2088 +0x33c fp=0xc0000bdfc8 sp=0xc0000bdda0 pc=0xd5aafc
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:151 +0x26 fp=0xc0000bdfe0 sp=0xc0000bdfc8 pc=0xd4df86
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000bdfe8 sp=0xc0000bdfe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:151 +0x5d6
goroutine 40 [select]:
runtime.gopark(0xc0000e6798?, 0x2?, 0x51?, 0x1c?, 0xc0000e678c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e6618 sp=0xc0000e65f8 pc=0x4404d6
runtime.selectgo(0xc0000e6798, 0xc0000e6788, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000e6758 sp=0xc0000e6618 pc=0x45035c
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc00009c7e0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2396 +0x92 fp=0xc0000e67c8 sp=0xc0000e6758 pc=0xd5cb12
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2189 +0x26 fp=0xc0000e67e0 sp=0xc0000e67c8 pc=0xd5b486
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e67e8 sp=0xc0000e67e0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2189 +0x296
goroutine 47 [IO wait]:
runtime.gopark(0x54f?, 0xb?, 0x0?, 0x0?, 0xa?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000799a0 sp=0xc000079980 pc=0x4404d6
runtime.netpollblock(0x484d05?, 0x4a5c25?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0000799d8 sp=0xc0000799a0 pc=0x438cb7
internal/poll.runtime_pollWait(0x7f61a8114e48, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0000799f8 sp=0xc0000799d8 pc=0x46c0c9
internal/poll.(*pollDesc).wait(0xc00021c200?, 0xc000160000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc000079a20 sp=0xc0000799f8 pc=0x4a5f32
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00021c200, {0xc000160000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc000079aa0 sp=0xc000079a20 pc=0x4a729a
net.(*netFD).Read(0xc00021c200, {0xc000160000?, 0xc000236230?, 0x57923f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc000079ae8 sp=0xc000079aa0 pc=0x684429
net.(*conn).Read(0xc000210068, {0xc000160000?, 0x569946?, 0xc00043ea28?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc000079b30 sp=0xc000079ae8 pc=0x6946a5
net/http.(*persistConn).Read(0xc00016f560, {0xc000160000?, 0xf168c0?, 0xc000079e08?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc000079b90 sp=0xc000079b30 pc=0x787b2e
bufio.(*Reader).fill(0xc0002385a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc000079bc8 sp=0xc000079b90 pc=0x52671f
bufio.(*Reader).ReadSlice(0xc0002385a0, 0x81?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc000079c18 sp=0xc000079bc8 pc=0x52730f
net/http/internal.readChunkLine(0x5a5?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc000079c68 sp=0xc000079c18 pc=0x725285
net/http/internal.(*chunkedReader).beginChunk(0xc00009ccf0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc000079c98 sp=0xc000079c68 pc=0x724ce8
net/http/internal.(*chunkedReader).Read(0xc00009ccf0, {0xc0078be600?, 0xc00022a1b0?, 0xc0078c64b0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc000079d18 sp=0xc000079c98 pc=0x724fb6
net/http.(*body).readLocked(0xc0000b8400, {0xc0078be600?, 0xc00043ea90?, 0xffbb00?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc000079d68 sp=0xc000079d18 pc=0x77c65c
net/http.(*body).Read(0x0?, {0xc0078be600?, 0x56953e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc000079de0 sp=0xc000079d68 pc=0x77c525
net/http.(*bodyEOFSignal).Read(0xc0000b8440, {0xc0078be600, 0x600, 0x600})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc000079e60 sp=0xc000079de0 pc=0x78c202
encoding/json.(*Decoder).refill(0xc00043ea00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc000079eb0 sp=0xc000079e60 pc=0x57c668
encoding/json.(*Decoder).readValue(0xc00043ea00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc000079f00 sp=0xc000079eb0 pc=0x57c25b
encoding/json.(*Decoder).Decode(0xc00043ea00, {0xef5e80, 0xc000236230})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc000079f30 sp=0xc000079f00 pc=0x57be98
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc000079fe0 sp=0xc000079f30 pc=0xa21a0b
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000079fe8 sp=0xc000079fe0 pc=0x471ba1
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb
goroutine 45 [select, 62 minutes]:
runtime.gopark(0xc000293f68?, 0x4?, 0x3?, 0x0?, 0xc000293db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000293c00 sp=0xc000293be0 pc=0x4404d6
runtime.selectgo(0xc000293f68, 0xc000293da8, 0xc00041f540?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000293d40 sp=0xc000293c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0004aeb40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000293fc8 sp=0xc000293d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000293fe0 sp=0xc000293fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000293fe8 sp=0xc000293fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 43 [select, 62 minutes]:
runtime.gopark(0xc00007bf68?, 0x4?, 0x3?, 0x0?, 0xc00007bdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007bc00 sp=0xc00007bbe0 pc=0x4404d6
runtime.selectgo(0xc00007bf68, 0xc00007bda8, 0xc0000b8100?, 0x0, 0xc0000e5d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00007bd40 sp=0xc00007bc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0002d8000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc00007bfc8 sp=0xc00007bd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc00007bfe0 sp=0xc00007bfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007bfe8 sp=0xc00007bfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 68 [select, 62 minutes]:
runtime.gopark(0xc00007af68?, 0x4?, 0x3?, 0x0?, 0xc00007adb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007ac00 sp=0xc00007abe0 pc=0x4404d6
runtime.selectgo(0xc00007af68, 0xc00007ada8, 0xc0000b8400?, 0x0, 0xc0000e5501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00007ad40 sp=0xc00007ac00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc00016f560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc00007afc8 sp=0xc00007ad40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc00007afe0 sp=0xc00007afc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007afe8 sp=0xc00007afe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 69 [select, 62 minutes]:
runtime.gopark(0xc000292f90?, 0x2?, 0xd8?, 0x2d?, 0xc000292f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000292d90 sp=0xc000292d70 pc=0x4404d6
runtime.selectgo(0xc000292f90, 0xc000292f20, 0xc00041e100?, 0x0, 0xc0004c2330?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000292ed0 sp=0xc000292d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc00016f560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000292fc8 sp=0xc000292ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000292fe0 sp=0xc000292fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000292fe8 sp=0xc000292fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 44 [select, 62 minutes]:
runtime.gopark(0xc00007ff90?, 0x2?, 0xd8?, 0xfd?, 0xc00007ff24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007fd90 sp=0xc00007fd70 pc=0x4404d6
runtime.selectgo(0xc00007ff90, 0xc00007ff20, 0xc0000b8380?, 0x0, 0xc0004c25a0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00007fed0 sp=0xc00007fd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0002d8000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00007ffc8 sp=0xc00007fed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc00007ffe0 sp=0xc00007ffc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007ffe8 sp=0xc00007ffe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 134 [IO wait, 57 minutes]:
runtime.gopark(0x1d32?, 0xb?, 0x0?, 0x0?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0093ed9a0 sp=0xc0093ed980 pc=0x4404d6
runtime.netpollblock(0x484d05?, 0x447885?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0093ed9d8 sp=0xc0093ed9a0 pc=0x438cb7
internal/poll.runtime_pollWait(0x7f61a81146c8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0093ed9f8 sp=0xc0093ed9d8 pc=0x46c0c9
internal/poll.(*pollDesc).wait(0xc00021c500?, 0xc000651000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0093eda20 sp=0xc0093ed9f8 pc=0x4a5f32
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00021c500, {0xc000651000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0093edaa0 sp=0xc0093eda20 pc=0x4a729a
net.(*netFD).Read(0xc00021c500, {0xc000651000?, 0x1c0000a60f0?, 0x7f619a38a500?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0093edae8 sp=0xc0093edaa0 pc=0x684429
net.(*conn).Read(0xc000210250, {0xc000651000?, 0x569946?, 0xc00017c3e8?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0093edb30 sp=0xc0093edae8 pc=0x6946a5
net/http.(*persistConn).Read(0xc000228480, {0xc000651000?, 0xf168c0?, 0xc0093ede08?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc0093edb90 sp=0xc0093edb30 pc=0x787b2e
bufio.(*Reader).fill(0xc000239200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc0093edbc8 sp=0xc0093edb90 pc=0x52671f
bufio.(*Reader).ReadSlice(0xc000239200, 0x81?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc0093edc18 sp=0xc0093edbc8 pc=0x52730f
net/http/internal.readChunkLine(0x944?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0093edc68 sp=0xc0093edc18 pc=0x725285
net/http/internal.(*chunkedReader).beginChunk(0xc0093e4060)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0093edc98 sp=0xc0093edc68 pc=0x724ce8
net/http/internal.(*chunkedReader).Read(0xc0093e4060, {0xc0093f4000?, 0xc00022a1b0?, 0xc0093e4090?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc0093edd18 sp=0xc0093edc98 pc=0x724fb6
net/http.(*body).readLocked(0xc005f88bc0, {0xc0093f4000?, 0xc00017c450?, 0xffbb00?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc0093edd68 sp=0xc0093edd18 pc=0x77c65c
net/http.(*body).Read(0x0?, {0xc0093f4000?, 0x56953e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc0093edde0 sp=0xc0093edd68 pc=0x77c525
net/http.(*bodyEOFSignal).Read(0xc005f88c40, {0xc0093f4000, 0x1e00, 0x1e00})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc0093ede60 sp=0xc0093edde0 pc=0x78c202
encoding/json.(*Decoder).refill(0xc00017c3c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0093edeb0 sp=0xc0093ede60 pc=0x57c668
encoding/json.(*Decoder).readValue(0xc00017c3c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0093edf00 sp=0xc0093edeb0 pc=0x57c25b
encoding/json.(*Decoder).Decode(0xc00017c3c0, {0xef5e80, 0xc0000a60f0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0093edf30 sp=0xc0093edf00 pc=0x57be98
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc0093edfe0 sp=0xc0093edf30 pc=0xa21a0b
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0093edfe8 sp=0xc0093edfe0 pc=0x471ba1
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb
goroutine 73 [select, 62 minutes]:
runtime.gopark(0xc0000cbd80?, 0x2?, 0x4b?, 0xce?, 0xc0000cbc7c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000cbae8 sp=0xc0000cbac8 pc=0x4404d6
runtime.selectgo(0xc0000cbd80, 0xc0000cbc78, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000cbc28 sp=0xc0000cbae8 pc=0x45035c
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint(0xc0000a41b0?, {0xc0002e60f0, 0x24}, 0xc0000a41c8, 0xc0000a41b0, 0xc000254000)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:503 +0x6da fp=0xc0000cbed0 sp=0xc0000cbc28 pc=0x8452da
github.com/couchbase/indexing/secondary/dcp.(*Client).RunObserveNodeServices(0xc0000ba000?, {0x10d73b5?, 0x0?}, 0x0?, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:411 +0xbc fp=0xc0000cbf40 sp=0xc0000cbed0 pc=0x8446dc
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunServicesObserver(0xc0000ba000)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:159 +0x59 fp=0xc0000cbfc8 sp=0xc0000cbf40 pc=0xb40599
github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier.func3()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:282 +0x26 fp=0xc0000cbfe0 sp=0xc0000cbfc8 pc=0xb419a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000cbfe8 sp=0xc0000cbfe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:282 +0x54d
goroutine 731 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1c09cc0?, 0x3?, 0xa?, 0x7?, 0xc0004b9ec8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b9f50 sp=0xc0004b9f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b9fe0 sp=0xc0004b9f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b9fe8 sp=0xc0004b9fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 58 [select]:
runtime.gopark(0xc000155d08?, 0x4?, 0x2?, 0x0?, 0xc000155c90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000155b08 sp=0xc000155ae8 pc=0x4404d6
runtime.selectgo(0xc000155d08, 0xc000155c88, 0xc002110eb0?, 0x0, 0xc0068ca101?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000155c48 sp=0xc000155b08 pc=0x45035c
github.com/couchbase/gometa/protocol.runWatcher(0xc002ae5f00, {0x12835b0, 0xc000162180}, {0x12939b8?, 0xc000162180}, {0x1291c20?, 0x1c08a58}, 0xc0001660e0, 0xc0002f88a0, 0xc000166150, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:357 +0x3be fp=0xc000155d60 sp=0xc000155c48 pc=0xcb13fe
github.com/couchbase/gometa/protocol.runOnce(0x3, {0xc00028b150, 0xe}, {0x12835b0, 0xc000162180}, {0x12939b8, 0xc000162180}, {0x1291c20, 0x1c08a58}, 0xc0001660e0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:213 +0x525 fp=0xc000155e90 sp=0xc000155d60 pc=0xcb04a5
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc00028b150, 0xe}, {0x12835b0, 0xc000162180}, {0x12939b8, 0xc000162180}, {0x1291c20, 0x1c08a58}, 0xc0001660e0, 0xc0002f88a0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:65 +0x174 fp=0xc000155f68 sp=0xc000155e90 pc=0xcafdd4
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x9f fp=0xc000155fe0 sp=0xc000155f68 pc=0xd1d59f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000155fe8 sp=0xc000155fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x1f8
goroutine 150 [select, 51 minutes]:
runtime.gopark(0xc0000d5d08?, 0x4?, 0x4b?, 0xce?, 0xc0000d5c90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000d5b08 sp=0xc0000d5ae8 pc=0x4404d6
runtime.selectgo(0xc0000d5d08, 0xc0000d5c88, 0xc0000d5c70?, 0x0, 0xc006195701?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000d5c48 sp=0xc0000d5b08 pc=0x45035c
github.com/couchbase/gometa/protocol.runWatcher(0xc006796c80, {0x12835b0, 0xc00027c3c0}, {0x12939b8?, 0xc00027c3c0}, {0x1291c20?, 0x1c08a58}, 0xc0001664d0, 0xc0090e33e0, 0xc000166540, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:357 +0x3be fp=0xc0000d5d60 sp=0xc0000d5c48 pc=0xcb13fe
github.com/couchbase/gometa/protocol.runOnce(0x3, {0xc0036b47a0, 0xe}, {0x12835b0, 0xc00027c3c0}, {0x12939b8, 0xc00027c3c0}, {0x1291c20, 0x1c08a58}, 0xc0001664d0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:213 +0x525 fp=0xc0000d5e90 sp=0xc0000d5d60 pc=0xcb04a5
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc0036b47a0, 0xe}, {0x12835b0, 0xc00027c3c0}, {0x12939b8, 0xc00027c3c0}, {0x1291c20, 0x1c08a58}, 0xc0001664d0, 0xc0090e33e0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:65 +0x174 fp=0xc0000d5f68 sp=0xc0000d5e90 pc=0xcafdd4
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x9f fp=0xc0000d5fe0 sp=0xc0000d5f68 pc=0xd1d59f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000d5fe8 sp=0xc0000d5fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x1f8
goroutine 122 [select]:
runtime.gopark(0xc0000e4f98?, 0x2?, 0x51?, 0x1c?, 0xc0000e4f8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e4e18 sp=0xc0000e4df8 pc=0x4404d6
runtime.selectgo(0xc0000e4f98, 0xc0000e4f88, 0x52092b?, 0x0, 0x300000000d555c5?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000e4f58 sp=0xc0000e4e18 pc=0x45035c
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc007e04120)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2396 +0x92 fp=0xc0000e4fc8 sp=0xc0000e4f58 pc=0xd5cb12
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2189 +0x26 fp=0xc0000e4fe0 sp=0xc0000e4fc8 pc=0xd5b486
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e4fe8 sp=0xc0000e4fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2189 +0x296
goroutine 5437 [select, 45 minutes]:
runtime.gopark(0xc007fabf68?, 0x4?, 0x3?, 0x0?, 0xc007fabdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007fabc00 sp=0xc007fabbe0 pc=0x4404d6
runtime.selectgo(0xc007fabf68, 0xc007fabda8, 0xc043799b00?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007fabd40 sp=0xc007fabc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0220a47e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007fabfc8 sp=0xc007fabd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007fabfe0 sp=0xc007fabfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007fabfe8 sp=0xc007fabfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 733 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f16036bd09a?, 0x3?, 0x41?, 0x37?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006cf50 sp=0xc00006cf30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006cfe0 sp=0xc00006cf50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 766 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602dff2b7?, 0x1?, 0xd5?, 0xb9?, 0x52092b?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e2750 sp=0xc0000e2730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e27e0 sp=0xc0000e2750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e27e8 sp=0xc0000e27e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 64 [select]:
runtime.gopark(0xc0004b4790?, 0x2?, 0xa9?, 0x3e?, 0xc0004b4774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b45f8 sp=0xc0004b45d8 pc=0x4404d6
runtime.selectgo(0xc0004b4790, 0xc0004b4770, 0xc0002c0230?, 0x0, 0xc0004b47d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0004b4738 sp=0xc0004b45f8 pc=0x45035c
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc000162180)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6530 +0xcd fp=0xc0004b47c8 sp=0xc0004b4738 pc=0xd2b92d
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x26 fp=0xc0004b47e0 sp=0xc0004b47c8 pc=0xd2b826
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b47e8 sp=0xc0004b47e0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x8d
goroutine 98 [chan send, 62 minutes]:
runtime.gopark(0xb3ad68?, 0xc0077c8000?, 0x1a?, 0x19?, 0x111aaa0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007dd60 sp=0xc00007dd40 pc=0x4404d6
runtime.chansend(0xc0001188a0, 0x127a958, 0x1, 0xc00015bd01?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:259 +0x42c fp=0xc00007dde8 sp=0xc00007dd60 pc=0x40ba6c
runtime.chansend1(0xc0000442d0?, 0x2c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:145 +0x1d fp=0xc00007de18 sp=0xc00007dde8 pc=0x40b61d
github.com/couchbase/indexing/secondary/common.(*internalVersionMonitor).notifier(0xc00044a150)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:743 +0x465 fp=0xc00007dfc8 sp=0xc00007de18 pc=0xb3b4c5
github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:236 +0x26 fp=0xc00007dfe0 sp=0xc00007dfc8 pc=0xb36be6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007dfe8 sp=0xc00007dfe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:236 +0x3e5
goroutine 101 [chan receive, 1 minutes]:
runtime.gopark(0xc0004134a0?, 0xc0002ddf90?, 0x20?, 0xdf?, 0xc00041e200?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002ddec8 sp=0xc0002ddea8 pc=0x4404d6
runtime.chanrecv(0xc0002802a0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0002ddf58 sp=0xc0002ddec8 pc=0x40c87b
runtime.chanrecv1(0xc0000220b0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc0002ddf80 sp=0xc0002ddf58 pc=0x40c378
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc0000220b0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1412 +0x79 fp=0xc0002ddfc8 sp=0xc0002ddf80 pc=0xd555b9
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x26 fp=0xc0002ddfe0 sp=0xc0002ddfc8 pc=0xd4df26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002ddfe8 sp=0xc0002ddfe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x616
goroutine 118 [semacquire, 56 minutes]:
runtime.gopark(0xc0094704a0?, 0xf?, 0x60?, 0x9e?, 0x1?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00882bb88 sp=0xc00882bb68 pc=0x4404d6
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.semacquire1(0xc0000ba004, 0x10?, 0x3, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:150 +0x1fe fp=0xc00882bbf0 sp=0xc00882bb88 pc=0x45141e
sync.runtime_SemacquireMutex(0x4132ff?, 0x3c?, 0x2?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:77 +0x25 fp=0xc00882bc20 sp=0xc00882bbf0 pc=0x46daa5
sync.(*Mutex).lockSlow(0xc0000ba000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:171 +0x165 fp=0xc00882bc70 sp=0xc00882bc20 pc=0x47aee5
sync.(*Mutex).Lock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:90
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback.func1(0xc0098bcf20?, 0xc00882bd28?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:129 +0x50 fp=0xc00882bcc8 sp=0xc00882bc70 pc=0xb402d0
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback(0xc0000ba000, {0xc007dd8180, 0x1, 0x103a4e0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:132 +0x16a fp=0xc00882bdc8 sp=0xc00882bcc8 pc=0xb3ffea
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).getNotifyCallback.func1({0x103a4e0?, 0xc009470460?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:83 +0x2ad fp=0xc00882bf98 sp=0xc00882bdc8 pc=0xb3f96d
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:493 +0x76 fp=0xc00882bfe0 sp=0xc00882bf98 pc=0x845736
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00882bfe8 sp=0xc00882bfe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:475 +0x665
goroutine 48 [select, 62 minutes]:
runtime.gopark(0xc000268f68?, 0x4?, 0x3?, 0x0?, 0xc000268db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000268c00 sp=0xc000268be0 pc=0x4404d6
runtime.selectgo(0xc000268f68, 0xc000268da8, 0xc00062c340?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000268d40 sp=0xc000268c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0002d85a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000268fc8 sp=0xc000268d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000268fe0 sp=0xc000268fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000268fe8 sp=0xc000268fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 117 [select, 62 minutes]:
runtime.gopark(0xc0002def90?, 0x2?, 0xd8?, 0xed?, 0xc0002def24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002ded90 sp=0xc0002ded70 pc=0x4404d6
runtime.selectgo(0xc0002def90, 0xc0002def20, 0xc00062c100?, 0x0, 0xc000282570?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0002deed0 sp=0xc0002ded90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0000b2120)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0002defc8 sp=0xc0002deed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0002defe0 sp=0xc0002defc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002defe8 sp=0xc0002defe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 104 [semacquire, 34 minutes]:
runtime.gopark(0xc00016e360?, 0xc00016e3f0?, 0xd0?, 0x14?, 0xc023300000?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0006a5ce0 sp=0xc0006a5cc0 pc=0x4404d6
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.semacquire1(0xc0000ba004, 0x68?, 0x3, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:150 +0x1fe fp=0xc0006a5d48 sp=0xc0006a5ce0 pc=0x45141e
sync.runtime_SemacquireMutex(0xc016042760?, 0xf8?, 0xc0000bddf8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:77 +0x25 fp=0xc0006a5d78 sp=0xc0006a5d48 pc=0x46daa5
sync.(*Mutex).lockSlow(0xc0000ba000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:171 +0x165 fp=0xc0006a5dc8 sp=0xc0006a5d78 pc=0x47aee5
sync.(*Mutex).Lock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:90
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).getNotifyCallback.func1({0xef77c0?, 0xc0020514c0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:58 +0x99 fp=0xc0006a5f98 sp=0xc0006a5dc8 pc=0xb3f759
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:493 +0x76 fp=0xc0006a5fe0 sp=0xc0006a5f98 pc=0x845736
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0006a5fe8 sp=0xc0006a5fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:475 +0x665
goroutine 78 [select, 62 minutes]:
runtime.gopark(0xc0000c5d28?, 0x2?, 0x4b?, 0xce?, 0xc0000c5c24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000c5a90 sp=0xc0000c5a70 pc=0x4404d6
runtime.selectgo(0xc0000c5d28, 0xc0000c5c20, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000c5bd0 sp=0xc0000c5a90 pc=0x45035c
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint(0x18?, {0xc0004db520, 0x19}, 0xc0000a4660, 0xc0000a4648, 0xc000254000)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:503 +0x6da fp=0xc0000c5e78 sp=0xc0000c5bd0 pc=0x8452da
github.com/couchbase/indexing/secondary/dcp.(*Client).RunObserveCollectionManifestChanges(0xc0000ba000?, {0x10d73b5?, 0x0?}, {0xc000138b88?, 0x0?}, 0x1000000000001?, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:426 +0xc7 fp=0xc0000c5ef8 sp=0xc0000c5e78 pc=0x8449c7
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunObserveCollectionManifestChanges(0xc0000ba000, {0xc000138b88, 0x7})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:169 +0x86 fp=0xc0000c5fb8 sp=0xc0000c5ef8 pc=0xb40726
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:140 +0x2e fp=0xc0000c5fe0 sp=0xc0000c5fb8 pc=0xb4024e
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000c5fe8 sp=0xc0000c5fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:140 +0x295
goroutine 76 [select, 61 minutes]:
runtime.gopark(0xc000295f68?, 0x4?, 0x4b?, 0xce?, 0xc000295db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000295c00 sp=0xc000295be0 pc=0x4404d6
runtime.selectgo(0xc000295f68, 0xc000295da8, 0xc005f88ac0?, 0x0, 0xc0002e6001?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000295d40 sp=0xc000295c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc000228240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000295fc8 sp=0xc000295d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000295fe0 sp=0xc000295fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000295fe8 sp=0xc000295fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 77 [select, 61 minutes]:
runtime.gopark(0xc000264f90?, 0x2?, 0xd8?, 0x4d?, 0xc000264f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000264d90 sp=0xc000264d70 pc=0x4404d6
runtime.selectgo(0xc000264f90, 0xc000264f20, 0xc000218280?, 0x0, 0xc007e04570?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000264ed0 sp=0xc000264d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc000228240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000264fc8 sp=0xc000264ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000264fe0 sp=0xc000264fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000264fe8 sp=0xc000264fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 121 [select, 57 minutes]:
runtime.gopark(0xc00934dbc0?, 0x3?, 0x0?, 0x0?, 0xc00934db3a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009f99998 sp=0xc009f99978 pc=0x4404d6
runtime.selectgo(0xc009f99bc0, 0xc00934db34, 0xc00933d000?, 0x0, 0xef1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009f99ad8 sp=0xc009f99998 pc=0x45035c
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc0001a64c0?, {0x10e53b4, 0x13}, 0xc009f99e88, 0xc0090e21e0)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc009f99e60 sp=0xc009f99ad8 pc=0xa21589
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x10e53b4?, 0x4b?}, 0x56?, 0x49?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc009f99ea8 sp=0xc009f99e60 pc=0xa21b18
github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings.func1.1(0xc0000e5701?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:85 +0xcc fp=0xc009f99f28 sp=0xc009f99ea8 pc=0xd7724c
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc009f99fa8)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc009f99f60 sp=0xc009f99f28 pc=0xb3e4e3
github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:89 +0x75 fp=0xc009f99fe0 sp=0xc009f99f60 pc=0xd77135
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009f99fe8 sp=0xc009f99fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:80 +0x1ef
goroutine 106 [select, 61 minutes]:
runtime.gopark(0xc000297f68?, 0x4?, 0x3?, 0x0?, 0xc000297db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000297c00 sp=0xc000297be0 pc=0x4404d6
runtime.selectgo(0xc000297f68, 0xc000297da8, 0xc005f88bc0?, 0x0, 0xc0004b7d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000297d40 sp=0xc000297c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc000228480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000297fc8 sp=0xc000297d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000297fe0 sp=0xc000297fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000297fe8 sp=0xc000297fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 105 [sleep]:
runtime.gopark(0x1f425a8603b3?, 0xc0000e0f18?, 0xc5?, 0xcd?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e0ee8 sp=0xc0000e0ec8 pc=0x4404d6
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc0000e0f28 sp=0xc0000e0ee8 pc=0x46ea15
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc000248160)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:461 +0xa5 fp=0xc0000e0fc8 sp=0xc0000e0f28 pc=0xd4d645
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc0000e0fe0 sp=0xc0000e0fc8 pc=0xd4a8a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e0fe8 sp=0xc0000e0fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x4b6
goroutine 107 [select, 61 minutes]:
runtime.gopark(0xc0002e0f90?, 0x2?, 0xd8?, 0xd?, 0xc0002e0f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002e0d90 sp=0xc0002e0d70 pc=0x4404d6
runtime.selectgo(0xc0002e0f90, 0xc0002e0f20, 0xc00041f700?, 0x0, 0xc007e04540?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0002e0ed0 sp=0xc0002e0d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc000228480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0002e0fc8 sp=0xc0002e0ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0002e0fe0 sp=0xc0002e0fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002e0fe8 sp=0xc0002e0fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 119 [semacquire, 56 minutes]:
runtime.gopark(0xc00024d300?, 0xc00024ddb0?, 0xd0?, 0x34?, 0x7f6199ed9678?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ecbce0 sp=0xc007ecbcc0 pc=0x4404d6
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.semacquire1(0xc0000ba004, 0x68?, 0x3, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:150 +0x1fe fp=0xc007ecbd48 sp=0xc007ecbce0 pc=0x45141e
sync.runtime_SemacquireMutex(0x20?, 0x2?, 0xc0000bfdf8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:77 +0x25 fp=0xc007ecbd78 sp=0xc007ecbd48 pc=0x46daa5
sync.(*Mutex).lockSlow(0xc0000ba000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:171 +0x165 fp=0xc007ecbdc8 sp=0xc007ecbd78 pc=0x47aee5
sync.(*Mutex).Lock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:90
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).getNotifyCallback.func1({0x10ab2a0?, 0xc002ca69c0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:58 +0x99 fp=0xc007ecbf98 sp=0xc007ecbdc8 pc=0xb3f759
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:493 +0x76 fp=0xc007ecbfe0 sp=0xc007ecbf98 pc=0x845736
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ecbfe8 sp=0xc007ecbfe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:475 +0x665
goroutine 81 [select]:
runtime.gopark(0xc000298f90?, 0x2?, 0x0?, 0x0?, 0xc000298f8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000298e18 sp=0xc000298df8 pc=0x4404d6
runtime.selectgo(0xc000298f90, 0xc000298f88, 0x0?, 0x0, 0x128acb0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000298f58 sp=0xc000298e18 pc=0x45035c
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc000040480, 0xc00010e540)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1830 +0x6e fp=0xc000298fc0 sp=0xc000298f58 pc=0xd4918e
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x2a fp=0xc000298fe0 sp=0xc000298fc0 pc=0xd490ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000298fe8 sp=0xc000298fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x298
goroutine 130 [select, 1 minutes]:
runtime.gopark(0xc0004b9750?, 0x2?, 0x0?, 0x30?, 0xc0004b9714?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b9590 sp=0xc0004b9570 pc=0x4404d6
runtime.selectgo(0xc0004b9750, 0xc0004b9710, 0x10f4788?, 0x0, 0xc0004b9720?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0004b96d0 sp=0xc0004b9590 pc=0x45035c
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc000040480, 0xc00010e540)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1849 +0x238 fp=0xc0004b97c0 sp=0xc0004b96d0 pc=0xd493f8
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2a fp=0xc0004b97e0 sp=0xc0004b97c0 pc=0xd4908a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b97e8 sp=0xc0004b97e0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2fa
goroutine 133 [IO wait]:
runtime.gopark(0x54f?, 0xb?, 0x0?, 0x0?, 0xf?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0093ec9a0 sp=0xc0093ec980 pc=0x4404d6
runtime.netpollblock(0x484d05?, 0x4a5c25?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0093ec9d8 sp=0xc0093ec9a0 pc=0x438cb7
internal/poll.runtime_pollWait(0x7f61a81147b8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0093ec9f8 sp=0xc0093ec9d8 pc=0x46c0c9
internal/poll.(*pollDesc).wait(0xc00021c280?, 0xc0000da000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0093eca20 sp=0xc0093ec9f8 pc=0x4a5f32
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00021c280, {0xc0000da000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0093ecaa0 sp=0xc0093eca20 pc=0x4a729a
net.(*netFD).Read(0xc00021c280, {0xc0000da000?, 0xc0000a60a0?, 0x57923f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0093ecae8 sp=0xc0093ecaa0 pc=0x684429
net.(*conn).Read(0xc0001283a0, {0xc0000da000?, 0x569946?, 0xc00017c2a8?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0093ecb30 sp=0xc0093ecae8 pc=0x6946a5
net/http.(*persistConn).Read(0xc000228240, {0xc0000da000?, 0xf168c0?, 0xc0093ece08?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc0093ecb90 sp=0xc0093ecb30 pc=0x787b2e
bufio.(*Reader).fill(0xc0004c8a20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc0093ecbc8 sp=0xc0093ecb90 pc=0x52671f
bufio.(*Reader).ReadSlice(0xc0004c8a20, 0x81?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc0093ecc18 sp=0xc0093ecbc8 pc=0x52730f
net/http/internal.readChunkLine(0x5a5?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0093ecc68 sp=0xc0093ecc18 pc=0x725285
net/http/internal.(*chunkedReader).beginChunk(0xc0093e4000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0093ecc98 sp=0xc0093ecc68 pc=0x724ce8
net/http/internal.(*chunkedReader).Read(0xc0093e4000, {0xc008719800?, 0xc00022a1b0?, 0xc0093e5740?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc0093ecd18 sp=0xc0093ecc98 pc=0x724fb6
net/http.(*body).readLocked(0xc005f88ac0, {0xc008719800?, 0xc00017c310?, 0xffbb00?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc0093ecd68 sp=0xc0093ecd18 pc=0x77c65c
net/http.(*body).Read(0x0?, {0xc008719800?, 0x56953e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc0093ecde0 sp=0xc0093ecd68 pc=0x77c525
net/http.(*bodyEOFSignal).Read(0xc005f88b40, {0xc008719800, 0x600, 0x600})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc0093ece60 sp=0xc0093ecde0 pc=0x78c202
encoding/json.(*Decoder).refill(0xc00017c280)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0093eceb0 sp=0xc0093ece60 pc=0x57c668
encoding/json.(*Decoder).readValue(0xc00017c280)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0093ecf00 sp=0xc0093eceb0 pc=0x57c25b
encoding/json.(*Decoder).Decode(0xc00017c280, {0xef5e80, 0xc0000a60a0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0093ecf30 sp=0xc0093ecf00 pc=0x57be98
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc0093ecfe0 sp=0xc0093ecf30 pc=0xa21a0b
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0093ecfe8 sp=0xc0093ecfe0 pc=0x471ba1
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb
goroutine 109 [select]:
runtime.gopark(0xc0000c9ba0?, 0x3?, 0x6?, 0x30?, 0xc0000c9b1a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000c9978 sp=0xc0000c9958 pc=0x4404d6
runtime.selectgo(0xc0000c9ba0, 0xc0000c9b14, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000c9ab8 sp=0xc0000c9978 pc=0x45035c
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc0001a64c0?, {0x10f0835, 0x1b}, 0xc0000c9e68, 0xc000118d20)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc0000c9e40 sp=0xc0000c9ab8 pc=0xa21589
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x10f0835?, 0x789940?}, 0x10000c0002d8000?, 0xc0000e6e20?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc0000c9e88 sp=0xc0000c9e40 pc=0xa21b18
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0xc00018e1c0?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1607 +0xc7 fp=0xc0000c9f00 sp=0xc0000c9e88 pc=0xc02087
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc0000c9fa0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc0000c9f38 sp=0xc0000c9f00 pc=0xb3e4e3
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1612 +0xdf fp=0xc0000c9fe0 sp=0xc0000c9f38 pc=0xc01f3f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000c9fe8 sp=0xc0000c9fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1600 +0xaf
goroutine 96 [select]:
runtime.gopark(0xc0025bff68?, 0x5?, 0xb0?, 0xa1?, 0xc0025bfdf6?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0016bfc60 sp=0xc0016bfc40 pc=0x4404d6
runtime.selectgo(0xc0016bff68, 0xc0025bfdec, 0x10d73b5?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0016bfda0 sp=0xc0016bfc60 pc=0x45035c
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges(0xc000022160)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2088 +0x33c fp=0xc0016bffc8 sp=0xc0016bfda0 pc=0xd5aafc
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:151 +0x26 fp=0xc0016bffe0 sp=0xc0016bffc8 pc=0xd4df86
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0016bffe8 sp=0xc0016bffe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:151 +0x5d6
goroutine 768 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1c09cc0?, 0x1?, 0x4e?, 0x8d?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b7f50 sp=0xc0004b7f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b7fe0 sp=0xc0004b7f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b7fe8 sp=0xc0004b7fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 818 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602df36c1?, 0x3?, 0xcb?, 0x48?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aca3750 sp=0xc00aca3730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00aca37e0 sp=0xc00aca3750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aca37e8 sp=0xc00aca37e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 154 [select]:
runtime.gopark(0xc0004b5f90?, 0x2?, 0xa9?, 0x3e?, 0xc0004b5f74?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b5df8 sp=0xc0004b5dd8 pc=0x4404d6
runtime.selectgo(0xc0004b5f90, 0xc0004b5f70, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0004b5f38 sp=0xc0004b5df8 pc=0x45035c
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc00027c3c0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6530 +0xcd fp=0xc0004b5fc8 sp=0xc0004b5f38 pc=0xd2b92d
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x26 fp=0xc0004b5fe0 sp=0xc0004b5fc8 pc=0xd2b826
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b5fe8 sp=0xc0004b5fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x8d
goroutine 97 [chan receive, 1 minutes]:
runtime.gopark(0xc000413140?, 0xc00025d490?, 0x0?, 0x0?, 0xc0090e38c0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ec4ec8 sp=0xc007ec4ea8 pc=0x4404d6
runtime.chanrecv(0xc007de82a0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc007ec4f58 sp=0xc007ec4ec8 pc=0x40c87b
runtime.chanrecv1(0xc000022160?, 0xc0090e2a20?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc007ec4f80 sp=0xc007ec4f58 pc=0x40c378
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc000022160)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1412 +0x79 fp=0xc007ec4fc8 sp=0xc007ec4f80 pc=0xd555b9
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x26 fp=0xc007ec4fe0 sp=0xc007ec4fc8 pc=0xd4df26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ec4fe8 sp=0xc007ec4fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x616
goroutine 129 [sleep]:
runtime.gopark(0x1f42900eefa2?, 0xc0004b6718?, 0xc5?, 0xcd?, 0x1?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b66e8 sp=0xc0004b66c8 pc=0x4404d6
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc0004b6728 sp=0xc0004b66e8 pc=0x46ea15
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc00014c420)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:461 +0xa5 fp=0xc0004b67c8 sp=0xc0004b6728 pc=0xd4d645
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc0004b67e0 sp=0xc0004b67c8 pc=0xd4a8a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b67e8 sp=0xc0004b67e0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x4b6
goroutine 162 [select]:
runtime.gopark(0xc007ec5f90?, 0x2?, 0x0?, 0x0?, 0xc007ec5f8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ec5e18 sp=0xc007ec5df8 pc=0x4404d6
runtime.selectgo(0xc007ec5f90, 0xc007ec5f88, 0x94?, 0x0, 0x7?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ec5f58 sp=0xc007ec5e18 pc=0x45035c
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc007e02000, 0xc000166310)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1830 +0x6e fp=0xc007ec5fc0 sp=0xc007ec5f58 pc=0xd4918e
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x2a fp=0xc007ec5fe0 sp=0xc007ec5fc0 pc=0xd490ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ec5fe8 sp=0xc007ec5fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x298
goroutine 163 [select, 1 minutes]:
runtime.gopark(0xc007eaff50?, 0x2?, 0x4b?, 0xce?, 0xc007eaff14?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eafd90 sp=0xc007eafd70 pc=0x4404d6
runtime.selectgo(0xc007eaff50, 0xc007eaff10, 0x10f4788?, 0x0, 0xc007eaff20?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007eafed0 sp=0xc007eafd90 pc=0x45035c
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc007e02000, 0xc000166310)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1849 +0x238 fp=0xc007eaffc0 sp=0xc007eafed0 pc=0xd493f8
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2a fp=0xc007eaffe0 sp=0xc007eaffc0 pc=0xd4908a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eaffe8 sp=0xc007eaffe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2fa
goroutine 732 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602beb8bb?, 0x3?, 0xad?, 0x4?, 0x52092b?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006c750 sp=0xc00006c730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006c7e0 sp=0xc00006c750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006c7e8 sp=0xc00006c7e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 797 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f160356731a?, 0x3?, 0x8a?, 0x0?, 0x94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eaaf50 sp=0xc007eaaf30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007eaafe0 sp=0xc007eaaf50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eaafe8 sp=0xc007eaafe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 166 [chan receive]:
runtime.gopark(0x0?, 0x56?, 0x50?, 0x2e?, 0x49d598?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000262da8 sp=0xc000262d88 pc=0x4404d6
runtime.chanrecv(0xc00940cd80, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000262e38 sp=0xc000262da8 pc=0x40c87b
runtime.chanrecv1(0xc002931ec0?, 0x56?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc000262e60 sp=0xc000262e38 pc=0x40c378
github.com/couchbase/indexing/secondary/queryport/n1ql.(*monitor).backfillMonitor(0xc007830320, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:91 +0x9b fp=0xc000262fc0 sp=0xc000262e60 pc=0xd8503b
github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:40 +0x2a fp=0xc000262fe0 sp=0xc000262fc0 pc=0xd848ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000262fe8 sp=0xc000262fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:40 +0xb8
goroutine 167 [chan receive, 1 minutes]:
runtime.gopark(0xc00940cb40?, 0xc0004b2de8?, 0xff?, 0x32?, 0x7f6199ed2848?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b2d68 sp=0xc0004b2d48 pc=0x4404d6
runtime.chanrecv(0xc00940cde0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0004b2df8 sp=0xc0004b2d68 pc=0x40c87b
runtime.chanrecv1(0xc0004b2eb8?, 0x7?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc0004b2e20 sp=0xc0004b2df8 pc=0x40c378
github.com/couchbase/indexing/secondary/queryport/n1ql.(*monitor).logStats(0xc007830320, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:124 +0x9b fp=0xc0004b2fc0 sp=0xc0004b2e20 pc=0xd8541b
github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:41 +0x2a fp=0xc0004b2fe0 sp=0xc0004b2fc0 pc=0xd8488a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b2fe8 sp=0xc0004b2fe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:41 +0x10a
goroutine 795 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602b2e8c5?, 0x3?, 0x6f?, 0x6b?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ea9f50 sp=0xc007ea9f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007ea9fe0 sp=0xc007ea9f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ea9fe8 sp=0xc007ea9fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 3111 [IO wait]:
runtime.gopark(0x46f9ce?, 0xb?, 0x0?, 0x0?, 0x14?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a27cb0 sp=0xc002a27c90 pc=0x4404d6
runtime.netpollblock(0x484d05?, 0xfaa7a0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc002a27ce8 sp=0xc002a27cb0 pc=0x438cb7
internal/poll.runtime_pollWait(0x7f61a8114d58, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc002a27d08 sp=0xc002a27ce8 pc=0x46c0c9
internal/poll.(*pollDesc).wait(0xc007dd9f80?, 0xc012112b00?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc002a27d30 sp=0xc002a27d08 pc=0x4a5f32
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc007dd9f80, {0xc012112b00, 0x8, 0x8})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc002a27db0 sp=0xc002a27d30 pc=0x4a729a
net.(*netFD).Read(0xc007dd9f80, {0xc012112b00?, 0xc002a27e30?, 0x455612?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc002a27df8 sp=0xc002a27db0 pc=0x684429
net.(*conn).Read(0xc004bf6d90, {0xc012112b00?, 0xc002a27ed8?, 0xbfbb8f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc002a27e40 sp=0xc002a27df8 pc=0x6946a5
github.com/couchbase/gometa/common.(*PeerPipe).readBytes(0xc002ae5f00, 0x128bb20?, {0x0?, 0xc03e3bdc40?, 0xc008284300?})
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:313 +0xcf fp=0xc002a27ee8 sp=0xc002a27e40 pc=0xbfbccf
github.com/couchbase/gometa/common.(*PeerPipe).doReceive(0xc002ae5f00)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:214 +0xd5 fp=0xc002a27fc8 sp=0xc002a27ee8 pc=0xbfae35
github.com/couchbase/gometa/common.NewPeerPipe.func2()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x26 fp=0xc002a27fe0 sp=0xc002a27fc8 pc=0xbf9ea6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a27fe8 sp=0xc002a27fe0 pc=0x471ba1
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x18a
goroutine 829 [select, 56 minutes]:
runtime.gopark(0xc0086d4f68?, 0x4?, 0x3?, 0x0?, 0xc0086d4db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0086d4c00 sp=0xc0086d4be0 pc=0x4404d6
runtime.selectgo(0xc0086d4f68, 0xc0086d4da8, 0xc00adc7a40?, 0x0, 0x4eac01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0086d4d40 sp=0xc0086d4c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc00574c360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0086d4fc8 sp=0xc0086d4d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0086d4fe0 sp=0xc0086d4fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0086d4fe8 sp=0xc0086d4fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 3110 [chan receive]:
runtime.gopark(0x4a9460?, 0xc007dd9f80?, 0x28?, 0xae?, 0xc00882ae88?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00882ae28 sp=0xc00882ae08 pc=0x4404d6
runtime.chanrecv(0xc0081dfc80, 0xc00882af90, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00882aeb8 sp=0xc00882ae28 pc=0x40c87b
runtime.chanrecv2(0xc004bf6d90?, 0xc0028b6900?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc00882aee0 sp=0xc00882aeb8 pc=0x40c3b8
github.com/couchbase/gometa/common.(*PeerPipe).doSend(0xc002ae5f00)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:167 +0x9e fp=0xc00882afc8 sp=0xc00882aee0 pc=0xbfa65e
github.com/couchbase/gometa/common.NewPeerPipe.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x26 fp=0xc00882afe0 sp=0xc00882afc8 pc=0xbf9f06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00882afe8 sp=0xc00882afe0 pc=0x471ba1
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x14d
goroutine 776 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f16033edaf9?, 0x3?, 0x14?, 0x2b?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e1f50 sp=0xc0000e1f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e1fe0 sp=0xc0000e1f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e1fe8 sp=0xc0000e1fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 5527 [select, 45 minutes]:
runtime.gopark(0xc007fecf90?, 0x2?, 0xd8?, 0xcd?, 0xc007fecf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007fecd90 sp=0xc007fecd70 pc=0x4404d6
runtime.selectgo(0xc007fecf90, 0xc007fecf20, 0xc0386f6640?, 0x0, 0xc01ef7b920?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007feced0 sp=0xc007fecd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e5e3440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007fecfc8 sp=0xc007feced0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007fecfe0 sp=0xc007fecfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007fecfe8 sp=0xc007fecfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 830 [select, 56 minutes]:
runtime.gopark(0xc0093eaf90?, 0x2?, 0xd8?, 0xad?, 0xc0093eaf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0093ead90 sp=0xc0093ead70 pc=0x4404d6
runtime.selectgo(0xc0093eaf90, 0xc0093eaf20, 0xc00537e3c0?, 0x0, 0xc007814420?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0093eaed0 sp=0xc0093ead90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc00574c360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0093eafc8 sp=0xc0093eaed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0093eafe0 sp=0xc0093eafc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0093eafe8 sp=0xc0093eafe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 1267 [select, 54 minutes]:
runtime.gopark(0xc008828f90?, 0x2?, 0xd8?, 0x8d?, 0xc008828f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008828d90 sp=0xc008828d70 pc=0x4404d6
runtime.selectgo(0xc008828f90, 0xc008828f20, 0xc005da88c0?, 0x0, 0xc006230ea0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008828ed0 sp=0xc008828d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0049d4360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc008828fc8 sp=0xc008828ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc008828fe0 sp=0xc008828fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008828fe8 sp=0xc008828fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 794 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f16036bc4df?, 0x3?, 0xd6?, 0x95?, 0xc004641a60?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ea9750 sp=0xc007ea9730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007ea97e0 sp=0xc007ea9750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ea97e8 sp=0xc007ea97e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 798 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1603709d05?, 0x3?, 0x45?, 0xa?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eab750 sp=0xc007eab730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007eab7e0 sp=0xc007eab750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eab7e8 sp=0xc007eab7e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 932 [select, 56 minutes]:
runtime.gopark(0xc00882cf90?, 0x2?, 0xd8?, 0xcd?, 0xc00882cf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00882cd90 sp=0xc00882cd70 pc=0x4404d6
runtime.selectgo(0xc00882cf90, 0xc00882cf20, 0xc00adc77c0?, 0x0, 0xc007dfe270?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00882ced0 sp=0xc00882cd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0066d0fc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00882cfc8 sp=0xc00882ced0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc00882cfe0 sp=0xc00882cfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00882cfe8 sp=0xc00882cfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 736 [GC worker (idle), 2 minutes]:
runtime.gopark(0x1f267470bf21?, 0x3?, 0x31?, 0x78?, 0x16?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000067750 sp=0xc000067730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000677e0 sp=0xc000067750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000677e8 sp=0xc0000677e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 761 [semacquire, 56 minutes]:
runtime.gopark(0xf12ae0?, 0xc00240dce0?, 0xa0?, 0x48?, 0x4?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002c5adb8 sp=0xc002c5ad98 pc=0x4404d6
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.semacquire1(0xc0000ba004, 0x40?, 0x3, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:150 +0x1fe fp=0xc002c5ae20 sp=0xc002c5adb8 pc=0x45141e
sync.runtime_SemacquireMutex(0x1?, 0x0?, 0x6f?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:77 +0x25 fp=0xc002c5ae50 sp=0xc002c5ae20 pc=0x46daa5
sync.(*Mutex).lockSlow(0xc0000ba000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:171 +0x165 fp=0xc002c5aea0 sp=0xc002c5ae50 pc=0x47aee5
sync.(*Mutex).Lock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:90
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunObserveCollectionManifestChanges.func1(0xc006ffe880?, {0xc0098bcf20?, 0xc?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:185 +0x5c fp=0xc002c5aef8 sp=0xc002c5aea0 pc=0xb40a3c
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunObserveCollectionManifestChanges(0xc0000ba000, {0xc0098bcf20, 0xc})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:188 +0x232 fp=0xc002c5afb8 sp=0xc002c5aef8 pc=0xb408d2
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:140 +0x2e fp=0xc002c5afe0 sp=0xc002c5afb8 pc=0xb4024e
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002c5afe8 sp=0xc002c5afe0 pc=0x471ba1
created by github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:140 +0x295
goroutine 796 [GC worker (idle)]:
runtime.gopark(0x1f42876a0300?, 0x1?, 0x81?, 0xc5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eaa750 sp=0xc007eaa730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007eaa7e0 sp=0xc007eaa750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eaa7e8 sp=0xc007eaa7e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 16992 [IO wait]:
runtime.gopark(0x0?, 0xb?, 0x0?, 0x0?, 0x17?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a4caf8 sp=0xc002a4cad8 pc=0x4404d6
runtime.netpollblock(0x484d05?, 0x492797?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc002a4cb30 sp=0xc002a4caf8 pc=0x438cb7
internal/poll.runtime_pollWait(0x7f61647876a8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc002a4cb50 sp=0xc002a4cb30 pc=0x46c0c9
internal/poll.(*pollDesc).wait(0xc0b9a34780?, 0xc0007ab000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc002a4cb78 sp=0xc002a4cb50 pc=0x4a5f32
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0b9a34780, {0xc0007ab000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc002a4cbf8 sp=0xc002a4cb78 pc=0x4a729a
net.(*netFD).Read(0xc0b9a34780, {0xc0007ab000?, 0x40bdd1?, 0x4?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc002a4cc40 sp=0xc002a4cbf8 pc=0x684429
net.(*conn).Read(0xc000128c90, {0xc0007ab000?, 0x0?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc002a4cc88 sp=0xc002a4cc40 pc=0x6946a5
net/http.(*persistConn).Read(0xc019d3b9e0, {0xc0007ab000?, 0xc00ab3ba40?, 0xc002a4cd30?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc002a4cce8 sp=0xc002a4cc88 pc=0x787b2e
bufio.(*Reader).fill(0xc004e0ef00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc002a4cd20 sp=0xc002a4cce8 pc=0x52671f
bufio.(*Reader).Peek(0xc004e0ef00, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:144 +0x5d fp=0xc002a4cd40 sp=0xc002a4cd20 pc=0x52687d
net/http.(*persistConn).readLoop(0xc019d3b9e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2093 +0x1ac fp=0xc002a4cfc8 sp=0xc002a4cd40 pc=0x78894c
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002a4cfe0 sp=0xc002a4cfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a4cfe8 sp=0xc002a4cfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5102 [select, 45 minutes]:
runtime.gopark(0xc002a29f68?, 0x4?, 0x3?, 0x0?, 0xc002a29db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a29c00 sp=0xc002a29be0 pc=0x4404d6
runtime.selectgo(0xc002a29f68, 0xc002a29da8, 0xc0408b1200?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002a29d40 sp=0xc002a29c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021d778c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002a29fc8 sp=0xc002a29d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002a29fe0 sp=0xc002a29fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a29fe8 sp=0xc002a29fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 729 [GC worker (idle)]:
runtime.gopark(0x1c09cc0?, 0x1?, 0x56?, 0xe2?, 0xc0000e06c8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e0750 sp=0xc0000e0730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e07e0 sp=0xc0000e0750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e07e8 sp=0xc0000e07e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 735 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f16036bc29d?, 0x3?, 0x27?, 0xa2?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006df50 sp=0xc00006df30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006dfe0 sp=0xc00006df50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006dfe8 sp=0xc00006dfe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 767 [GC worker (idle), 7 minutes]:
runtime.gopark(0x1ee09972d983?, 0x3?, 0xcc?, 0xfa?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e5750 sp=0xc0000e5730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e57e0 sp=0xc0000e5750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e57e8 sp=0xc0000e57e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 779 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f101918364a?, 0x3?, 0x7a?, 0x2a?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e5f50 sp=0xc0000e5f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e5fe0 sp=0xc0000e5f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e5fe8 sp=0xc0000e5fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 734 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602f08d16?, 0x3?, 0xb8?, 0x58?, 0x127f740?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006d750 sp=0xc00006d730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006d7e0 sp=0xc00006d750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006d7e8 sp=0xc00006d7e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 781 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f16034f84da?, 0x3?, 0xde?, 0xdb?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aca6f50 sp=0xc00aca6f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00aca6fe0 sp=0xc00aca6f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aca6fe8 sp=0xc00aca6fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 1233 [select, 54 minutes]:
runtime.gopark(0xc0093eef90?, 0x2?, 0xd8?, 0xed?, 0xc0093eef24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0093eed90 sp=0xc0093eed70 pc=0x4404d6
runtime.selectgo(0xc0093eef90, 0xc0093eef20, 0xc004681fc0?, 0x0, 0xc006007f80?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0093eeed0 sp=0xc0093eed90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc00485e6c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0093eefc8 sp=0xc0093eeed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0093eefe0 sp=0xc0093eefc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0093eefe8 sp=0xc0093eefe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 849 [select, 56 minutes]:
runtime.gopark(0xc0002e3f90?, 0x2?, 0xd8?, 0x3d?, 0xc0002e3f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002e3d90 sp=0xc0002e3d70 pc=0x4404d6
runtime.selectgo(0xc0002e3f90, 0xc0002e3f20, 0xc0052bd7c0?, 0x0, 0xc0090fc810?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0002e3ed0 sp=0xc0002e3d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc00571c900)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0002e3fc8 sp=0xc0002e3ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0002e3fe0 sp=0xc0002e3fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002e3fe8 sp=0xc0002e3fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 1232 [select, 54 minutes]:
runtime.gopark(0xc00007ef68?, 0x4?, 0x3?, 0x0?, 0xc00007edb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007ec00 sp=0xc00007ebe0 pc=0x4404d6
runtime.selectgo(0xc00007ef68, 0xc00007eda8, 0xc0034b4580?, 0x0, 0xc00aca9d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00007ed40 sp=0xc00007ec00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc00485e6c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc00007efc8 sp=0xc00007ed40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc00007efe0 sp=0xc00007efc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007efe8 sp=0xc00007efe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 790 [GC worker (idle), 7 minutes]:
runtime.gopark(0x1ee09976c95a?, 0x3?, 0x3f?, 0x4e?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b3750 sp=0xc0004b3730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b37e0 sp=0xc0004b3750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b37e8 sp=0xc0004b37e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 769 [GC worker (idle)]:
runtime.gopark(0x1f4287c445d2?, 0x1?, 0x8b?, 0x33?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eacf50 sp=0xc007eacf30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007eacfe0 sp=0xc007eacf50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eacfe8 sp=0xc007eacfe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 730 [GC worker (idle)]:
runtime.gopark(0x1c09cc0?, 0x1?, 0xf1?, 0x28?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b8750 sp=0xc0004b8730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b87e0 sp=0xc0004b8750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b87e8 sp=0xc0004b87e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 807 [GC worker (idle)]:
runtime.gopark(0x1c09cc0?, 0x1?, 0xb5?, 0xd0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e7f50 sp=0xc0000e7f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e7fe0 sp=0xc0000e7f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e7fe8 sp=0xc0000e7fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 809 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602df5761?, 0x3?, 0x3c?, 0xd3?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00ad85750 sp=0xc00ad85730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00ad857e0 sp=0xc00ad85750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00ad857e8 sp=0xc00ad857e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 804 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602ae3003?, 0x3?, 0x6e?, 0x42?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eae750 sp=0xc007eae730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007eae7e0 sp=0xc007eae750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eae7e8 sp=0xc007eae7e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 808 [GC worker (idle), 2 minutes]:
runtime.gopark(0x1f2674a9595b?, 0x3?, 0xbc?, 0xc9?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00ad84f50 sp=0xc00ad84f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00ad84fe0 sp=0xc00ad84f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00ad84fe8 sp=0xc00ad84fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 1113 [chan send, 54 minutes]:
runtime.gopark(0xc006aee0f0?, 0xc00632c420?, 0x2?, 0x0?, 0xc008947a90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008947a50 sp=0xc008947a30 pc=0x4404d6
runtime.chansend(0xc002c53560, 0xc008947b38, 0x1, 0x73613a726f746172?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:259 +0x42c fp=0xc008947ad8 sp=0xc008947a50 pc=0x40ba6c
runtime.chansend1(0x7473696e696d6441?, 0x73613a726f746172?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:145 +0x1d fp=0xc008947b08 sp=0xc008947ad8 pc=0x40b61d
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc004991f20?, {0x0?, 0x1102ad4?}, {0x127f300?, 0xc000116f00?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x128 fp=0xc008947b58 sp=0xc008947b08 pc=0xbb1c48
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x41e fp=0xc008947c50 sp=0xc008947b58 pc=0xbb61de
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44a fp=0xc008947d48 sp=0xc008947c50 pc=0xbb620a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc000664300, 0xc0002150e0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x354 fp=0xc008947fc0 sp=0xc008947d48 pc=0xbb52d4
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc008947fe0 sp=0xc008947fc0 pc=0xbb1aea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008947fe8 sp=0xc008947fe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 1266 [select, 54 minutes]:
runtime.gopark(0xc007ec7f68?, 0x4?, 0x3?, 0x0?, 0xc007ec7db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ec7c00 sp=0xc007ec7be0 pc=0x4404d6
runtime.selectgo(0xc007ec7f68, 0xc007ec7da8, 0xc003c6c9c0?, 0x0, 0x77c501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ec7d40 sp=0xc007ec7c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0049d4360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007ec7fc8 sp=0xc007ec7d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007ec7fe0 sp=0xc007ec7fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ec7fe8 sp=0xc007ec7fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 803 [GC worker (idle), 7 minutes]:
runtime.gopark(0x1c09cc0?, 0x1?, 0x46?, 0x2?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eaef50 sp=0xc007eaef30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007eaefe0 sp=0xc007eaef50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eaefe8 sp=0xc007eaefe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 806 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602acf75b?, 0x3?, 0x6b?, 0x7?, 0xc0000e6fd0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e6f50 sp=0xc0000e6f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e6fe0 sp=0xc0000e6f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e6fe8 sp=0xc0000e6fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 805 [GC worker (idle), 7 minutes]:
runtime.gopark(0x1ee09976cd8a?, 0x3?, 0x30?, 0x1d?, 0xc007eaf7d0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eaf750 sp=0xc007eaf730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007eaf7e0 sp=0xc007eaf750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eaf7e8 sp=0xc007eaf7e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 802 [GC worker (idle), 5 minutes]:
runtime.gopark(0x1eef1ddb6b51?, 0x3?, 0x25?, 0x6e?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007eadf50 sp=0xc007eadf30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007eadfe0 sp=0xc007eadf50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007eadfe8 sp=0xc007eadfe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 5103 [select, 45 minutes]:
runtime.gopark(0xc002a23f90?, 0x2?, 0xd8?, 0x3d?, 0xc002a23f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a23d90 sp=0xc002a23d70 pc=0x4404d6
runtime.selectgo(0xc002a23f90, 0xc002a23f20, 0xc0408b11c0?, 0x0, 0xc02a669bf0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002a23ed0 sp=0xc002a23d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021d778c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002a23fc8 sp=0xc002a23ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002a23fe0 sp=0xc002a23fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a23fe8 sp=0xc002a23fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 1079 [sleep]:
runtime.gopark(0x1f4180d1ed01?, 0x375badc2d6f?, 0x0?, 0x1e?, 0xc0f1afc94c3f8576?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc08fdd9e60 sp=0xc08fdd9e40 pc=0x4404d6
time.Sleep(0x12a05d4f1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc08fdd9ea0 sp=0xc08fdd9e60 pc=0x46ea15
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc000664300, {0xc008f8d428, 0x12})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc08fdd9f00 sp=0xc08fdd9ea0 pc=0xbc7f77
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc008f8d428?, 0xc0000d7f01?})
:1 +0x34 fp=0xc08fdd9f28 sp=0xc08fdd9f00 pc=0xbdf534
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc08fdd9f48 sp=0xc08fdd9f28 pc=0xbce7c5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc00357a980)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc08fdd9fc8 sp=0xc08fdd9f48 pc=0xbd3abb
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc08fdd9fe0 sp=0xc08fdd9fc8 pc=0xbd1ee6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc08fdd9fe8 sp=0xc08fdd9fe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 905 [sleep]:
runtime.gopark(0x1f417c7e1375?, 0x375b6884701?, 0x0?, 0x1e?, 0xc0f1afc947eb9f44?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0009dbe60 sp=0xc0009dbe40 pc=0x4404d6
time.Sleep(0x12a05ca60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc0009dbea0 sp=0xc0009dbe60 pc=0x46ea15
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc002120f00, {0xc006457020, 0xf})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc0009dbf00 sp=0xc0009dbea0 pc=0xbc7f77
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc006457020?, 0xc008945f01?})
:1 +0x34 fp=0xc0009dbf28 sp=0xc0009dbf00 pc=0xbdf534
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc0009dbf48 sp=0xc0009dbf28 pc=0xbce7c5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc0051ff4c0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc0009dbfc8 sp=0xc0009dbf48 pc=0xbd3abb
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0009dbfe0 sp=0xc0009dbfc8 pc=0xbd1ee6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0009dbfe8 sp=0xc0009dbfe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 5094 [select, 45 minutes]:
runtime.gopark(0xc000294f68?, 0x4?, 0x3?, 0x0?, 0xc000294db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000294c00 sp=0xc000294be0 pc=0x4404d6
runtime.selectgo(0xc000294f68, 0xc000294da8, 0xc043799180?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000294d40 sp=0xc000294c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021d77680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000294fc8 sp=0xc000294d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000294fe0 sp=0xc000294fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000294fe8 sp=0xc000294fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5327 [select, 45 minutes]:
runtime.gopark(0xc002c59f68?, 0x4?, 0x3?, 0x0?, 0xc002c59db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002c59c00 sp=0xc002c59be0 pc=0x4404d6
runtime.selectgo(0xc002c59f68, 0xc002c59da8, 0xc021dad4c0?, 0x0, 0xc038170001?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002c59d40 sp=0xc002c59c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc022219e60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002c59fc8 sp=0xc002c59d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002c59fe0 sp=0xc002c59fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002c59fe8 sp=0xc002c59fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 789 [GC worker (idle), 2 minutes]:
runtime.gopark(0x1f2674a9595b?, 0x1?, 0x14?, 0x9e?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b2750 sp=0xc0004b2730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b27e0 sp=0xc0004b2750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b27e8 sp=0xc0004b27e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 848 [select, 56 minutes]:
runtime.gopark(0xc000266f68?, 0x4?, 0x3?, 0x0?, 0xc000266db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000266c00 sp=0xc000266be0 pc=0x4404d6
runtime.selectgo(0xc000266f68, 0xc000266da8, 0xc0052bd8c0?, 0x0, 0x77c501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000266d40 sp=0xc000266c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc00571c900)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000266fc8 sp=0xc000266d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000266fe0 sp=0xc000266fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000266fe8 sp=0xc000266fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5098 [select, 45 minutes]:
runtime.gopark(0xc002212f68?, 0x4?, 0x3?, 0x0?, 0xc002212db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002212c00 sp=0xc002212be0 pc=0x4404d6
runtime.selectgo(0xc002212f68, 0xc002212da8, 0xc0408b10c0?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002212d40 sp=0xc002212c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021d777a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002212fc8 sp=0xc002212d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002212fe0 sp=0xc002212fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002212fe8 sp=0xc002212fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 955 [select, 56 minutes]:
runtime.gopark(0xc0002dff68?, 0x4?, 0x4b?, 0xce?, 0xc0002dfdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002dfc00 sp=0xc0002dfbe0 pc=0x4404d6
runtime.selectgo(0xc0002dff68, 0xc0002dfda8, 0xc005141fc0?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0002dfd40 sp=0xc0002dfc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0066d17a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0002dffc8 sp=0xc0002dfd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0002dffe0 sp=0xc0002dffc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002dffe8 sp=0xc0002dffe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5420 [select, 45 minutes]:
runtime.gopark(0xc007ea1f90?, 0x2?, 0xd8?, 0x1d?, 0xc007ea1f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ea1d90 sp=0xc007ea1d70 pc=0x4404d6
runtime.selectgo(0xc007ea1f90, 0xc007ea1f20, 0xc043799680?, 0x0, 0xc02d77c120?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ea1ed0 sp=0xc007ea1d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021d77e60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007ea1fc8 sp=0xc007ea1ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007ea1fe0 sp=0xc007ea1fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ea1fe8 sp=0xc007ea1fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 793 [GC worker (idle)]:
runtime.gopark(0x1c09cc0?, 0x1?, 0xa1?, 0xc2?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ea8f50 sp=0xc007ea8f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007ea8fe0 sp=0xc007ea8f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ea8fe8 sp=0xc007ea8fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 792 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f16034f889b?, 0x1?, 0xdf?, 0x53?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b8f50 sp=0xc0004b8f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b8fe0 sp=0xc0004b8f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b8fe8 sp=0xc0004b8fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 777 [GC worker (idle)]:
runtime.gopark(0x1c09cc0?, 0x1?, 0xe3?, 0xe9?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e2f50 sp=0xc0000e2f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e2fe0 sp=0xc0000e2f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e2fe8 sp=0xc0000e2fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 778 [GC worker (idle), 2 minutes]:
runtime.gopark(0x1f26747163c0?, 0x1?, 0x53?, 0x77?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e3f50 sp=0xc0000e3f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e3fe0 sp=0xc0000e3f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e3fe8 sp=0xc0000e3fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 791 [GC worker (idle), 7 minutes]:
runtime.gopark(0x1ee09972d3ad?, 0x3?, 0xe0?, 0x11?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b3f50 sp=0xc0004b3f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b3fe0 sp=0xc0004b3f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b3fe8 sp=0xc0004b3fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 728 [GC worker (idle)]:
runtime.gopark(0x1c09cc0?, 0x1?, 0xb2?, 0x30?, 0xc0004b4fd0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b4f50 sp=0xc0004b4f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b4fe0 sp=0xc0004b4f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b4fe8 sp=0xc0004b4fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 787 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f10190535e4?, 0x1?, 0x5f?, 0x15?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004b5750 sp=0xc0004b5730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0004b57e0 sp=0xc0004b5750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0004b57e8 sp=0xc0004b57e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 788 [GC worker (idle), 2 minutes]:
runtime.gopark(0x1f267471833a?, 0x3?, 0x5a?, 0x70?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e1750 sp=0xc0000e1730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e17e0 sp=0xc0000e1750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e17e8 sp=0xc0000e17e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 780 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602f08b19?, 0x3?, 0x7?, 0x50?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000e3750 sp=0xc0000e3730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000e37e0 sp=0xc0000e3750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000e37e8 sp=0xc0000e37e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 868 [sleep]:
runtime.gopark(0x1f420f7748c9?, 0x376498180ef?, 0x0?, 0x1e?, 0xc0f1afc9e3af43b9?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc08fddbe60 sp=0xc08fddbe40 pc=0x4404d6
time.Sleep(0x12a05cf03)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc08fddbea0 sp=0xc08fddbe60 pc=0x46ea15
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc002120900, {0xc00600b398, 0x12})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc08fddbf00 sp=0xc08fddbea0 pc=0xbc7f77
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc00600b398?, 0xc075a37f01?})
:1 +0x34 fp=0xc08fddbf28 sp=0xc08fddbf00 pc=0xbdf534
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc08fddbf48 sp=0xc08fddbf28 pc=0xbce7c5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc003fd57c0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc08fddbfc8 sp=0xc08fddbf48 pc=0xbd3abb
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc08fddbfe0 sp=0xc08fddbfc8 pc=0xbd1ee6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc08fddbfe8 sp=0xc08fddbfe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 775 [GC worker (idle), 3 minutes]:
runtime.gopark(0x1f1602acf8f0?, 0x3?, 0xc9?, 0x2f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ead750 sp=0xc007ead730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc007ead7e0 sp=0xc007ead750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ead7e8 sp=0xc007ead7e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 782 [GC worker (idle)]:
runtime.gopark(0x1c09cc0?, 0x1?, 0x2e?, 0xc7?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aca7750 sp=0xc00aca7730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00aca77e0 sp=0xc00aca7750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aca77e8 sp=0xc00aca77e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 783 [GC worker (idle), 7 minutes]:
runtime.gopark(0x1c09cc0?, 0x1?, 0xec?, 0x6?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aca7f50 sp=0xc00aca7f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00aca7fe0 sp=0xc00aca7f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aca7fe8 sp=0xc00aca7fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 784 [GC worker (idle)]:
runtime.gopark(0x1f42876a09df?, 0x1?, 0xbc?, 0xb?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aca8750 sp=0xc00aca8730 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00aca87e0 sp=0xc00aca8750 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aca87e8 sp=0xc00aca87e0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 785 [GC worker (idle)]:
runtime.gopark(0x1f428769f782?, 0x1?, 0x7a?, 0x18?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aca8f50 sp=0xc00aca8f30 pc=0x4404d6
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00aca8fe0 sp=0xc00aca8f50 pc=0x421af1
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aca8fe8 sp=0xc00aca8fe0 pc=0x471ba1
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 953 [select, 56 minutes]:
runtime.gopark(0xc000263f68?, 0x4?, 0x3?, 0x0?, 0xc000263db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000263c00 sp=0xc000263be0 pc=0x4404d6
runtime.selectgo(0xc000263f68, 0xc000263da8, 0xc00531c3c0?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000263d40 sp=0xc000263c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc00571d0e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000263fc8 sp=0xc000263d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000263fe0 sp=0xc000263fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000263fe8 sp=0xc000263fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 882 [chan send, 56 minutes]:
runtime.gopark(0xc008925000?, 0xc007814300?, 0x2?, 0x0?, 0xc002571a90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008943a50 sp=0xc008943a30 pc=0x4404d6
runtime.chansend(0xc007b29200, 0xc008943b38, 0x1, 0x73613a726f746172?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:259 +0x42c fp=0xc008943ad8 sp=0xc008943a50 pc=0x40ba6c
runtime.chansend1(0x7473696e696d6441?, 0x73613a726f746172?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:145 +0x1d fp=0xc008943b08 sp=0xc008943ad8 pc=0x40b61d
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc006effc50?, {0x0?, 0x1102ad4?}, {0x127f300?, 0xc000116f00?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x128 fp=0xc008943b58 sp=0xc008943b08 pc=0xbb1c48
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x41e fp=0xc008943c50 sp=0xc008943b58 pc=0xbb61de
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44a fp=0xc008943d48 sp=0xc008943c50 pc=0xbb620a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc002120900, 0xc006012de0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x354 fp=0xc008943fc0 sp=0xc008943d48 pc=0xbb52d4
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc008943fe0 sp=0xc008943fc0 pc=0xbb1aea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008943fe8 sp=0xc008943fe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 956 [select, 56 minutes]:
runtime.gopark(0xc002c54f90?, 0x2?, 0xd8?, 0x4d?, 0xc002c54f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002c54d90 sp=0xc002c54d70 pc=0x4404d6
runtime.selectgo(0xc002c54f90, 0xc002c54f20, 0xc00531c2c0?, 0x0, 0xc0090fccc0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002c54ed0 sp=0xc002c54d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0066d17a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002c54fc8 sp=0xc002c54ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002c54fe0 sp=0xc002c54fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002c54fe8 sp=0xc002c54fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 904 [sleep]:
runtime.gopark(0x1f420e0b0988?, 0x376481541a1?, 0x0?, 0x1e?, 0xc0f1afc9e243051e?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002214e60 sp=0xc002214e40 pc=0x4404d6
time.Sleep(0x12a05cd2c)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc002214ea0 sp=0xc002214e60 pc=0x46ea15
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc002120f00, {0xc002ba0738, 0x12})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc002214f00 sp=0xc002214ea0 pc=0xbc7f77
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc002ba0738?, 0xc0000d7f01?})
:1 +0x34 fp=0xc002214f28 sp=0xc002214f00 pc=0xbdf534
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc002214f48 sp=0xc002214f28 pc=0xbce7c5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc0051ff3c0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc002214fc8 sp=0xc002214f48 pc=0xbd3abb
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc002214fe0 sp=0xc002214fc8 pc=0xbd1ee6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002214fe8 sp=0xc002214fe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 865 [select]:
runtime.gopark(0xc002a28f98?, 0x2?, 0x0?, 0x30?, 0xc002a28f94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a28e20 sp=0xc002a28e00 pc=0x4404d6
runtime.selectgo(0xc002a28f98, 0xc002a28f90, 0x1bd1e00?, 0x0, 0x3768b8cc77c?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002a28f60 sp=0xc002a28e20 pc=0x45035c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc000590960)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc002a28fc8 sp=0xc002a28f60 pc=0xbe89c5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc002a28fe0 sp=0xc002a28fc8 pc=0xbe88e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a28fe8 sp=0xc002a28fe0 pc=0x471ba1
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 869 [sleep]:
runtime.gopark(0x1f41a040cef4?, 0x375da4b0989?, 0x0?, 0x1e?, 0xc0f1afc96bae60fe?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0009dde60 sp=0xc0009dde40 pc=0x4404d6
time.Sleep(0x12a05d041)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc0009ddea0 sp=0xc0009dde60 pc=0x46ea15
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc002120900, {0xc002a7c700, 0xf})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc0009ddf00 sp=0xc0009ddea0 pc=0xbc7f77
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc002a7c700?, 0xc009f9bf01?})
:1 +0x34 fp=0xc0009ddf28 sp=0xc0009ddf00 pc=0xbdf534
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc0009ddf48 sp=0xc0009ddf28 pc=0xbce7c5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc003fd59c0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc0009ddfc8 sp=0xc0009ddf48 pc=0xbd3abb
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0009ddfe0 sp=0xc0009ddfc8 pc=0xbd1ee6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0009ddfe8 sp=0xc0009ddfe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 5484 [select, 45 minutes]:
runtime.gopark(0xc007ff1f68?, 0x4?, 0x3?, 0x0?, 0xc007ff1db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ff1c00 sp=0xc007ff1be0 pc=0x4404d6
runtime.selectgo(0xc007ff1f68, 0xc007ff1da8, 0xc0316a0300?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ff1d40 sp=0xc007ff1c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0220a4c60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007ff1fc8 sp=0xc007ff1d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007ff1fe0 sp=0xc007ff1fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ff1fe8 sp=0xc007ff1fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 895 [select]:
runtime.gopark(0xc0009def98?, 0x2?, 0x0?, 0x30?, 0xc0009def94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0009dee20 sp=0xc0009dee00 pc=0x4404d6
runtime.selectgo(0xc0009def98, 0xc0009def90, 0x1bd1e00?, 0x0, 0x3763b9af276?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0009def60 sp=0xc0009dee20 pc=0x45035c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc000590f00)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc0009defc8 sp=0xc0009def60 pc=0xbe89c5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc0009defe0 sp=0xc0009defc8 pc=0xbe88e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0009defe8 sp=0xc0009defe0 pc=0x471ba1
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 896 [chan send, 56 minutes]:
runtime.gopark(0xc0084133f0?, 0xc0090fcdb0?, 0x2?, 0x0?, 0xc00015ba90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00015ba50 sp=0xc00015ba30 pc=0x4404d6
runtime.chansend(0xc0063a2de0, 0xc00015bb38, 0x1, 0x73613a726f746172?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:259 +0x42c fp=0xc00015bad8 sp=0xc00015ba50 pc=0x40ba6c
runtime.chansend1(0x7473696e696d6441?, 0x73613a726f746172?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:145 +0x1d fp=0xc00015bb08 sp=0xc00015bad8 pc=0x40b61d
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc0078c6e70?, {0x0?, 0x1102ad4?}, {0x127f300?, 0xc000116f00?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x128 fp=0xc00015bb58 sp=0xc00015bb08 pc=0xbb1c48
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x41e fp=0xc00015bc50 sp=0xc00015bb58 pc=0xbb61de
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44a fp=0xc00015bd48 sp=0xc00015bc50 pc=0xbb620a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc002120f00, 0xc000169d60)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x354 fp=0xc00015bfc0 sp=0xc00015bd48 pc=0xbb52d4
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc00015bfe0 sp=0xc00015bfc0 pc=0xbb1aea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00015bfe8 sp=0xc00015bfe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 931 [select, 56 minutes]:
runtime.gopark(0xc007ec9f68?, 0x4?, 0x3?, 0x0?, 0xc007ec9db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ec9c00 sp=0xc007ec9be0 pc=0x4404d6
runtime.selectgo(0xc007ec9f68, 0xc007ec9da8, 0xc00adc7800?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ec9d40 sp=0xc007ec9c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0066d0fc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007ec9fc8 sp=0xc007ec9d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007ec9fe0 sp=0xc007ec9fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ec9fe8 sp=0xc007ec9fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 954 [select, 56 minutes]:
runtime.gopark(0xc000265f90?, 0x2?, 0xd8?, 0x5d?, 0xc000265f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000265d90 sp=0xc000265d70 pc=0x4404d6
runtime.selectgo(0xc000265f90, 0xc000265f20, 0xc00531c1c0?, 0x0, 0xc0090fcc30?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000265ed0 sp=0xc000265d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc00571d0e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000265fc8 sp=0xc000265ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000265fe0 sp=0xc000265fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000265fe8 sp=0xc000265fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 959 [select, 56 minutes]:
runtime.gopark(0xc002c55f68?, 0x4?, 0x3?, 0x0?, 0xc002c55db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002c55c00 sp=0xc002c55be0 pc=0x4404d6
runtime.selectgo(0xc002c55f68, 0xc002c55da8, 0xc00537e4c0?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002c55d40 sp=0xc002c55c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc00571d7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002c55fc8 sp=0xc002c55d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002c55fe0 sp=0xc002c55fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002c55fe8 sp=0xc002c55fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 960 [select, 56 minutes]:
runtime.gopark(0xc002c56f90?, 0x2?, 0xd8?, 0x6d?, 0xc002c56f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002c56d90 sp=0xc002c56d70 pc=0x4404d6
runtime.selectgo(0xc002c56f90, 0xc002c56f20, 0xc00531c7c0?, 0x0, 0xc0090fced0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002c56ed0 sp=0xc002c56d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc00571d7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002c56fc8 sp=0xc002c56ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002c56fe0 sp=0xc002c56fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002c56fe8 sp=0xc002c56fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 1080 [sleep]:
runtime.gopark(0x1f41f019d3bf?, 0x3762a24112c?, 0x0?, 0x1e?, 0xc0f1afc9c451d4be?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc08fddae60 sp=0xc08fddae40 pc=0x4404d6
time.Sleep(0x12a05d301)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc08fddaea0 sp=0xc08fddae60 pc=0x46ea15
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient(0xc000664300, {0xc009ea0bf0, 0xf})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agentrouting.go:162 +0x137 fp=0xc08fddaf00 sp=0xc08fddaea0 pc=0xbc7f77
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).slowDialMemdClient-fm({0xc009ea0bf0?, 0xc075a33f01?})
:1 +0x34 fp=0xc08fddaf28 sp=0xc08fddaf00 pc=0xbdf534
gopkg.in/couchbase/gocbcore%2ev7.newMemdClientMux.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclientmux.go:22 +0x25 fp=0xc08fddaf48 sp=0xc08fddaf28 pc=0xbce7c5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc00357ab80)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:188 +0x23b fp=0xc08fddafc8 sp=0xc08fddaf48 pc=0xbd3abb
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc08fddafe0 sp=0xc08fddafc8 pc=0xbd1ee6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc08fddafe8 sp=0xc08fddafe0 pc=0x471ba1
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 1112 [select]:
runtime.gopark(0xc007ec8f98?, 0x2?, 0x0?, 0x30?, 0xc007ec8f94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ec8e20 sp=0xc007ec8e00 pc=0x4404d6
runtime.selectgo(0xc007ec8f98, 0xc007ec8f90, 0x1bd1e00?, 0x0, 0x375fda065d8?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ec8f60 sp=0xc007ec8e20 pc=0x45035c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc0005510e0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc007ec8fc8 sp=0xc007ec8f60 pc=0xbe89c5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc007ec8fe0 sp=0xc007ec8fc8 pc=0xbe88e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ec8fe8 sp=0xc007ec8fe0 pc=0x471ba1
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 5483 [select, 45 minutes]:
runtime.gopark(0xc007f8af90?, 0x2?, 0xd8?, 0xad?, 0xc007f8af24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f8ad90 sp=0xc007f8ad70 pc=0x4404d6
runtime.selectgo(0xc007f8af90, 0xc007f8af20, 0xc0386f6340?, 0x0, 0xc03bf91f50?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f8aed0 sp=0xc007f8ad90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acde60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007f8afc8 sp=0xc007f8aed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007f8afe0 sp=0xc007f8afc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f8afe8 sp=0xc007f8afe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5490 [select, 45 minutes]:
runtime.gopark(0xc007f8ef90?, 0x2?, 0xd8?, 0xed?, 0xc007f8ef24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f8ed90 sp=0xc007f8ed70 pc=0x4404d6
runtime.selectgo(0xc007f8ef90, 0xc007f8ef20, 0xc043f365c0?, 0x0, 0xc03b98cc00?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f8eed0 sp=0xc007f8ed90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e441560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007f8efc8 sp=0xc007f8eed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007f8efe0 sp=0xc007f8efc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f8efe8 sp=0xc007f8efe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5429 [select, 45 minutes]:
runtime.gopark(0xc007e5cf68?, 0x4?, 0x3?, 0x0?, 0xc007e5cdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e5cc00 sp=0xc007e5cbe0 pc=0x4404d6
runtime.selectgo(0xc007e5cf68, 0xc007e5cda8, 0xc0408b1940?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e5cd40 sp=0xc007e5cc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0220a45a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007e5cfc8 sp=0xc007e5cd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007e5cfe0 sp=0xc007e5cfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e5cfe8 sp=0xc007e5cfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5380 [select, 45 minutes]:
runtime.gopark(0xc000299f90?, 0x2?, 0xd8?, 0x9d?, 0xc000299f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000299d90 sp=0xc000299d70 pc=0x4404d6
runtime.selectgo(0xc000299f90, 0xc000299f20, 0xc021dad5c0?, 0x0, 0xc02b3bbf20?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000299ed0 sp=0xc000299d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0220a4120)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000299fc8 sp=0xc000299ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000299fe0 sp=0xc000299fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000299fe8 sp=0xc000299fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 1002 [select, 54 minutes]:
runtime.gopark(0xc002216f90?, 0x2?, 0xd8?, 0x6d?, 0xc002216f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002216d90 sp=0xc002216d70 pc=0x4404d6
runtime.selectgo(0xc002216f90, 0xc002216f20, 0xc0034b5d80?, 0x0, 0xc00632c810?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002216ed0 sp=0xc002216d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc00498d560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002216fc8 sp=0xc002216ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002216fe0 sp=0xc002216fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002216fe8 sp=0xc002216fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 1001 [select, 54 minutes]:
runtime.gopark(0xc002215f68?, 0x4?, 0x3?, 0x0?, 0xc002215db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002215c00 sp=0xc002215be0 pc=0x4404d6
runtime.selectgo(0xc002215f68, 0xc002215da8, 0xc0046221c0?, 0x0, 0xc002029d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002215d40 sp=0xc002215c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc00498d560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002215fc8 sp=0xc002215d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002215fe0 sp=0xc002215fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002215fe8 sp=0xc002215fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5423 [select, 45 minutes]:
runtime.gopark(0xc0086d1f68?, 0x4?, 0x3?, 0x0?, 0xc0086d1db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0086d1c00 sp=0xc0086d1be0 pc=0x4404d6
runtime.selectgo(0xc0086d1f68, 0xc0086d1da8, 0xc0408b1dc0?, 0x0, 0xc017b90c01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0086d1d40 sp=0xc0086d1c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acd9e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0086d1fc8 sp=0xc0086d1d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0086d1fe0 sp=0xc0086d1fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0086d1fe8 sp=0xc0086d1fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5387 [select, 45 minutes]:
runtime.gopark(0xc0093eff68?, 0x4?, 0x3?, 0x0?, 0xc0093efdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0093efc00 sp=0xc0093efbe0 pc=0x4404d6
runtime.selectgo(0xc0093eff68, 0xc0093efda8, 0xc0408b14c0?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0093efd40 sp=0xc0093efc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021d77b00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0093effc8 sp=0xc0093efd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0093effe0 sp=0xc0093effc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0093effe8 sp=0xc0093effe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5424 [select, 45 minutes]:
runtime.gopark(0xc0086d2f90?, 0x2?, 0xd8?, 0x2d?, 0xc0086d2f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0086d2d90 sp=0xc0086d2d70 pc=0x4404d6
runtime.selectgo(0xc0086d2f90, 0xc0086d2f20, 0xc043799800?, 0x0, 0xc02d77c660?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0086d2ed0 sp=0xc0086d2d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acd9e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0086d2fc8 sp=0xc0086d2ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0086d2fe0 sp=0xc0086d2fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0086d2fe8 sp=0xc0086d2fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5401 [select, 45 minutes]:
runtime.gopark(0xc007e5df90?, 0x2?, 0xd8?, 0xdd?, 0xc007e5df24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e5dd90 sp=0xc007e5dd70 pc=0x4404d6
runtime.selectgo(0xc007e5df90, 0xc007e5df20, 0xc0408b15c0?, 0x0, 0xc03c0230b0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e5ded0 sp=0xc007e5dd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021d77c20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007e5dfc8 sp=0xc007e5ded0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007e5dfe0 sp=0xc007e5dfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e5dfe8 sp=0xc007e5dfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5525 [select, 45 minutes]:
runtime.gopark(0xc008009f90?, 0x2?, 0xd8?, 0x9d?, 0xc008009f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008009d90 sp=0xc008009d70 pc=0x4404d6
runtime.selectgo(0xc008009f90, 0xc008009f20, 0xc0386f6600?, 0x0, 0xc01ef7b620?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008009ed0 sp=0xc008009d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e461d40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc008009fc8 sp=0xc008009ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc008009fe0 sp=0xc008009fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008009fe8 sp=0xc008009fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5419 [select, 45 minutes]:
runtime.gopark(0xc0086d3f68?, 0x4?, 0x3?, 0x0?, 0xc0086d3db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0086d3c00 sp=0xc0086d3be0 pc=0x4404d6
runtime.selectgo(0xc0086d3f68, 0xc0086d3da8, 0xc021dadac0?, 0x0, 0xc00202a501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0086d3d40 sp=0xc0086d3c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021d77e60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0086d3fc8 sp=0xc0086d3d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0086d3fe0 sp=0xc0086d3fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0086d3fe8 sp=0xc0086d3fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5444 [select, 45 minutes]:
runtime.gopark(0xc007ea2f68?, 0x4?, 0x3?, 0x0?, 0xc007ea2db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ea2c00 sp=0xc007ea2be0 pc=0x4404d6
runtime.selectgo(0xc007ea2f68, 0xc007ea2da8, 0xc0408b1ac0?, 0x0, 0xc007ea8501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ea2d40 sp=0xc007ea2c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e4dca20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007ea2fc8 sp=0xc007ea2d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007ea2fe0 sp=0xc007ea2fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ea2fe8 sp=0xc007ea2fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5406 [select, 45 minutes]:
runtime.gopark(0xc007e5ff68?, 0x4?, 0x3?, 0x0?, 0xc007e5fdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e5fc00 sp=0xc007e5fbe0 pc=0x4404d6
runtime.selectgo(0xc007e5ff68, 0xc007e5fda8, 0xc021dad940?, 0x0, 0xc035438b01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e5fd40 sp=0xc007e5fc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0220a4360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007e5ffc8 sp=0xc007e5fd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007e5ffe0 sp=0xc007e5ffc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e5ffe8 sp=0xc007e5ffe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5524 [select, 45 minutes]:
runtime.gopark(0xc007fa6f68?, 0x4?, 0x3?, 0x0?, 0xc007fa6db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007fa6c00 sp=0xc007fa6be0 pc=0x4404d6
runtime.selectgo(0xc007fa6f68, 0xc007fa6da8, 0xc0316a0500?, 0x0, 0xc007ea8501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007fa6d40 sp=0xc007fa6c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e461d40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007fa6fc8 sp=0xc007fa6d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007fa6fe0 sp=0xc007fa6fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007fa6fe8 sp=0xc007fa6fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5405 [select, 45 minutes]:
runtime.gopark(0xc007e5ef90?, 0x2?, 0xd8?, 0xed?, 0xc007e5ef24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e5ed90 sp=0xc007e5ed70 pc=0x4404d6
runtime.selectgo(0xc007e5ef90, 0xc007e5ef20, 0xc0408b1740?, 0x0, 0xc03c023530?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e5eed0 sp=0xc007e5ed90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021d77d40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007e5efc8 sp=0xc007e5eed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007e5efe0 sp=0xc007e5efc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e5efe8 sp=0xc007e5efe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5445 [select, 45 minutes]:
runtime.gopark(0xc007ea3f90?, 0x2?, 0xd8?, 0x3d?, 0xc007ea3f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ea3d90 sp=0xc007ea3d70 pc=0x4404d6
runtime.selectgo(0xc007ea3f90, 0xc007ea3f20, 0xc0408b1a40?, 0x0, 0xc03c023f20?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ea3ed0 sp=0xc007ea3d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e4dca20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007ea3fc8 sp=0xc007ea3ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007ea3fe0 sp=0xc007ea3fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ea3fe8 sp=0xc007ea3fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5431 [select, 45 minutes]:
runtime.gopark(0xc007e9ef68?, 0x4?, 0x3?, 0x0?, 0xc007e9edb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e9ec00 sp=0xc007e9ebe0 pc=0x4404d6
runtime.selectgo(0xc007e9ef68, 0xc007e9eda8, 0xc0408b1c00?, 0x0, 0xc020c3a501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e9ed40 sp=0xc007e9ec00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e4dcb40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007e9efc8 sp=0xc007e9ed40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007e9efe0 sp=0xc007e9efc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e9efe8 sp=0xc007e9efe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5489 [select, 45 minutes]:
runtime.gopark(0xc007fedf90?, 0x2?, 0xd8?, 0xdd?, 0xc007fedf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007fedd90 sp=0xc007fedd70 pc=0x4404d6
runtime.selectgo(0xc007fedf90, 0xc007fedf20, 0xc0386f64c0?, 0x0, 0xc01ef7ab40?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007feded0 sp=0xc007fedd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e5cb200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007fedfc8 sp=0xc007feded0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007fedfe0 sp=0xc007fedfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007fedfe8 sp=0xc007fedfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5488 [select, 45 minutes]:
runtime.gopark(0xc007ff3f68?, 0x4?, 0x3?, 0x0?, 0xc007ff3db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ff3c00 sp=0xc007ff3be0 pc=0x4404d6
runtime.selectgo(0xc007ff3f68, 0xc007ff3da8, 0xc0316a0400?, 0x0, 0xc007ea8501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ff3d40 sp=0xc007ff3c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e5cb200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007ff3fc8 sp=0xc007ff3d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007ff3fe0 sp=0xc007ff3fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ff3fe8 sp=0xc007ff3fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5480 [select, 45 minutes]:
runtime.gopark(0xc007f91f68?, 0x4?, 0x3?, 0x0?, 0xc007f91db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f91c00 sp=0xc007f91be0 pc=0x4404d6
runtime.selectgo(0xc007f91f68, 0xc007f91da8, 0xc021dadd80?, 0x0, 0xc022f6ad01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f91d40 sp=0xc007f91c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e5cb0e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007f91fc8 sp=0xc007f91d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007f91fe0 sp=0xc007f91fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f91fe8 sp=0xc007f91fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5481 [select, 45 minutes]:
runtime.gopark(0xc007f10f90?, 0x2?, 0xd8?, 0xd?, 0xc007f10f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f10d90 sp=0xc007f10d70 pc=0x4404d6
runtime.selectgo(0xc007f10f90, 0xc007f10f20, 0xc0386f6300?, 0x0, 0xc03bf91e00?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f10ed0 sp=0xc007f10d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e5cb0e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007f10fc8 sp=0xc007f10ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007f10fe0 sp=0xc007f10fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f10fe8 sp=0xc007f10fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5477 [select, 45 minutes]:
runtime.gopark(0xc007f8bf90?, 0x2?, 0xd8?, 0xbd?, 0xc007f8bf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f8bd90 sp=0xc007f8bd70 pc=0x4404d6
runtime.selectgo(0xc007f8bf90, 0xc007f8bf20, 0xc0386f61c0?, 0x0, 0xc03bf918f0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f8bed0 sp=0xc007f8bd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e5cafc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007f8bfc8 sp=0xc007f8bed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007f8bfe0 sp=0xc007f8bfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f8bfe8 sp=0xc007f8bfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5476 [select, 45 minutes]:
runtime.gopark(0xc007f90f68?, 0x4?, 0x3?, 0x0?, 0xc007f90db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f90c00 sp=0xc007f90be0 pc=0x4404d6
runtime.selectgo(0xc007f90f68, 0xc007f90da8, 0xc0437999c0?, 0x0, 0xc022f6ad01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f90d40 sp=0xc007f90c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e5cafc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007f90fc8 sp=0xc007f90d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007f90fe0 sp=0xc007f90fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f90fe8 sp=0xc007f90fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5457 [select, 45 minutes]:
runtime.gopark(0xc007e9cf90?, 0x2?, 0xd8?, 0xcd?, 0xc007e9cf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e9cd90 sp=0xc007e9cd70 pc=0x4404d6
runtime.selectgo(0xc007e9cf90, 0xc007e9cf20, 0xc0408b1ec0?, 0x0, 0xc03bf91440?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e9ced0 sp=0xc007e9cd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e5caea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007e9cfc8 sp=0xc007e9ced0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007e9cfe0 sp=0xc007e9cfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e9cfe8 sp=0xc007e9cfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5453 [select, 45 minutes]:
runtime.gopark(0xc007ea0f90?, 0x2?, 0xd8?, 0xd?, 0xc007ea0f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ea0d90 sp=0xc007ea0d70 pc=0x4404d6
runtime.selectgo(0xc007ea0f90, 0xc007ea0f20, 0xc0408b1d40?, 0x0, 0xc03bf90f30?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ea0ed0 sp=0xc007ea0d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0220a46c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007ea0fc8 sp=0xc007ea0ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007ea0fe0 sp=0xc007ea0fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ea0fe8 sp=0xc007ea0fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5450 [select, 45 minutes]:
runtime.gopark(0xc007e58f68?, 0x4?, 0x3?, 0x0?, 0xc007e58db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e58c00 sp=0xc007e58be0 pc=0x4404d6
runtime.selectgo(0xc007e58f68, 0xc007e58da8, 0xc021dadc80?, 0x0, 0xc007ea8501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e58d40 sp=0xc007e58c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e5caa20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007e58fc8 sp=0xc007e58d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007e58fe0 sp=0xc007e58fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e58fe8 sp=0xc007e58fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5451 [select, 45 minutes]:
runtime.gopark(0xc007f15f90?, 0x2?, 0xd8?, 0x5d?, 0xc007f15f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f15d90 sp=0xc007f15d70 pc=0x4404d6
runtime.selectgo(0xc007f15f90, 0xc007f15f20, 0xc0408b1d00?, 0x0, 0xc03bf90de0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f15ed0 sp=0xc007f15d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e5caa20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007f15fc8 sp=0xc007f15ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007f15fe0 sp=0xc007f15fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f15fe8 sp=0xc007f15fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5456 [select, 45 minutes]:
runtime.gopark(0xc007f17f68?, 0x4?, 0x3?, 0x0?, 0xc007f17db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f17c00 sp=0xc007f17be0 pc=0x4404d6
runtime.selectgo(0xc007f17f68, 0xc007f17da8, 0xc043799880?, 0x0, 0xc022f6e501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f17d40 sp=0xc007f17c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e5caea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007f17fc8 sp=0xc007f17d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007f17fe0 sp=0xc007f17fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f17fe8 sp=0xc007f17fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5383 [select, 45 minutes]:
runtime.gopark(0xc0086d6f68?, 0x4?, 0x3?, 0x0?, 0xc0086d6db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0086d6c00 sp=0xc0086d6be0 pc=0x4404d6
runtime.selectgo(0xc0086d6f68, 0xc0086d6da8, 0xc043799400?, 0x0, 0xc03e4e1301?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0086d6d40 sp=0xc0086d6c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0220a4240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0086d6fc8 sp=0xc0086d6d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0086d6fe0 sp=0xc0086d6fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0086d6fe8 sp=0xc0086d6fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5417 [select, 45 minutes]:
runtime.gopark(0xc007ec6f68?, 0x4?, 0x3?, 0x0?, 0xc007ec6db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ec6c00 sp=0xc007ec6be0 pc=0x4404d6
runtime.selectgo(0xc007ec6f68, 0xc007ec6da8, 0xc0408b1380?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ec6d40 sp=0xc007ec6c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acd8c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007ec6fc8 sp=0xc007ec6d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007ec6fe0 sp=0xc007ec6fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ec6fe8 sp=0xc007ec6fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5404 [select, 45 minutes]:
runtime.gopark(0xc007e59f68?, 0x4?, 0x3?, 0x0?, 0xc007e59db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e59c00 sp=0xc007e59be0 pc=0x4404d6
runtime.selectgo(0xc007e59f68, 0xc007e59da8, 0xc021dad800?, 0x0, 0xc00281a501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e59d40 sp=0xc007e59c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021d77d40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007e59fc8 sp=0xc007e59d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007e59fe0 sp=0xc007e59fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e59fe8 sp=0xc007e59fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5400 [select, 45 minutes]:
runtime.gopark(0xc002217f68?, 0x4?, 0x3?, 0x0?, 0xc002217db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002217c00 sp=0xc002217be0 pc=0x4404d6
runtime.selectgo(0xc002217f68, 0xc002217da8, 0xc0408b1640?, 0x0, 0xc002c30501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002217d40 sp=0xc002217c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021d77c20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002217fc8 sp=0xc002217d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002217fe0 sp=0xc002217fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002217fe8 sp=0xc002217fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 3101 [IO wait]:
runtime.gopark(0x46f9ce?, 0xb?, 0x0?, 0x0?, 0x16?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a4dcb0 sp=0xc002a4dc90 pc=0x4404d6
runtime.netpollblock(0x484d05?, 0xfaa7a0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc002a4dce8 sp=0xc002a4dcb0 pc=0x438cb7
internal/poll.runtime_pollWait(0x7f619a015888, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc002a4dd08 sp=0xc002a4dce8 pc=0x46c0c9
internal/poll.(*pollDesc).wait(0xc007cb8000?, 0xc00c35c810?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc002a4dd30 sp=0xc002a4dd08 pc=0x4a5f32
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc007cb8000, {0xc00c35c810, 0x8, 0x8})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc002a4ddb0 sp=0xc002a4dd30 pc=0x4a729a
net.(*netFD).Read(0xc007cb8000, {0xc00c35c810?, 0xc002a4de30?, 0x455612?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc002a4ddf8 sp=0xc002a4ddb0 pc=0x684429
net.(*conn).Read(0xc0002115d8, {0xc00c35c810?, 0xc002a4ded8?, 0xbfbb8f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc002a4de40 sp=0xc002a4ddf8 pc=0x6946a5
github.com/couchbase/gometa/common.(*PeerPipe).readBytes(0xc006796c80, 0x128bb20?, {0x0?, 0xc040619b80?, 0xc0021473e0?})
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:313 +0xcf fp=0xc002a4dee8 sp=0xc002a4de40 pc=0xbfbccf
github.com/couchbase/gometa/common.(*PeerPipe).doReceive(0xc006796c80)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:214 +0xd5 fp=0xc002a4dfc8 sp=0xc002a4dee8 pc=0xbfae35
github.com/couchbase/gometa/common.NewPeerPipe.func2()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x26 fp=0xc002a4dfe0 sp=0xc002a4dfc8 pc=0xbf9ea6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a4dfe8 sp=0xc002a4dfe0 pc=0x471ba1
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x18a
goroutine 3100 [chan receive, 51 minutes]:
runtime.gopark(0x4a9460?, 0xc007cb8000?, 0x28?, 0xfe?, 0xc002a4fe88?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a4fe28 sp=0xc002a4fe08 pc=0x4404d6
runtime.chanrecv(0xc002dbfaa0, 0xc002a4ff90, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc002a4feb8 sp=0xc002a4fe28 pc=0x40c87b
runtime.chanrecv2(0xc0002115d8?, 0xc007dfa6c0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc002a4fee0 sp=0xc002a4feb8 pc=0x40c3b8
github.com/couchbase/gometa/common.(*PeerPipe).doSend(0xc006796c80)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:167 +0x9e fp=0xc002a4ffc8 sp=0xc002a4fee0 pc=0xbfa65e
github.com/couchbase/gometa/common.NewPeerPipe.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x26 fp=0xc002a4ffe0 sp=0xc002a4ffc8 pc=0xbf9f06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a4ffe8 sp=0xc002a4ffe0 pc=0x471ba1
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x14d
goroutine 3132 [select]:
runtime.gopark(0xc002343f90?, 0x2?, 0xc0?, 0x9b?, 0xc002343f4c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008949dc8 sp=0xc008949da8 pc=0x4404d6
runtime.selectgo(0xc008949f90, 0xc002343f48, 0xc01bfa5110?, 0x0, 0x1010001011197d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008949f08 sp=0xc008949dc8 pc=0x45035c
github.com/couchbase/gometa/protocol.(*Follower).startListener(0xc007e38d90)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:149 +0xe5 fp=0xc008949fc8 sp=0xc008949f08 pc=0xcae925
github.com/couchbase/gometa/protocol.(*Follower).Start.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x26 fp=0xc008949fe0 sp=0xc008949fc8 pc=0xcae526
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008949fe8 sp=0xc008949fe0 pc=0x471ba1
created by github.com/couchbase/gometa/protocol.(*Follower).Start
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x56
goroutine 17178 [IO wait]:
runtime.gopark(0x0?, 0xb?, 0x0?, 0x0?, 0x20?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0093ebaf8 sp=0xc0093ebad8 pc=0x4404d6
runtime.netpollblock(0x484d05?, 0x492797?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0093ebb30 sp=0xc0093ebaf8 pc=0x438cb7
internal/poll.runtime_pollWait(0x7f610fa479f0, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0093ebb50 sp=0xc0093ebb30 pc=0x46c0c9
internal/poll.(*pollDesc).wait(0xc000fd5080?, 0xc007ada000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0093ebb78 sp=0xc0093ebb50 pc=0x4a5f32
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000fd5080, {0xc007ada000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0093ebbf8 sp=0xc0093ebb78 pc=0x4a729a
net.(*netFD).Read(0xc000fd5080, {0xc007ada000?, 0x40bdd1?, 0x4?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0093ebc40 sp=0xc0093ebbf8 pc=0x684429
net.(*conn).Read(0xc008fb6068, {0xc007ada000?, 0x0?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0093ebc88 sp=0xc0093ebc40 pc=0x6946a5
net/http.(*persistConn).Read(0xc017b7d200, {0xc007ada000?, 0xc021e9e600?, 0xc0093ebd30?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc0093ebce8 sp=0xc0093ebc88 pc=0x787b2e
bufio.(*Reader).fill(0xc004e0e960)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc0093ebd20 sp=0xc0093ebce8 pc=0x52671f
bufio.(*Reader).Peek(0xc004e0e960, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:144 +0x5d fp=0xc0093ebd40 sp=0xc0093ebd20 pc=0x52687d
net/http.(*persistConn).readLoop(0xc017b7d200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2093 +0x1ac fp=0xc0093ebfc8 sp=0xc0093ebd40 pc=0x78894c
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0093ebfe0 sp=0xc0093ebfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0093ebfe8 sp=0xc0093ebfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 3133 [select]:
runtime.gopark(0xc0025c3f90?, 0x2?, 0x80?, 0xdc?, 0xc0025c3f4c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000d7dc8 sp=0xc0000d7da8 pc=0x4404d6
runtime.selectgo(0xc0000d7f90, 0xc0025c3f48, 0xc001686360?, 0x0, 0x101000101ca4fd0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000d7f08 sp=0xc0000d7dc8 pc=0x45035c
github.com/couchbase/gometa/protocol.(*Follower).startListener(0xc007e39b90)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:149 +0xe5 fp=0xc0000d7fc8 sp=0xc0000d7f08 pc=0xcae925
github.com/couchbase/gometa/protocol.(*Follower).Start.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x26 fp=0xc0000d7fe0 sp=0xc0000d7fc8 pc=0xcae526
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000d7fe8 sp=0xc0000d7fe0 pc=0x471ba1
created by github.com/couchbase/gometa/protocol.(*Follower).Start
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x56
goroutine 5328 [select, 45 minutes]:
runtime.gopark(0xc0002e1f90?, 0x2?, 0xd8?, 0x1d?, 0xc0002e1f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002e1d90 sp=0xc0002e1d70 pc=0x4404d6
runtime.selectgo(0xc0002e1f90, 0xc0002e1f20, 0xc021dad480?, 0x0, 0xc02b3bb5c0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0002e1ed0 sp=0xc0002e1d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc022219e60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0002e1fc8 sp=0xc0002e1ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0002e1fe0 sp=0xc0002e1fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002e1fe8 sp=0xc0002e1fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5418 [select, 45 minutes]:
runtime.gopark(0xc007ecaf90?, 0x2?, 0xd8?, 0xad?, 0xc007ecaf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ecad90 sp=0xc007ecad70 pc=0x4404d6
runtime.selectgo(0xc007ecaf90, 0xc007ecaf20, 0xc043799640?, 0x0, 0xc0381d1ec0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ecaed0 sp=0xc007ecad90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acd8c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007ecafc8 sp=0xc007ecaed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007ecafe0 sp=0xc007ecafc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ecafe8 sp=0xc007ecafe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5430 [select, 45 minutes]:
runtime.gopark(0xc007e9df90?, 0x2?, 0xd8?, 0xdd?, 0xc007e9df24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e9dd90 sp=0xc007e9dd70 pc=0x4404d6
runtime.selectgo(0xc007e9df90, 0xc007e9df20, 0xc021dadbc0?, 0x0, 0xc02b757440?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e9ded0 sp=0xc007e9dd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0220a45a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007e9dfc8 sp=0xc007e9ded0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007e9dfe0 sp=0xc007e9dfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e9dfe8 sp=0xc007e9dfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5438 [select, 45 minutes]:
runtime.gopark(0xc007facf90?, 0x2?, 0xd8?, 0xcd?, 0xc007facf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007facd90 sp=0xc007facd70 pc=0x4404d6
runtime.selectgo(0xc007facf90, 0xc007facf20, 0xc021dade80?, 0x0, 0xc02b757e00?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007faced0 sp=0xc007facd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0220a47e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007facfc8 sp=0xc007faced0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007facfe0 sp=0xc007facfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007facfe8 sp=0xc007facfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5452 [select, 45 minutes]:
runtime.gopark(0xc007f16f68?, 0x4?, 0x3?, 0x0?, 0xc007f16db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f16c00 sp=0xc007f16be0 pc=0x4404d6
runtime.selectgo(0xc007f16f68, 0xc007f16da8, 0xc043799700?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f16d40 sp=0xc007f16c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0220a46c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007f16fc8 sp=0xc007f16d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007f16fe0 sp=0xc007f16fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f16fe8 sp=0xc007f16fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5394 [select, 45 minutes]:
runtime.gopark(0xc008829f68?, 0x4?, 0x3?, 0x0?, 0xc008829db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008829c00 sp=0xc008829be0 pc=0x4404d6
runtime.selectgo(0xc008829f68, 0xc008829da8, 0xc0437992c0?, 0x0, 0x77c501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008829d40 sp=0xc008829c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021d779e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc008829fc8 sp=0xc008829d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc008829fe0 sp=0xc008829fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008829fe8 sp=0xc008829fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5426 [select, 45 minutes]:
runtime.gopark(0xc007e5bf90?, 0x2?, 0xd8?, 0xbd?, 0xc007e5bf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e5bd90 sp=0xc007e5bd70 pc=0x4404d6
runtime.selectgo(0xc007e5bf90, 0xc007e5bf20, 0xc021dada40?, 0x0, 0xc02b756f30?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e5bed0 sp=0xc007e5bd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0220a4480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007e5bfc8 sp=0xc007e5bed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007e5bfe0 sp=0xc007e5bfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e5bfe8 sp=0xc007e5bfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5099 [select, 45 minutes]:
runtime.gopark(0xc002a22f90?, 0x2?, 0xd8?, 0x2d?, 0xc002a22f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a22d90 sp=0xc002a22d70 pc=0x4404d6
runtime.selectgo(0xc002a22f90, 0xc002a22f20, 0xc0408b1080?, 0x0, 0xc02a6696e0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002a22ed0 sp=0xc002a22d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021d777a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002a22fc8 sp=0xc002a22ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002a22fe0 sp=0xc002a22fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a22fe8 sp=0xc002a22fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5095 [select, 45 minutes]:
runtime.gopark(0xc002a48f90?, 0x2?, 0xd8?, 0x8d?, 0xc002a48f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a48d90 sp=0xc002a48d70 pc=0x4404d6
runtime.selectgo(0xc002a48f90, 0xc002a48f20, 0xc0408b0f40?, 0x0, 0xc02a6691d0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002a48ed0 sp=0xc002a48d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021d77680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002a48fc8 sp=0xc002a48ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002a48fe0 sp=0xc002a48fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a48fe8 sp=0xc002a48fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5393 [select, 45 minutes]:
runtime.gopark(0xc007e5af68?, 0x4?, 0x3?, 0x0?, 0xc007e5adb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e5ac00 sp=0xc007e5abe0 pc=0x4404d6
runtime.selectgo(0xc007e5af68, 0xc007e5ada8, 0xc0408b1800?, 0x0, 0xc035438901?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e5ad40 sp=0xc007e5ac00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0220a4480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007e5afc8 sp=0xc007e5ad40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007e5afe0 sp=0xc007e5afc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e5afe8 sp=0xc007e5afe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5384 [select, 45 minutes]:
runtime.gopark(0xc002c5bf90?, 0x2?, 0xd8?, 0xbd?, 0xc002c5bf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002c5bd90 sp=0xc002c5bd70 pc=0x4404d6
runtime.selectgo(0xc002c5bf90, 0xc002c5bf20, 0xc021dad700?, 0x0, 0xc02b756390?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002c5bed0 sp=0xc002c5bd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0220a4240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002c5bfc8 sp=0xc002c5bed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002c5bfe0 sp=0xc002c5bfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002c5bfe8 sp=0xc002c5bfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5395 [select, 45 minutes]:
runtime.gopark(0xc002213f90?, 0x2?, 0xd8?, 0x3d?, 0xc002213f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002213d90 sp=0xc002213d70 pc=0x4404d6
runtime.selectgo(0xc002213f90, 0xc002213f20, 0xc0408b1300?, 0x0, 0xc03c022630?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002213ed0 sp=0xc002213d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021d779e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002213fc8 sp=0xc002213ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002213fe0 sp=0xc002213fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002213fe8 sp=0xc002213fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5407 [select, 45 minutes]:
runtime.gopark(0xc0086d0f90?, 0x2?, 0xd8?, 0xd?, 0xc0086d0f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0086d0d90 sp=0xc0086d0d70 pc=0x4404d6
runtime.selectgo(0xc0086d0f90, 0xc0086d0f20, 0xc0408b1780?, 0x0, 0xc03c0236e0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0086d0ed0 sp=0xc0086d0d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0220a4360)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0086d0fc8 sp=0xc0086d0ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0086d0fe0 sp=0xc0086d0fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0086d0fe8 sp=0xc0086d0fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 4986 [select, 45 minutes]:
runtime.gopark(0xc002a26f68?, 0x4?, 0x3?, 0x0?, 0xc002a26db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a26c00 sp=0xc002a26be0 pc=0x4404d6
runtime.selectgo(0xc002a26f68, 0xc002a26da8, 0xc021dad380?, 0x0, 0x3233333733383101?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002a26d40 sp=0xc002a26c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02d47e6c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002a26fc8 sp=0xc002a26d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002a26fe0 sp=0xc002a26fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a26fe8 sp=0xc002a26fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5432 [select, 45 minutes]:
runtime.gopark(0xc007e9ff90?, 0x2?, 0xd8?, 0xfd?, 0xc007e9ff24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e9fd90 sp=0xc007e9fd70 pc=0x4404d6
runtime.selectgo(0xc007e9ff90, 0xc007e9ff20, 0xc021dadc00?, 0x0, 0xc02b7575c0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007e9fed0 sp=0xc007e9fd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e4dcb40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007e9ffc8 sp=0xc007e9fed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007e9ffe0 sp=0xc007e9ffc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e9ffe8 sp=0xc007e9ffe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5459 [select, 45 minutes]:
runtime.gopark(0xc007f11f68?, 0x4?, 0x3?, 0x0?, 0xc007f11db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f11c00 sp=0xc007f11be0 pc=0x4404d6
runtime.selectgo(0xc007f11f68, 0xc007f11da8, 0xc0408b1f00?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f11d40 sp=0xc007f11c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acdb00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007f11fc8 sp=0xc007f11d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007f11fe0 sp=0xc007f11fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f11fe8 sp=0xc007f11fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5412 [select, 45 minutes]:
runtime.gopark(0xc0086d5f90?, 0x2?, 0xd8?, 0x5d?, 0xc0086d5f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0086d5d90 sp=0xc0086d5d70 pc=0x4404d6
runtime.selectgo(0xc0086d5f90, 0xc0086d5f20, 0xc0437993c0?, 0x0, 0xc0381d1590?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0086d5ed0 sp=0xc0086d5d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acd680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0086d5fc8 sp=0xc0086d5ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0086d5fe0 sp=0xc0086d5fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0086d5fe8 sp=0xc0086d5fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5385 [select, 45 minutes]:
runtime.gopark(0xc0093e8f68?, 0x4?, 0x3?, 0x0?, 0xc0093e8db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0093e8c00 sp=0xc0093e8be0 pc=0x4404d6
runtime.selectgo(0xc0093e8f68, 0xc0093e8da8, 0xc043799540?, 0x0, 0xc03e4e1301?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0093e8d40 sp=0xc0093e8c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acd7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0093e8fc8 sp=0xc0093e8d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0093e8fe0 sp=0xc0093e8fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0093e8fe8 sp=0xc0093e8fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 4304 [select, 45 minutes]:
runtime.gopark(0xc002a49f90?, 0x2?, 0xd8?, 0x9d?, 0xc002a49f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a49d90 sp=0xc002a49d70 pc=0x4404d6
runtime.selectgo(0xc002a49f90, 0xc002a49f20, 0xc043799280?, 0x0, 0xc0381d1020?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002a49ed0 sp=0xc002a49d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acd560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002a49fc8 sp=0xc002a49ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002a49fe0 sp=0xc002a49fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a49fe8 sp=0xc002a49fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 4987 [select, 45 minutes]:
runtime.gopark(0xc000267f90?, 0x2?, 0xd8?, 0x7d?, 0xc000267f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000267d90 sp=0xc000267d70 pc=0x4404d6
runtime.selectgo(0xc000267f90, 0xc000267f20, 0xc03e021f80?, 0x0, 0xc02a668cc0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000267ed0 sp=0xc000267d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02d47e6c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000267fc8 sp=0xc000267ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000267fe0 sp=0xc000267fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000267fe8 sp=0xc000267fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 4299 [select, 45 minutes]:
runtime.gopark(0xc002a25f68?, 0x4?, 0x3?, 0x0?, 0xc002a25db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002a25c00 sp=0xc002a25be0 pc=0x4404d6
runtime.selectgo(0xc002a25f68, 0xc002a25da8, 0xc0408b0e40?, 0x0, 0xc04362e501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002a25d40 sp=0xc002a25c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acd440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002a25fc8 sp=0xc002a25d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002a25fe0 sp=0xc002a25fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002a25fe8 sp=0xc002a25fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5379 [select, 45 minutes]:
runtime.gopark(0xc002c57f68?, 0x4?, 0x3?, 0x0?, 0xc002c57db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002c57c00 sp=0xc002c57be0 pc=0x4404d6
runtime.selectgo(0xc002c57f68, 0xc002c57da8, 0xc043799040?, 0x0, 0xc03e4e1701?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002c57d40 sp=0xc002c57c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc0220a4120)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002c57fc8 sp=0xc002c57d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002c57fe0 sp=0xc002c57fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002c57fe8 sp=0xc002c57fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5485 [select, 45 minutes]:
runtime.gopark(0xc007ff2f90?, 0x2?, 0xd8?, 0x2d?, 0xc007ff2f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ff2d90 sp=0xc007ff2d70 pc=0x4404d6
runtime.selectgo(0xc007ff2f90, 0xc007ff2f20, 0xc0386f6380?, 0x0, 0xc01ef7a000?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ff2ed0 sp=0xc007ff2d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc0220a4c60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007ff2fc8 sp=0xc007ff2ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007ff2fe0 sp=0xc007ff2fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ff2fe8 sp=0xc007ff2fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5411 [select, 45 minutes]:
runtime.gopark(0xc002219f68?, 0x4?, 0x3?, 0x0?, 0xc002219db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002219c00 sp=0xc002219be0 pc=0x4404d6
runtime.selectgo(0xc002219f68, 0xc002219da8, 0xc021dad600?, 0x0, 0x77c501?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002219d40 sp=0xc002219c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acd680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc002219fc8 sp=0xc002219d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc002219fe0 sp=0xc002219fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002219fe8 sp=0xc002219fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5388 [select, 45 minutes]:
runtime.gopark(0xc0086d7f90?, 0x2?, 0xd8?, 0x7d?, 0xc0086d7f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0086d7d90 sp=0xc0086d7d70 pc=0x4404d6
runtime.selectgo(0xc0086d7f90, 0xc0086d7f20, 0xc021dad780?, 0x0, 0xc02b7566c0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0086d7ed0 sp=0xc0086d7d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021d77b00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0086d7fc8 sp=0xc0086d7ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0086d7fe0 sp=0xc0086d7fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0086d7fe8 sp=0xc0086d7fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5386 [select, 45 minutes]:
runtime.gopark(0xc002218f90?, 0x2?, 0xd8?, 0x8d?, 0xc002218f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc002218d90 sp=0xc002218d70 pc=0x4404d6
runtime.selectgo(0xc002218f90, 0xc002218f20, 0xc021dad740?, 0x0, 0xc02b756540?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc002218ed0 sp=0xc002218d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acd7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc002218fc8 sp=0xc002218ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc002218fe0 sp=0xc002218fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002218fe8 sp=0xc002218fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 4303 [select, 45 minutes]:
runtime.gopark(0xc008827f68?, 0x4?, 0x3?, 0x0?, 0xc008827db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008827c00 sp=0xc008827be0 pc=0x4404d6
runtime.selectgo(0xc008827f68, 0xc008827da8, 0xc0408b0f80?, 0x0, 0x203001?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008827d40 sp=0xc008827c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acd560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc008827fc8 sp=0xc008827d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc008827fe0 sp=0xc008827fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008827fe8 sp=0xc008827fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 4300 [select, 45 minutes]:
runtime.gopark(0xc008826f90?, 0x2?, 0xd8?, 0x6d?, 0xc008826f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008826d90 sp=0xc008826d70 pc=0x4404d6
runtime.selectgo(0xc008826f90, 0xc008826f20, 0xc043799140?, 0x0, 0xc0381d0ae0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008826ed0 sp=0xc008826d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acd440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc008826fc8 sp=0xc008826ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc008826fe0 sp=0xc008826fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008826fe8 sp=0xc008826fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5460 [select, 45 minutes]:
runtime.gopark(0xc007f8ff90?, 0x2?, 0xd8?, 0xfd?, 0xc007f8ff24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f8fd90 sp=0xc007f8fd70 pc=0x4404d6
runtime.selectgo(0xc007f8ff90, 0xc007f8ff20, 0xc043799980?, 0x0, 0xc02d77cb70?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f8fed0 sp=0xc007f8fd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acdb00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007f8ffc8 sp=0xc007f8fed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007f8ffe0 sp=0xc007f8ffc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f8ffe8 sp=0xc007f8ffe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5463 [select, 45 minutes]:
runtime.gopark(0xc007f12f68?, 0x4?, 0x3?, 0x0?, 0xc007f12db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f12c00 sp=0xc007f12be0 pc=0x4404d6
runtime.selectgo(0xc007f12f68, 0xc007f12da8, 0xc0386f6200?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f12d40 sp=0xc007f12c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acdc20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007f12fc8 sp=0xc007f12d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007f12fe0 sp=0xc007f12fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f12fe8 sp=0xc007f12fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5464 [select, 45 minutes]:
runtime.gopark(0xc007f8cf90?, 0x2?, 0xd8?, 0xcd?, 0xc007f8cf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f8cd90 sp=0xc007f8cd70 pc=0x4404d6
runtime.selectgo(0xc007f8cf90, 0xc007f8cf20, 0xc043799ac0?, 0x0, 0xc02d77d0b0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f8ced0 sp=0xc007f8cd90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acdc20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007f8cfc8 sp=0xc007f8ced0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007f8cfe0 sp=0xc007f8cfc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f8cfe8 sp=0xc007f8cfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5467 [select, 45 minutes]:
runtime.gopark(0xc007f13f68?, 0x4?, 0x3?, 0x0?, 0xc007f13db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f13c00 sp=0xc007f13be0 pc=0x4404d6
runtime.selectgo(0xc007f13f68, 0xc007f13da8, 0xc021dadec0?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f13d40 sp=0xc007f13c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acdd40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007f13fc8 sp=0xc007f13d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007f13fe0 sp=0xc007f13fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f13fe8 sp=0xc007f13fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5468 [select, 45 minutes]:
runtime.gopark(0xc007f14f90?, 0x2?, 0xd8?, 0x4d?, 0xc007f14f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f14d90 sp=0xc007f14d70 pc=0x4404d6
runtime.selectgo(0xc007f14f90, 0xc007f14f20, 0xc043799c00?, 0x0, 0xc02d77d590?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f14ed0 sp=0xc007f14d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc021acdd40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007f14fc8 sp=0xc007f14ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007f14fe0 sp=0xc007f14fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f14fe8 sp=0xc007f14fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5482 [select, 45 minutes]:
runtime.gopark(0xc007fadf68?, 0x4?, 0x3?, 0x0?, 0xc007faddb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007fadc00 sp=0xc007fadbe0 pc=0x4404d6
runtime.selectgo(0xc007fadf68, 0xc007fadda8, 0xc043799cc0?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007fadd40 sp=0xc007fadc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc021acde60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007fadfc8 sp=0xc007fadd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007fadfe0 sp=0xc007fadfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007fadfe8 sp=0xc007fadfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5492 [select, 45 minutes]:
runtime.gopark(0xc007feef90?, 0x2?, 0xd8?, 0xed?, 0xc007feef24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007feed90 sp=0xc007feed70 pc=0x4404d6
runtime.selectgo(0xc007feef90, 0xc007feef20, 0xc043f36600?, 0x0, 0xc03b98cdb0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007feeed0 sp=0xc007feed90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e441c20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007feefc8 sp=0xc007feeed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007feefe0 sp=0xc007feefc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007feefe8 sp=0xc007feefe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5441 [select, 45 minutes]:
runtime.gopark(0xc007f8df68?, 0x4?, 0x3?, 0x0?, 0xc007f8ddb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007f8dc00 sp=0xc007f8dbe0 pc=0x4404d6
runtime.selectgo(0xc007f8df68, 0xc007f8dda8, 0xc0386f63c0?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007f8dd40 sp=0xc007f8dc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e441560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007f8dfc8 sp=0xc007f8dd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007f8dfe0 sp=0xc007f8dfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007f8dfe8 sp=0xc007f8dfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5494 [select, 45 minutes]:
runtime.gopark(0xc007ff0f90?, 0x2?, 0xd8?, 0xd?, 0xc007ff0f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007ff0d90 sp=0xc007ff0d70 pc=0x4404d6
runtime.selectgo(0xc007ff0f90, 0xc007ff0f20, 0xc043f36640?, 0x0, 0xc03b98cf30?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007ff0ed0 sp=0xc007ff0d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e441e60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007ff0fc8 sp=0xc007ff0ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007ff0fe0 sp=0xc007ff0fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007ff0fe8 sp=0xc007ff0fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5491 [select, 45 minutes]:
runtime.gopark(0xc007fa7f68?, 0x4?, 0x3?, 0x0?, 0xc007fa7db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007fa7c00 sp=0xc007fa7be0 pc=0x4404d6
runtime.selectgo(0xc007fa7f68, 0xc007fa7da8, 0xc0386f6500?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007fa7d40 sp=0xc007fa7c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e441c20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007fa7fc8 sp=0xc007fa7d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007fa7fe0 sp=0xc007fa7fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007fa7fe8 sp=0xc007fa7fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5496 [select, 45 minutes]:
runtime.gopark(0xc008006f90?, 0x2?, 0xd8?, 0x6d?, 0xc008006f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008006d90 sp=0xc008006d70 pc=0x4404d6
runtime.selectgo(0xc008006f90, 0xc008006f20, 0xc043f36680?, 0x0, 0xc03b98cfc0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008006ed0 sp=0xc008006d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e5e3560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc008006fc8 sp=0xc008006ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc008006fe0 sp=0xc008006fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008006fe8 sp=0xc008006fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5509 [select, 45 minutes]:
runtime.gopark(0xc00800af68?, 0x4?, 0x3?, 0x0?, 0xc00800adb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00800ac00 sp=0xc00800abe0 pc=0x4404d6
runtime.selectgo(0xc00800af68, 0xc00800ada8, 0xc0316a0640?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00800ad40 sp=0xc00800ac00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e441d40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc00800afc8 sp=0xc00800ad40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc00800afe0 sp=0xc00800afc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00800afe8 sp=0xc00800afe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5510 [select, 45 minutes]:
runtime.gopark(0xc007fa8f90?, 0x2?, 0xd8?, 0x8d?, 0xc007fa8f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007fa8d90 sp=0xc007fa8d70 pc=0x4404d6
runtime.selectgo(0xc007fa8f90, 0xc007fa8f20, 0xc0316a0600?, 0x0, 0xc037a14a20?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007fa8ed0 sp=0xc007fa8d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc02e441d40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007fa8fc8 sp=0xc007fa8ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007fa8fe0 sp=0xc007fa8fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007fa8fe8 sp=0xc007fa8fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 5493 [select, 45 minutes]:
runtime.gopark(0xc007feff68?, 0x4?, 0x3?, 0x0?, 0xc007fefdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007fefc00 sp=0xc007fefbe0 pc=0x4404d6
runtime.selectgo(0xc007feff68, 0xc007fefda8, 0xc0316a0740?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007fefd40 sp=0xc007fefc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e441e60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007feffc8 sp=0xc007fefd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007feffe0 sp=0xc007feffc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007feffe8 sp=0xc007feffe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5526 [select, 45 minutes]:
runtime.gopark(0xc00800bf68?, 0x4?, 0x3?, 0x0?, 0xc00800bdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00800bc00 sp=0xc00800bbe0 pc=0x4404d6
runtime.selectgo(0xc00800bf68, 0xc00800bda8, 0xc0316a0840?, 0x0, 0xc0002c0e01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00800bd40 sp=0xc00800bc00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e5e3440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc00800bfc8 sp=0xc00800bd40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc00800bfe0 sp=0xc00800bfc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00800bfe8 sp=0xc00800bfe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 5495 [select, 45 minutes]:
runtime.gopark(0xc008005f68?, 0x4?, 0x3?, 0x0?, 0xc008005db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008005c00 sp=0xc008005be0 pc=0x4404d6
runtime.selectgo(0xc008005f68, 0xc008005da8, 0xc0386f6680?, 0x0, 0x44fa01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008005d40 sp=0xc008005c00 pc=0x45035c
net/http.(*persistConn).readLoop(0xc02e5e3560)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc008005fc8 sp=0xc008005d40 pc=0x789525
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc008005fe0 sp=0xc008005fc8 pc=0x787126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008005fe8 sp=0xc008005fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 16993 [select]:
runtime.gopark(0xc0093e9f90?, 0x2?, 0xd8?, 0x9d?, 0xc0093e9f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0093e9d90 sp=0xc0093e9d70 pc=0x4404d6
runtime.selectgo(0xc0093e9f90, 0xc0093e9f20, 0xc01665b000?, 0x0, 0xc015e60360?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0093e9ed0 sp=0xc0093e9d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc019d3b9e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0093e9fc8 sp=0xc0093e9ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0093e9fe0 sp=0xc0093e9fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0093e9fe8 sp=0xc0093e9fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 17179 [select]:
runtime.gopark(0xc08fdd7f90?, 0x2?, 0xd8?, 0x7d?, 0xc08fdd7f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc08fdd7d90 sp=0xc08fdd7d70 pc=0x4404d6
runtime.selectgo(0xc08fdd7f90, 0xc08fdd7f20, 0xc01634f200?, 0x0, 0xc0161d9140?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc08fdd7ed0 sp=0xc08fdd7d90 pc=0x45035c
net/http.(*persistConn).writeLoop(0xc017b7d200)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc08fdd7fc8 sp=0xc08fdd7ed0 pc=0x78a5d5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc08fdd7fe0 sp=0xc08fdd7fc8 pc=0x7870c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc08fdd7fe8 sp=0xc08fdd7fe0 pc=0x471ba1
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
signal: aborted (core dumped)
FAIL github.com/couchbase/indexing/secondary/tests/functionaltests 3812.004s
Indexer Go routine dump logged in /opt/build/ns_server/logs/n_1/indexer_functests_pprof.log
curl: /opt/build/install/lib/libcurl.so.4: no version information available (required by curl)
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 62842 0 62842 0 0 9060k 0 --:--:-- --:--:-- --:--:-- 9.9M
2023/02/10 19:03:36 In TestMain()
2023/02/10 19:03:36 Changing config key indexer.api.enableTestServer to value true
2023/02/10 19:03:36 Using memory_optimized for creating indexes
2023/02/10 19:03:37 Changing config key indexer.settings.storage_mode to value memory_optimized
=== RUN TestRangeWithConcurrentAddMuts
2023/02/10 19:03:42 In TestRangeWithConcurrentAddMuts()
2023/02/10 19:03:42 In DropAllSecondaryIndexes()
2023/02/10 19:03:42 Index found: bucket1_age
2023/02/10 19:03:42 Dropped index bucket1_age
2023/02/10 19:03:42 Index found: bucket2_city
2023/02/10 19:03:42 Dropped index bucket2_city
2023/02/10 19:03:42 Index found: bucket2_company
2023/02/10 19:03:42 Dropped index bucket2_company
2023/02/10 19:03:42 Index found: bucket1_gender
2023/02/10 19:03:42 Dropped index bucket1_gender
2023/02/10 19:03:42 Generating JSON docs
2023/02/10 19:03:42 Setting initial JSON docs in KV
2023/02/10 19:03:43 All indexers are active
2023/02/10 19:03:43 Creating a 2i
2023/02/10 19:03:46 Created the secondary index index_company. Waiting for it become active
2023/02/10 19:03:46 Index is 7210012980563125209 now active
2023/02/10 19:03:46 In Range Scan for Thread 1:
2023/02/10 19:03:46 CreateDocs:: Creating mutations
2023/02/10 19:03:47 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
--- PASS: TestRangeWithConcurrentAddMuts (125.47s)
=== RUN TestRangeWithConcurrentDelMuts
2023/02/10 19:05:47 In TestRangeWithConcurrentDelMuts()
2023/02/10 19:05:47 Generating JSON docs
2023/02/10 19:05:49 Setting initial JSON docs in KV
2023/02/10 19:06:11 All indexers are active
2023/02/10 19:06:11 Creating a 2i
2023/02/10 19:06:11 Index found: index_company
2023/02/10 19:06:11 In Range Scan for Thread 1:
2023/02/10 19:06:11 CreateDocs:: Delete mutations
2023/02/10 19:06:11 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
--- PASS: TestRangeWithConcurrentDelMuts (143.93s)
=== RUN TestScanWithConcurrentIndexOps
2023/02/10 19:08:11 In TestScanWithConcurrentIndexOps()
2023/02/10 19:08:11 Generating JSON docs
2023/02/10 19:08:16 Setting initial JSON docs in KV
2023/02/10 19:09:36 All indexers are active
2023/02/10 19:09:36 Creating a 2i
2023/02/10 19:09:36 Index found: index_company
2023/02/10 19:09:36 Create and Drop index operations
2023/02/10 19:09:36 In Range Scan for Thread 1:
2023/02/10 19:09:37 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
2023/02/10 19:09:55 Created the secondary index index_age. Waiting for it become active
2023/02/10 19:09:55 Index is 8569479330096565322 now active
2023/02/10 19:10:13 Created the secondary index index_firstname. Waiting for it become active
2023/02/10 19:10:13 Index is 4438437378215033144 now active
2023/02/10 19:10:15 Dropping the secondary index index_age
2023/02/10 19:10:15 Index dropped
2023/02/10 19:10:16 Dropping the secondary index index_firstname
2023/02/10 19:10:16 Index dropped
2023/02/10 19:10:34 Created the secondary index index_age. Waiting for it become active
2023/02/10 19:10:34 Index is 9610986242039502161 now active
2023/02/10 19:10:54 Created the secondary index index_firstname. Waiting for it become active
2023/02/10 19:10:54 Index is 5287759879947021638 now active
2023/02/10 19:10:55 Dropping the secondary index index_age
2023/02/10 19:10:56 Index dropped
2023/02/10 19:10:57 Dropping the secondary index index_firstname
2023/02/10 19:10:57 Index dropped
2023/02/10 19:11:14 Created the secondary index index_age. Waiting for it become active
2023/02/10 19:11:14 Index is 12552529582217110053 now active
2023/02/10 19:11:33 Created the secondary index index_firstname. Waiting for it become active
2023/02/10 19:11:33 Index is 12890757530207489226 now active
2023/02/10 19:11:35 Dropping the secondary index index_age
2023/02/10 19:11:35 Index dropped
2023/02/10 19:11:36 Dropping the secondary index index_firstname
2023/02/10 19:11:36 Index dropped
--- PASS: TestScanWithConcurrentIndexOps (206.19s)
=== RUN TestConcurrentScans_SameIndex
2023/02/10 19:11:37 In TestConcurrentScans_SameIndex()
2023/02/10 19:11:37 Generating JSON docs
2023/02/10 19:11:43 Setting initial JSON docs in KV
2023/02/10 19:13:05 All indexers are active
2023/02/10 19:13:05 Creating a 2i
2023/02/10 19:13:05 Index found: index_company
2023/02/10 19:13:05 In Range Scan for Thread 3:
2023/02/10 19:13:05 In Range Scan for Thread 1:
2023/02/10 19:13:05 In Range Scan for Thread 2:
2023/02/10 19:13:05 In Range Scan for Thread 4:
2023/02/10 19:13:05 In Range Scan for Thread 5:
2023/02/10 19:13:05 In Range Scan for Thread 6:
2023/02/10 19:13:05 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
2023/02/10 19:13:05 ListAllSecondaryIndexes() for Thread 4: : Index index_company Bucket default
2023/02/10 19:13:05 ListAllSecondaryIndexes() for Thread 3: : Index index_company Bucket default
2023/02/10 19:13:05 ListAllSecondaryIndexes() for Thread 6: : Index index_company Bucket default
2023/02/10 19:13:05 ListAllSecondaryIndexes() for Thread 2: : Index index_company Bucket default
2023/02/10 19:13:05 ListAllSecondaryIndexes() for Thread 5: : Index index_company Bucket default
--- PASS: TestConcurrentScans_SameIndex (209.32s)
=== RUN TestConcurrentScans_MultipleIndexes
2023/02/10 19:15:06 In TestConcurrentScans_MultipleIndexes()
2023/02/10 19:15:06 Generating JSON docs
2023/02/10 19:15:12 Setting initial JSON docs in KV
2023/02/10 19:16:31 All indexers are active
2023/02/10 19:16:31 Creating multiple indexes
2023/02/10 19:16:31 Index found: index_company
2023/02/10 19:17:00 Created the secondary index index_age. Waiting for it become active
2023/02/10 19:17:00 Index is 4994934348887603613 now active
2023/02/10 19:17:25 Created the secondary index index_firstname. Waiting for it become active
2023/02/10 19:17:25 Index is 12382146705024711223 now active
2023/02/10 19:17:25 In Range Scan for Thread 3:
2023/02/10 19:17:25 In Range Scan for Thread 1:
2023/02/10 19:17:25 In Range Scan
2023/02/10 19:17:25 ListAllSecondaryIndexes() for Thread 1: : Index index_firstname Bucket default
2023/02/10 19:17:25 ListAllSecondaryIndexes() for Thread 1: : Index index_age Bucket default
2023/02/10 19:17:25 ListAllSecondaryIndexes() for Thread 1: : Index index_company Bucket default
2023/02/10 19:17:25 ListAllSecondaryIndexes() for Thread 3: : Index index_firstname Bucket default
2023/02/10 19:17:25 ListAllSecondaryIndexes() for Thread 3: : Index index_age Bucket default
2023/02/10 19:17:25 ListAllSecondaryIndexes() for Thread 3: : Index index_company Bucket default
--- PASS: TestConcurrentScans_MultipleIndexes (259.39s)
=== RUN TestMutationsWithMultipleIndexBuilds
2023/02/10 19:19:26 In TestMutationsWithMultipleIndexBuilds()
2023/02/10 19:19:26 In DropAllSecondaryIndexes()
2023/02/10 19:19:26 Index found: index_company
2023/02/10 19:19:26 Dropped index index_company
2023/02/10 19:19:26 Index found: index_age
2023/02/10 19:19:26 Dropped index index_age
2023/02/10 19:19:26 Index found: index_firstname
2023/02/10 19:19:26 Dropped index index_firstname
2023/02/10 19:19:26 Generating JSON docs
2023/02/10 19:19:32 Setting initial JSON docs in KV
2023/02/10 19:20:58 Created the secondary index index_primary. Waiting for it become active
2023/02/10 19:20:58 Index is 7682855667719840250 now active
2023/02/10 19:20:58 Creating multiple indexes in deferred mode
2023/02/10 19:20:58 Build Indexes and wait for indexes to become active: [index_company index_age index_firstname index_lastname]
2023/02/10 19:20:58 Build command issued for the deferred indexes [index_company index_age index_firstname index_lastname], bucket: default, scope: _default, coll: _default
2023/02/10 19:20:58 Waiting for the index index_company to become active
2023/02/10 19:20:58 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:20:59 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:00 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:01 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:02 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:03 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:04 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:05 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:06 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:07 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:08 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:09 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:10 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:11 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:12 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:13 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:14 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:15 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:16 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:17 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:18 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:19 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:20 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:21 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:22 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:23 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:24 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:25 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:26 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:27 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:28 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:29 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:30 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:31 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:32 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:33 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:34 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:35 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:36 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:37 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:38 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:39 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:40 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:41 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:42 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:43 Waiting for index 5410924244226275354 to go active ...
2023/02/10 19:21:44 Index is 5410924244226275354 now active
2023/02/10 19:21:44 Waiting for the index index_age to become active
2023/02/10 19:21:44 Index is 13223518263510521345 now active
2023/02/10 19:21:44 Waiting for the index index_firstname to become active
2023/02/10 19:21:44 Index is 2677713580407128021 now active
2023/02/10 19:21:44 Waiting for the index index_lastname to become active
2023/02/10 19:21:44 Index is 1688032677338187397 now active
--- PASS: TestMutationsWithMultipleIndexBuilds (138.27s)
PASS
ok github.com/couchbase/indexing/secondary/tests/largedatatests 1088.133s
Indexer Go routine dump logged in /opt/build/ns_server/logs/n_1/indexer_largedata_pprof.log
curl: /opt/build/install/lib/libcurl.so.4: no version information available (required by curl)
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 68328 0 68328 0 0 4698k 0 --:--:-- --:--:-- --:--:-- 5132k
Serverless tests
Starting server: attempt 1
Serverless tests
2023/02/10 19:24:47 In TestMain()
2023/02/10 19:24:47 otp node fetch error: json: cannot unmarshal string into Go value of type couchbase.Pool
2023/02/10 19:24:47 Initialising services with role: kv,n1ql on node: 127.0.0.1:9000
2023/02/10 19:24:48 Initialising web UI on node: 127.0.0.1:9000
2023/02/10 19:24:48 InitWebCreds, response is: {"newBaseUri":"http://127.0.0.1:9000/"}
2023/02/10 19:24:48 Setting data quota of 1500M and Index quota of 1500M
2023/02/10 19:24:48 Adding serverGroup: Group 2 via server: 127.0.0.1:9000
2023/02/10 19:24:48 AddServerGroup: Successfully added serverGroup 127.0.0.1:9000, server: Group 2, response: []
2023/02/10 19:24:49 Adding node: https://127.0.0.1:19001 with role: index to the cluster with uri: /pools/default/serverGroups/0309217dccd98f2f7d4b72b8d8ad3677/addNode
2023/02/10 19:24:55 AddNodeWithServerGroup: Successfully added node: 127.0.0.1:9001 (role index, serverGroup: Group 2), response: {"otpNode":"n_1@127.0.0.1"}
2023/02/10 19:24:56 Adding node: https://127.0.0.1:19002 with role: index to the cluster with uri: /pools/default/serverGroups/0/addNode
2023/02/10 19:25:03 AddNodeWithServerGroup: Successfully added node: 127.0.0.1:9002 (role index, serverGroup: Group 1), response: {"otpNode":"n_2@127.0.0.1"}
2023/02/10 19:25:08 Rebalance progress: 0
2023/02/10 19:25:13 Rebalance progress: 100
2023/02/10 19:25:18 Created bucket default, responseBody:
2023/02/10 19:25:23 Cluster status: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 172.31.5.112:9000:[kv n1ql]]
2023/02/10 19:25:23 Successfully initialised cluster
2023/02/10 19:25:23 Cluster status: map[127.0.0.1:9001:[index] 127.0.0.1:9002:[index] 172.31.5.112:9000:[kv n1ql]]
2023/02/10 19:25:23 Changing config key queryport.client.settings.backfillLimit to value 0
2023/02/10 19:25:23 Changing config key queryport.client.log_level to value Warn
2023/02/10 19:25:23 Changing config key indexer.api.enableTestServer to value true
2023/02/10 19:25:24 Changing config key indexer.settings.persisted_snapshot_init_build.moi.interval to value 60000
2023/02/10 19:25:24 Changing config key indexer.settings.persisted_snapshot.moi.interval to value 60000
2023/02/10 19:25:24 Changing config key indexer.settings.log_level to value info
2023/02/10 19:25:24 Changing config key indexer.settings.storage_mode.disable_upgrade to value true
2023/02/10 19:25:24 Changing config key indexer.settings.rebalance.blob_storage_scheme to value
2023/02/10 19:25:24 Changing config key indexer.plasma.serverless.shardCopy.dbg to value true
2023/02/10 19:25:24 Changing config key indexer.rebalance.serverless.transferBatchSize to value 2
2023/02/10 19:25:24 Changing config key indexer.client_stats_refresh_interval to value 500
2023/02/10 19:25:24 Using plasma for creating indexes
2023/02/10 19:25:24 Changing config key indexer.settings.storage_mode to value plasma
2023/02/10 19:25:29 Data file exists. Skipping download
2023/02/10 19:25:29 Data file exists. Skipping download
2023/02/10 19:25:31 In DropAllSecondaryIndexes()
2023/02/10 19:25:31 Emptying the default bucket
2023/02/10 19:25:31 Deleted bucket default, responseBody:
2023/02/10 19:25:31 http://127.0.0.1:9000/pools/default/buckets/bucket_1
2023/02/10 19:25:31 &{DELETE http://127.0.0.1:9000/pools/default/buckets/bucket_1 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000460d8}
2023/02/10 19:25:31 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:55:31 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc003980200 31 [] false false map[] 0xc00044c400 }
2023/02/10 19:25:31 DeleteBucket failed for bucket bucket_1
2023/02/10 19:25:31 Deleted bucket bucket_1, responseBody: Requested resource not found.
2023/02/10 19:25:31 http://127.0.0.1:9000/pools/default/buckets/bucket_%!(NOVERB)
2023/02/10 19:25:31 &{DELETE http://127.0.0.1:9000/pools/default/buckets/bucket_%252 HTTP/1.1 1 1 map[Authorization:[Basic QWRtaW5pc3RyYXRvcjphc2Rhc2Q=] Content-Type:[application/x-www-form-urlencoded; charset=UTF-8]] 0 [] false 127.0.0.1:9000 map[] map[] map[] 0xc0000460d8}
2023/02/10 19:25:31 &{404 Object Not Found 404 HTTP/1.1 1 1 map[Cache-Control:[no-cache,no-store,must-revalidate] Content-Length:[31] Content-Type:[text/plain] Date:[Fri, 10 Feb 2023 13:55:31 GMT] Expires:[Thu, 01 Jan 1970 00:00:00 GMT] Pragma:[no-cache] Server:[Couchbase Server] X-Content-Type-Options:[nosniff] X-Frame-Options:[DENY] X-Permitted-Cross-Domain-Policies:[none] X-Xss-Protection:[1; mode=block]] 0xc003980800 31 [] false false map[] 0xc000226100 }
2023/02/10 19:25:31 DeleteBucket failed for bucket bucket_%2
2023/02/10 19:25:31 Deleted bucket bucket_%2, responseBody: Requested resource not found.
2023/02/10 19:25:46 cleanupStorageDir: Cleaning up /opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/serverlesstests/shard_rebalance_storage_dir
=== RUN TestIndexPlacement
2023/02/10 19:25:46 Created bucket bucket_1, responseBody:
2023/02/10 19:25:46 WaitForBucketCreation: Checking bucket(bucket_1) creation for host: 127.0.0.1:9000
2023/02/10 19:25:48 WaitForBucketCreation: Checking bucket(bucket_1) creation for host: 127.0.0.1:9001
2023/02/10 19:25:48 WaitForBucketCreation: Checking bucket(bucket_1) creation for host: 127.0.0.1:9002
2023/02/10 19:25:48 Created collection succeeded for bucket: bucket_1, scope: _default, collection: c1, body: {"uid":"2"}
2023/02/10 19:25:48 TestIndexPlacement: Manifest for bucket: bucket_1, scope: _default, collection: c1 is: map[uid:2]
2023/02/10 19:25:48 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9000, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:25:48 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9001, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:25:48 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9002, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:25:48 Received OK response from ensureManifest, bucket: bucket_1, uid: 2
2023/02/10 19:25:49 Executing N1ql statement: create index idx_1 on `bucket_1`.`_default`.`c1`(company)
2023/02/10 19:35:15 Index status is: Ready for index: idx_1, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:35:15 Index status is: Ready for index: idx_1 (replica 1), bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:35:18 scanIndexReplicas: Scanning all for index: idx_1, bucket: bucket_1, scope: _default, collection: c1
2023-02-10T19:35:18.424+05:30 [Info] creating GsiClient for 127.0.0.1:9000
2023/02/10 19:35:20 Deleted bucket bucket_1, responseBody:
--- PASS: TestIndexPlacement (588.51s)
=== RUN TestShardIdMapping
2023/02/10 19:35:35 Created bucket bucket_1, responseBody:
2023/02/10 19:35:35 WaitForBucketCreation: Checking bucket(bucket_1) creation for host: 127.0.0.1:9000
2023/02/10 19:35:36 WaitForBucketCreation: Checking bucket(bucket_1) creation for host: 127.0.0.1:9001
2023/02/10 19:35:36 WaitForBucketCreation: Checking bucket(bucket_1) creation for host: 127.0.0.1:9002
2023/02/10 19:35:36 Retrying to set key: User-11274635433767794895, collectionId: 0
2023/02/10 19:35:38 Executing N1ql statement: create index idx_secondary on `bucket_1`.`_default`.`_default`(age)
2023/02/10 19:36:50 Index status is: Ready for index: idx_secondary, bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:36:50 Index status is: Ready for index: idx_secondary (replica 1), bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:36:50 Executing N1ql statement: create index idx_secondary_defer on `bucket_1`.`_default`.`_default`(company) with {"defer_build":true}
2023/02/10 19:36:56 Index status is: Created for index: idx_secondary_defer, bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:36:56 Index status is: Created for index: idx_secondary_defer (replica 1), bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:36:56 Executing N1ql statement: create primary index `#primary` on `bucket_1`.`_default`.`_default`
2023/02/10 19:37:01 Index status is: Ready for index: #primary, bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:37:01 Index status is: Ready for index: #primary (replica 1), bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:37:01 Executing N1ql statement: create primary index `#primary_defer` on `bucket_1`.`_default`.`_default` with {"defer_build":true}
2023/02/10 19:37:05 Index status is: Created for index: #primary_defer, bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:37:05 Index status is: Created for index: #primary_defer (replica 1), bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:37:05 Executing N1ql statement: create index idx_partitioned on `bucket_1`.`_default`.`_default`(emailid) partition by hash(meta().id)
2023/02/10 19:37:16 Index status is: Ready for index: idx_partitioned, bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:37:16 Index status is: Ready for index: idx_partitioned (replica 1), bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:37:16 Executing N1ql statement: create index idx_partitioned_defer on `bucket_1`.`_default`.`_default`(balance) partition by hash(meta().id) with {"defer_build":true}
2023/02/10 19:37:26 Index status is: Created for index: idx_partitioned_defer, bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:37:26 Index status is: Created for index: idx_partitioned_defer (replica 1), bucket: bucket_1, scope: _default, collection: _default
2023/02/10 19:37:26 Created collection succeeded for bucket: bucket_1, scope: _default, collection: c1, body: {"uid":"2"}
2023/02/10 19:37:26 TestIndexPlacement: Manifest for bucket: bucket_1, scope: _default, collection: c1 is: map[uid:2]
2023/02/10 19:37:26 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9000, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:26 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9001, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:26 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9002, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:26 Received OK response from ensureManifest, bucket: bucket_1, uid: 2
2023/02/10 19:37:27 Executing N1ql statement: create index idx_secondary on `bucket_1`.`_default`.`c1`(age)
2023/02/10 19:37:35 Index status is: Ready for index: idx_secondary, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:35 Index status is: Ready for index: idx_secondary (replica 1), bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:35 Executing N1ql statement: create index idx_secondary_defer on `bucket_1`.`_default`.`c1`(company) with {"defer_build":true}
2023/02/10 19:37:41 Index status is: Created for index: idx_secondary_defer, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:41 Index status is: Created for index: idx_secondary_defer (replica 1), bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:41 Executing N1ql statement: create primary index `#primary` on `bucket_1`.`_default`.`c1`
2023/02/10 19:37:51 Index status is: Ready for index: #primary, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:51 Index status is: Ready for index: #primary (replica 1), bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:37:51 Executing N1ql statement: create primary index `#primary_defer` on `bucket_1`.`_default`.`c1` with {"defer_build":true}
2023/02/10 19:38:01 Index status is: Created for index: #primary_defer, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:38:01 Index status is: Created for index: #primary_defer (replica 1), bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:38:01 Executing N1ql statement: create index idx_partitioned on `bucket_1`.`_default`.`c1`(emailid) partition by hash(meta().id)
2023/02/10 19:38:06 Index status is: Ready for index: idx_partitioned, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:38:06 Index status is: Ready for index: idx_partitioned (replica 1), bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:38:06 Executing N1ql statement: create index idx_partitioned_defer on `bucket_1`.`_default`.`c1`(balance) partition by hash(meta().id) with {"defer_build":true}
2023/02/10 19:38:11 Index status is: Created for index: idx_partitioned_defer, bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:38:11 Index status is: Created for index: idx_partitioned_defer (replica 1), bucket: bucket_1, scope: _default, collection: c1
2023/02/10 19:38:11 Created collection succeeded for bucket: bucket_1, scope: _default, collection: c2%, body: {"uid":"3"}
2023/02/10 19:38:11 TestIndexPlacement: Manifest for bucket: bucket_1, scope: _default, collection: c2% is: map[uid:3]
2023/02/10 19:38:11 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9000, bucket: bucket_1, scope: _default, collection: c2%
2023/02/10 19:38:11 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9001, bucket: bucket_1, scope: _default, collection: c2%
2023/02/10 19:38:11 WaitForCollectionCreation: Checking collection creation for host: 127.0.0.1:9002, bucket: bucket_1, scope: _default, collection: c2%
2023/02/10 19:38:11 Received OK response from ensureManifest, bucket: bucket_1, uid: 3
2023/02/10 19:38:12 Executing N1ql statement: create index idx_secondary on `bucket_1`.`_default`.`c2%`(age)
2023/02/10 19:38:20 Index status is: Ready for index: idx_secondary, bucket: bucket_1, scope: _default, collection: c2%
panic: test timed out after 4h0m0s
goroutine 90082 [running]:
panic({0x106ca60, 0xc0077eee50})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/panic.go:987 +0x3ba fp=0xc009ed9f98 sp=0xc009ed9ed8 pc=0x441afa
testing.(*M).startAlarm.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:2036 +0x8e fp=0xc009ed9fe0 sp=0xc009ed9f98 pc=0x52a2ee
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009ed9fe8 sp=0xc009ed9fe0 pc=0x476581
created by time.goFunc
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/time/sleep.go:176 +0x32
goroutine 1 [chan receive, 230 minutes]:
runtime.gopark(0x1?, 0xc00082d8b8?, 0x1f?, 0x58?, 0xc00082d868?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00082d838 sp=0xc00082d818 pc=0x444c16
runtime.chanrecv(0xc00ba183f0, 0xc00082d937, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00082d8c8 sp=0xc00082d838 pc=0x40ec3b
runtime.chanrecv1(0x1283a57?, 0x1283a57?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc00082d8f0 sp=0xc00082d8c8 pc=0x40e738
testing.(*T).Run(0xc0008f84e0, {0x1283a57?, 0x525fa5?}, 0x12fed48)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1494 +0x37a fp=0xc00082d990 sp=0xc00082d8f0 pc=0x5273ba
testing.runTests.func1(0xc004acf3e0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1846 +0x6e fp=0xc00082d9e0 sp=0xc00082d990 pc=0x52930e
testing.tRunner(0xc0008f84e0, 0xc00082dae8)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1446 +0x10b fp=0xc00082da30 sp=0xc00082d9e0 pc=0x5265cb
testing.runTests(0xc0001360a0?, {0x1fa7240, 0x22, 0x22}, {0x30?, 0x1140a20?, 0x2033920?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1844 +0x456 fp=0xc00082db18 sp=0xc00082da30 pc=0x5291b6
testing.(*M).Run(0xc0001360a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1726 +0x5d9 fp=0xc00082dd10 sp=0xc00082db18 pc=0x527c99
github.com/couchbase/indexing/secondary/tests/serverlesstests.TestMain(0xffffffffffffffff?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/serverlesstests/common_test.go:160 +0x14a5 fp=0xc00082dec8 sp=0xc00082dd10 pc=0xfa9185
main.main()
_testmain.go:115 +0x1d3 fp=0xc00082df80 sp=0xc00082dec8 pc=0xfc6ff3
runtime.main()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:250 +0x212 fp=0xc00082dfe0 sp=0xc00082df80 pc=0x444852
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00082dfe8 sp=0xc00082dfe0 pc=0x476581
goroutine 2 [force gc (idle), 3 minutes]:
runtime.gopark(0x2d7ee0c21f17?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006afb0 sp=0xc00006af90 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.forcegchelper()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:302 +0xad fp=0xc00006afe0 sp=0xc00006afb0 pc=0x444aad
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006afe8 sp=0xc00006afe0 pc=0x476581
created by runtime.init.6
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:290 +0x25
goroutine 18 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000066790 sp=0xc000066770 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.bgsweep(0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgcsweep.go:297 +0xd7 fp=0xc0000667c8 sp=0xc000066790 pc=0x42f097
runtime.gcenable.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:178 +0x26 fp=0xc0000667e0 sp=0xc0000667c8 pc=0x423d06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000667e8 sp=0xc0000667e0 pc=0x476581
created by runtime.gcenable
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:178 +0x6b
goroutine 19 [GC scavenge wait]:
runtime.gopark(0x2033ec0?, 0x165550?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000066f70 sp=0xc000066f50 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.(*scavengerState).park(0x2033ec0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgcscavenge.go:389 +0x53 fp=0xc000066fa0 sp=0xc000066f70 pc=0x42d0f3
runtime.bgscavenge(0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgcscavenge.go:622 +0x65 fp=0xc000066fc8 sp=0xc000066fa0 pc=0x42d6e5
runtime.gcenable.func2()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:179 +0x26 fp=0xc000066fe0 sp=0xc000066fc8 pc=0x423ca6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000066fe8 sp=0xc000066fe0 pc=0x476581
created by runtime.gcenable
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:179 +0xaa
goroutine 3 [finalizer wait]:
runtime.gopark(0x0?, 0x13041e8?, 0x40?, 0x1?, 0x2000000020?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006a628 sp=0xc00006a608 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.runfinq()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mfinal.go:180 +0x10f fp=0xc00006a7e0 sp=0xc00006a628 pc=0x422e0f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006a7e8 sp=0xc00006a7e0 pc=0x476581
created by runtime.createfing
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mfinal.go:157 +0x45
goroutine 34 [select, 240 minutes]:
runtime.gopark(0xc00006b798?, 0x2?, 0x78?, 0xb7?, 0xc00006b784?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006b610 sp=0xc00006b5f0 pc=0x444c16
runtime.selectgo(0xc00006b798, 0xc00006b780, 0xc00006b7a0?, 0x0, 0x11?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00006b750 sp=0xc00006b610 pc=0x454a9c
github.com/couchbase/cbauth/cbauthimpl.(*tlsNotifier).loop(0xc0002a60d8)
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:405 +0x67 fp=0xc00006b7c8 sp=0xc00006b750 pc=0x7ab667
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func2()
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:565 +0x26 fp=0xc00006b7e0 sp=0xc00006b7c8 pc=0x7ac2c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006b7e8 sp=0xc00006b7e0 pc=0x476581
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:565 +0x385
goroutine 35 [select, 240 minutes]:
runtime.gopark(0xc0002c4798?, 0x2?, 0x0?, 0x0?, 0xc0002c478c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c4608 sp=0xc0002c45e8 pc=0x444c16
runtime.selectgo(0xc0002c4798, 0xc0002c4788, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0002c4748 sp=0xc0002c4608 pc=0x454a9c
github.com/couchbase/cbauth/cbauthimpl.(*cfgChangeNotifier).loop(0xc0002a60f0)
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:325 +0x85 fp=0xc0002c47c8 sp=0xc0002c4748 pc=0x7ab0c5
github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest.func3()
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:566 +0x26 fp=0xc0002c47e0 sp=0xc0002c47c8 pc=0x7ac266
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c47e8 sp=0xc0002c47e0 pc=0x476581
created by github.com/couchbase/cbauth/cbauthimpl.NewSVCForTest
/opt/build/goproj/src/github.com/couchbase/cbauth/cbauthimpl/impl.go:566 +0x3d6
goroutine 36 [IO wait]:
runtime.gopark(0xc0093c6078?, 0xb?, 0x0?, 0x0?, 0x6?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000cb780 sp=0xc0000cb760 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x402000?, 0xc0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0000cb7b8 sp=0xc0000cb780 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f676075a098, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0000cb7d8 sp=0xc0000cb7b8 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc000040100?, 0xc000189000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0000cb800 sp=0xc0000cb7d8 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000040100, {0xc000189000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0000cb880 sp=0xc0000cb800 pc=0x4aca5a
net.(*netFD).Read(0xc000040100, {0xc000189000?, 0xc0000cb918?, 0x56f0ff?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0000cb8c8 sp=0xc0000cb880 pc=0x68ae29
net.(*conn).Read(0xc000014500, {0xc000189000?, 0x570216?, 0x10734c0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0000cb910 sp=0xc0000cb8c8 pc=0x69b0a5
bufio.(*Reader).Read(0xc0000a83c0, {0xc0002fc001, 0x5ff, 0x45a394?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc0000cb948 sp=0xc0000cb910 pc=0x52c99b
github.com/couchbase/cbauth/revrpc.(*minirwc).Read(0x1?, {0xc0002fc001?, 0x8?, 0x20?})
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:103 +0x25 fp=0xc0000cb978 sp=0xc0000cb948 pc=0x813c85
encoding/json.(*Decoder).refill(0xc00029f400)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0000cb9c8 sp=0xc0000cb978 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00029f400)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0000cba18 sp=0xc0000cb9c8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00029f400, {0x10ac6a0, 0xc0002b02c0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0000cba48 sp=0xc0000cba18 pc=0x581998
net/rpc/jsonrpc.(*serverCodec).ReadRequestHeader(0xc0002b02a0, 0xc0002863e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/rpc/jsonrpc/server.go:66 +0x85 fp=0xc0000cba88 sp=0xc0000cba48 pc=0x812ee5
github.com/couchbase/cbauth/revrpc.(*jsonServerCodec).ReadRequestHeader(0xc000292690?, 0xc0000cbb38?)
:1 +0x2a fp=0xc0000cbaa8 sp=0xc0000cba88 pc=0x81600a
net/rpc.(*Server).readRequestHeader(0xc000292690, {0x15cc990, 0xc000288660})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/rpc/server.go:588 +0x66 fp=0xc0000cbb78 sp=0xc0000cbaa8 pc=0x8114c6
net/rpc.(*Server).readRequest(0x0?, {0x15cc990, 0xc000288660})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/rpc/server.go:548 +0x3b fp=0xc0000cbc50 sp=0xc0000cbb78 pc=0x81101b
net/rpc.(*Server).ServeCodec(0xc000292690, {0x15cc990?, 0xc000288660})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/rpc/server.go:463 +0x87 fp=0xc0000cbd48 sp=0xc0000cbc50 pc=0x810567
github.com/couchbase/cbauth/revrpc.(*Service).Run(0xc0002c4f60?, 0xc0000cdfa0)
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:236 +0x77f fp=0xc0000cbf38 sp=0xc0000cbd48 pc=0x8149bf
github.com/couchbase/cbauth/revrpc.BabysitService(0x0?, 0x0?, {0x15c0be0?, 0xc000012600?})
/opt/build/goproj/src/github.com/couchbase/cbauth/revrpc/revrpc.go:335 +0x58 fp=0xc0000cbf70 sp=0xc0000cbf38 pc=0x815058
github.com/couchbase/cbauth.runRPCForSvc(0x0?, 0xc0002be000)
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:57 +0xbd fp=0xc0000cbfc0 sp=0xc0000cbf70 pc=0x81f5dd
github.com/couchbase/cbauth.startDefault.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:66 +0x25 fp=0xc0000cbfe0 sp=0xc0000cbfc0 pc=0x81f8c5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000cbfe8 sp=0xc0000cbfe0 pc=0x476581
created by github.com/couchbase/cbauth.startDefault
/opt/build/goproj/src/github.com/couchbase/cbauth/default.go:65 +0xf9
goroutine 38 [GC worker (idle), 240 minutes]:
runtime.gopark(0x2076482867bf?, 0x3?, 0x54?, 0x2a?, 0x16?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c5750 sp=0xc0002c5730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0002c57e0 sp=0xc0002c5750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c57e8 sp=0xc0002c57e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 5 [chan receive, 181 minutes]:
runtime.gopark(0xc000200060?, 0x18?, 0x8?, 0x11?, 0x18?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c4ef8 sp=0xc0002c4ed8 pc=0x444c16
runtime.chanrecv(0xc0001e2cc0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0002c4f88 sp=0xc0002c4ef8 pc=0x40ec3b
runtime.chanrecv1(0xc0002c4fd0?, 0x81f8c5?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc0002c4fb0 sp=0xc0002c4f88 pc=0x40e738
github.com/couchbase/regulator/utils/logging.duplicateFlushLoop()
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:253 +0x25 fp=0xc0002c4fd0 sp=0xc0002c4fb0 pc=0xa40f05
github.com/couchbase/regulator/utils/logging.init.0.func1()
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:49 +0x25 fp=0xc0002c4fe0 sp=0xc0002c4fd0 pc=0xa436a5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c4fe8 sp=0xc0002c4fe0 pc=0x476581
created by github.com/couchbase/regulator/utils/logging.init.0
/opt/build/goproj/src/github.com/couchbase/regulator/utils/logging/logger_golog.go:49 +0x7e
goroutine 6 [GC worker (idle), 240 minutes]:
runtime.gopark(0x207647fb507e?, 0x1?, 0x14?, 0x6f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006bf50 sp=0xc00006bf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006bfe0 sp=0xc00006bf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006bfe8 sp=0xc00006bfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 7 [GC worker (idle), 240 minutes]:
runtime.gopark(0x2076482867bf?, 0x3?, 0x3d?, 0x62?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006c750 sp=0xc00006c730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006c7e0 sp=0xc00006c750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006c7e8 sp=0xc00006c7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 50 [GC worker (idle), 240 minutes]:
runtime.gopark(0x2076482864b0?, 0x3?, 0x37?, 0x4f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c0750 sp=0xc0002c0730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0002c07e0 sp=0xc0002c0750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c07e8 sp=0xc0002c07e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 20 [chan receive]:
runtime.gopark(0xc009f392c0?, 0x44aa54?, 0x8?, 0x7f?, 0x461c65?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000067eb0 sp=0xc000067e90 pc=0x444c16
runtime.chanrecv(0xc0002002a0, 0xc000067f98, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000067f40 sp=0xc000067eb0 pc=0x40ec3b
runtime.chanrecv2(0xbebc200?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc000067f68 sp=0xc000067f40 pc=0x40e778
github.com/couchbase/plasma.(*smrManager).run(0xc000210660)
/opt/build/goproj/src/github.com/couchbase/plasma/smr.go:526 +0x96 fp=0xc000067fc8 sp=0xc000067f68 pc=0xf57016
github.com/couchbase/plasma.NewSmrManager.func1()
/opt/build/goproj/src/github.com/couchbase/plasma/smr.go:435 +0x26 fp=0xc000067fe0 sp=0xc000067fc8 pc=0xf56f46
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x476581
created by github.com/couchbase/plasma.NewSmrManager
/opt/build/goproj/src/github.com/couchbase/plasma/smr.go:435 +0xaf
goroutine 21 [chan receive]:
runtime.gopark(0x1fe3b20?, 0x106bee0?, 0x20?, 0x3b?, 0x106cce0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0070c2eb0 sp=0xc0070c2e90 pc=0x444c16
runtime.chanrecv(0xc0002000c0, 0xc0070c2fb0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0070c2f40 sp=0xc0070c2eb0 pc=0x40ec3b
runtime.chanrecv2(0xc00010c300?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc0070c2f68 sp=0xc0070c2f40 pc=0x40e778
github.com/couchbase/plasma.runCleanerAutoTuner()
/opt/build/goproj/src/github.com/couchbase/plasma/auto_tuner.go:653 +0x194 fp=0xc0070c2fe0 sp=0xc0070c2f68 pc=0xf4f354
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0070c2fe8 sp=0xc0070c2fe0 pc=0x476581
created by github.com/couchbase/plasma.init.2
/opt/build/goproj/src/github.com/couchbase/plasma/shard.go:239 +0x1fa
goroutine 22 [chan receive]:
runtime.gopark(0xc0002003c0?, 0xc00020c680?, 0x20?, 0x8f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000068ec8 sp=0xc000068ea8 pc=0x444c16
runtime.chanrecv(0xc000200360, 0xc000068fb0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000068f58 sp=0xc000068ec8 pc=0x40ec3b
runtime.chanrecv2(0xdf8475800?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc000068f80 sp=0xc000068f58 pc=0x40e778
github.com/couchbase/plasma.singletonWorker()
/opt/build/goproj/src/github.com/couchbase/plasma/shard.go:4929 +0xb0 fp=0xc000068fe0 sp=0xc000068f80 pc=0xf56850
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000068fe8 sp=0xc000068fe0 pc=0x476581
created by github.com/couchbase/plasma.init.2
/opt/build/goproj/src/github.com/couchbase/plasma/shard.go:240 +0x206
goroutine 23 [chan receive]:
runtime.gopark(0xc00a566300?, 0xc0000696f0?, 0xbb?, 0x15?, 0xc00020c820?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000696a8 sp=0xc000069688 pc=0x444c16
runtime.chanrecv(0xc000200420, 0xc0000697b0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000069738 sp=0xc0000696a8 pc=0x40ec3b
runtime.chanrecv2(0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc000069760 sp=0xc000069738 pc=0x40e778
github.com/couchbase/plasma.systemResourceTracker()
/opt/build/goproj/src/github.com/couchbase/plasma/mem.go:542 +0xa5 fp=0xc0000697e0 sp=0xc000069760 pc=0xf5f9c5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000697e8 sp=0xc0000697e0 pc=0x476581
created by github.com/couchbase/plasma.init.2
/opt/build/goproj/src/github.com/couchbase/plasma/shard.go:241 +0x212
goroutine 24 [chan receive]:
runtime.gopark(0x459d52?, 0xc00007bbe0?, 0xe6?, 0x2d?, 0x461c65?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007bbc0 sp=0xc00007bba0 pc=0x444c16
runtime.chanrecv(0xc0001142a0, 0xc00007bf80, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00007bc50 sp=0xc00007bbc0 pc=0x40ec3b
runtime.chanrecv2(0xc0000569e0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc00007bc78 sp=0xc00007bc50 pc=0x40e778
github.com/couchbase/plasma.AggregateAndLogStats()
/opt/build/goproj/src/github.com/couchbase/plasma/shard.go:4890 +0x147 fp=0xc00007bfe0 sp=0xc00007bc78 pc=0xf54ac7
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007bfe8 sp=0xc00007bfe0 pc=0x476581
created by github.com/couchbase/plasma.init.2
/opt/build/goproj/src/github.com/couchbase/plasma/shard.go:242 +0x21e
goroutine 8 [chan receive]:
runtime.gopark(0xc00af449c0?, 0x44aa54?, 0x8?, 0x37?, 0x461c65?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c36b0 sp=0xc0002c3690 pc=0x444c16
runtime.chanrecv(0xc0002001e0, 0xc0002c3798, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0002c3740 sp=0xc0002c36b0 pc=0x40ec3b
runtime.chanrecv2(0x3b9aca00?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc0002c3768 sp=0xc0002c3740 pc=0x40e778
github.com/couchbase/plasma.(*CleanerAutoTuner).refreshCleanerBandwidth(0xc00010c300)
/opt/build/goproj/src/github.com/couchbase/plasma/auto_tuner.go:664 +0x86 fp=0xc0002c37c8 sp=0xc0002c3768 pc=0xf4f4e6
github.com/couchbase/plasma.runCleanerAutoTuner.func2()
/opt/build/goproj/src/github.com/couchbase/plasma/auto_tuner.go:650 +0x26 fp=0xc0002c37e0 sp=0xc0002c37c8 pc=0xf4f3c6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c37e8 sp=0xc0002c37e0 pc=0x476581
created by github.com/couchbase/plasma.runCleanerAutoTuner
/opt/build/goproj/src/github.com/couchbase/plasma/auto_tuner.go:650 +0x136
goroutine 25 [chan receive]:
runtime.gopark(0xc00a429f80?, 0xc0001143b8?, 0xe?, 0x17?, 0x2?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006ce48 sp=0xc00006ce28 pc=0x444c16
runtime.chanrecv(0xc000114360, 0xc00006cf38, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00006ced8 sp=0xc00006ce48 pc=0x40ec3b
runtime.chanrecv2(0x10bd520?, 0xc000210570?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc00006cf00 sp=0xc00006ced8 pc=0x40e778
github.com/couchbase/plasma.(*TenantMgr).Run(0xc0000569e0)
/opt/build/goproj/src/github.com/couchbase/plasma/tenant.go:424 +0x9d fp=0xc00006cfc8 sp=0xc00006cf00 pc=0xf5a25d
github.com/couchbase/plasma.init.3.func1()
/opt/build/goproj/src/github.com/couchbase/plasma/tenant.go:57 +0x26 fp=0xc00006cfe0 sp=0xc00006cfc8 pc=0xf58ca6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x476581
created by github.com/couchbase/plasma.init.3
/opt/build/goproj/src/github.com/couchbase/plasma/tenant.go:57 +0x5d
goroutine 901 [select, 232 minutes]:
runtime.gopark(0xc008475f90?, 0x2?, 0xd8?, 0x5d?, 0xc008475f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008475d90 sp=0xc008475d70 pc=0x444c16
runtime.selectgo(0xc008475f90, 0xc008475f20, 0xc00b957080?, 0x0, 0xc005604300?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008475ed0 sp=0xc008475d90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc001b37c20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc008475fc8 sp=0xc008475ed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc008475fe0 sp=0xc008475fc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008475fe8 sp=0xc008475fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 108 [chan receive, 240 minutes]:
runtime.gopark(0x4aec20?, 0xc000040900?, 0x28?, 0x9e?, 0xc000829e88?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000839e28 sp=0xc000839e08 pc=0x444c16
runtime.chanrecv(0xc000115980, 0xc000829f90, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000839eb8 sp=0xc000839e28 pc=0x40ec3b
runtime.chanrecv2(0xc000122098?, 0xc000295600?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc000839ee0 sp=0xc000839eb8 pc=0x40e778
github.com/couchbase/gometa/common.(*PeerPipe).doSend(0xc000284f80)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:167 +0x9e fp=0xc000839fc8 sp=0xc000839ee0 pc=0xc108de
github.com/couchbase/gometa/common.NewPeerPipe.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x26 fp=0xc000839fe0 sp=0xc000839fc8 pc=0xc10186
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000839fe8 sp=0xc000839fe0 pc=0x476581
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x14d
goroutine 109 [IO wait]:
runtime.gopark(0x2710?, 0xb?, 0x0?, 0x0?, 0xa?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0008e4cb0 sp=0xc0008e4c90 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x454193?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0008e4ce8 sp=0xc0008e4cb0 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6760759cd8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0008e4d08 sp=0xc0008e4ce8 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc000040900?, 0xc009c0bb80?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0008e4d30 sp=0xc0008e4d08 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000040900, {0xc009c0bb80, 0x8, 0x8})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0008e4db0 sp=0xc0008e4d30 pc=0x4aca5a
net.(*netFD).Read(0xc000040900, {0xc009c0bb80?, 0xc0008e4e30?, 0x459d52?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0008e4df8 sp=0xc0008e4db0 pc=0x68ae29
net.(*conn).Read(0xc000122098, {0xc009c0bb80?, 0xc0008e4ed8?, 0xc11e0f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0008e4e40 sp=0xc0008e4df8 pc=0x69b0a5
github.com/couchbase/gometa/common.(*PeerPipe).readBytes(0xc000284f80, 0x15cd900?, {0x0?, 0xc0078a2cd0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:313 +0xcf fp=0xc0008e4ee8 sp=0xc0008e4e40 pc=0xc11f4f
github.com/couchbase/gometa/common.(*PeerPipe).doReceive(0xc000284f80)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:214 +0xd5 fp=0xc0008e4fc8 sp=0xc0008e4ee8 pc=0xc110b5
github.com/couchbase/gometa/common.NewPeerPipe.func2()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x26 fp=0xc0008e4fe0 sp=0xc0008e4fc8 pc=0xc10126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0008e4fe8 sp=0xc0008e4fe0 pc=0x476581
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x18a
goroutine 40 [select, 240 minutes]:
runtime.gopark(0xc00066bf68?, 0x4?, 0x3?, 0x0?, 0xc00066bdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0008eac00 sp=0xc0008eabe0 pc=0x444c16
runtime.selectgo(0xc0008eaf68, 0xc00066bda8, 0xc000285200?, 0x0, 0xc00066bd01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0008ead40 sp=0xc0008eac00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc000278c60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0008eafc8 sp=0xc0008ead40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0008eafe0 sp=0xc0008eafc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0008eafe8 sp=0xc0008eafe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 67 [chan receive, 240 minutes]:
runtime.gopark(0x7891f1?, 0xc00055c780?, 0x0?, 0x0?, 0x1000000000000?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00083ae78 sp=0xc00083ae58 pc=0x444c16
runtime.chanrecv(0xc000200d20, 0xc00023ff90, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00083af08 sp=0xc00083ae78 pc=0x40ec3b
runtime.chanrecv2(0xc00057c240?, 0x1fa5800?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc00083af30 sp=0xc00083af08 pc=0x40e778
github.com/couchbase/goutils/systemeventlog.(*SystemEventLoggerImpl).logEvents(0xc000666bd0)
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:186 +0xb7 fp=0xc00083afc8 sp=0xc00083af30 pc=0xc13337
github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger.func1()
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x26 fp=0xc00083afe0 sp=0xc00083afc8 pc=0xc12c46
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00083afe8 sp=0xc00083afe0 pc=0x476581
created by github.com/couchbase/goutils/systemeventlog.NewSystemEventLogger
/opt/build/goproj/src/github.com/couchbase/goutils/systemeventlog/system_event_logger.go:125 +0x1d6
goroutine 247 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc00072bf68?, 0x78ee66?, 0x50?, 0xbf?, 0xc00072bfb8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072bf50 sp=0xc00072bf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072bfe0 sp=0xc00072bf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072bfe8 sp=0xc00072bfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 16 [select, 240 minutes]:
runtime.gopark(0xc000453f68?, 0x4?, 0x6b?, 0xf3?, 0xc000453db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00083bc00 sp=0xc00083bbe0 pc=0x444c16
runtime.selectgo(0xc00083bf68, 0xc000453da8, 0xc00045e040?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00083bd40 sp=0xc00083bc00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc00057c240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc00083bfc8 sp=0xc00083bd40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc00083bfe0 sp=0xc00083bfc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00083bfe8 sp=0xc00083bfe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 66 [select, 240 minutes]:
runtime.gopark(0xc00082df90?, 0x2?, 0xd8?, 0xdd?, 0xc00082df24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000834d90 sp=0xc000834d70 pc=0x444c16
runtime.selectgo(0xc000834f90, 0xc00082df20, 0xc0004e8a00?, 0x0, 0xc00044a120?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000834ed0 sp=0xc000834d90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc00057c240)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000834fc8 sp=0xc000834ed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000834fe0 sp=0xc000834fc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000834fe8 sp=0xc000834fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 42 [IO wait, 225 minutes]:
runtime.gopark(0xd4f?, 0xb?, 0x0?, 0x0?, 0x8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00082b9a0 sp=0xc00082b980 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc00082b9d8 sp=0xc00082b9a0 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6760759dc8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc00082b9f8 sp=0xc00082b9d8 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00028c300?, 0xc0006ea000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00082ba20 sp=0xc00082b9f8 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00028c300, {0xc0006ea000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00082baa0 sp=0xc00082ba20 pc=0x4aca5a
net.(*netFD).Read(0xc00028c300, {0xc0006ea000?, 0x1c00043e0a0?, 0x7f676042c908?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc00082bae8 sp=0xc00082baa0 pc=0x68ae29
net.(*conn).Read(0xc000014b20, {0xc0006ea000?, 0x56f446?, 0xc00046a028?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc00082bb30 sp=0xc00082bae8 pc=0x69b0a5
net/http.(*persistConn).Read(0xc00057c240, {0xc0006ea000?, 0x105c3e0?, 0xc00082be08?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc00082bb90 sp=0xc00082bb30 pc=0x78e52e
bufio.(*Reader).fill(0xc000200ae0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc00082bbc8 sp=0xc00082bb90 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc000200ae0, 0x81?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc00082bc18 sp=0xc00082bbc8 pc=0x52cfaf
net/http/internal.readChunkLine(0xda5?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc00082bc68 sp=0xc00082bc18 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc00044a210)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc00082bc98 sp=0xc00082bc68 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc00044a210, {0xc0093ed000?, 0xc00016c1b0?, 0xc0063f1c80?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc00082bd18 sp=0xc00082bc98 pc=0x72b9b6
net/http.(*body).readLocked(0xc00045e040, {0xc0093ed000?, 0xc00046a090?, 0x1167d00?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc00082bd68 sp=0xc00082bd18 pc=0x78305c
net/http.(*body).Read(0x0?, {0xc0093ed000?, 0x56f03e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc00082bde0 sp=0xc00082bd68 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc00045e080, {0xc0093ed000, 0xe00, 0xe00})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc00082be60 sp=0xc00082bde0 pc=0x792c02
encoding/json.(*Decoder).refill(0xc00046a000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc00082beb0 sp=0xc00082be60 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00046a000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc00082bf00 sp=0xc00082beb0 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00046a000, {0x10356e0, 0xc00043e0a0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc00082bf30 sp=0xc00082bf00 pc=0x581998
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc00082bfe0 sp=0xc00082bf30 pc=0xa34d4b
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00082bfe8 sp=0xc00082bfe0 pc=0x476581
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb
goroutine 116 [select, 240 minutes]:
runtime.gopark(0xc00044fd08?, 0x4?, 0x2?, 0x0?, 0xc00044fc90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00044fb08 sp=0xc00044fae8 pc=0x444c16
runtime.selectgo(0xc00044fd08, 0xc00044fc88, 0xc00043ecd0?, 0x0, 0xc00067c101?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00044fc48 sp=0xc00044fb08 pc=0x454a9c
github.com/couchbase/gometa/protocol.runWatcher(0xc00071ed40, {0x15c4640, 0xc00024e780}, {0x15d6298?, 0xc00024e780}, {0x15d4100?, 0x206f6b8}, 0xc0002bc4d0, 0xc000055b60, 0xc0002bc540, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:357 +0x3be fp=0xc00044fd60 sp=0xc00044fc48 pc=0xcc7abe
github.com/couchbase/gometa/protocol.runOnce(0x1, {0xc00071d340, 0xe}, {0x15c4640, 0xc00024e780}, {0x15d6298, 0xc00024e780}, {0x15d4100, 0x206f6b8}, 0xc0002bc4d0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:213 +0x525 fp=0xc00044fe90 sp=0xc00044fd60 pc=0xcc6b65
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc00071d340, 0xe}, {0x15c4640, 0xc00024e780}, {0x15d6298, 0xc00024e780}, {0x15d4100, 0x206f6b8}, 0xc0002bc4d0, 0xc000055b60, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:65 +0x174 fp=0xc00044ff68 sp=0xc00044fe90 pc=0xcc6494
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x9f fp=0xc00044ffe0 sp=0xc00044ff68 pc=0xd2441f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00044ffe8 sp=0xc00044ffe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x1f8
goroutine 85 [select]:
runtime.gopark(0xc000731798?, 0x2?, 0xd1?, 0x7e?, 0xc00073178c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000731618 sp=0xc0007315f8 pc=0x444c16
runtime.selectgo(0xc000731798, 0xc000731788, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000731758 sp=0xc000731618 pc=0x454a9c
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc000700e10)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2396 +0x92 fp=0xc0007317c8 sp=0xc000731758 pc=0xd63992
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2189 +0x26 fp=0xc0007317e0 sp=0xc0007317c8 pc=0xd62306
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0007317e8 sp=0xc0007317e0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2189 +0x296
goroutine 39 [select, 225 minutes]:
runtime.gopark(0xc000455ba0?, 0x3?, 0x6?, 0x30?, 0xc000455b1a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000455978 sp=0xc000455958 pc=0x444c16
runtime.selectgo(0xc000455ba0, 0xc000455b14, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000455ab8 sp=0xc000455978 pc=0x454a9c
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc000081fe0?, {0x12902f6, 0x1b}, 0xc000455e68, 0xc0000555c0)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc000455e40 sp=0xc000455ab8 pc=0xa348c9
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x12902f6?, 0x0?}, 0x0?, 0x0?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc000455e88 sp=0xc000455e40 pc=0xa34e58
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0x0?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1607 +0xc7 fp=0xc000455f00 sp=0xc000455e88 pc=0xc18307
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc000455fa0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc000455f38 sp=0xc000455f00 pc=0xb58b23
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1612 +0xdf fp=0xc000455fe0 sp=0xc000455f38 pc=0xc181bf
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000455fe8 sp=0xc000455fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1600 +0xaf
goroutine 114 [chan send, 240 minutes]:
runtime.gopark(0xb507e8?, 0xc006e74000?, 0x43?, 0x1b?, 0x12c5597?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0008e5d60 sp=0xc0008e5d40 pc=0x444c16
runtime.chansend(0xc000055260, 0x15bc290, 0x1, 0xc0006d1d01?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:259 +0x42c fp=0xc0008e5de8 sp=0xc0008e5d60 pc=0x40de2c
runtime.chansend1(0xc000118a80?, 0x2c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:145 +0x1d fp=0xc0008e5e18 sp=0xc0008e5de8 pc=0x40d9dd
github.com/couchbase/indexing/secondary/common.(*internalVersionMonitor).notifier(0xc0002e2000)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:743 +0x465 fp=0xc0008e5fc8 sp=0xc0008e5e18 pc=0xb50f45
github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:236 +0x26 fp=0xc0008e5fe0 sp=0xc0008e5fc8 pc=0xb4c666
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0008e5fe8 sp=0xc0008e5fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/common.newInternalVersionMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/internal_version.go:236 +0x3e5
goroutine 112 [select]:
runtime.gopark(0xc009b79f90?, 0x2?, 0x50?, 0x4e?, 0xc009b79f4c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009b79dc8 sp=0xc009b79da8 pc=0x444c16
runtime.selectgo(0xc009b79f90, 0xc009b79f48, 0xc006eefd10?, 0x0, 0x101000101b50a43?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009b79f08 sp=0xc009b79dc8 pc=0x454a9c
github.com/couchbase/gometa/protocol.(*Follower).startListener(0xc0000184d0)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:149 +0xe5 fp=0xc009b79fc8 sp=0xc009b79f08 pc=0xcc4fe5
github.com/couchbase/gometa/protocol.(*Follower).Start.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x26 fp=0xc009b79fe0 sp=0xc009b79fc8 pc=0xcc4be6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009b79fe8 sp=0xc009b79fe0 pc=0x476581
created by github.com/couchbase/gometa/protocol.(*Follower).Start
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x56
goroutine 41 [select, 240 minutes]:
runtime.gopark(0xc00065ef90?, 0x2?, 0xd8?, 0xed?, 0xc00065ef24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00065ed90 sp=0xc00065ed70 pc=0x444c16
runtime.selectgo(0xc00065ef90, 0xc00065ef20, 0xc00045e000?, 0x0, 0xc000883bc0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00065eed0 sp=0xc00065ed90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc000278c60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00065efc8 sp=0xc00065eed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc00065efe0 sp=0xc00065efc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00065efe8 sp=0xc00065efe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 101 [select, 240 minutes]:
runtime.gopark(0xc000249f68?, 0x4?, 0x3?, 0x0?, 0xc000249db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000835c00 sp=0xc000835be0 pc=0x444c16
runtime.selectgo(0xc000835f68, 0xc000249da8, 0xc0004e8380?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000835d40 sp=0xc000835c00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc000278ea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000835fc8 sp=0xc000835d40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000835fe0 sp=0xc000835fc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000835fe8 sp=0xc000835fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 102 [select, 240 minutes]:
runtime.gopark(0xc00065af90?, 0x2?, 0xd8?, 0xad?, 0xc00065af24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00065ad90 sp=0xc00065ad70 pc=0x444c16
runtime.selectgo(0xc00065af90, 0xc00065af20, 0xc000284e80?, 0x0, 0xc000210b70?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00065aed0 sp=0xc00065ad90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc000278ea0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00065afc8 sp=0xc00065aed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc00065afe0 sp=0xc00065afc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00065afe8 sp=0xc00065afe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 72 [semacquire, 213 minutes]:
runtime.gopark(0xc00057c5a0?, 0xc00057c630?, 0x20?, 0x47?, 0xc00a87e000?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00953fce0 sp=0xc00953fcc0 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.semacquire1(0xc00027a2a4, 0x68?, 0x3, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:150 +0x1fe fp=0xc00953fd48 sp=0xc00953fce0 pc=0x455b5e
sync.runtime_SemacquireMutex(0xc009c0b140?, 0xf8?, 0xc000827df8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:77 +0x25 fp=0xc00953fd78 sp=0xc00953fd48 pc=0x472485
sync.(*Mutex).lockSlow(0xc00027a2a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:171 +0x165 fp=0xc00953fdc8 sp=0xc00953fd78 pc=0x47f8c5
sync.(*Mutex).Lock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:90
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).getNotifyCallback.func1({0x10372e0?, 0xc008d6afe0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:58 +0x99 fp=0xc00953ff98 sp=0xc00953fdc8 pc=0xb59d99
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:493 +0x76 fp=0xc00953ffe0 sp=0xc00953ff98 pc=0x84d6f6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00953ffe8 sp=0xc00953ffe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:475 +0x665
goroutine 107 [select, 240 minutes]:
runtime.gopark(0xc0000cdd08?, 0x4?, 0x2?, 0x0?, 0xc0000cdc90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000cdb08 sp=0xc0000cdae8 pc=0x444c16
runtime.selectgo(0xc0000cdd08, 0xc0000cdc88, 0xc000216910?, 0x0, 0xc000883701?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000cdc48 sp=0xc0000cdb08 pc=0x454a9c
github.com/couchbase/gometa/protocol.runWatcher(0xc000284f80, {0x15c4640, 0xc00014c3c0}, {0x15d6298?, 0xc00014c3c0}, {0x15d4100?, 0x206f6b8}, 0xc0004e41c0, 0xc0002b7a40, 0xc0004e4230, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:357 +0x3be fp=0xc0000cdd60 sp=0xc0000cdc48 pc=0xcc7abe
github.com/couchbase/gometa/protocol.runOnce(0x1, {0xc00071d310, 0xe}, {0x15c4640, 0xc00014c3c0}, {0x15d6298, 0xc00014c3c0}, {0x15d4100, 0x206f6b8}, 0xc0004e41c0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:213 +0x525 fp=0xc0000cde90 sp=0xc0000cdd60 pc=0xcc6b65
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc00071d310, 0xe}, {0x15c4640, 0xc00014c3c0}, {0x15d6298, 0xc00014c3c0}, {0x15d4100, 0x206f6b8}, 0xc0004e41c0, 0xc0002b7a40, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:65 +0x174 fp=0xc0000cdf68 sp=0xc0000cde90 pc=0xcc6494
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x9f fp=0xc0000cdfe0 sp=0xc0000cdf68 pc=0xd2441f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000cdfe8 sp=0xc0000cdfe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x1f8
goroutine 113 [select]:
runtime.gopark(0xc00065bf90?, 0x2?, 0x22?, 0x7c?, 0xc00065bf74?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00065bdf8 sp=0xc00065bdd8 pc=0x444c16
runtime.selectgo(0xc00065bf90, 0xc00065bf70, 0x100000001?, 0x0, 0xc0002e2000?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00065bf38 sp=0xc00065bdf8 pc=0x454a9c
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc00024e780)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6530 +0xcd fp=0xc00065bfc8 sp=0xc00065bf38 pc=0xd327ad
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x26 fp=0xc00065bfe0 sp=0xc00065bfc8 pc=0xd326a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00065bfe8 sp=0xc00065bfe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x8d
goroutine 234 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0xaf?, 0xc7?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a677750 sp=0xc00a677730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a6777e0 sp=0xc00a677750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a6777e8 sp=0xc00a6777e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 117 [chan receive, 240 minutes]:
runtime.gopark(0x4aec20?, 0xc00012c580?, 0x28?, 0xce?, 0xc00065ce88?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00065ce28 sp=0xc00065ce08 pc=0x444c16
runtime.chanrecv(0xc00074ca80, 0xc00065cf90, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00065ceb8 sp=0xc00065ce28 pc=0x40ec3b
runtime.chanrecv2(0xc000208258?, 0xc0004472c0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc00065cee0 sp=0xc00065ceb8 pc=0x40e778
github.com/couchbase/gometa/common.(*PeerPipe).doSend(0xc00071ed40)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:167 +0x9e fp=0xc00065cfc8 sp=0xc00065cee0 pc=0xc108de
github.com/couchbase/gometa/common.NewPeerPipe.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x26 fp=0xc00065cfe0 sp=0xc00065cfc8 pc=0xc10186
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00065cfe8 sp=0xc00065cfe0 pc=0x476581
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x14d
goroutine 218 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc00072ef80?, 0xc00a50b7d0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072ef50 sp=0xc00072ef30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072efe0 sp=0xc00072ef50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072efe8 sp=0xc00072efe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 233 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0x5?, 0x76?, 0xc001add7b8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001add750 sp=0xc001add730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001add7e0 sp=0xc001add750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001add7e8 sp=0xc001add7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 45 [select]:
runtime.gopark(0xc009b15f90?, 0x2?, 0x60?, 0x2d?, 0xc009b15f4c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009b15dc8 sp=0xc009b15da8 pc=0x444c16
runtime.selectgo(0xc009b15f90, 0xc009b15f48, 0xc0096e5080?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009b15f08 sp=0xc009b15dc8 pc=0x454a9c
github.com/couchbase/gometa/protocol.(*Follower).startListener(0xc000667180)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:149 +0xe5 fp=0xc009b15fc8 sp=0xc009b15f08 pc=0xcc4fe5
github.com/couchbase/gometa/protocol.(*Follower).Start.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x26 fp=0xc009b15fe0 sp=0xc009b15fc8 pc=0xcc4be6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009b15fe8 sp=0xc009b15fe0 pc=0x476581
created by github.com/couchbase/gometa/protocol.(*Follower).Start
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x56
goroutine 46 [select]:
runtime.gopark(0xc00007df90?, 0x2?, 0x22?, 0x7c?, 0xc00007df74?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007ddf8 sp=0xc00007ddd8 pc=0x444c16
runtime.selectgo(0xc00007df90, 0xc00007df70, 0xc0002166e0?, 0x0, 0xc00007dfd0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00007df38 sp=0xc00007ddf8 pc=0x454a9c
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc00014c3c0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6530 +0xcd fp=0xc00007dfc8 sp=0xc00007df38 pc=0xd327ad
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x26 fp=0xc00007dfe0 sp=0xc00007dfc8 pc=0xd326a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007dfe8 sp=0xc00007dfe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x8d
goroutine 118 [IO wait]:
runtime.gopark(0x2710?, 0xb?, 0x0?, 0x0?, 0xe?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0008e8cb0 sp=0xc0008e8c90 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x454193?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0008e8ce8 sp=0xc0008e8cb0 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6760759918, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0008e8d08 sp=0xc0008e8ce8 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00012c580?, 0xc009a62930?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0008e8d30 sp=0xc0008e8d08 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00012c580, {0xc009a62930, 0x8, 0x8})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0008e8db0 sp=0xc0008e8d30 pc=0x4aca5a
net.(*netFD).Read(0xc00012c580, {0xc009a62930?, 0xc0008e8e30?, 0x459d52?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0008e8df8 sp=0xc0008e8db0 pc=0x68ae29
net.(*conn).Read(0xc000208258, {0xc009a62930?, 0xc0008e8ed8?, 0xc11e0f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0008e8e40 sp=0xc0008e8df8 pc=0x69b0a5
github.com/couchbase/gometa/common.(*PeerPipe).readBytes(0xc00071ed40, 0x15cd900?, {0x0?, 0xc007824dc0?, 0xc0002c7738?})
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:313 +0xcf fp=0xc0008e8ee8 sp=0xc0008e8e40 pc=0xc11f4f
github.com/couchbase/gometa/common.(*PeerPipe).doReceive(0xc00071ed40)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:214 +0xd5 fp=0xc0008e8fc8 sp=0xc0008e8ee8 pc=0xc110b5
github.com/couchbase/gometa/common.NewPeerPipe.func2()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x26 fp=0xc0008e8fe0 sp=0xc0008e8fc8 pc=0xc10126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0008e8fe8 sp=0xc0008e8fe0 pc=0x476581
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x18a
goroutine 47 [select]:
runtime.gopark(0xc007131f68?, 0x5?, 0x90?, 0x69?, 0xc007131df6?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007131c60 sp=0xc007131c40 pc=0x444c16
runtime.selectgo(0xc007131f68, 0xc007131dec, 0x12759d7?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007131da0 sp=0xc007131c60 pc=0x454a9c
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges(0xc00014afd0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2088 +0x33c fp=0xc007131fc8 sp=0xc007131da0 pc=0xd6197c
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:151 +0x26 fp=0xc007131fe0 sp=0xc007131fc8 pc=0xd54e06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007131fe8 sp=0xc007131fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:151 +0x5d6
goroutine 48 [chan receive]:
runtime.gopark(0xc00bb6f9e0?, 0x78a970?, 0x0?, 0x58?, 0x15cc7d0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000432ec8 sp=0xc000432ea8 pc=0x444c16
runtime.chanrecv(0xc0002b1200, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000432f58 sp=0xc000432ec8 pc=0x40ec3b
runtime.chanrecv1(0xc00014afd0?, 0xc000466310?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc000432f80 sp=0xc000432f58 pc=0x40e738
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc00014afd0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1412 +0x79 fp=0xc000432fc8 sp=0xc000432f80 pc=0xd5c439
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x26 fp=0xc000432fe0 sp=0xc000432fc8 pc=0xd54da6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000432fe8 sp=0xc000432fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x616
goroutine 75 [semacquire, 240 minutes]:
runtime.gopark(0xc00027a040?, 0xf?, 0x0?, 0x15?, 0x1?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000434b88 sp=0xc000434b68 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.semacquire1(0xc00027a2a4, 0x10?, 0x3, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:150 +0x1fe fp=0xc000434bf0 sp=0xc000434b88 pc=0x455b5e
sync.runtime_SemacquireMutex(0x41581f?, 0x3c?, 0x42c1a7?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:77 +0x25 fp=0xc000434c20 sp=0xc000434bf0 pc=0x472485
sync.(*Mutex).lockSlow(0xc00027a2a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:171 +0x165 fp=0xc000434c70 sp=0xc000434c20 pc=0x47f8c5
sync.(*Mutex).Lock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:90
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback.func1(0xc00012be08?, 0xc000434d28?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:129 +0x50 fp=0xc000434cc8 sp=0xc000434c70 pc=0xb5a910
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback(0xc00027a2a0, {0x206f6b8, 0x0, 0x11b2480?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:132 +0x16a fp=0xc000434dc8 sp=0xc000434cc8 pc=0xb5a62a
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).getNotifyCallback.func1({0x11b2480?, 0xc00027a000?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:83 +0x2ad fp=0xc000434f98 sp=0xc000434dc8 pc=0xb59fad
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:493 +0x76 fp=0xc000434fe0 sp=0xc000434f98 pc=0x84d6f6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000434fe8 sp=0xc000434fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:475 +0x665
goroutine 119 [select, 240 minutes]:
runtime.gopark(0xc000661f68?, 0x4?, 0x3?, 0x0?, 0xc000661db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000661c00 sp=0xc000661be0 pc=0x444c16
runtime.selectgo(0xc000661f68, 0xc000661da8, 0xc0004e8280?, 0x0, 0x1?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000661d40 sp=0xc000661c00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc00057cc60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000661fc8 sp=0xc000661d40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000661fe0 sp=0xc000661fc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000661fe8 sp=0xc000661fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 120 [select, 240 minutes]:
runtime.gopark(0xc0008e9f90?, 0x2?, 0xd8?, 0x9d?, 0xc0008e9f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0008e9d90 sp=0xc0008e9d70 pc=0x444c16
runtime.selectgo(0xc0008e9f90, 0xc0008e9f20, 0xc00071ed80?, 0x0, 0xc00022c450?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0008e9ed0 sp=0xc0008e9d90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc00057cc60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc0008e9fc8 sp=0xc0008e9ed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc0008e9fe0 sp=0xc0008e9fc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0008e9fe8 sp=0xc0008e9fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 131 [select, 240 minutes]:
runtime.gopark(0xc0006cdd88?, 0x2?, 0x60?, 0xca?, 0xc0006cdc84?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0006cdaf0 sp=0xc0006cdad0 pc=0x444c16
runtime.selectgo(0xc0006cdd88, 0xc0006cdc80, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0006cdc30 sp=0xc0006cdaf0 pc=0x454a9c
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint(0x0?, {0xc0002ad1e8, 0x17}, 0xc000013368, 0xc000013350, 0xc00055cba0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:503 +0x6da fp=0xc0006cded8 sp=0xc0006cdc30 pc=0x84d29a
github.com/couchbase/indexing/secondary/dcp.(*Client).RunObservePool(0xc00027a2a0?, {0x12759d7?, 0xc00006d780?}, 0xc0002800f0?, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:395 +0xb2 fp=0xc0006cdf40 sp=0xc0006cded8 pc=0x84c3d2
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunPoolObserver(0xc00027a2a0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:150 +0x5c fp=0xc0006cdfc8 sp=0xc0006cdf40 pc=0xb5aa7c
github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:281 +0x26 fp=0xc0006cdfe0 sp=0xc0006cdfc8 pc=0xb5c046
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0006cdfe8 sp=0xc0006cdfe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:281 +0x50a
goroutine 132 [select, 240 minutes]:
runtime.gopark(0xc000417d80?, 0x2?, 0x6b?, 0xf3?, 0xc000417c7c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000417ae8 sp=0xc000417ac8 pc=0x444c16
runtime.selectgo(0xc000417d80, 0xc000417c78, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000417c28 sp=0xc000417ae8 pc=0x454a9c
github.com/couchbase/indexing/secondary/dcp.(*Client).runObserveStreamingEndpoint(0xc00043aae0?, {0xc000440ba0, 0x24}, 0xc00043aaf8, 0xc00043aae0, 0xc00055cba0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:503 +0x6da fp=0xc000417ed0 sp=0xc000417c28 pc=0x84d29a
github.com/couchbase/indexing/secondary/dcp.(*Client).RunObserveNodeServices(0xc00027a2a0?, {0x12759d7?, 0xc0002b6420?}, 0xc0000470f0?, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:411 +0xbc fp=0xc000417f40 sp=0xc000417ed0 pc=0x84c69c
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunServicesObserver(0xc00027a2a0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:159 +0x59 fp=0xc000417fc8 sp=0xc000417f40 pc=0xb5abd9
github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier.func3()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:282 +0x26 fp=0xc000417fe0 sp=0xc000417fc8 pc=0xb5bfe6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000417fe8 sp=0xc000417fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:282 +0x54d
goroutine 863 [select, 232 minutes]:
runtime.gopark(0xc00007af90?, 0x2?, 0xd8?, 0xad?, 0xc00007af24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007ad90 sp=0xc00007ad70 pc=0x444c16
runtime.selectgo(0xc00007af90, 0xc00007af20, 0xc00b956ec0?, 0x0, 0xc0055c1b30?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00007aed0 sp=0xc00007ad90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc001b0d7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00007afc8 sp=0xc00007aed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc00007afe0 sp=0xc00007afc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007afe8 sp=0xc00007afe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 245 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc00072b780?, 0xc00a6ed9f0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072b750 sp=0xc00072b730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072b7e0 sp=0xc00072b750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072b7e8 sp=0xc00072b7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 90066 [select]:
runtime.gopark(0xc009ed6f68?, 0x4?, 0x3?, 0x0?, 0xc009ed6db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009ed6c00 sp=0xc009ed6be0 pc=0x444c16
runtime.selectgo(0xc009ed6f68, 0xc009ed6da8, 0xc00625b300?, 0x0, 0x454101?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009ed6d40 sp=0xc009ed6c00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc00622a480)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc009ed6fc8 sp=0xc009ed6d40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc009ed6fe0 sp=0xc009ed6fc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009ed6fe8 sp=0xc009ed6fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 146 [sleep]:
runtime.gopark(0x2d92a24c8d68?, 0xc00006d718?, 0x85?, 0xf1?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006d6e8 sp=0xc00006d6c8 pc=0x444c16
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc00006d728 sp=0xc00006d6e8 pc=0x4733f5
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc000571290)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:461 +0xa5 fp=0xc00006d7c8 sp=0xc00006d728 pc=0xd544c5
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc00006d7e0 sp=0xc00006d7c8 pc=0xd51726
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006d7e8 sp=0xc00006d7e0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x4b6
goroutine 127 [semacquire, 240 minutes]:
runtime.gopark(0x1057920?, 0xc00275f4a0?, 0xa0?, 0xc8?, 0x4?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00007edb8 sp=0xc00007ed98 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.semacquire1(0xc00027a2a4, 0x40?, 0x3, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:150 +0x1fe fp=0xc00007ee20 sp=0xc00007edb8 pc=0x455b5e
sync.runtime_SemacquireMutex(0x1?, 0x0?, 0x6a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:77 +0x25 fp=0xc00007ee50 sp=0xc00007ee20 pc=0x472485
sync.(*Mutex).lockSlow(0xc00027a2a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:171 +0x165 fp=0xc00007eea0 sp=0xc00007ee50 pc=0x47f8c5
sync.(*Mutex).Lock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:90
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunObserveCollectionManifestChanges.func1(0xc003c84180?, {0xc00012be08?, 0x7?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:185 +0x5c fp=0xc00007eef8 sp=0xc00007eea0 pc=0xb5b07c
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).RunObserveCollectionManifestChanges(0xc00027a2a0, {0xc00012be08, 0x7})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:188 +0x232 fp=0xc00007efb8 sp=0xc00007eef8 pc=0xb5af12
github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:140 +0x2e fp=0xc00007efe0 sp=0xc00007efb8 pc=0xb5a88e
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00007efe8 sp=0xc00007efe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/common.(*serviceNotifierInstance).bucketsChangeCallback
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:140 +0x295
goroutine 171 [select]:
runtime.gopark(0xc000837f98?, 0x2?, 0x2?, 0x30?, 0xc000837f94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000837e20 sp=0xc000837e00 pc=0x444c16
runtime.selectgo(0xc000837f98, 0xc000837f90, 0x2033920?, 0x0, 0xd24d6b872e4?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000837f60 sp=0xc000837e20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc000134000)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc000837fc8 sp=0xc000837f60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc000837fe0 sp=0xc000837fc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000837fe8 sp=0xc000837fe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 217 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc00a54ad20?, 0xc00a50a888?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072e750 sp=0xc00072e730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072e7e0 sp=0xc00072e750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072e7e8 sp=0xc00072e7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 90017 [select]:
runtime.gopark(0xc007b20fb0?, 0x2?, 0x2?, 0x30?, 0xc007b20f8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007b20e08 sp=0xc007b20de8 pc=0x444c16
runtime.selectgo(0xc007b20fb0, 0xc007b20f88, 0xc009e9e150?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007b20f48 sp=0xc007b20e08 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:161 +0x8a fp=0xc007b20fe0 sp=0xc007b20f48 pc=0xbd35ca
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007b20fe8 sp=0xc007b20fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:160 +0x433
goroutine 133 [sleep]:
runtime.gopark(0x2d928c09d2f9?, 0xc0002c1718?, 0x85?, 0xf1?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c16e8 sp=0xc0002c16c8 pc=0x444c16
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc0002c1728 sp=0xc0002c16e8 pc=0x4733f5
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc00027efd0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:461 +0xa5 fp=0xc0002c17c8 sp=0xc0002c1728 pc=0xd544c5
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc0002c17e0 sp=0xc0002c17c8 pc=0xd51726
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c17e8 sp=0xc0002c17e0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x4b6
goroutine 134 [select, 225 minutes]:
runtime.gopark(0xc000435f90?, 0x2?, 0x0?, 0x0?, 0xc000435f8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000435e18 sp=0xc000435df8 pc=0x444c16
runtime.selectgo(0xc000435f90, 0xc000435f88, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000435f58 sp=0xc000435e18 pc=0x454a9c
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc00028c400, 0xc0005742a0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1830 +0x6e fp=0xc000435fc0 sp=0xc000435f58 pc=0xd5000e
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x2a fp=0xc000435fe0 sp=0xc000435fc0 pc=0xd4ff6a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000435fe8 sp=0xc000435fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x298
goroutine 135 [select]:
runtime.gopark(0xc0002c2750?, 0x2?, 0xe0?, 0xa?, 0xc0002c2714?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c2590 sp=0xc0002c2570 pc=0x444c16
runtime.selectgo(0xc0002c2750, 0xc0002c2710, 0x129442c?, 0x0, 0xc0002c2720?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0002c26d0 sp=0xc0002c2590 pc=0x454a9c
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc00028c400, 0xc0005742a0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1849 +0x238 fp=0xc0002c27c0 sp=0xc0002c26d0 pc=0xd50278
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2a fp=0xc0002c27e0 sp=0xc0002c27c0 pc=0xd4ff0a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c27e8 sp=0xc0002c27e0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2fa
goroutine 916 [sleep]:
runtime.gopark(0x2d9285f3d6ff?, 0x0?, 0x18?, 0x7b?, 0xc0063be5a8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aac3ae0 sp=0xc00aac3ac0 pc=0x444c16
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc00aac3b20 sp=0xc00aac3ae0 pc=0x4733f5
github.com/couchbase/indexing/secondary/tests/serverlesstests.waitForIndexStatus({0x1277004, 0x8}, {0x1276ed4, 0x8}, {0x12716fa, 0x3}, {0xc00aab92e0, 0x19}, {0x1272b27, 0x5}, ...)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/serverlesstests/common_test.go:578 +0x268 fp=0xc00aac3c40 sp=0xc00aac3b20 pc=0xfa9fe8
github.com/couchbase/indexing/secondary/tests/serverlesstests.execN1qlAndWaitForStatus({0xc007740180, 0x3e}, {0x1277004, 0x8}, {0x1276ed4, 0x8}, {0x12716fa, 0x3}, {0x127d4c6, 0xd}, ...)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/serverlesstests/common_test.go:592 +0x314 fp=0xc00aac3cf8 sp=0xc00aac3c40 pc=0xfaa7f4
github.com/couchbase/indexing/secondary/tests/serverlesstests.createAllIndexes({0x1277004, 0x8}, {0x1276ed4, 0x8}, {0x12716fa, 0x3}, 0x8?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/serverlesstests/set00_indexoperations_test.go:102 +0x1d2 fp=0xc00aac3db8 sp=0xc00aac3cf8 pc=0xfb2872
github.com/couchbase/indexing/secondary/tests/serverlesstests.TestShardIdMapping(0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/tests/serverlesstests/set00_indexoperations_test.go:72 +0x850 fp=0xc00aac3f70 sp=0xc00aac3db8 pc=0xfb2610
testing.tRunner(0xc00bb5e000, 0x12fed48)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1446 +0x10b fp=0xc00aac3fc0 sp=0xc00aac3f70 pc=0x5265cb
testing.(*T).Run.func1()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1493 +0x2a fp=0xc00aac3fe0 sp=0xc00aac3fc0 pc=0x52746a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aac3fe8 sp=0xc00aac3fe0 pc=0x476581
created by testing.(*T).Run
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/testing/testing.go:1493 +0x35f
goroutine 1088 [IO wait]:
runtime.gopark(0xc009cb41e0?, 0xb?, 0x0?, 0x0?, 0x2b?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e1f7b8 sp=0xc007e1f798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x57f631?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc007e1f7f0 sp=0xc007e1f7b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f675951e378, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc007e1f810 sp=0xc007e1f7f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc006edec80?, 0xc006c28000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc007e1f838 sp=0xc007e1f810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc006edec80, {0xc006c28000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc007e1f8b8 sp=0xc007e1f838 pc=0x4aca5a
net.(*netFD).Read(0xc006edec80, {0xc006c28000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc007e1f900 sp=0xc007e1f8b8 pc=0x68ae29
net.(*conn).Read(0xc00a9ca780, {0xc006c28000?, 0xc00469e100?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc007e1f948 sp=0xc007e1f900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc0064cec60, {0xc006c28000?, 0x415b67?, 0x20?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc007e1f9a8 sp=0xc007e1f948 pc=0x78e52e
bufio.(*Reader).fill(0xc009dba900)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc007e1f9e0 sp=0xc007e1f9a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc009dba900, 0x70?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc007e1fa30 sp=0xc007e1f9e0 pc=0x52cfaf
net/http/internal.readChunkLine(0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc007e1fa80 sp=0xc007e1fa30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc006cb06c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc007e1fab0 sp=0xc007e1fa80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc006cb06c0, {0xc006c54004?, 0x1?, 0xc007e1fbf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc007e1fb30 sp=0xc007e1fab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc0030ddc00, {0xc006c54004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc007e1fb80 sp=0xc007e1fb30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc006c54004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc007e1fbf8 sp=0xc007e1fb80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc0030dde00, {0xc006c54004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc007e1fc78 sp=0xc007e1fbf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc008d477c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc007e1fcc8 sp=0xc007e1fc78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc008d477c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc007e1fd18 sp=0xc007e1fcc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc008d477c0, {0x10aa6c0, 0xc00a7153b0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc007e1fd48 sp=0xc007e1fd18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc009998300, 0xc007f04580)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc007e1ffc0 sp=0xc007e1fd48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc007e1ffe0 sp=0xc007e1ffc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e1ffe8 sp=0xc007e1ffe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 235 [GC worker (idle), 3 minutes]:
runtime.gopark(0x2070ae0?, 0x1?, 0xb1?, 0xe8?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a677f50 sp=0xc00a677f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a677fe0 sp=0xc00a677f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a677fe8 sp=0xc00a677fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 246 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc001addf80?, 0x12b22bd?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001addf50 sp=0xc001addf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001addfe0 sp=0xc001addf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001addfe8 sp=0xc001addfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 244 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc00a7860c0?, 0x78ee66?, 0x50?, 0x7?, 0xc0007307b8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000730750 sp=0xc000730730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0007307e0 sp=0xc000730750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0007307e8 sp=0xc0007307e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 230 [GC worker (idle), 240 minutes]:
runtime.gopark(0x10bfd40?, 0xc001c1fe90?, 0x40?, 0xfd?, 0xc001c46000?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001adff50 sp=0xc001adff30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001adffe0 sp=0xc001adff50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001adffe8 sp=0xc001adffe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 172 [chan send, 232 minutes]:
runtime.gopark(0xc00ba7ed40?, 0xc005626540?, 0x2?, 0x0?, 0xc0006cfa90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0006cfa50 sp=0xc0006cfa30 pc=0x444c16
runtime.chansend(0xc009e54180, 0xc0006cfb38, 0x1, 0x73613a726f746172?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:259 +0x42c fp=0xc0006cfad8 sp=0xc0006cfa50 pc=0x40de2c
runtime.chansend1(0x7473696e696d6441?, 0x73613a726f746172?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:145 +0x1d fp=0xc0006cfb08 sp=0xc0006cfad8 pc=0x40d9dd
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func2(0xc0062f59b0?, {0x0?, 0x12a7849?}, {0x15bfd60?, 0xc00009a870?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:879 +0x128 fp=0xc0006cfb58 sp=0xc0006cfb08 pc=0xbcf548
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x1)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:136 +0x41e fp=0xc0006cfc50 sp=0xc0006cfb58 pc=0xbd3ade
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func1(0x0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:140 +0x44a fp=0xc0006cfd48 sp=0xc0006cfc50 pc=0xbd3b0a
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc0005a1500, 0xc009b996a0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:148 +0x354 fp=0xc0006cffc0 sp=0xc0006cfd48 pc=0xbd2bd4
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc0006cffe0 sp=0xc0006cffc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0006cffe8 sp=0xc0006cffe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 177 [sync.Cond.Wait, 230 minutes]:
runtime.gopark(0x0?, 0x2020200a2c22656c?, 0x1f?, 0x58?, 0x4e4f4322203a2279?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000838d78 sp=0xc000838d58 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
sync.runtime_notifyListWait(0xc0058a8e10, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:517 +0x14c fp=0xc000838dc0 sp=0xc000838d78 pc=0x47266c
sync.(*Cond).Wait(0xc00946d170?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/cond.go:70 +0x8c fp=0xc000838df8 sp=0xc000838dc0 pc=0x47dbcc
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc009b999a0, 0xc00946d170)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:138 +0x54 fp=0xc000838e48 sp=0xc000838df8 pc=0xbeeef4
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(...)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:28
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc0058a8f00, 0xc000137720)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:129 +0x505 fp=0xc000838f48 sp=0xc000838e48 pc=0xbf07a5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc0058a8f00)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:195 +0x346 fp=0xc000838fc8 sp=0xc000838f48 pc=0xbf14c6
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc000838fe0 sp=0xc000838fc8 pc=0xbef7e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000838fe8 sp=0xc000838fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 248 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc0002c2f80?, 0xc009c498d0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c2f50 sp=0xc0002c2f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0002c2fe0 sp=0xc0002c2f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c2fe8 sp=0xc0002c2fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 228 [GC worker (idle), 240 minutes]:
runtime.gopark(0x10bfd40?, 0xc001ab6d50?, 0x40?, 0xfd?, 0xc001ab6ea0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001adef50 sp=0xc001adef30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001adefe0 sp=0xc001adef50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001adefe8 sp=0xc001adefe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 229 [GC worker (idle), 240 minutes]:
runtime.gopark(0x10bfd40?, 0xc001b6f5f0?, 0x40?, 0xfd?, 0xc001b6f740?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001adf750 sp=0xc001adf730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001adf7e0 sp=0xc001adf750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001adf7e8 sp=0xc001adf7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 996 [IO wait, 230 minutes]:
runtime.gopark(0xc00b7e24e0?, 0xb?, 0x0?, 0x0?, 0x32?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c7468 sp=0xc0002c7448 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0002c74a0 sp=0xc0002c7468 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6760759af8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0002c74c0 sp=0xc0002c74a0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc009486300?, 0xc0094d5000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0002c74e8 sp=0xc0002c74c0 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc009486300, {0xc0094d5000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0002c7568 sp=0xc0002c74e8 pc=0x4aca5a
net.(*netFD).Read(0xc009486300, {0xc0094d5000?, 0xc009355320?, 0x15bc290?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0002c75b0 sp=0xc0002c7568 pc=0x68ae29
net.(*conn).Read(0xc004ddab40, {0xc0094d5000?, 0x0?, 0x415b67?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0002c75f8 sp=0xc0002c75b0 pc=0x69b0a5
bufio.(*Reader).Read(0xc009c348a0, {0xc0094c2588, 0x18, 0x3fdd0015b419390d?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc0002c7630 sp=0xc0002c75f8 pc=0x52c99b
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc0094bc6e0, {0xc0094c2588?, 0xc009816630?, 0x0?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:143 +0x6d fp=0xc0002c7678 sp=0xc0002c7630 pc=0xbedb4d
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc0094bc6e0, 0xc009816630)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:159 +0x36 fp=0xc0002c76d8 sp=0xc0002c7678 pc=0xbedbf6
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:286 +0x102 fp=0xc0002c77e0 sp=0xc0002c76d8 pc=0xbeb262
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c77e8 sp=0xc0002c77e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:279 +0x16c
goroutine 232 [GC worker (idle), 240 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072af50 sp=0xc00072af30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072afe0 sp=0xc00072af50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072afe8 sp=0xc00072afe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 231 [GC worker (idle), 240 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072a750 sp=0xc00072a730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072a7e0 sp=0xc00072a750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072a7e8 sp=0xc00072a7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 90013 [select]:
runtime.gopark(0xc009b19f68?, 0x4?, 0x3?, 0x0?, 0xc009b19db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009b19c00 sp=0xc009b19be0 pc=0x444c16
runtime.selectgo(0xc009b19f68, 0xc009b19da8, 0xc0030ddc00?, 0x0, 0x454101?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009b19d40 sp=0xc009b19c00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc0064cec60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc009b19fc8 sp=0xc009b19d40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc009b19fe0 sp=0xc009b19fc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009b19fe8 sp=0xc009b19fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 193 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc001ade780?, 0xc00a631240?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001ade750 sp=0xc001ade730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001ade7e0 sp=0xc001ade750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001ade7e8 sp=0xc001ade7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 258 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc00020a4a0?, 0x1c?, 0x0?, 0x0?, 0xc0002840c0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c6f50 sp=0xc0002c6f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0002c6fe0 sp=0xc0002c6f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c6fe8 sp=0xc0002c6fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 259 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc0002c0f80?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c0f50 sp=0xc0002c0f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0002c0fe0 sp=0xc0002c0f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c0fe8 sp=0xc0002c0fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 219 [GC worker (idle), 240 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072f750 sp=0xc00072f730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072f7e0 sp=0xc00072f750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072f7e8 sp=0xc00072f7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 260 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc000230180?, 0xc000042690?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c7f50 sp=0xc0002c7f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0002c7fe0 sp=0xc0002c7f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c7fe8 sp=0xc0002c7fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 220 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc00055ca20?, 0xc0004436c0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072ff50 sp=0xc00072ff30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072ffe0 sp=0xc00072ff50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072ffe8 sp=0xc00072ffe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 221 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc0002b6420?, 0xc0000470f0?, 0x0?, 0x0?, 0xc0005a5200?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000069f50 sp=0xc000069f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc000069fe0 sp=0xc000069f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 261 [GC worker (idle), 240 minutes]:
runtime.gopark(0xd4ffcc?, 0xc00028c400?, 0x88?, 0x1f?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c1f50 sp=0xc0002c1f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0002c1fe0 sp=0xc0002c1f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c1fe8 sp=0xc0002c1fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 222 [GC worker (idle), 240 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000067750 sp=0xc000067730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc0000677e0 sp=0xc000067750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000677e8 sp=0xc0000677e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 249 [GC worker (idle), 240 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072c750 sp=0xc00072c730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072c7e0 sp=0xc00072c750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072c7e8 sp=0xc00072c7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 223 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc0002b7500?, 0x40d9dd?, 0x0?, 0x0?, 0xc00006dfa8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00006df50 sp=0xc00006df30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00006dfe0 sp=0xc00006df50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00006dfe8 sp=0xc00006dfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 262 [GC worker (idle), 240 minutes]:
runtime.gopark(0x10bfd40?, 0xc003c7ae40?, 0x40?, 0xfd?, 0xc003c7bcb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001ad9750 sp=0xc001ad9730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001ad97e0 sp=0xc001ad9750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001ad97e8 sp=0xc001ad97e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 250 [GC worker (idle), 240 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000731f50 sp=0xc000731f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc000731fe0 sp=0xc000731f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000731fe8 sp=0xc000731fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 263 [GC worker (idle), 240 minutes]:
runtime.gopark(0x10bfd40?, 0xc0041778c0?, 0x40?, 0xfd?, 0xc004177ce0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001ad9f50 sp=0xc001ad9f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001ad9fe0 sp=0xc001ad9f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001ad9fe8 sp=0xc001ad9fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 264 [GC worker (idle), 240 minutes]:
runtime.gopark(0x10bfd40?, 0xc0043f7ef0?, 0x40?, 0xfd?, 0xc004412420?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001ada750 sp=0xc001ada730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001ada7e0 sp=0xc001ada750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001ada7e8 sp=0xc001ada7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 265 [GC worker (idle), 240 minutes]:
runtime.gopark(0x10bfd40?, 0xc00467ad50?, 0x40?, 0xfd?, 0xc00467b260?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001adaf50 sp=0xc001adaf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001adafe0 sp=0xc001adaf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001adafe8 sp=0xc001adafe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 266 [GC worker (idle), 240 minutes]:
runtime.gopark(0x10bfd40?, 0xc0042d4390?, 0x40?, 0xfd?, 0xc0042d44e0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001adb750 sp=0xc001adb730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001adb7e0 sp=0xc001adb750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001adb7e8 sp=0xc001adb7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 251 [GC worker (idle), 240 minutes]:
runtime.gopark(0xc0002b71a0?, 0xc0007fcbf0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000730f50 sp=0xc000730f30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc000730fe0 sp=0xc000730f50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000730fe8 sp=0xc000730fe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 252 [GC worker (idle), 240 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072cf50 sp=0xc00072cf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072cfe0 sp=0xc00072cf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072cfe8 sp=0xc00072cfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 267 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0x8c?, 0x3e?, 0xc002738bd0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001adbf50 sp=0xc001adbf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001adbfe0 sp=0xc001adbf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001adbfe8 sp=0xc001adbfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 268 [GC worker (idle), 227 minutes]:
runtime.gopark(0x2070ae0?, 0x3?, 0x9f?, 0x4f?, 0xc0035b7440?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001adc750 sp=0xc001adc730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001adc7e0 sp=0xc001adc750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001adc7e8 sp=0xc001adc7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 269 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0x94?, 0xd3?, 0xc001824c00?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001adcf50 sp=0xc001adcf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc001adcfe0 sp=0xc001adcf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001adcfe8 sp=0xc001adcfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 253 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0xf0?, 0x79?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072d750 sp=0xc00072d730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072d7e0 sp=0xc00072d750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072d7e8 sp=0xc00072d7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 270 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0xe7?, 0x18?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a67b750 sp=0xc00a67b730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a67b7e0 sp=0xc00a67b750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a67b7e8 sp=0xc00a67b7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 271 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0x37?, 0x8a?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a67bf50 sp=0xc00a67bf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a67bfe0 sp=0xc00a67bf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a67bfe8 sp=0xc00a67bfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 254 [GC worker (idle), 3 minutes]:
runtime.gopark(0x2070ae0?, 0x1?, 0x9d?, 0x4e?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00072df50 sp=0xc00072df30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00072dfe0 sp=0xc00072df50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00072dfe8 sp=0xc00072dfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 272 [GC worker (idle), 227 minutes]:
runtime.gopark(0x21275719dd3f?, 0x1?, 0x3d?, 0x84?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a67c750 sp=0xc00a67c730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a67c7e0 sp=0xc00a67c750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a67c7e8 sp=0xc00a67c7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 273 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0x8b?, 0x22?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a67cf50 sp=0xc00a67cf30 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a67cfe0 sp=0xc00a67cf50 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a67cfe8 sp=0xc00a67cfe0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 274 [GC worker (idle)]:
runtime.gopark(0x2070ae0?, 0x1?, 0xef?, 0xf4?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a67d750 sp=0xc00a67d730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a67d7e0 sp=0xc00a67d750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a67d7e8 sp=0xc00a67d7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 255 [GC worker (idle), 3 minutes]:
runtime.gopark(0x2070ae0?, 0x1?, 0x9a?, 0x67?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a7ab750 sp=0xc00a7ab730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a7ab7e0 sp=0xc00a7ab750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a7ab7e8 sp=0xc00a7ab7e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 236 [GC worker (idle), 7 minutes]:
runtime.gopark(0x2070ae0?, 0x1?, 0x16?, 0xce?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a678750 sp=0xc00a678730 pc=0x444c16
runtime.gcBgMarkWorker()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1235 +0xf1 fp=0xc00a6787e0 sp=0xc00a678750 pc=0x425e51
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a6787e8 sp=0xc00a6787e0 pc=0x476581
created by runtime.gcBgMarkStartWorkers
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/mgc.go:1159 +0x25
goroutine 511 [select]:
runtime.gopark(0xc009157f90?, 0x2?, 0x20?, 0xee?, 0xc009157f4c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009157dc8 sp=0xc009157da8 pc=0x444c16
runtime.selectgo(0xc009157f90, 0xc009157f48, 0xc0062f4b40?, 0x0, 0x101000101000001?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009157f08 sp=0xc009157dc8 pc=0x454a9c
github.com/couchbase/gometa/protocol.(*Follower).startListener(0xc000018a10)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:149 +0xe5 fp=0xc009157fc8 sp=0xc009157f08 pc=0xcc4fe5
github.com/couchbase/gometa/protocol.(*Follower).Start.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x26 fp=0xc009157fe0 sp=0xc009157fc8 pc=0xcc4be6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009157fe8 sp=0xc009157fe0 pc=0x476581
created by github.com/couchbase/gometa/protocol.(*Follower).Start
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x56
goroutine 1223 [chan receive, 228 minutes]:
runtime.gopark(0xc0058b8fc0?, 0xc0051a1718?, 0x1f?, 0x58?, 0x3?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0051a1698 sp=0xc0051a1678 pc=0x444c16
runtime.chanrecv(0xc00aa49260, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0051a1728 sp=0xc0051a1698 pc=0x40ec3b
runtime.chanrecv1(0xc0084a7d58?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc0051a1750 sp=0xc0051a1728 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc0051a17e0 sp=0xc0051a1750 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0051a17e8 sp=0xc0051a17e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 1028 [sync.Cond.Wait]:
runtime.gopark(0x0?, 0xc00846b680?, 0x90?, 0x8d?, 0x4?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aa39d78 sp=0xc00aa39d58 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
sync.runtime_notifyListWait(0xc006143210, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:517 +0x14c fp=0xc00aa39dc0 sp=0xc00aa39d78 pc=0x47266c
sync.(*Cond).Wait(0xc00a061b90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/cond.go:70 +0x8c fp=0xc00aa39df8 sp=0xc00aa39dc0 pc=0x47dbcc
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc008c648a0, 0xc00a061b90)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:138 +0x54 fp=0xc00aa39e48 sp=0xc00aa39df8 pc=0xbeeef4
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(...)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:28
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc005ebea00, 0xc000572fa0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:129 +0x505 fp=0xc00aa39f48 sp=0xc00aa39e48 pc=0xbf07a5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc005ebea00)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:195 +0x346 fp=0xc00aa39fc8 sp=0xc00aa39f48 pc=0xbf14c6
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc00aa39fe0 sp=0xc00aa39fc8 pc=0xbef7e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aa39fe8 sp=0xc00aa39fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 1354 [IO wait, 228 minutes]:
runtime.gopark(0x41cc06?, 0xb?, 0x0?, 0x0?, 0x36?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00846a468 sp=0xc00846a448 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc00846a4a0 sp=0xc00846a468 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f675951e468, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc00846a4c0 sp=0xc00846a4a0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc0090a8b80?, 0xc00935f000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00846a4e8 sp=0xc00846a4c0 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0090a8b80, {0xc00935f000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00846a568 sp=0xc00846a4e8 pc=0x4aca5a
net.(*netFD).Read(0xc0090a8b80, {0xc00935f000?, 0xc009306de0?, 0x15bc290?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc00846a5b0 sp=0xc00846a568 pc=0x68ae29
net.(*conn).Read(0xc004f06b10, {0xc00935f000?, 0x0?, 0x415b67?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc00846a5f8 sp=0xc00846a5b0 pc=0x69b0a5
bufio.(*Reader).Read(0xc001fedce0, {0xc008ee7b60, 0x18, 0x3fdca6d46f7186ed?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc00846a630 sp=0xc00846a5f8 pc=0x52c99b
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc00b950960, {0xc008ee7b60?, 0xc009480090?, 0x0?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:143 +0x6d fp=0xc00846a678 sp=0xc00846a630 pc=0xbedb4d
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc00b950960, 0xc009480090)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:159 +0x36 fp=0xc00846a6d8 sp=0xc00846a678 pc=0xbedbf6
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:286 +0x102 fp=0xc00846a7e0 sp=0xc00846a6d8 pc=0xbeb262
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00846a7e8 sp=0xc00846a7e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:279 +0x16c
goroutine 1324 [IO wait]:
runtime.gopark(0xc009cb41e0?, 0xb?, 0x0?, 0x0?, 0x20?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004517b8 sp=0xc000451798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x57f631?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0004517f0 sp=0xc0004517b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759578b78, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc000451810 sp=0xc0004517f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc0096feb00?, 0xc0071fa000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc000451838 sp=0xc000451810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0096feb00, {0xc0071fa000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0004518b8 sp=0xc000451838 pc=0x4aca5a
net.(*netFD).Read(0xc0096feb00, {0xc0071fa000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc000451900 sp=0xc0004518b8 pc=0x68ae29
net.(*conn).Read(0xc00a9ca850, {0xc0071fa000?, 0xc00338f800?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc000451948 sp=0xc000451900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc0051ae240, {0xc0071fa000?, 0x415b67?, 0x20?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc0004519a8 sp=0xc000451948 pc=0x78e52e
bufio.(*Reader).fill(0xc009dbb260)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc0004519e0 sp=0xc0004519a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc009dbb260, 0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc000451a30 sp=0xc0004519e0 pc=0x52cfaf
net/http/internal.readChunkLine(0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc000451a80 sp=0xc000451a30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc005d5ccc0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc000451ab0 sp=0xc000451a80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc005d5ccc0, {0xc00746d004?, 0x1?, 0xc000451bf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc000451b30 sp=0xc000451ab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc001aca280, {0xc00746d004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc000451b80 sp=0xc000451b30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc00746d004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc000451bf8 sp=0xc000451b80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc001aca300, {0xc00746d004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc000451c78 sp=0xc000451bf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc00813ac80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc000451cc8 sp=0xc000451c78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00813ac80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc000451d18 sp=0xc000451cc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00813ac80, {0x10aa6c0, 0xc0093a9b00})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc000451d48 sp=0xc000451d18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc0005a1e00, 0xc008d6bc00)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc000451fc0 sp=0xc000451d48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc000451fe0 sp=0xc000451fc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000451fe8 sp=0xc000451fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 830 [sync.Cond.Wait]:
runtime.gopark(0x0?, 0xc00a678e80?, 0x90?, 0x7a?, 0x4?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009af4d78 sp=0xc009af4d58 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
sync.runtime_notifyListWait(0xc006736690, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:517 +0x14c fp=0xc009af4dc0 sp=0xc009af4d78 pc=0x47266c
sync.(*Cond).Wait(0xc009e53510?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/cond.go:70 +0x8c fp=0xc009af4df8 sp=0xc009af4dc0 pc=0x47dbcc
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc008d6ab20, 0xc009e53510)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:138 +0x54 fp=0xc009af4e48 sp=0xc009af4df8 pc=0xbeeef4
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(...)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:28
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc005c28780, 0xc0024e3e00)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:129 +0x505 fp=0xc009af4f48 sp=0xc009af4e48 pc=0xbf07a5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc005c28780)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:195 +0x346 fp=0xc009af4fc8 sp=0xc009af4f48 pc=0xbf14c6
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc009af4fe0 sp=0xc009af4fc8 pc=0xbef7e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009af4fe8 sp=0xc009af4fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 862 [select, 232 minutes]:
runtime.gopark(0xc0070bcf68?, 0x4?, 0x3?, 0x0?, 0xc0070bcdb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0070bcc00 sp=0xc0070bcbe0 pc=0x444c16
runtime.selectgo(0xc0070bcf68, 0xc0070bcda8, 0xc00b956f40?, 0x0, 0xc0056e4c01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0070bcd40 sp=0xc0070bcc00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc001b0d7a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0070bcfc8 sp=0xc0070bcd40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0070bcfe0 sp=0xc0070bcfc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0070bcfe8 sp=0xc0070bcfe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 1044 [sync.Cond.Wait]:
runtime.gopark(0x0?, 0x40ecea?, 0x18?, 0x4d?, 0x4?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009af5d78 sp=0xc009af5d58 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
sync.runtime_notifyListWait(0xc004c58110, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:517 +0x14c fp=0xc009af5dc0 sp=0xc009af5d78 pc=0x47266c
sync.(*Cond).Wait(0xc00a4c54b0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/cond.go:70 +0x8c fp=0xc009af5df8 sp=0xc009af5dc0 pc=0x47dbcc
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc007ecbfa0, 0xc00a4c54b0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:138 +0x54 fp=0xc009af5e48 sp=0xc009af5df8 pc=0xbeeef4
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(...)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:28
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc006204f00, 0xc0001fb9a0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:129 +0x505 fp=0xc009af5f48 sp=0xc009af5e48 pc=0xbf07a5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc006204f00)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:195 +0x346 fp=0xc009af5fc8 sp=0xc009af5f48 pc=0xbf14c6
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc009af5fe0 sp=0xc009af5fc8 pc=0xbef7e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009af5fe8 sp=0xc009af5fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 479 [select, 225 minutes]:
runtime.gopark(0xc000453ba0?, 0x3?, 0x0?, 0x30?, 0xc000453b1a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000453978 sp=0xc000453958 pc=0x444c16
runtime.selectgo(0xc000453ba0, 0xc000453b14, 0x0?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000453ab8 sp=0xc000453978 pc=0x454a9c
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc000081fe0?, {0x12902f6, 0x1b}, 0xc000453e68, 0xc0050993e0)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc000453e40 sp=0xc000453ab8 pc=0xa348c9
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x12902f6?, 0x790340?}, 0xc00190a6c0?, 0xc0051a3620?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc000453e88 sp=0xc000453e40 pc=0xa34e58
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2.1(0xc004c7f800?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1607 +0xc7 fp=0xc000453f00 sp=0xc000453e88 pc=0xc18307
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc000453fa0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc000453f38 sp=0xc000453f00 pc=0xb58b23
github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1612 +0xdf fp=0xc000453fe0 sp=0xc000453f38 pc=0xc181bf
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000453fe8 sp=0xc000453fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/common.(*CommandListener).ListenTokens
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/common/token.go:1600 +0xaf
goroutine 1323 [select]:
runtime.gopark(0xc00aa36f98?, 0x2?, 0x2?, 0x30?, 0xc00aa36f94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aa36e20 sp=0xc00aa36e00 pc=0x444c16
runtime.selectgo(0xc00aa36f98, 0xc00aa36f90, 0x2033920?, 0x0, 0xd2573d8cf50?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00aa36f60 sp=0xc00aa36e20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc00a8d92c0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc00aa36fc8 sp=0xc00aa36f60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc00aa36fe0 sp=0xc00aa36fc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aa36fe8 sp=0xc00aa36fe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 512 [select]:
runtime.gopark(0xc0051a4790?, 0x2?, 0x22?, 0x7c?, 0xc0051a4774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0051a45f8 sp=0xc0051a45d8 pc=0x444c16
runtime.selectgo(0xc0051a4790, 0xc0051a4770, 0x0?, 0x0, 0x2?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0051a4738 sp=0xc0051a45f8 pc=0x454a9c
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc00522e540)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6530 +0xcd fp=0xc0051a47c8 sp=0xc0051a4738 pc=0xd327ad
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x26 fp=0xc0051a47e0 sp=0xc0051a47c8 pc=0xd326a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0051a47e8 sp=0xc0051a47e0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x8d
goroutine 509 [IO wait, 225 minutes]:
runtime.gopark(0xd4f?, 0xb?, 0x0?, 0x0?, 0x15?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0008e79a0 sp=0xc0008e7980 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0008e79d8 sp=0xc0008e79a0 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759579898, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0008e79f8 sp=0xc0008e79d8 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00a419980?, 0xc00564b000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0008e7a20 sp=0xc0008e79f8 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00a419980, {0xc00564b000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0008e7aa0 sp=0xc0008e7a20 pc=0x4aca5a
net.(*netFD).Read(0xc00a419980, {0xc00564b000?, 0x1c00a7844b0?, 0x7f67606b6e70?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0008e7ae8 sp=0xc0008e7aa0 pc=0x68ae29
net.(*conn).Read(0xc009512c88, {0xc00564b000?, 0x56f446?, 0xc0000037e8?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0008e7b30 sp=0xc0008e7ae8 pc=0x69b0a5
net/http.(*persistConn).Read(0xc0019425a0, {0xc00564b000?, 0x105c3e0?, 0xc0008e7e08?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc0008e7b90 sp=0xc0008e7b30 pc=0x78e52e
bufio.(*Reader).fill(0xc0052faa80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc0008e7bc8 sp=0xc0008e7b90 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc0052faa80, 0x81?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc0008e7c18 sp=0xc0008e7bc8 pc=0x52cfaf
net/http/internal.readChunkLine(0xda5?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0008e7c68 sp=0xc0008e7c18 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc001f39050)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0008e7c98 sp=0xc0008e7c68 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc001f39050, {0xc0091ea000?, 0xc00016c1b0?, 0x41f36b?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc0008e7d18 sp=0xc0008e7c98 pc=0x72b9b6
net/http.(*body).readLocked(0xc003b5a500, {0xc0091ea000?, 0xc000003850?, 0x1167d00?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc0008e7d68 sp=0xc0008e7d18 pc=0x78305c
net/http.(*body).Read(0x0?, {0xc0091ea000?, 0x56f03e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc0008e7de0 sp=0xc0008e7d68 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc003b5a700, {0xc0091ea000, 0xe00, 0xe00})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc0008e7e60 sp=0xc0008e7de0 pc=0x792c02
encoding/json.(*Decoder).refill(0xc0000037c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0008e7eb0 sp=0xc0008e7e60 pc=0x582168
encoding/json.(*Decoder).readValue(0xc0000037c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0008e7f00 sp=0xc0008e7eb0 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc0000037c0, {0x10356e0, 0xc00a7844b0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0008e7f30 sp=0xc0008e7f00 pc=0x581998
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc0008e7fe0 sp=0xc0008e7f30 pc=0xa34d4b
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0008e7fe8 sp=0xc0008e7fe0 pc=0x476581
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb
goroutine 497 [select, 232 minutes]:
runtime.gopark(0xc006f0fbc0?, 0x3?, 0x0?, 0x0?, 0xc006f0fb3a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000cf998 sp=0xc0000cf978 pc=0x444c16
runtime.selectgo(0xc0000cfbc0, 0xc006f0fb34, 0xc009c6e010?, 0x0, 0x3?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0000cfad8 sp=0xc0000cf998 pc=0x454a9c
github.com/couchbase/cbauth/metakv.doRunObserveChildren(0xc000081fe0?, {0x1284951, 0x13}, 0xc0000cfe88, 0xc004c7fa40)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:301 +0x429 fp=0xc0000cfe60 sp=0xc0000cfad8 pc=0xa348c9
github.com/couchbase/cbauth/metakv.(*store).runObserveChildren(...)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:259
github.com/couchbase/cbauth/metakv.RunObserveChildren({0x1284951?, 0x3?}, 0xc0051a5784?, 0xc0051a57b8?)
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:389 +0x58 fp=0xc0000cfea8 sp=0xc0000cfe60 pc=0xa34e58
github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings.func1.1(0x1?, {0x0?, 0x0?})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:85 +0xcc fp=0xc0000cff28 sp=0xc0000cfea8 pc=0xd7e0cc
github.com/couchbase/indexing/secondary/common.(*RetryHelper).Run(0xc0000cffa8)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/retry_helper.go:36 +0x83 fp=0xc0000cff60 sp=0xc0000cff28 pc=0xb58b23
github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:89 +0x75 fp=0xc0000cffe0 sp=0xc0000cff60 pc=0xd7dfb5
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000cffe8 sp=0xc0000cffe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.NewClientSettings
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/settings.go:80 +0x1ef
goroutine 530 [select]:
runtime.gopark(0x13046d0?, 0x0?, 0x9?, 0x18?, 0x1?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0051a5e18 sp=0xc0051a5df8 pc=0x444c16
runtime.selectgo(0xc0051a5f98, 0xc0051a5f88, 0x0?, 0x0, 0x2?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0051a5f58 sp=0xc0051a5e18 pc=0x454a9c
github.com/couchbase/indexing/secondary/queryport/client.(*schedTokenMonitor).updater(0xc004a6cff0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2396 +0x92 fp=0xc0051a5fc8 sp=0xc0051a5f58 pc=0xd63992
github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2189 +0x26 fp=0xc0051a5fe0 sp=0xc0051a5fc8 pc=0xd62306
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0051a5fe8 sp=0xc0051a5fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newSchedTokenMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2189 +0x296
goroutine 542 [IO wait]:
runtime.gopark(0x2710?, 0xb?, 0x0?, 0x0?, 0x17?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00042ecb0 sp=0xc00042ec90 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x454193?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc00042ece8 sp=0xc00042ecb0 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6760759a08, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc00042ed08 sp=0xc00042ece8 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc006edf200?, 0xc00a391ce0?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00042ed30 sp=0xc00042ed08 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc006edf200, {0xc00a391ce0, 0x8, 0x8})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00042edb0 sp=0xc00042ed30 pc=0x4aca5a
net.(*netFD).Read(0xc006edf200, {0xc00a391ce0?, 0xc00042ee30?, 0x459d52?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc00042edf8 sp=0xc00042edb0 pc=0x68ae29
net.(*conn).Read(0xc000209458, {0xc00a391ce0?, 0xc00042eed8?, 0xc11e0f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc00042ee40 sp=0xc00042edf8 pc=0x69b0a5
github.com/couchbase/gometa/common.(*PeerPipe).readBytes(0xc000848fc0, 0x15cd900?, {0x0?, 0xc0077eed90?, 0x40c70c0000000000?})
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:313 +0xcf fp=0xc00042eee8 sp=0xc00042ee40 pc=0xc11f4f
github.com/couchbase/gometa/common.(*PeerPipe).doReceive(0xc000848fc0)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:214 +0xd5 fp=0xc00042efc8 sp=0xc00042eee8 pc=0xc110b5
github.com/couchbase/gometa/common.NewPeerPipe.func2()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x26 fp=0xc00042efe0 sp=0xc00042efc8 pc=0xc10126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00042efe8 sp=0xc00042efe0 pc=0x476581
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x18a
goroutine 546 [select, 232 minutes]:
runtime.gopark(0xc000836f68?, 0x4?, 0x3?, 0x0?, 0xc000836db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000836c00 sp=0xc000836be0 pc=0x444c16
runtime.selectgo(0xc000836f68, 0xc000836da8, 0xc003b5a500?, 0x0, 0x454101?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000836d40 sp=0xc000836c00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc0019425a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc000836fc8 sp=0xc000836d40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc000836fe0 sp=0xc000836fc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000836fe8 sp=0xc000836fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 533 [select, 232 minutes]:
runtime.gopark(0xc0070bdf68?, 0x4?, 0x3?, 0x0?, 0xc0070bddb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0070bdc00 sp=0xc0070bdbe0 pc=0x444c16
runtime.selectgo(0xc0070bdf68, 0xc0070bdda8, 0xc003b5a900?, 0x0, 0x454101?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0070bdd40 sp=0xc0070bdc00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc00194a7e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc0070bdfc8 sp=0xc0070bdd40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc0070bdfe0 sp=0xc0070bdfc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0070bdfe8 sp=0xc0070bdfe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 534 [select, 232 minutes]:
runtime.gopark(0xc00722bf90?, 0x2?, 0xd8?, 0xbd?, 0xc00722bf24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00722bd90 sp=0xc00722bd70 pc=0x444c16
runtime.selectgo(0xc00722bf90, 0xc00722bf20, 0xc0029de540?, 0x0, 0xc004b1a180?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00722bed0 sp=0xc00722bd90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc00194a7e0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc00722bfc8 sp=0xc00722bed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc00722bfe0 sp=0xc00722bfc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00722bfe8 sp=0xc00722bfe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 547 [select, 232 minutes]:
runtime.gopark(0xc000078f90?, 0x2?, 0xd8?, 0x8d?, 0xc000078f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000078d90 sp=0xc000078d70 pc=0x444c16
runtime.selectgo(0xc000078f90, 0xc000078f20, 0xc003e88700?, 0x0, 0xc004abd440?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000078ed0 sp=0xc000078d90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc0019425a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc000078fc8 sp=0xc000078ed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc000078fe0 sp=0xc000078fc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000078fe8 sp=0xc000078fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 510 [IO wait, 232 minutes]:
runtime.gopark(0x1d53?, 0xb?, 0x0?, 0x0?, 0x13?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0004339a0 sp=0xc000433980 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0004339d8 sp=0xc0004339a0 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6760759738, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0004339f8 sp=0xc0004339d8 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc006edee00?, 0xc00579f000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc000433a20 sp=0xc0004339f8 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc006edee00, {0xc00579f000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc000433aa0 sp=0xc000433a20 pc=0x4aca5a
net.(*netFD).Read(0xc006edee00, {0xc00579f000?, 0x1c00a784500?, 0x7f67606bb8f8?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc000433ae8 sp=0xc000433aa0 pc=0x68ae29
net.(*conn).Read(0xc000209390, {0xc00579f000?, 0x56f446?, 0xc0024ba028?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc000433b30 sp=0xc000433ae8 pc=0x69b0a5
net/http.(*persistConn).Read(0xc00194a7e0, {0xc00579f000?, 0x105c3e0?, 0xc000433e08?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc000433b90 sp=0xc000433b30 pc=0x78e52e
bufio.(*Reader).fill(0xc004cabf80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc000433bc8 sp=0xc000433b90 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc004cabf80, 0x81?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc000433c18 sp=0xc000433bc8 pc=0x52cfaf
net/http/internal.readChunkLine(0x1d4d?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc000433c68 sp=0xc000433c18 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc001f391a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc000433c98 sp=0xc000433c68 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc001f391a0, {0xc005832000?, 0xc00016c1b0?, 0xc004b1ac30?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc000433d18 sp=0xc000433c98 pc=0x72b9b6
net/http.(*body).readLocked(0xc003b5a900, {0xc005832000?, 0xc0024ba090?, 0x1167d00?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc000433d68 sp=0xc000433d18 pc=0x78305c
net/http.(*body).Read(0x0?, {0xc005832000?, 0x56f03e?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc000433de0 sp=0xc000433d68 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc003b5ab00, {0xc005832000, 0x1e00, 0x1e00})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc000433e60 sp=0xc000433de0 pc=0x792c02
encoding/json.(*Decoder).refill(0xc0024ba000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc000433eb0 sp=0xc000433e60 pc=0x582168
encoding/json.(*Decoder).readValue(0xc0024ba000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc000433f00 sp=0xc000433eb0 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc0024ba000, {0x10356e0, 0xc00a784500})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc000433f30 sp=0xc000433f00 pc=0x581998
github.com/couchbase/cbauth/metakv.doRunObserveChildren.func1()
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:284 +0x10b fp=0xc000433fe0 sp=0xc000433f30 pc=0xa34d4b
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000433fe8 sp=0xc000433fe0 pc=0x476581
created by github.com/couchbase/cbauth/metakv.doRunObserveChildren
/opt/build/goproj/src/github.com/couchbase/cbauth/metakv/metakv.go:280 +0x2eb
goroutine 540 [select, 232 minutes]:
runtime.gopark(0xc0006d1d08?, 0x4?, 0x2?, 0x0?, 0xc0006d1c90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0006d1b08 sp=0xc0006d1ae8 pc=0x444c16
runtime.selectgo(0xc0006d1d08, 0xc0006d1c88, 0xc00a7846e0?, 0x0, 0xc004b88d01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0006d1c48 sp=0xc0006d1b08 pc=0x454a9c
github.com/couchbase/gometa/protocol.runWatcher(0xc000848fc0, {0x15c4640, 0xc00522e540}, {0x15d6298?, 0xc00522e540}, {0x15d4100?, 0x206f6b8}, 0xc0053c8460, 0xc005992780, 0xc0053c84d0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:357 +0x3be fp=0xc0006d1d60 sp=0xc0006d1c48 pc=0xcc7abe
github.com/couchbase/gometa/protocol.runOnce(0x1, {0xc00a5466b0, 0xe}, {0x15c4640, 0xc00522e540}, {0x15d6298, 0xc00522e540}, {0x15d4100, 0x206f6b8}, 0xc0053c8460, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:213 +0x525 fp=0xc0006d1e90 sp=0xc0006d1d60 pc=0xcc6b65
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc00a5466b0, 0xe}, {0x15c4640, 0xc00522e540}, {0x15d6298, 0xc00522e540}, {0x15d4100, 0x206f6b8}, 0xc0053c8460, 0xc005992780, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:65 +0x174 fp=0xc0006d1f68 sp=0xc0006d1e90 pc=0xcc6494
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x9f fp=0xc0006d1fe0 sp=0xc0006d1f68 pc=0xd2441f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0006d1fe8 sp=0xc0006d1fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x1f8
goroutine 541 [chan receive, 232 minutes]:
runtime.gopark(0x4aec20?, 0xc006edf200?, 0x28?, 0xe?, 0xc000660e88?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000660e28 sp=0xc000660e08 pc=0x444c16
runtime.chanrecv(0xc0057d48a0, 0xc000660f90, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000660eb8 sp=0xc000660e28 pc=0x40ec3b
runtime.chanrecv2(0xc000209458?, 0xc0023587c0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc000660ee0 sp=0xc000660eb8 pc=0x40e778
github.com/couchbase/gometa/common.(*PeerPipe).doSend(0xc000848fc0)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:167 +0x9e fp=0xc000660fc8 sp=0xc000660ee0 pc=0xc108de
github.com/couchbase/gometa/common.NewPeerPipe.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x26 fp=0xc000660fe0 sp=0xc000660fc8 pc=0xc10186
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000660fe8 sp=0xc000660fe0 pc=0x476581
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x14d
goroutine 513 [select]:
runtime.gopark(0xc000415f90?, 0x2?, 0x0?, 0x2f?, 0xc000415f4c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000415dc8 sp=0xc000415da8 pc=0x444c16
runtime.selectgo(0xc000415f90, 0xc000415f48, 0xc0096e50b0?, 0x0, 0x10000000001?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000415f08 sp=0xc000415dc8 pc=0x454a9c
github.com/couchbase/gometa/protocol.(*Follower).startListener(0xc000018e70)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:149 +0xe5 fp=0xc000415fc8 sp=0xc000415f08 pc=0xcc4fe5
github.com/couchbase/gometa/protocol.(*Follower).Start.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x26 fp=0xc000415fe0 sp=0xc000415fc8 pc=0xcc4be6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000415fe8 sp=0xc000415fe0 pc=0x476581
created by github.com/couchbase/gometa/protocol.(*Follower).Start
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/follower.go:76 +0x56
goroutine 1037 [select]:
runtime.gopark(0xc009edaf98?, 0x2?, 0x1?, 0x30?, 0xc009edaf94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009edae20 sp=0xc009edae00 pc=0x444c16
runtime.selectgo(0xc009edaf98, 0xc009edaf90, 0x2033920?, 0x0, 0xd256083c9aa?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009edaf60 sp=0xc009edae20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc00a8d83c0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc009edafc8 sp=0xc009edaf60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc009edafe0 sp=0xc009edafc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009edafe8 sp=0xc009edafe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 543 [select, 232 minutes]:
runtime.gopark(0xc000419d08?, 0x4?, 0x2?, 0x0?, 0xc000419c90?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000419b08 sp=0xc000419ae8 pc=0x444c16
runtime.selectgo(0xc000419d08, 0xc000419c88, 0xc0055aa4b0?, 0x0, 0xc004bf0001?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000419c48 sp=0xc000419b08 pc=0x454a9c
github.com/couchbase/gometa/protocol.runWatcher(0xc000bc37c0, {0x15c4640, 0xc0024f6000}, {0x15d6298?, 0xc0024f6000}, {0x15d4100?, 0x206f6b8}, 0xc004d12e70, 0xc005992b40, 0xc004d12ee0, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:357 +0x3be fp=0xc000419d60 sp=0xc000419c48 pc=0xcc7abe
github.com/couchbase/gometa/protocol.runOnce(0x1, {0xc00a5466e0, 0xe}, {0x15c4640, 0xc0024f6000}, {0x15d6298, 0xc0024f6000}, {0x15d4100, 0x206f6b8}, 0xc004d12e70, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:213 +0x525 fp=0xc000419e90 sp=0xc000419d60 pc=0xcc6b65
github.com/couchbase/gometa/protocol.RunWatcherServerWithRequest2({0xc00a5466e0, 0xe}, {0x15c4640, 0xc0024f6000}, {0x15d6298, 0xc0024f6000}, {0x15d4100, 0x206f6b8}, 0xc004d12e70, 0xc005992b40, ...)
/opt/build/goproj/src/github.com/couchbase/gometa/protocol/watcherServer.go:65 +0x174 fp=0xc000419f68 sp=0xc000419e90 pc=0xcc6494
github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x9f fp=0xc000419fe0 sp=0xc000419f68 pc=0xd2441f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000419fe8 sp=0xc000419fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/client.(*MetadataProvider).startWatcher
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:4315 +0x1f8
goroutine 544 [chan receive, 232 minutes]:
runtime.gopark(0x4aec20?, 0xc006edf380?, 0x28?, 0x9e?, 0xc000079e88?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc000079e28 sp=0xc000079e08 pc=0x444c16
runtime.chanrecv(0xc0057d4a80, 0xc000079f90, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc000079eb8 sp=0xc000079e28 pc=0x40ec3b
runtime.chanrecv2(0xc000209480?, 0xc005637d80?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:447 +0x18 fp=0xc000079ee0 sp=0xc000079eb8 pc=0x40e778
github.com/couchbase/gometa/common.(*PeerPipe).doSend(0xc000bc37c0)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:167 +0x9e fp=0xc000079fc8 sp=0xc000079ee0 pc=0xc108de
github.com/couchbase/gometa/common.NewPeerPipe.func1()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x26 fp=0xc000079fe0 sp=0xc000079fc8 pc=0xc10186
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000079fe8 sp=0xc000079fe0 pc=0x476581
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:65 +0x14d
goroutine 545 [IO wait]:
runtime.gopark(0x2710?, 0xb?, 0x0?, 0x0?, 0x18?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0070c0cb0 sp=0xc0070c0c90 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x454193?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0070c0ce8 sp=0xc0070c0cb0 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6760759fa8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0070c0d08 sp=0xc0070c0ce8 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc006edf380?, 0xc009c0bd60?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0070c0d30 sp=0xc0070c0d08 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc006edf380, {0xc009c0bd60, 0x8, 0x8})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0070c0db0 sp=0xc0070c0d30 pc=0x4aca5a
net.(*netFD).Read(0xc006edf380, {0xc009c0bd60?, 0xc0070c0e30?, 0x459d52?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0070c0df8 sp=0xc0070c0db0 pc=0x68ae29
net.(*conn).Read(0xc000209480, {0xc009c0bd60?, 0xc0070c0ed8?, 0xc11e0f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0070c0e40 sp=0xc0070c0df8 pc=0x69b0a5
github.com/couchbase/gometa/common.(*PeerPipe).readBytes(0xc000bc37c0, 0x15cd900?, {0x0?, 0xc0078a2e70?, 0xc00a7a6738?})
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:313 +0xcf fp=0xc0070c0ee8 sp=0xc0070c0e40 pc=0xc11f4f
github.com/couchbase/gometa/common.(*PeerPipe).doReceive(0xc000bc37c0)
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:214 +0xd5 fp=0xc0070c0fc8 sp=0xc0070c0ee8 pc=0xc110b5
github.com/couchbase/gometa/common.NewPeerPipe.func2()
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x26 fp=0xc0070c0fe0 sp=0xc0070c0fc8 pc=0xc10126
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0070c0fe8 sp=0xc0070c0fe0 pc=0x476581
created by github.com/couchbase/gometa/common.NewPeerPipe
/opt/build/goproj/src/github.com/couchbase/gometa/common/peerPipe.go:66 +0x18a
goroutine 562 [select]:
runtime.gopark(0xc0051a5790?, 0x2?, 0x22?, 0x7c?, 0xc0051a5774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0051a55f8 sp=0xc0051a55d8 pc=0x444c16
runtime.selectgo(0xc0051a5790, 0xc0051a5770, 0x0?, 0x0, 0x2?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0051a5738 sp=0xc0051a55f8 pc=0x454a9c
github.com/couchbase/indexing/secondary/manager/client.(*watcher).timeoutChecker(0xc0024f6000)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6530 +0xcd fp=0xc0051a57c8 sp=0xc0051a5738 pc=0xd327ad
github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x26 fp=0xc0051a57e0 sp=0xc0051a57c8 pc=0xd326a6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0051a57e8 sp=0xc0051a57e0 pc=0x476581
created by github.com/couchbase/indexing/secondary/manager/client.(*watcher).startTimer
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/manager/client/metadata_provider.go:6521 +0x8d
goroutine 552 [semacquire, 232 minutes]:
runtime.gopark(0xc00065fab0?, 0x45d91c?, 0x20?, 0xff?, 0x41581f?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00065fa38 sp=0xc00065fa18 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
runtime.semacquire1(0xc00027a2a4, 0xc0?, 0x3, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:150 +0x1fe fp=0xc00065faa0 sp=0xc00065fa38 pc=0x455b5e
sync.runtime_SemacquireMutex(0x3?, 0x0?, 0xc005992d20?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:77 +0x25 fp=0xc00065fad0 sp=0xc00065faa0 pc=0x472485
sync.(*Mutex).lockSlow(0xc00027a2a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:171 +0x165 fp=0xc00065fb20 sp=0xc00065fad0 pc=0x47f8c5
sync.(*Mutex).Lock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/mutex.go:90
github.com/couchbase/indexing/secondary/common.NewServicesChangeNotifier({0xc005992d20, 0x3f}, {0x12759d7, 0x7}, {0x127af6a, 0xb})
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/common/services_notifier.go:286 +0x597 fp=0xc00065fda0 sp=0xc00065fb20 pc=0xb5bc17
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).watchClusterChanges(0xc004bd0bb0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:2073 +0xff fp=0xc00065ffc8 sp=0xc00065fda0 pc=0xd6173f
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:151 +0x26 fp=0xc00065ffe0 sp=0xc00065ffc8 pc=0xd54e06
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00065ffe8 sp=0xc00065ffe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:151 +0x5d6
goroutine 553 [chan receive]:
runtime.gopark(0xc00188dc20?, 0x78a970?, 0x40?, 0x3a?, 0x15cc798?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00846eec8 sp=0xc00846eea8 pc=0x444c16
runtime.chanrecv(0xc0057d4ba0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00846ef58 sp=0xc00846eec8 pc=0x40ec3b
runtime.chanrecv1(0xc004bd0bb0?, 0xc005099e00?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc00846ef80 sp=0xc00846ef58 pc=0x40e738
github.com/couchbase/indexing/secondary/queryport/client.(*metadataClient).logstats(0xc004bd0bb0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:1412 +0x79 fp=0xc00846efc8 sp=0xc00846ef80 pc=0xd5c439
github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x26 fp=0xc00846efe0 sp=0xc00846efc8 pc=0xd54da6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00846efe8 sp=0xc00846efe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newMetaBridgeClient
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/meta_client.go:152 +0x616
goroutine 563 [sleep]:
runtime.gopark(0x2d92a24d6c9a?, 0xc0051a6718?, 0x85?, 0xf1?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0051a66e8 sp=0xc0051a66c8 pc=0x444c16
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc0051a6728 sp=0xc0051a66e8 pc=0x4733f5
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc0052d4580)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:461 +0xa5 fp=0xc0051a67c8 sp=0xc0051a6728 pc=0xd544c5
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc0051a67e0 sp=0xc0051a67c8 pc=0xd51726
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0051a67e8 sp=0xc0051a67e0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x4b6
goroutine 564 [sleep]:
runtime.gopark(0x2d9274d5beeb?, 0xc00a67a718?, 0x85?, 0xf1?, 0x10?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a67a6e8 sp=0xc00a67a6c8 pc=0x444c16
time.Sleep(0x3b9aca00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/time.go:195 +0x135 fp=0xc00a67a728 sp=0xc00a67a6e8 pc=0x4733f5
github.com/couchbase/indexing/secondary/queryport/client.(*connectionPool).releaseConnsRoutine(0xc0052d4790)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:461 +0xa5 fp=0xc00a67a7c8 sp=0xc00a67a728 pc=0xd544c5
github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x26 fp=0xc00a67a7e0 sp=0xc00a67a7c8 pc=0xd51726
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a67a7e8 sp=0xc00a67a7e0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.newConnectionPool
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/conn_pool.go:101 +0x4b6
goroutine 554 [select, 232 minutes]:
runtime.gopark(0xc00a7abf90?, 0x2?, 0x0?, 0x0?, 0xc00a7abf8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a7abe18 sp=0xc00a7abdf8 pc=0x444c16
runtime.selectgo(0xc00a7abf90, 0xc00a7abf88, 0x0?, 0x0, 0xc005d44500?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00a7abf58 sp=0xc00a7abe18 pc=0x454a9c
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).listenMetaChange(0xc006eded00, 0xc002475500)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1830 +0x6e fp=0xc00a7abfc0 sp=0xc00a7abf58 pc=0xd5000e
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x2a fp=0xc00a7abfe0 sp=0xc00a7abfc0 pc=0xd4ff6a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a7abfe8 sp=0xc00a7abfe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1823 +0x298
goroutine 555 [select]:
runtime.gopark(0xc00a7adf50?, 0x2?, 0x2?, 0x0?, 0xc00a7adf14?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a7add90 sp=0xc00a7add70 pc=0x444c16
runtime.selectgo(0xc00a7adf50, 0xc00a7adf10, 0x129442c?, 0x0, 0xc00a7adf20?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00a7aded0 sp=0xc00a7add90 pc=0x454a9c
github.com/couchbase/indexing/secondary/queryport/client.(*GsiClient).logstats(0xc006eded00, 0xc002475500)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1849 +0x238 fp=0xc00a7adfc0 sp=0xc00a7aded0 pc=0xd50278
github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2a fp=0xc00a7adfe0 sp=0xc00a7adfc0 pc=0xd4ff0a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a7adfe8 sp=0xc00a7adfe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/client.makeWithMetaProvider
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/client/client.go:1824 +0x2fa
goroutine 558 [chan receive]:
runtime.gopark(0x0?, 0x56?, 0x50?, 0x1e?, 0x4a2278?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008471da8 sp=0xc008471d88 pc=0x444c16
runtime.chanrecv(0xc0022b3380, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc008471e38 sp=0xc008471da8 pc=0x40ec3b
runtime.chanrecv1(0xc008471f48?, 0x56?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc008471e60 sp=0xc008471e38 pc=0x40e738
github.com/couchbase/indexing/secondary/queryport/n1ql.(*monitor).backfillMonitor(0xc005936620, 0x0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:91 +0x9b fp=0xc008471fc0 sp=0xc008471e60 pc=0xd82ebb
github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor.func1()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:40 +0x2a fp=0xc008471fe0 sp=0xc008471fc0 pc=0xd8276a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008471fe8 sp=0xc008471fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:40 +0xb8
goroutine 559 [chan receive]:
runtime.gopark(0xc009f38720?, 0xc005d5a750?, 0xf0?, 0x7d?, 0x4766c7?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a7a7d68 sp=0xc00a7a7d48 pc=0x444c16
runtime.chanrecv(0xc0022b33e0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00a7a7df8 sp=0xc00a7a7d68 pc=0x40ec3b
runtime.chanrecv1(0xc00a7a7eb8?, 0xc004c88d80?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc00a7a7e20 sp=0xc00a7a7df8 pc=0x40e738
github.com/couchbase/indexing/secondary/queryport/n1ql.(*monitor).logStats(0xc005936620, 0xc0047df7a0?)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:124 +0x9b fp=0xc00a7a7fc0 sp=0xc00a7a7e20 pc=0xd8329b
github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor.func2()
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:41 +0x2a fp=0xc00a7a7fe0 sp=0xc00a7a7fc0 pc=0xd8270a
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a7a7fe8 sp=0xc00a7a7fe0 pc=0x476581
created by github.com/couchbase/indexing/secondary/queryport/n1ql.initGSIMonitor
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/queryport/n1ql/monitor.go:41 +0x10a
goroutine 1222 [IO wait, 228 minutes]:
runtime.gopark(0xc00a67acb0?, 0xb?, 0x0?, 0x0?, 0x25?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a67ac68 sp=0xc00a67ac48 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc00a67aca0 sp=0xc00a67ac68 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f675951eaf8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc00a67acc0 sp=0xc00a67aca0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00826d680?, 0xc008317000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00a67ace8 sp=0xc00a67acc0 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00826d680, {0xc008317000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00a67ad68 sp=0xc00a67ace8 pc=0x4aca5a
net.(*netFD).Read(0xc00826d680, {0xc008317000?, 0xc00aa49440?, 0x15bc290?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc00a67adb0 sp=0xc00a67ad68 pc=0x68ae29
net.(*conn).Read(0xc00c606260, {0xc008317000?, 0x0?, 0x415b67?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc00a67adf8 sp=0xc00a67adb0 pc=0x69b0a5
bufio.(*Reader).Read(0xc001f2b500, {0xc00aa418d8, 0x18, 0x3fdd0015b419390d?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc00a67ae30 sp=0xc00a67adf8 pc=0x52c99b
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc009808e10, {0xc00aa418d8?, 0xc002319950?, 0x0?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:143 +0x6d fp=0xc00a67ae78 sp=0xc00a67ae30 pc=0xbedb4d
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc009808e10, 0xc002319950)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:159 +0x36 fp=0xc00a67aed8 sp=0xc00a67ae78 pc=0xbedbf6
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:286 +0x102 fp=0xc00a67afe0 sp=0xc00a67aed8 pc=0xbeb262
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a67afe8 sp=0xc00a67afe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:279 +0x16c
goroutine 894 [select, 232 minutes]:
runtime.gopark(0xc007229f90?, 0x2?, 0xd8?, 0x9d?, 0xc007229f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007229d90 sp=0xc007229d70 pc=0x444c16
runtime.selectgo(0xc007229f90, 0xc007229f20, 0xc00bb3a500?, 0x0, 0xc0056262a0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007229ed0 sp=0xc007229d90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc001b37680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc007229fc8 sp=0xc007229ed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc007229fe0 sp=0xc007229fc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007229fe8 sp=0xc007229fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 998 [IO wait]:
runtime.gopark(0xc009cb41e0?, 0xb?, 0x0?, 0x0?, 0x23?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000c97b8 sp=0xc0000c9798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x43b590?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0000c97f0 sp=0xc0000c97b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6760759468, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0000c9810 sp=0xc0000c97f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc006edf980?, 0xc00734d000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0000c9838 sp=0xc0000c9810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc006edf980, {0xc00734d000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0000c98b8 sp=0xc0000c9838 pc=0x4aca5a
net.(*netFD).Read(0xc006edf980, {0xc00734d000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0000c9900 sp=0xc0000c98b8 pc=0x68ae29
net.(*conn).Read(0xc004f06f00, {0xc00734d000?, 0xc001e7e600?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0000c9948 sp=0xc0000c9900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc006646900, {0xc00734d000?, 0x415b67?, 0x20?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc0000c99a8 sp=0xc0000c9948 pc=0x78e52e
bufio.(*Reader).fill(0xc009c35ec0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc0000c99e0 sp=0xc0000c99a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc009c35ec0, 0x70?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc0000c9a30 sp=0xc0000c99e0 pc=0x52cfaf
net/http/internal.readChunkLine(0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0000c9a80 sp=0xc0000c9a30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc006eef530)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0000c9ab0 sp=0xc0000c9a80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc006eef530, {0xc007477004?, 0x1?, 0xc0000c9bf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc0000c9b30 sp=0xc0000c9ab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc001acb280, {0xc007477004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc0000c9b80 sp=0xc0000c9b30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc007477004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc0000c9bf8 sp=0xc0000c9b80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc001acb300, {0xc007477004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc0000c9c78 sp=0xc0000c9bf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc00813b2c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0000c9cc8 sp=0xc0000c9c78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00813b2c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0000c9d18 sp=0xc0000c9cc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00813b2c0, {0x10aa6c0, 0xc0078a8960})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0000c9d48 sp=0xc0000c9d18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc009998000, 0xc0094f2fc0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc0000c9fc0 sp=0xc0000c9d48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc0000c9fe0 sp=0xc0000c9fc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000c9fe8 sp=0xc0000c9fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 90061 [select]:
runtime.gopark(0xc0051a77b0?, 0x2?, 0x1?, 0x30?, 0xc0051a778c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0051a7608 sp=0xc0051a75e8 pc=0x444c16
runtime.selectgo(0xc0051a77b0, 0xc0051a7788, 0xc0080eca38?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0051a7748 sp=0xc0051a7608 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:161 +0x8a fp=0xc0051a77e0 sp=0xc0051a7748 pc=0xbd35ca
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0051a77e8 sp=0xc0051a77e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:160 +0x433
goroutine 997 [select]:
runtime.gopark(0xc00988df98?, 0x2?, 0x0?, 0x30?, 0xc00988df94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00988de20 sp=0xc00988de00 pc=0x444c16
runtime.selectgo(0xc00988df98, 0xc00988df90, 0x2033920?, 0x0, 0xd2683eff891?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00988df60 sp=0xc00988de20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc00057e5a0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc00988dfc8 sp=0xc00988df60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc00988dfe0 sp=0xc00988dfc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00988dfe8 sp=0xc00988dfe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 893 [select, 232 minutes]:
runtime.gopark(0xc007228f68?, 0x4?, 0x3?, 0x0?, 0xc007228db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007228c00 sp=0xc007228be0 pc=0x444c16
runtime.selectgo(0xc007228f68, 0xc007228da8, 0xc00bb3a540?, 0x0, 0x68ae01?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007228d40 sp=0xc007228c00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc001b37680)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007228fc8 sp=0xc007228d40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007228fe0 sp=0xc007228fc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007228fe8 sp=0xc007228fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 1151 [sync.Cond.Wait]:
runtime.gopark(0x0?, 0xc0092d3d98?, 0x40?, 0x10?, 0x8?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0092d3d78 sp=0xc0092d3d58 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
sync.runtime_notifyListWait(0xc001b33e90, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:517 +0x14c fp=0xc0092d3dc0 sp=0xc0092d3d78 pc=0x47266c
sync.(*Cond).Wait(0xc009e530b0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/cond.go:70 +0x8c fp=0xc0092d3df8 sp=0xc0092d3dc0 pc=0x47dbcc
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc008d6a920, 0xc009e530b0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:138 +0x54 fp=0xc0092d3e48 sp=0xc0092d3df8 pc=0xbeeef4
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(...)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:28
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc005669100, 0xc000234b40)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:129 +0x505 fp=0xc0092d3f48 sp=0xc0092d3e48 pc=0xbf07a5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc005669100)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:195 +0x346 fp=0xc0092d3fc8 sp=0xc0092d3f48 pc=0xbf14c6
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc0092d3fe0 sp=0xc0092d3fc8 pc=0xbef7e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0092d3fe8 sp=0xc0092d3fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 900 [select, 232 minutes]:
runtime.gopark(0xc007227f68?, 0x4?, 0x3?, 0x0?, 0xc007227db0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007227c00 sp=0xc007227be0 pc=0x444c16
runtime.selectgo(0xc007227f68, 0xc007227da8, 0xc00bb3a640?, 0x0, 0x454101?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007227d40 sp=0xc007227c00 pc=0x454a9c
net/http.(*persistConn).readLoop(0xc001b37c20)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2213 +0xd85 fp=0xc007227fc8 sp=0xc007227d40 pc=0x78ff25
net/http.(*Transport).dialConn.func5()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x26 fp=0xc007227fe0 sp=0xc007227fc8 pc=0x78db26
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007227fe8 sp=0xc007227fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1751 +0x173e
goroutine 977 [select]:
runtime.gopark(0xc0008ebf98?, 0x2?, 0x2?, 0x30?, 0xc0008ebf94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0008ebe20 sp=0xc0008ebe00 pc=0x444c16
runtime.selectgo(0xc0008ebf98, 0xc0008ebf90, 0x2033920?, 0x0, 0xd2542429811?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0008ebf60 sp=0xc0008ebe20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc000134780)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc0008ebfc8 sp=0xc0008ebf60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc0008ebfe0 sp=0xc0008ebfc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0008ebfe8 sp=0xc0008ebfe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 1276 [chan receive, 227 minutes]:
runtime.gopark(0x0?, 0xc009b2df18?, 0x1f?, 0x58?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009b2de98 sp=0xc009b2de78 pc=0x444c16
runtime.chanrecv(0xc009dc2600, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc009b2df28 sp=0xc009b2de98 pc=0x40ec3b
runtime.chanrecv1(0xc00dc04498?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc009b2df50 sp=0xc009b2df28 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc009b2dfe0 sp=0xc009b2df50 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009b2dfe8 sp=0xc009b2dfe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 1355 [chan receive, 228 minutes]:
runtime.gopark(0xc00ae819e0?, 0xc008469718?, 0x1f?, 0x58?, 0x3?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008469698 sp=0xc008469678 pc=0x444c16
runtime.chanrecv(0xc009306ba0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc008469728 sp=0xc008469698 pc=0x40ec3b
runtime.chanrecv1(0xc0092bc420?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc008469750 sp=0xc008469728 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc0084697e0 sp=0xc008469750 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0084697e8 sp=0xc0084697e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 1174 [select, 228 minutes]:
runtime.gopark(0xc007b21fb0?, 0x2?, 0xb0?, 0x1f?, 0xc007b21f74?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007b21df8 sp=0xc007b21dd8 pc=0x444c16
runtime.selectgo(0xc007b21fb0, 0xc007b21f70, 0xc007b21fb0?, 0x0, 0x12ce498?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007b21f38 sp=0xc007b21df8 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:257 +0xa6 fp=0xc007b21fe0 sp=0xc007b21f38 pc=0xbeb986
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007b21fe8 sp=0xc007b21fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:255 +0xea
goroutine 1203 [IO wait]:
runtime.gopark(0xc0091b8110?, 0xb?, 0x0?, 0x0?, 0x16?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00aac17b8 sp=0xc00aac1798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x43b590?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc00aac17f0 sp=0xc00aac17b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f675951ecd8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc00aac1810 sp=0xc00aac17f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00826dd80?, 0xc007214000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00aac1838 sp=0xc00aac1810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00826dd80, {0xc007214000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00aac18b8 sp=0xc00aac1838 pc=0x4aca5a
net.(*netFD).Read(0xc00826dd80, {0xc007214000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc00aac1900 sp=0xc00aac18b8 pc=0x68ae29
net.(*conn).Read(0xc000122a48, {0xc007214000?, 0xc005d44000?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc00aac1948 sp=0xc00aac1900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc0066c9680, {0xc007214000?, 0x0?, 0xd6f?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc00aac19a8 sp=0xc00aac1948 pc=0x78e52e
bufio.(*Reader).fill(0xc009d3fec0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc00aac19e0 sp=0xc00aac19a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc009d3fec0, 0x80?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc00aac1a30 sp=0xc00aac19e0 pc=0x52cfaf
net/http/internal.readChunkLine(0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc00aac1a80 sp=0xc00aac1a30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc009803f50)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc00aac1ab0 sp=0xc00aac1a80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc009803f50, {0xc0072f2004?, 0x1?, 0xc00aac1bf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc00aac1b30 sp=0xc00aac1ab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc001acb100, {0xc0072f2004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc00aac1b80 sp=0xc00aac1b30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc0072f2004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc00aac1bf8 sp=0xc00aac1b80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc001acb180, {0xc0072f2004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc00aac1c78 sp=0xc00aac1bf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc00813b180)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc00aac1cc8 sp=0xc00aac1c78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00813b180)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc00aac1d18 sp=0xc00aac1cc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00813b180, {0x10aa6c0, 0xc0078a8918})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc00aac1d48 sp=0xc00aac1d18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00a8f1c80, 0xc008487c60)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc00aac1fc0 sp=0xc00aac1d48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc00aac1fe0 sp=0xc00aac1fc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00aac1fe8 sp=0xc00aac1fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 1378 [sync.Cond.Wait]:
runtime.gopark(0x0?, 0xc009eddd98?, 0xc6?, 0x40?, 0x2070ae0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009eddd78 sp=0xc009eddd58 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
sync.runtime_notifyListWait(0xc003db5e10, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:517 +0x14c fp=0xc009edddc0 sp=0xc009eddd78 pc=0x47266c
sync.(*Cond).Wait(0xc00a4c52a0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/cond.go:70 +0x8c fp=0xc009edddf8 sp=0xc009edddc0 pc=0x47dbcc
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc007ecbea0, 0xc00a4c52a0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:138 +0x54 fp=0xc009edde48 sp=0xc009edddf8 pc=0xbeeef4
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(...)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:28
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc005850880, 0xc000572aa0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:129 +0x505 fp=0xc009eddf48 sp=0xc009edde48 pc=0xbf07a5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc005850880)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:195 +0x346 fp=0xc009eddfc8 sp=0xc009eddf48 pc=0xbf14c6
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc009eddfe0 sp=0xc009eddfc8 pc=0xbef7e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009eddfe8 sp=0xc009eddfe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 917 [select]:
runtime.gopark(0xc009159f98?, 0x2?, 0x0?, 0x30?, 0xc009159f94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009159e20 sp=0xc009159e00 pc=0x444c16
runtime.selectgo(0xc009159f98, 0xc009159f90, 0x2033920?, 0x0, 0xd24a82ab357?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009159f60 sp=0xc009159e20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc0005770e0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc009159fc8 sp=0xc009159f60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc009159fe0 sp=0xc009159fc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009159fe8 sp=0xc009159fe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 918 [IO wait]:
runtime.gopark(0xc0006dc930?, 0xb?, 0x0?, 0x0?, 0x9?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00419f7b8 sp=0xc00419f798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x57f631?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc00419f7f0 sp=0xc00419f7b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759579118, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc00419f810 sp=0xc00419f7f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc0096fe780?, 0xc006c3e000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00419f838 sp=0xc00419f810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0096fe780, {0xc006c3e000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00419f8b8 sp=0xc00419f838 pc=0x4aca5a
net.(*netFD).Read(0xc0096fe780, {0xc006c3e000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc00419f900 sp=0xc00419f8b8 pc=0x68ae29
net.(*conn).Read(0xc00a9ca788, {0xc006c3e000?, 0xc002990ec0?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc00419f948 sp=0xc00419f900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc00631f0e0, {0xc006c3e000?, 0x415b67?, 0x20?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc00419f9a8 sp=0xc00419f948 pc=0x78e52e
bufio.(*Reader).fill(0xc009dba9c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc00419f9e0 sp=0xc00419f9a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc009dba9c0, 0xf0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc00419fa30 sp=0xc00419f9e0 pc=0x52cfaf
net/http/internal.readChunkLine(0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc00419fa80 sp=0xc00419fa30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc006168e10)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc00419fab0 sp=0xc00419fa80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc006168e10, {0xc006e37004?, 0x1?, 0xc00419fbf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc00419fb30 sp=0xc00419fab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc00469e400, {0xc006e37004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc00419fb80 sp=0xc00419fb30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc006e37004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc00419fbf8 sp=0xc00419fb80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc00469e500, {0xc006e37004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc00419fc78 sp=0xc00419fbf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc00029f180)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc00419fcc8 sp=0xc00419fc78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00029f180)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc00419fd18 sp=0xc00419fcc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00029f180, {0x10aa6c0, 0xc007a649f0})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc00419fd48 sp=0xc00419fd18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc000496600, 0xc00bb7cd60)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc00419ffc0 sp=0xc00419fd48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc00419ffe0 sp=0xc00419ffc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00419ffe8 sp=0xc00419ffe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 926 [select, 230 minutes]:
runtime.gopark(0xc001ad87b0?, 0x2?, 0xb0?, 0x87?, 0xc001ad8774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc001ad85f8 sp=0xc001ad85d8 pc=0x444c16
runtime.selectgo(0xc001ad87b0, 0xc001ad8770, 0xc001ad87b0?, 0x0, 0x12ce498?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc001ad8738 sp=0xc001ad85f8 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:257 +0xa6 fp=0xc001ad87e0 sp=0xc001ad8738 pc=0xbeb986
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc001ad87e8 sp=0xc001ad87e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:255 +0xea
goroutine 1308 [select]:
runtime.gopark(0xc009edcf98?, 0x2?, 0x1?, 0x30?, 0xc009edcf94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009edce20 sp=0xc009edce00 pc=0x444c16
runtime.selectgo(0xc009edcf98, 0xc009edcf90, 0x2033920?, 0x0, 0xd2558f1de58?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009edcf60 sp=0xc009edce20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc0001354a0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc009edcfc8 sp=0xc009edcf60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc009edcfe0 sp=0xc009edcfc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009edcfe8 sp=0xc009edcfe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 995 [select, 230 minutes]:
runtime.gopark(0xc007b27fb0?, 0x2?, 0xb0?, 0x7f?, 0xc007b27f74?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007b27df8 sp=0xc007b27dd8 pc=0x444c16
runtime.selectgo(0xc007b27fb0, 0xc007b27f70, 0xc007b27fb0?, 0x0, 0x12b22bd?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007b27f38 sp=0xc007b27df8 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:257 +0xa6 fp=0xc007b27fe0 sp=0xc007b27f38 pc=0xbeb986
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007b27fe8 sp=0xc007b27fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:255 +0xea
goroutine 922 [sync.Cond.Wait]:
runtime.gopark(0x0?, 0x10bfd40?, 0x1f?, 0x58?, 0x10bfd40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00722ad78 sp=0xc00722ad58 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
sync.runtime_notifyListWait(0xc006143510, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:517 +0x14c fp=0xc00722adc0 sp=0xc00722ad78 pc=0x47266c
sync.(*Cond).Wait(0xc00a061da0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/cond.go:70 +0x8c fp=0xc00722adf8 sp=0xc00722adc0 pc=0x47dbcc
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc008c649a0, 0xc00a061da0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:138 +0x54 fp=0xc00722ae48 sp=0xc00722adf8 pc=0xbeeef4
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(...)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:28
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc0055ae280, 0xc000136820)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:129 +0x505 fp=0xc00722af48 sp=0xc00722ae48 pc=0xbf07a5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc0055ae280)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:195 +0x346 fp=0xc00722afc8 sp=0xc00722af48 pc=0xbf14c6
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc00722afe0 sp=0xc00722afc8 pc=0xbef7e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00722afe8 sp=0xc00722afe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 1053 [chan receive, 230 minutes]:
runtime.gopark(0xc00a679638?, 0xc00a679718?, 0x1f?, 0x58?, 0x3?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a679698 sp=0xc00a679678 pc=0x444c16
runtime.chanrecv(0xc009962c60, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00a679728 sp=0xc00a679698 pc=0x40ec3b
runtime.chanrecv1(0xc009931638?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc00a679750 sp=0xc00a679728 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc00a6797e0 sp=0xc00a679750 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a6797e8 sp=0xc00a6797e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 1208 [sync.Cond.Wait]:
runtime.gopark(0x0?, 0xc0051a1e80?, 0xe8?, 0x4e?, 0x4?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008474d78 sp=0xc008474d58 pc=0x444c16
runtime.goparkunlock(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:369
sync.runtime_notifyListWait(0xc003db5210, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/sema.go:517 +0x14c fp=0xc008474dc0 sp=0xc008474d78 pc=0x47266c
sync.(*Cond).Wait(0xc00a4c5090?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/sync/cond.go:70 +0x8c fp=0xc008474df8 sp=0xc008474dc0 pc=0x47dbcc
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc007ecbda0, 0xc00a4c5090)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:138 +0x54 fp=0xc008474e48 sp=0xc008474df8 pc=0xbeeef4
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(...)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdopqueue.go:28
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc002302080, 0xc00029d360)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:129 +0x505 fp=0xc008474f48 sp=0xc008474e48 pc=0xbf07a5
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc002302080)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:195 +0x346 fp=0xc008474fc8 sp=0xc008474f48 pc=0xbf14c6
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x26 fp=0xc008474fe0 sp=0xc008474fc8 pc=0xbef7e6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008474fe8 sp=0xc008474fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipeline.go:70 +0x91
goroutine 1010 [chan receive, 230 minutes]:
runtime.gopark(0xc00a679e38?, 0xc00a679f18?, 0x1f?, 0x58?, 0x3?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a679e98 sp=0xc00a679e78 pc=0x444c16
runtime.chanrecv(0xc009175140, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00a679f28 sp=0xc00a679e98 pc=0x40ec3b
runtime.chanrecv1(0xc0094c24e0?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc00a679f50 sp=0xc00a679f28 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc00a679fe0 sp=0xc00a679f50 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a679fe8 sp=0xc00a679fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 927 [IO wait, 230 minutes]:
runtime.gopark(0x203002?, 0xb?, 0x0?, 0x0?, 0x21?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c5c68 sp=0xc0002c5c48 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0002c5ca0 sp=0xc0002c5c68 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759579028, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0002c5cc0 sp=0xc0002c5ca0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc009149580?, 0xc0093ec000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0002c5ce8 sp=0xc0002c5cc0 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc009149580, {0xc0093ec000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0002c5d68 sp=0xc0002c5ce8 pc=0x4aca5a
net.(*netFD).Read(0xc009149580, {0xc0093ec000?, 0xc005993200?, 0x15bc290?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0002c5db0 sp=0xc0002c5d68 pc=0x68ae29
net.(*conn).Read(0xc00028a518, {0xc0093ec000?, 0x0?, 0x415b67?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0002c5df8 sp=0xc0002c5db0 pc=0x69b0a5
bufio.(*Reader).Read(0xc00244c7e0, {0xc00ba10b58, 0x18, 0x3fdd5edcca185719?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc0002c5e30 sp=0xc0002c5df8 pc=0x52c99b
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc00b8cc730, {0xc00ba10b58?, 0xc00a9ad560?, 0x0?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:143 +0x6d fp=0xc0002c5e78 sp=0xc0002c5e30 pc=0xbedb4d
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc00b8cc730, 0xc00a9ad560)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:159 +0x36 fp=0xc0002c5ed8 sp=0xc0002c5e78 pc=0xbedbf6
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:286 +0x102 fp=0xc0002c5fe0 sp=0xc0002c5ed8 pc=0xbeb262
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c5fe8 sp=0xc0002c5fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:279 +0x16c
goroutine 928 [chan receive, 230 minutes]:
runtime.gopark(0xc001b0dd40?, 0xc0002c6718?, 0x1f?, 0x58?, 0x3?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0002c6698 sp=0xc0002c6678 pc=0x444c16
runtime.chanrecv(0xc005992ea0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc0002c6728 sp=0xc0002c6698 pc=0x40ec3b
runtime.chanrecv1(0xc00ba10ab0?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc0002c6750 sp=0xc0002c6728 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc0002c67e0 sp=0xc0002c6750 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0002c67e8 sp=0xc0002c67e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 946 [select, 230 minutes]:
runtime.gopark(0xc00a7a67b0?, 0x2?, 0xb0?, 0x67?, 0xc00a7a6774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a7a65f8 sp=0xc00a7a65d8 pc=0x444c16
runtime.selectgo(0xc00a7a67b0, 0xc00a7a6770, 0xc00a7a67b0?, 0x0, 0x13?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00a7a6738 sp=0xc00a7a65f8 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:257 +0xa6 fp=0xc00a7a67e0 sp=0xc00a7a6738 pc=0xbeb986
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a7a67e8 sp=0xc00a7a67e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:255 +0xea
goroutine 947 [IO wait, 230 minutes]:
runtime.gopark(0x2?, 0xb?, 0x0?, 0x0?, 0x24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a7a6c68 sp=0xc00a7a6c48 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc00a7a6ca0 sp=0xc00a7a6c68 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759578e48, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc00a7a6cc0 sp=0xc00a7a6ca0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00947c100?, 0xc00947e000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00a7a6ce8 sp=0xc00a7a6cc0 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00947c100, {0xc00947e000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00a7a6d68 sp=0xc00a7a6ce8 pc=0x4aca5a
net.(*netFD).Read(0xc00947c100, {0xc00947e000?, 0xc0002b7f80?, 0x15bc290?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc00a7a6db0 sp=0xc00a7a6d68 pc=0x68ae29
net.(*conn).Read(0xc00028a690, {0xc00947e000?, 0x0?, 0x415b67?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc00a7a6df8 sp=0xc00a7a6db0 pc=0x69b0a5
bufio.(*Reader).Read(0xc00244d7a0, {0xc00ba11938, 0x18, 0x3fdae90ad3e6672e?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc00a7a6e30 sp=0xc00a7a6df8 pc=0x52c99b
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc00b8cceb0, {0xc00ba11938?, 0xc00016e5a0?, 0x0?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:143 +0x6d fp=0xc00a7a6e78 sp=0xc00a7a6e30 pc=0xbedb4d
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc00b8cceb0, 0xc00016e5a0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:159 +0x36 fp=0xc00a7a6ed8 sp=0xc00a7a6e78 pc=0xbedbf6
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:286 +0x102 fp=0xc00a7a6fe0 sp=0xc00a7a6ed8 pc=0xbeb262
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a7a6fe8 sp=0xc00a7a6fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:279 +0x16c
goroutine 948 [chan receive, 230 minutes]:
runtime.gopark(0x50?, 0xc00a7a8718?, 0x1f?, 0x58?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a7a8698 sp=0xc00a7a8678 pc=0x444c16
runtime.chanrecv(0xc0094666c0, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00a7a8728 sp=0xc00a7a8698 pc=0x40ec3b
runtime.chanrecv1(0xc009e702e8?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc00a7a8750 sp=0xc00a7a8728 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc00a7a87e0 sp=0xc00a7a8750 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a7a87e8 sp=0xc00a7a87e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 1059 [select]:
runtime.gopark(0xc00953cf98?, 0x2?, 0x0?, 0x30?, 0xc00953cf94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00953ce20 sp=0xc00953ce00 pc=0x444c16
runtime.selectgo(0xc00953cf98, 0xc00953cf90, 0x2033920?, 0x0, 0xd2667f42971?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00953cf60 sp=0xc00953ce20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc00a8d85a0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc00953cfc8 sp=0xc00953cf60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc00953cfe0 sp=0xc00953cfc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00953cfe8 sp=0xc00953cfe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 978 [IO wait]:
runtime.gopark(0xc00a062110?, 0xb?, 0x0?, 0x0?, 0x1a?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007e1d7b8 sp=0xc007e1d798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x57f631?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc007e1d7f0 sp=0xc007e1d7b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f675951ea08, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc007e1d810 sp=0xc007e1d7f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00826dd00?, 0xc007202000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc007e1d838 sp=0xc007e1d810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00826dd00, {0xc007202000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc007e1d8b8 sp=0xc007e1d838 pc=0x4aca5a
net.(*netFD).Read(0xc00826dd00, {0xc007202000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc007e1d900 sp=0xc007e1d8b8 pc=0x68ae29
net.(*conn).Read(0xc000122960, {0xc007202000?, 0xc0047b7600?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc007e1d948 sp=0xc007e1d900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc0064c6240, {0xc007202000?, 0x415b67?, 0x20?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc007e1d9a8 sp=0xc007e1d948 pc=0x78e52e
bufio.(*Reader).fill(0xc009d3f2c0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc007e1d9e0 sp=0xc007e1d9a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc009d3f2c0, 0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc007e1da30 sp=0xc007e1d9e0 pc=0x52cfaf
net/http/internal.readChunkLine(0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc007e1da80 sp=0xc007e1da30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc00af8c5a0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc007e1dab0 sp=0xc007e1da80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc00af8c5a0, {0xc007204004?, 0x1?, 0xc007e1dbf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc007e1db30 sp=0xc007e1dab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc006cea200, {0xc007204004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc007e1db80 sp=0xc007e1db30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc007204004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc007e1dbf8 sp=0xc007e1db80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc006cea280, {0xc007204004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc007e1dc78 sp=0xc007e1dbf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc008d47e00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc007e1dcc8 sp=0xc007e1dc78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc008d47e00)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc007e1dd18 sp=0xc007e1dcc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc008d47e00, {0x10aa6c0, 0xc007d03290})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc007e1dd48 sp=0xc007e1dd18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00022b680, 0xc0096c5ba0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc007e1dfc0 sp=0xc007e1dd48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc007e1dfe0 sp=0xc007e1dfc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007e1dfe8 sp=0xc007e1dfe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 90056 [select]:
runtime.gopark(0xc008559fb0?, 0x2?, 0x2?, 0x30?, 0xc008559f8c?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc008559e08 sp=0xc008559de8 pc=0x444c16
runtime.selectgo(0xc008559fb0, 0xc008559f88, 0xc00b25bf98?, 0x0, 0x0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008559f48 sp=0xc008559e08 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:161 +0x8a fp=0xc008559fe0 sp=0xc008559f48 pc=0xbd35ca
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008559fe8 sp=0xc008559fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:160 +0x433
goroutine 1202 [select]:
runtime.gopark(0xc007b22798?, 0x2?, 0x0?, 0x30?, 0xc007b22794?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc007b22620 sp=0xc007b22600 pc=0x444c16
runtime.selectgo(0xc007b22798, 0xc007b22790, 0x2033920?, 0x0, 0xd266e1e355c?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc007b22760 sp=0xc007b22620 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc000577680)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc007b227c8 sp=0xc007b22760 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc007b227e0 sp=0xc007b227c8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc007b227e8 sp=0xc007b227e0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 1060 [IO wait]:
runtime.gopark(0xc00a062110?, 0xb?, 0x0?, 0x0?, 0x11?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009b7f7b8 sp=0xc009b7f798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x57f631?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc009b7f7f0 sp=0xc009b7f7b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759578c68, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc009b7f810 sp=0xc009b7f7f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00917b200?, 0xc007309000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc009b7f838 sp=0xc009b7f810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00917b200, {0xc007309000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc009b7f8b8 sp=0xc009b7f838 pc=0x4aca5a
net.(*netFD).Read(0xc00917b200, {0xc007309000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc009b7f900 sp=0xc009b7f8b8 pc=0x68ae29
net.(*conn).Read(0xc004f06ee8, {0xc007309000?, 0xc001aca900?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc009b7f948 sp=0xc009b7f900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc006586480, {0xc007309000?, 0x415b67?, 0x20?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc009b7f9a8 sp=0xc009b7f948 pc=0x78e52e
bufio.(*Reader).fill(0xc009c35d40)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc009b7f9e0 sp=0xc009b7f9a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc009c35d40, 0xb0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc009b7fa30 sp=0xc009b7f9e0 pc=0x52cfaf
net/http/internal.readChunkLine(0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc009b7fa80 sp=0xc009b7fa30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc005dea9f0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc009b7fab0 sp=0xc009b7fa80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc005dea9f0, {0xc007216004?, 0x1?, 0xc009b7fbf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc009b7fb30 sp=0xc009b7fab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc006ceaa80, {0xc007216004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc009b7fb80 sp=0xc009b7fb30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc007216004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc009b7fbf8 sp=0xc009b7fb80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc006ceab00, {0xc007216004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc009b7fc78 sp=0xc009b7fbf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc00734e000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc009b7fcc8 sp=0xc009b7fc78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00734e000)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc009b7fd18 sp=0xc009b7fcc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00734e000, {0x10aa6c0, 0xc007d03c38})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc009b7fd48 sp=0xc009b7fd18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00a8f0c00, 0xc009c0dca0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc009b7ffc0 sp=0xc009b7fd48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc009b7ffe0 sp=0xc009b7ffc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009b7ffe8 sp=0xc009b7ffe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 987 [select, 230 minutes]:
runtime.gopark(0xc00846b7b0?, 0x2?, 0xb0?, 0xb7?, 0xc00846b774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00846b5f8 sp=0xc00846b5d8 pc=0x444c16
runtime.selectgo(0xc00846b7b0, 0xc00846b770, 0xc00846b7b0?, 0x0, 0x12ce498?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc00846b738 sp=0xc00846b5f8 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:257 +0xa6 fp=0xc00846b7e0 sp=0xc00846b738 pc=0xbeb986
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00846b7e8 sp=0xc00846b7e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:255 +0xea
goroutine 988 [IO wait, 230 minutes]:
runtime.gopark(0x203002?, 0xb?, 0x0?, 0x0?, 0x34?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0051a4c68 sp=0xc0051a4c48 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0051a4ca0 sp=0xc0051a4c68 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759578d58, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0051a4cc0 sp=0xc0051a4ca0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc0096fe580?, 0xc0098cd000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0051a4ce8 sp=0xc0051a4cc0 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0096fe580, {0xc0098cd000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0051a4d68 sp=0xc0051a4ce8 pc=0x4aca5a
net.(*netFD).Read(0xc0096fe580, {0xc0098cd000?, 0xc00989b2c0?, 0x15bc290?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0051a4db0 sp=0xc0051a4d68 pc=0x68ae29
net.(*conn).Read(0xc00a9ab080, {0xc0098cd000?, 0x0?, 0x415b67?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0051a4df8 sp=0xc0051a4db0 pc=0x69b0a5
bufio.(*Reader).Read(0xc009fb81e0, {0xc0096b5ec0, 0x18, 0x3fdd0015b419390d?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc0051a4e30 sp=0xc0051a4df8 pc=0x52c99b
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc0096bb900, {0xc0096b5ec0?, 0xc00a89d200?, 0x0?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:143 +0x6d fp=0xc0051a4e78 sp=0xc0051a4e30 pc=0xbedb4d
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc0096bb900, 0xc00a89d200)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:159 +0x36 fp=0xc0051a4ed8 sp=0xc0051a4e78 pc=0xbedbf6
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:286 +0x102 fp=0xc0051a4fe0 sp=0xc0051a4ed8 pc=0xbeb262
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0051a4fe8 sp=0xc0051a4fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:279 +0x16c
goroutine 1032 [chan receive, 230 minutes]:
runtime.gopark(0x0?, 0xc00846c718?, 0x1f?, 0x58?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00846c698 sp=0xc00846c678 pc=0x444c16
runtime.chanrecv(0xc00989b080, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00846c728 sp=0xc00846c698 pc=0x40ec3b
runtime.chanrecv1(0xc00a8a03d8?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc00846c750 sp=0xc00846c728 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc00846c7e0 sp=0xc00846c750 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00846c7e8 sp=0xc00846c7e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 90014 [select]:
runtime.gopark(0xc009b16f90?, 0x2?, 0xd8?, 0x6d?, 0xc009b16f24?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009b16d90 sp=0xc009b16d70 pc=0x444c16
runtime.selectgo(0xc009b16f90, 0xc009b16f20, 0xc00325b800?, 0x0, 0xc0061687b0?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009b16ed0 sp=0xc009b16d90 pc=0x454a9c
net/http.(*persistConn).writeLoop(0xc0064cec60)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2392 +0xf5 fp=0xc009b16fc8 sp=0xc009b16ed0 pc=0x790fd5
net/http.(*Transport).dialConn.func6()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x26 fp=0xc009b16fe0 sp=0xc009b16fc8 pc=0x78dac6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009b16fe8 sp=0xc009b16fe0 pc=0x476581
created by net/http.(*Transport).dialConn
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1752 +0x1791
goroutine 1038 [IO wait]:
runtime.gopark(0xc00a062110?, 0xb?, 0x0?, 0x0?, 0x1e?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009b7d7b8 sp=0xc009b7d798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc009b7d7f0 sp=0xc009b7d7b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f675951e558, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc009b7d810 sp=0xc009b7d7f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc0096fea80?, 0xc007306000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc009b7d838 sp=0xc009b7d810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0096fea80, {0xc007306000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc009b7d8b8 sp=0xc009b7d838 pc=0x4aca5a
net.(*netFD).Read(0xc0096fea80, {0xc007306000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc009b7d900 sp=0xc009b7d8b8 pc=0x68ae29
net.(*conn).Read(0xc004f06e60, {0xc007306000?, 0xc007306000?, 0x1?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc009b7d948 sp=0xc009b7d900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc0064fb320, {0xc007306000?, 0x0?, 0xcfb?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc009b7d9a8 sp=0xc009b7d948 pc=0x78e52e
bufio.(*Reader).fill(0xc009c35260)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc009b7d9e0 sp=0xc009b7d9a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc009c35260, 0x1?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc009b7da30 sp=0xc009b7d9e0 pc=0x52cfaf
net/http/internal.readChunkLine(0xc007306000?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc009b7da80 sp=0xc009b7da30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc005d5c0f0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc009b7dab0 sp=0xc009b7da80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc005d5c0f0, {0xc007205004?, 0x1?, 0xc009b7dbf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc009b7db30 sp=0xc009b7dab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc0047b7900, {0xc007205004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc009b7db80 sp=0xc009b7db30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc007205004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc009b7dbf8 sp=0xc009b7db80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc0047b7a00, {0xc007205004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc009b7dc78 sp=0xc009b7dbf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc00813a780)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc009b7dcc8 sp=0xc009b7dc78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00813a780)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc009b7dd18 sp=0xc009b7dcc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00813a780, {0x10aa6c0, 0xc0093a9278})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc009b7dd48 sp=0xc009b7dd18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00a8f0900, 0xc009c0c860)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc009b7dfc0 sp=0xc009b7dd48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc009b7dfe0 sp=0xc009b7dfc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009b7dfe8 sp=0xc009b7dfe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 1066 [select, 230 minutes]:
runtime.gopark(0xc0084677b0?, 0x2?, 0xb0?, 0x77?, 0xc008467774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0084675f8 sp=0xc0084675d8 pc=0x444c16
runtime.selectgo(0xc0084677b0, 0xc008467770, 0xc0084677b0?, 0x0, 0x12ce498?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc008467738 sp=0xc0084675f8 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:257 +0xa6 fp=0xc0084677e0 sp=0xc008467738 pc=0xbeb986
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0084677e8 sp=0xc0084677e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:255 +0xea
goroutine 909 [select, 230 minutes]:
runtime.gopark(0xc0051a0fb0?, 0x2?, 0xb0?, 0xf?, 0xc0051a0f74?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0051a0df8 sp=0xc0051a0dd8 pc=0x444c16
runtime.selectgo(0xc0051a0fb0, 0xc0051a0f70, 0xc0051a0fb0?, 0x0, 0x12ce498?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc0051a0f38 sp=0xc0051a0df8 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:257 +0xa6 fp=0xc0051a0fe0 sp=0xc0051a0f38 pc=0xbeb986
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0051a0fe8 sp=0xc0051a0fe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:255 +0xea
goroutine 1309 [IO wait]:
runtime.gopark(0xc0091b8110?, 0xb?, 0x0?, 0x0?, 0x28?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0006cb7b8 sp=0xc0006cb798 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x57f631?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc0006cb7f0 sp=0xc0006cb7b8 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759578f38, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc0006cb810 sp=0xc0006cb7f0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc00826dc80?, 0xc006cbf000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc0006cb838 sp=0xc0006cb810 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00826dc80, {0xc006cbf000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc0006cb8b8 sp=0xc0006cb838 pc=0x4aca5a
net.(*netFD).Read(0xc00826dc80, {0xc006cbf000?, 0x40?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc0006cb900 sp=0xc0006cb8b8 pc=0x68ae29
net.(*conn).Read(0xc00c606f70, {0xc006cbf000?, 0xc00625ad80?, 0x0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc0006cb948 sp=0xc0006cb900 pc=0x69b0a5
net/http.(*persistConn).Read(0xc00658fd40, {0xc006cbf000?, 0x415b67?, 0x20?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:1929 +0x4e fp=0xc0006cb9a8 sp=0xc0006cb948 pc=0x78e52e
bufio.(*Reader).fill(0xc002581440)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:106 +0xff fp=0xc0006cb9e0 sp=0xc0006cb9a8 pc=0x52c3bf
bufio.(*Reader).ReadSlice(0xc002581440, 0x20?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:372 +0x2f fp=0xc0006cba30 sp=0xc0006cb9e0 pc=0x52cfaf
net/http/internal.readChunkLine(0x40?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:129 +0x25 fp=0xc0006cba80 sp=0xc0006cba30 pc=0x72bc85
net/http/internal.(*chunkedReader).beginChunk(0xc0061d3e30)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:48 +0x28 fp=0xc0006cbab0 sp=0xc0006cba80 pc=0x72b6e8
net/http/internal.(*chunkedReader).Read(0xc0061d3e30, {0xc007285004?, 0x1?, 0xc0006cbbf0?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/internal/chunked.go:98 +0x156 fp=0xc0006cbb30 sp=0xc0006cbab0 pc=0x72b9b6
net/http.(*body).readLocked(0xc00625ab00, {0xc007285004?, 0x10?, 0x12?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:846 +0x3c fp=0xc0006cbb80 sp=0xc0006cbb30 pc=0x78305c
net/http.(*body).Read(0xbe5f9f?, {0xc007285004?, 0x1?, 0x12c1686?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transfer.go:838 +0x125 fp=0xc0006cbbf8 sp=0xc0006cbb80 pc=0x782f25
net/http.(*bodyEOFSignal).Read(0xc00625ab80, {0xc007285004, 0xdfc, 0xdfc})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/http/transport.go:2774 +0x142 fp=0xc0006cbc78 sp=0xc0006cbbf8 pc=0x792c02
encoding/json.(*Decoder).refill(0xc00a8d4c80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:165 +0x188 fp=0xc0006cbcc8 sp=0xc0006cbc78 pc=0x582168
encoding/json.(*Decoder).readValue(0xc00a8d4c80)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:140 +0xbb fp=0xc0006cbd18 sp=0xc0006cbcc8 pc=0x581d5b
encoding/json.(*Decoder).Decode(0xc00a8d4c80, {0x10aa6c0, 0xc00946fc50})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/encoding/json/stream.go:63 +0x78 fp=0xc0006cbd48 sp=0xc0006cbd18 pc=0x581998
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).httpLooper(0xc00907e900, 0xc0091c4f20)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agenthttpcfg.go:179 +0x66c fp=0xc0006cbfc0 sp=0xc0006cbd48 pc=0xbd2eec
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect.func4()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x2a fp=0xc0006cbfe0 sp=0xc0006cbfc0 pc=0xbcf3ea
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0006cbfe8 sp=0xc0006cbfe0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/agent.go:877 +0x31b
goroutine 1049 [select, 230 minutes]:
runtime.gopark(0xc0000687b0?, 0x2?, 0xb0?, 0x87?, 0xc000068774?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc0000685f8 sp=0xc0000685d8 pc=0x444c16
runtime.selectgo(0xc0000687b0, 0xc000068770, 0xc0000687b0?, 0x0, 0x12ce498?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc000068738 sp=0xc0000685f8 pc=0x454a9c
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:257 +0xa6 fp=0xc0000687e0 sp=0xc000068738 pc=0xbeb986
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:255 +0xea
goroutine 1050 [IO wait, 230 minutes]:
runtime.gopark(0x203002?, 0xb?, 0x0?, 0x0?, 0x39?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a7aa468 sp=0xc00a7aa448 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc00a7aa4a0 sp=0xc00a7aa468 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f6759578998, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc00a7aa4c0 sp=0xc00a7aa4a0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc009974280?, 0xc009c8b000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00a7aa4e8 sp=0xc00a7aa4c0 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc009974280, {0xc009c8b000, 0x1000, 0x1000})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_unix.go:167 +0x25a fp=0xc00a7aa568 sp=0xc00a7aa4e8 pc=0x4aca5a
net.(*netFD).Read(0xc009974280, {0xc009c8b000?, 0xc009c02900?, 0x15bc290?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/fd_posix.go:55 +0x29 fp=0xc00a7aa5b0 sp=0xc00a7aa568 pc=0x68ae29
net.(*conn).Read(0xc00028b748, {0xc009c8b000?, 0x0?, 0x415b67?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/net/net.go:183 +0x45 fp=0xc00a7aa5f8 sp=0xc00a7aa5b0 pc=0x69b0a5
bufio.(*Reader).Read(0xc00202c300, {0xc0099316e0, 0x18, 0x3fdd0015b419390d?})
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/bufio/bufio.go:237 +0x1bb fp=0xc00a7aa630 sp=0xc00a7aa5f8 pc=0x52c99b
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc00996e6e0, {0xc0099316e0?, 0xc00997f950?, 0x0?})
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:143 +0x6d fp=0xc00a7aa678 sp=0xc00a7aa630 pc=0xbedb4d
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc00996e6e0, 0xc00997f950)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdconn.go:159 +0x36 fp=0xc00a7aa6d8 sp=0xc00a7aa678 pc=0xbedbf6
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:286 +0x102 fp=0xc00a7aa7e0 sp=0xc00a7aa6d8 pc=0xbeb262
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a7aa7e8 sp=0xc00a7aa7e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdclient.go:279 +0x16c
goroutine 1087 [select]:
runtime.gopark(0xc009158f98?, 0x2?, 0x2?, 0x30?, 0xc009158f94?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009158e20 sp=0xc009158e00 pc=0x444c16
runtime.selectgo(0xc009158f98, 0xc009158f90, 0x2033920?, 0x0, 0xd2480d86cc5?, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/select.go:328 +0x7bc fp=0xc009158f60 sp=0xc009158e20 pc=0x454a9c
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).loggerRoutine(0xc0001343c0)
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:244 +0xa5 fp=0xc009158fc8 sp=0xc009158f60 pc=0xc030a5
gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x26 fp=0xc009158fe0 sp=0xc009158fc8 pc=0xc02fc6
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009158fe8 sp=0xc009158fe0 pc=0x476581
created by gopkg.in/couchbase/gocb%2ev1.(*ThresholdLoggingTracer).startLoggerRoutine
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocb.v1@v1.6.7/thresholdlogtracer.go:239 +0x4aa
goroutine 911 [chan receive, 230 minutes]:
runtime.gopark(0x0?, 0xc00a549718?, 0x1f?, 0x58?, 0x18?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc00a549698 sp=0xc00a549678 pc=0x444c16
runtime.chanrecv(0xc009ecea80, 0x0, 0x1)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:583 +0x49b fp=0xc00a549728 sp=0xc00a549698 pc=0x40ec3b
runtime.chanrecv1(0xc00a3e69f0?, 0x12?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/chan.go:442 +0x18 fp=0xc00a549750 sp=0xc00a549728 pc=0x40e738
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1()
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:63 +0xef fp=0xc00a5497e0 sp=0xc00a549750 pc=0xbf0f2f
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a5497e8 sp=0xc00a5497e0 pc=0x476581
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/opt/build/go/pkg/mod/gopkg.in/couchbase/gocbcore.v7@v7.1.18/memdpipelineclient.go:60 +0x14c
goroutine 1471 [IO wait, 227 minutes]:
runtime.gopark(0x203001?, 0xb?, 0x0?, 0x0?, 0x29?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/proc.go:363 +0xd6 fp=0xc009b2a468 sp=0xc009b2a448 pc=0x444c16
runtime.netpollblock(0x4897c5?, 0x4ab3e5?, 0x0?)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:526 +0xf7 fp=0xc009b2a4a0 sp=0xc009b2a468 pc=0x43d3f7
internal/poll.runtime_pollWait(0x7f675951e0a8, 0x72)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/runtime/netpoll.go:305 +0x89 fp=0xc009b2a4c0 sp=0xc009b2a4a0 pc=0x470a09
internal/poll.(*pollDesc).wait(0xc009b4b600?, 0xc00adac000?, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc009b2a4e8 sp=0xc009b2a4c0 pc=0x4ab6f2
internal/poll.(*pollDesc).waitRead(...)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.19.2/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc009b4b600, {0xc00adac000, 0x1000,