Grid Stats - New Nodes & Utilization Overview

Hi all, back after little break from our normal weekly report…

New Active Nodes, March 27 – April 3

Total new: 24

  • Belgium: 4
  • Germany: 4
  • Switzerland: 3
  • United States: 2
  • Netherlands: 7
  • United Kingdom: 2
  • Slovakia: 1
  • Vietnam: 1

Total Capacity

Online nodes: 2761 (-17)

Change
Cores 65,469 -1.09%
RAM 422,911 GB -1.44%
SSD 10,001,202 GB -1.1%
HDD 33,971,888 GB -0.26%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 2,437 88%
1 Month 1,946 70%
3 Months 1,207 44%
6 Months 617 22%
9 Months 244 9%
1 Year 134 5%

Utilization

Mainnet Utilization

Cores 1,661 / 64,224 (2.59%)
RAM 2,323 / 414,348 GB (0.56%)
SSD 40,872 / 9,929,408 GB (0.41%)
HDD 1,074 / 33,675,958 GB (0.0%)

Testnet Utilization

Cores 129 / 1,245 (10.36%)
RAM 347 / 8,562 GB (4.05%)
SSD 3,802 / 71,794 GB (5.3%)
HDD 172 / 295,930 GB (0.06%)

Total Utilization

Cores 1,790 / 65,469 (2.73%)
RAM 2,669 / 422,911 GB (0.63%)
SSD 44,674 / 10,001,202 GB (0.45%)
HDD 1,246 / 33,971,888 GB (0.0%)
4 Likes

New Active Nodes, April 3 – April 10

Total new: 23

  • Germany: 6
  • United States: 2
  • Netherlands: 12
  • Vietnam: 2
  • United Kingdom: 1

Total Capacity

Online nodes: 2759 (-2)

Change
Cores 65,256 -0.33%
RAM 421,383 GB -0.36%
SSD 10,007,955 GB 0.07%
HDD 33,968,683 GB -0.01%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 2,418 88%
1 Month 1,886 68%
3 Months 1,173 43%
6 Months 616 22%
9 Months 252 9%
1 Year 142 5%

Utilization

Mainnet Utilization

Cores 1,602 / 63,819 (2.51%)
RAM 2,318 / 411,296 GB (0.56%)
SSD 40,664 / 9,916,491 GB (0.41%)
HDD 1,074 / 33,672,754 GB (0.0%)

Testnet Utilization

Cores 112 / 1,437 (7.79%)
RAM 319 / 10,087 GB (3.17%)
SSD 3,716 / 91,464 GB (4.06%)
HDD 172 / 295,930 GB (0.06%)

Total Utilization

Cores 1,714 / 65,256 (2.63%)
RAM 2,637 / 421,383 GB (0.63%)
SSD 44,380 / 10,007,955 GB (0.44%)
HDD 1,246 / 33,968,683 GB (0.0%)
3 Likes

Hi everyone, this is the first stats report since the farmerbot came to mainnet. That means that sleeping nodes are now included in the node count. Actually, it’s probably the case that there were some sleeping nodes on testnet or QA net last week that didn’t get counted (16 on testnet and 0 on QA net are asleep as of today).

I’ll need to update my scripts to include the capacity in the sleeping nodes in the capacity total, so that’s missing for now. Also the utilization percentages won’t count the capacity in sleeping nodes either. Hope to have that all fixed for next week!

New Active Nodes, April 10 – April 17

Total new: 25

  • Netherlands: 6
  • United States: 3
  • Belgium: 1
  • Slovakia: 3
  • Vietnam: 6
  • Germany: 2
  • United Kingdom: 4

Total Capacity

Online nodes: 2724
Sleeping nodes: 79
Total nodes: 2803 (+44)

Change
Cores 64,654 -0.92%
RAM 420,560 GB -0.2%
SSD 9,912,784 GB -0.96%
HDD 33,635,115 GB -0.99%

Uptimes

Not counting sleeping nodes. Should we include nodes that are asleep but consistently hit their periodic wake up here? Let me know what you think in a reply :slight_smile:

Uptime greater than # of Nodes % of active nodes
1 Week 2,263 83%
1 Month 1,759 65%
3 Months 1,096 40%
6 Months 605 22%
9 Months 247 9%
1 Year 142 5%

Utilization

Some, but not all standby nodes are included in the capacity totals.

Mainnet Utilization

Cores 1,867 / 63,183 (2.95%)
RAM 2,546 / 409,947 GB (0.62%)
SSD 45,817 / 9,817,616 GB (0.47%)
HDD 1,074 / 33,339,185 GB (0.0%)

Testnet Utilization

Cores 107 / 1,471 (7.27%)
RAM 315 / 10,613 GB (2.97%)
SSD 3,647 / 95,168 GB (3.83%)
HDD 172 / 295,930 GB (0.06%)

Total Utilization

Cores 1,974 / 64,654 (3.05%)
RAM 2,861 / 420,560 GB (0.68%)
SSD 49,464 / 9,912,784 GB (0.5%)
HDD 1,246 / 33,635,115 GB (0.0%)
5 Likes

I think we should include nodes that are asleep but consistently hit their periodic wake up because they are part of the grid’s capacity ready and waiting for a workload.

1 Like

Hello again,

Another quick update before getting into the stats. I realized after posting last week’s numbers that my methodology for classifying sleeping versus online nodes wasn’t quite correct. The quick version is that some nodes were counted twice in the total nodes count but I’m not sure how many. On the flip side, the total capacity figures are actually missing some, but not all of the sleeping nodes, because I didn’t try to add them back in.

The problem turned out to be simpler than I thought. Previously, a node was considered “online” for our purposes here if it had registered an update in the last 24 hours. That might seem a little generous, but it gives a wider view of nodes that are active on the network, even if they’ve been down for a bit (95% uptime, also means up to ~1.5 days downtime per month). Nodes that go to sleep should also report an update about one per day to be considered active, so it turns out these criterion are almost the same.

Since it can take some time for a larger farm to finish waking up all its nodes, the updates for sleeping nodes might be spaced out a bit more than 24 hours. For this time, I just expanded the period to 36 hours for all nodes.


Thanks to @fromenator for chiming in. Just to clarify, all sleeping nodes are included in node counts and total capacity figures. I was just wondering about whether they should be included in the uptime figures, or if we should reserve that for nodes that are actually powered on.


New Active Nodes, April 17 – April 24

Total new: 14

  • Netherlands: 1
  • Belgium: 5
  • Bulgaria: 3
  • Canada: 2
  • United States: 2
  • United Kingdom: 1

Total Capacity

Online nodes: 2609
Sleeping nodes: 121
Total nodes: 2730

Change
Cores 65,820 1.8%
RAM 427,622 GB 1.68%
SSD 9,933,341 GB 0.21%
HDD 33,327,683 GB -0.91%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 2,260 83%
1 Month 1,666 61%
3 Months 1,056 39%
6 Months 605 22%
9 Months 319 12%
1 Year 148 5%

Utilization

Mainnet Utilization

Cores 1,928 / 64,509 (2.99%)
RAM 2,587 / 418,196 GB (0.62%)
SSD 46,303 / 9,859,600 GB (0.47%)
HDD 1,074 / 33,031,753 GB (0.0%)

Testnet Utilization

Cores 105 / 1,311 (8.01%)
RAM 309 / 9,426 GB (3.27%)
SSD 3,551 / 73,741 GB (4.82%)
HDD 172 / 295,930 GB (0.06%)

Total Utilization

Cores 2,033 / 65,820 (3.09%)
RAM 2,896 / 427,622 GB (0.68%)
SSD 49,854 / 9,933,341 GB (0.5%)
HDD 1,246 / 33,327,683 GB (0.0%)
2 Likes

New Active Nodes, April 24 – May 1

Total new: 55

  • Belgium: 7
  • Germany: 23
  • Vietnam: 5
  • United Kingdom: 2
  • United States: 16
  • Canada: 1
  • Slovakia: 1

Total Capacity

Online nodes: 2388
Sleeping nodes: 190
Total nodes: 2758

Change
Cores 66,649 1.26%
RAM 434,221 GB 1.54%
SSD 9,932,358 GB -0.01%
HDD 32,512,836 GB -2.44%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 2,266 82%
1 Month 1,653 60%
3 Months 1,016 37%
6 Months 572 21%
9 Months 332 12%
1 Year 141 5%

Utilization

Mainnet Utilization

Cores 1,887 / 65,545 (2.88%)
RAM 2,561 / 426,358 GB (0.6%)
SSD 45,971 / 9,876,478 GB (0.47%)
HDD 1,074 / 32,224,908 GB (0.0%)

Testnet Utilization

Cores 102 / 1,104 (9.24%)
RAM 304 / 7,864 GB (3.87%)
SSD 3,505 / 55,880 GB (6.27%)
HDD 0 / 287,928 GB (0.0%)

Total Utilization

Cores 1,989 / 66,649 (2.98%)
RAM 2,865 / 434,221 GB (0.66%)
SSD 49,475 / 9,932,358 GB (0.5%)
HDD 1,074 / 32,512,836 GB (0.0%)
5 Likes

New Active Nodes, May 1 – May 8

Total new: 10

  • United States: 2
  • Netherlands: 6
  • Switzerland: 1
  • Vietnam: 1

Total Capacity

Online nodes: 2510
Sleeping nodes: 225
Total nodes: 2735

Change
Cores 66,473 -0.26%
RAM 429,955 GB -0.98%
SSD 9,987,472 GB 0.55%
HDD 31,417,362 GB -3.37%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 2,212 81%
1 Month 1,591 58%
3 Months 969 35%
6 Months 557 20%
9 Months 322 12%
1 Year 135 5%

Utilization

Mainnet Utilization

Cores 2,037 / 65,690 (3.1%)
RAM 2,781 / 424,552 GB (0.66%)
SSD 49,921 / 9,969,591 GB (0.5%)
HDD 1,074 / 31,161,440 GB (0.0%)

Testnet Utilization

Cores 101 / 783 (12.9%)
RAM 303 / 5,402 GB (5.61%)
SSD 3,450 / 17,881 GB (19.3%)
HDD 0 / 255,922 GB (0.0%)

Total Utilization

Cores 2,138 / 66,473 (3.22%)
RAM 3,084 / 429,955 GB (0.72%)
SSD 53,372 / 9,987,472 GB (0.53%)
HDD 1,074 / 31,417,362 GB (0.0%)
4 Likes

New Active Nodes, May 8 – May 15

Total new: 27

  • United States: 9
  • Netherlands: 7
  • Canada: 3
  • United Kingdom: 1
  • Spain: 3
  • Australia: 1
  • Ukraine: 1
  • Germany: 2

Total Capacity

Online nodes: 2548
Sleeping nodes: 171
Total nodes: 2719

Change
Cores 65,941 -0.8%
RAM 425,966 GB -0.93%
SSD 9,934,008 GB -0.54%
HDD 31,033,708 GB -1.22%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 2,140 79%
1 Month 1,583 58%
3 Months 960 35%
6 Months 555 20%
9 Months 313 12%
1 Year 144 5%

Utilization

Mainnet Utilization

Cores 2,068 / 65,168 (3.17%)
RAM 2,725 / 420,609 GB (0.65%)
SSD 50,764 / 9,916,913 GB (0.51%)
HDD 1,074 / 30,781,787 GB (0.0%)

Testnet Utilization

Cores 129 / 773 (16.69%)
RAM 312 / 5,358 GB (5.82%)
SSD 3,485 / 17,095 GB (20.38%)
HDD 0 / 251,921 GB (0.0%)

Total Utilization

Cores 2,197 / 65,941 (3.33%)
RAM 3,037 / 425,966 GB (0.71%)
SSD 54,249 / 9,934,008 GB (0.55%)
HDD 1,074 / 31,033,708 GB (0.0%)
3 Likes

New Active Nodes, May 15 – May 22

Total new: 31

  • Egypt: 1
  • Netherlands: 12
  • United States: 4
  • Ukraine: 2
  • Slovakia: 1
  • United Kingdom: 1
  • Poland: 3
  • Sweden: 1
  • Germany: 1
  • Canada: 1
  • Vietnam: 4

Total Capacity

Online nodes: 2431
Sleeping nodes: 284
Total nodes: 2715

Change
Cores 66,690 1.14%
RAM 433,616 GB 1.8%
SSD 9,953,109 GB 0.19%
HDD 30,166,457 GB -2.79%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 1,928 71%
1 Month 1,426 53%
3 Months 816 30%
6 Months 482 18%
9 Months 299 11%
1 Year 134 5%

Utilization

Mainnet Utilization

Cores 2,158 / 65,910 (3.27%)
RAM 2,747 / 428,259 GB (0.64%)
SSD 51,658 / 9,936,462 GB (0.52%)
HDD 1,074 / 29,914,536 GB (0.0%)

Testnet Utilization

Cores 102 / 780 (13.08%)
RAM 304 / 5,357 GB (5.68%)
SSD 3,505 / 16,647 GB (21.05%)
HDD 0 / 251,921 GB (0.0%)

Total Utilization

Cores 2,260 / 66,690 (3.39%)
RAM 3,051 / 433,616 GB (0.7%)
SSD 55,162 / 9,953,109 GB (0.55%)
HDD 1,074 / 30,166,457 GB (0.0%)
2 Likes

New Active Nodes, May 22 – May 29

Total new: 25

  • Germany: 9
  • Belgium: 5
  • Netherlands: 3
  • United States: 1
  • Vietnam: 5
  • Canada: 1
  • Lebanon: 1

Total Capacity

Total active

Online nodes: 2412
Sleeping nodes: 270
Total nodes: 2682

Change
Cores 65,207 -2.22%
RAM 420,765 GB -2.96%
SSD 9,805,103 GB -1.49%
HDD 29,684,913 GB -1.6%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 2,035 76%
1 Month 1,388 52%
3 Months 842 31%
6 Months 468 17%
9 Months 308 11%
1 Year 136 5%

Utilization

Mainnet Utilization

Cores 2,236 / 64,409 (3.47%)
RAM 2,929 / 415,271 GB (0.71%)
SSD 54,107 / 9,783,624 GB (0.55%)
HDD 1,074 / 29,432,992 GB (0.0%)

Testnet Utilization

Cores 98 / 798 (12.28%)
RAM 295 / 5,495 GB (5.37%)
SSD 3,182 / 21,479 GB (14.82%)
HDD 0 / 251,921 GB (0.0%)

Total Utilization

Cores 2,334 / 65,207 (3.58%)
RAM 3,224 / 420,765 GB (0.77%)
SSD 57,289 / 9,805,103 GB (0.58%)
HDD 1,074 / 29,684,913 GB (0.0%)
4 Likes

I hope soon to cross the threshold of one percent RAM utilization.

1 Like

New Active Nodes, May 29 – June 5

Total new: 19

  • Belgium: 3
  • Vietnam: 6
  • Switzerland: 1
  • United States: 4
  • Netherlands: 4
  • Ukraine: 1

Total Capacity

Online nodes: 2340
Sleeping nodes: 307
Total nodes: 2647

Change
Cores 62,544 -6.22%
RAM 406,241 GB -6.31%
SSD 9,641,097 GB -3.13%
HDD 29,767,077 GB -1.32%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 2,012 76%
1 Month 1,366 52%
3 Months 821 31%
6 Months 471 18%
9 Months 318 12%
1 Year 138 5%

Utilization

Mainnet Utilization

Cores 2,258 / 61,768 (3.66%)
RAM 2,958 / 400,892 GB (0.74%)
SSD 54,351 / 9,624,506 GB (0.56%)
HDD 1,074 / 29,515,027 GB (0.0%)

Testnet Utilization

Cores 95 / 776 (12.24%)
RAM 287 / 5,349 GB (5.37%)
SSD 3,143 / 16,592 GB (18.94%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization

Cores 2,353 / 62,544 (3.76%)
RAM 3,246 / 406,241 GB (0.8%)
SSD 57,494 / 9,641,097 GB (0.6%)
HDD 1,074 / 29,767,077 GB (0.0%)
5 Likes

New Active Nodes, June 5 – 12

Total new: 85

  • United States: 4
  • Belgium: 12
  • Ukraine: 60
  • Vietnam: 8
  • Australia: 1

Total Capacity

Online nodes: 2313
Sleeping nodes: 322
Total nodes: 2635

Change
Cores 61,836 -1.13%
RAM 401,187 GB -1.24%
SSD 9,530,051 GB -1.15%
HDD 26,935,349 GB -9.51%

Uptimes

Uptime greater than # of Nodes % of active nodes
1 Week 1,841 70%
1 Month 1,221 46%
3 Months 747 28%
6 Months 479 18%
9 Months 319 12%
1 Year 138 5%

Utilization

Mainnet Utilization

Cores 2,295 / 61,064 (3.76%)
RAM 3,015 / 395,847 GB (0.76%)
SSD 54,017 / 9,513,515 GB (0.57%)
HDD 1,074 / 26,683,299 GB (0.0%)

Testnet Utilization

Cores 93 / 772 (12.05%)
RAM 287 / 5,340 GB (5.37%)
SSD 3,146 / 16,536 GB (19.03%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization

Cores 2,388 / 61,836 (3.86%)
RAM 3,302 / 401,187 GB (0.82%)
SSD 57,164 / 9,530,051 GB (0.6%)
HDD 1,074 / 26,935,349 GB (0.0%)
3 Likes

New Active Nodes, June 12 – 19

Total new: 18

  • Belgium: 1
  • Ukraine: 7
  • United States: 1
  • Netherlands: 3
  • Vietnam: 1
  • Austria: 3
  • Germany: 1
  • Australia: 1

Total Capacity

Online nodes: 2356,
Sleeping nodes: 335
Total nodes: 2691

Change
Cores 64,463 4.25%
RAM 413,743 GB 3.13%
SSD 9,656,959 GB 1.33%
HDD 29,428,663 GB 9.26%
Uptime greater than # of Nodes % of active nodes
1 Week 1,926 72%
1 Month 1,189 44%
3 Months 728 27%
6 Months 453 17%
9 Months 289 11%
1 Year 139 5%

Utilization

Mainnet Utilization

Cores 2,111 / 63,697 (3.31%)
RAM 3,129 / 408,420 GB (0.77%)
SSD 53,041 / 9,640,645 GB (0.55%)
HDD 1,074 / 29,176,613 GB (0.0%)

Testnet Utilization

Cores 87 / 766 (11.36%)
RAM 270 / 5,323 GB (5.07%)
SSD 2,924 / 16,313 GB (17.93%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization

Cores 2,198 / 64,463 (3.41%)
RAM 3,399 / 413,743 GB (0.82%)
SSD 55,965 / 9,656,959 GB (0.58%)
HDD 1,074 / 29,428,663 GB (0.0%)
3 Likes

New Active Nodes, June 19 – 26

Total new: 26

  • Egypt: 1
  • Belgium: 1
  • Australia: 10
  • Germany: 5
  • Vietnam: 2
  • Netherlands: 4
  • United States: 1
  • Switzerland: 2

Total Capacity

Online nodes: 2357
Sleeping nodes: 354
Total nodes: 2711

Change
Cores 64,810 0.54%
RAM 417,885 GB 1.0%
SSD 9,696,110 GB 0.41%
HDD 29,407,880 GB -0.07%

Utilization

Mainnet Utilization

Cores 2,009 / 64,046 (3.14%)
RAM 3,154 / 412,576 GB (0.76%)
SSD 54,994 / 9,679,706 GB (0.57%)
HDD 1,160 / 29,155,831 GB (0.0%)

Testnet Utilization

Cores 115 / 764 (15.05%)
RAM 279 / 5,309 GB (5.25%)
SSD 2,959 / 16,404 GB (18.04%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization

Cores 2,124 / 64,810 (3.28%)
RAM 3,432 / 417,885 GB (0.82%)
SSD 57,953 / 9,696,110 GB (0.6%)
HDD 1,160 / 29,407,880 GB (0.004%)
2 Likes

New Active Nodes, June 26 – July 3

Total new: 5

  • Ukraine: 1
  • United States: 3
  • Vietnam: 1

Total Capacity

Online nodes: 2317
Sleeping nodes: 402
Total nodes: 2719

Change
Cores 66,814 3.09%
RAM 432,972 GB 3.61%
SSD 9,873,033 GB 1.82%
HDD 29,341,377 GB -0.23%

Utilization

Mainnet Utilization

Cores 2,048 / 66,048 (3.1%)
RAM 3,247 / 427,655 GB (0.76%)
SSD 78,040 / 9,856,570 GB (0.79%)
HDD 1,160 / 29,089,327 GB (0.0%)

Testnet Utilization

Cores 96 / 766 (12.53%)
RAM 288 / 5,318 GB (5.42%)
SSD 2,994 / 16,463 GB (18.19%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization

Cores 2,144 / 66,814 (3.21%)
RAM 3,535 / 432,972 GB (0.82%)
SSD 81,034 / 9,873,033 GB (0.82%)
HDD 1,160 / 29,341,377 GB (0.004%)
3 Likes

5 news nodes but 2,000 additional cores over last week?

Yeah, I raised an eyebrow at this initially too. “New” nodes are node IDs that were created during the week that the report is for. So nodes that were created earlier, were taken down, then became active again are not included in this figure.

That said, there are still only 8 more nodes in the active set than the week before. This points to the fact that in any given week, there are a significant number of nodes that become inactive, and therefore the actual churn in nodes is not reflected in these figures.

So the conclusion is that last week, a number of high capacity nodes rejoined the network with existing node IDs. Simultaneously, an approximately equal number of lower capacity nodes became inactive. I estimate the churn was around 80 nodes, so that’s an average difference of 25 cores between nodes in the first group and nodes in the second group to give a total difference of 2000.

I want to return to the question of node churn and try to understand better what’s happening. Are these mostly nodes that join the network for a short time and then disappear? Or are they nodes that stick around but consistently go down for a week or more at a time? And to the extent that it’s the latter, why?

One final note I’ll make here is that I don’t attempt to account for the fact that nodes can rejoin the network with a new node ID after the disks are wiped. My assumption is that it’s a small number, but in a week where 5 new node IDs are registered, even a single case would be 20%.

I’d like to think that’s older hardware being replaced by newer at a healthy pace :slight_smile:

1 Like

New Active Nodes, July 3 – July 10

Total new: 16

  • Egypt: 4
  • Netherlands: 5
  • Poland: 1
  • Canada: 1
  • United States: 1
  • Germany: 1
  • Belgium: 2
  • Vietnam: 1

Total Capacity

Online nodes: 2290
Sleeping nodes: 397
Total nodes: 2687

Change
Cores 66,740 -0.11%
RAM 433,217 GB 0.06%
SSD 9,830,097 GB -0.43%
HDD 28,934,236 GB -1.39%

Utilization

Mainnet Utilization

Cores 2,011 / 65,980 (3.05%)
RAM 3,088 / 427,897 GB (0.72%)
SSD 67,884 / 9,813,943 GB (0.69%)
HDD 1,160 / 28,680,185 GB (0.0%)

Testnet Utilization

Cores 95 / 760 (12.5%)
RAM 287 / 5,320 GB (5.4%)
SSD 2,976 / 16,154 GB (18.42%)
HDD 0 / 254,050 GB (0.0%)

Total Utilization

Cores 2,106 / 66,740 (3.16%)
RAM 3,375 / 433,217 GB (0.78%)
SSD 70,860 / 9,830,097 GB (0.72%)
HDD 1,160 / 28,934,236 GB (0.0%)
1 Like