EGTB generator

Discussion about development of draughts in the time of computer and Internet.
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

Hi,

The results of 4 kings vs 4 kings by the latest version (3.401), available on GitHub:

Code: Select all

generated 4wX-0wO-4bX-0bO.dtm: material=4 0 4 0 positions=37581505500 maximum-index=37581505499 passes=39 maximum-dtm=39 threads=16
self-consistency: passes=1 updates=0/0
final read-only consistency verification: threads=16 cache=8192 MiB total positions-checked=75163011000 positions-skipped=0
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                        202632056820
  Hits                           182197619298
  Misses                          20434437522
  Hit rate                             89.92%
  Decompressions                  17348537797
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                        289514820826
  Hits                           288976583537
  Misses                            538237289
  Hit rate                             99.81%
  Decompressions                    498554521
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                        202632056820
  Hits                           182217224193
  Misses                          20414832627
  Hit rate                             89.93%
  Decompressions                  17325691054
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  4wX-0wO-1bX-0bO.dtm             17907193560               0               0   100.00         40.41 resident
  4wX-0wO-2bX-0bO.dtm             71365116672        42998985        42073008    99.94        909.27 shared
  4wX-0wO-3bX-0bO.dtm            113359746588     20391438537     17306464789    82.01      13336.01 shared
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  4wX-0wO-1bX-0bO.dtm             17907193560               0               0   100.00         40.41 resident
  4wX-0wO-2bX-0bO.dtm             71365116672               0               0   100.00        909.27 shared
  4wX-0wO-3bX-0bO.dtm            113359746588     20414832627     17325691054    81.99      13336.01 shared
optimistic dependency cache activity (whole run):
  Busy reads                           5341866
  Invalidated reads                      32351
  Publication conflicts                5258279
  Pages published                  40844011870
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  4wX-0wO-2bX-0bO.dtm               909.27       909.27         937.69     100.00 dense-lazy
  4wX-0wO-1bX-0bO.dtm                40.41        40.41          40.41     100.00 resident
  4wX-0wO-3bX-0bO.dtm             13336.01      2333.60        2406.53      17.50 cached
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=4096 MiB maximum-database=512 MiB used=40.41 MiB loaded=1 cached=2
optimistic dependency caches: initial-database=64 MiB used=3242.88 MiB databases=2
adaptive shared-cache budget: 4096 MiB allocated=3344.21 MiB growths=6 (metadata included)
shared-cache growth stalls: 6.793300 s total
shared-cache coordinator: shrinks=0 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
WTM: wins=3916965780 losses=55858469 draws=33608681251
WTM DTM statistics:
     DTM            Frequency
     -36                   20
     -34                  188
     -32                  916
     -30                 2384
     -28                 2936
     -26                 4278
     -24                 6042
     -22                 7470
     -20                 9810
     -18                16866
     -16               132301
     -14               598460
     -12              1624982
     -10              1832427
      -8              6566184
      -6              7089677
      -4             18292002
      -2             19671526
      -1          33608681251
       1            577942958
       3            355101700
       5            384795448
       7            305759996
       9            514490445
      11           1075233279
      13            599088625
      15             69563208
      17             11516247
      19              7707348
      21              6309378
      23              4212676
      25              2233408
      27              1422964
      29              1011554
      31               382120
      33               132036
      35                50642
      37                10472
      39                 1276
BTM: wins=3916965780 losses=55858469 draws=33608681251
BTM DTM statistics:
     DTM            Frequency
     -36                   20
     -34                  188
     -32                  916
     -30                 2384
     -28                 2936
     -26                 4278
     -24                 6042
     -22                 7470
     -20                 9810
     -18                16866
     -16               132301
     -14               598460
     -12              1624982
     -10              1832427
      -8              6566184
      -6              7089677
      -4             18292002
      -2             19671526
      -1          33608681251
       1            577942958
       3            355101700
       5            384795448
       7            305759996
       9            514490445
      11           1075233279
      13            599088625
      15             69563208
      17             11516247
      19              7707348
      21              6309378
      23              4212676
      25              2233408
      27              1422964
      29              1011554
      31               382120
      33               132036
      35                50642
      37                10472
      39                 1276
DTM example positions:
  WTM longest win      W:WK23,K28,K48,K49:BK33,K43,K46,K47 {39}
  WTM longest loss     W:WK27,K38,K39,K41:BK15,K16,K20,K50 {-36}
  BTM longest win      B:WK33,K43,K46,K47:BK23,K28,K48,K49 {39}
  BTM longest loss     B:WK15,K16,K20,K50:BK27,K38,K39,K41 {-36}
  draw                 W:WK43,K44,K45,K46:BK47,K48,K49,K50 {-1}
storage: raw=150326022000 payload=9938147555 file=10945232659 bytes overall=7.28% (13.73:1)
wall-clock timings:
  setup                             0.048 s
  initialization                20335.486 s
  backpropagation                1884.287 s
  frontier compilation            112.729 s
  generation subtotal           22334.703 s
  verify + statistics/fallback  21340.013 s
  storage metadata                  0.414 s
  durable publication               0.002 s
  total                         43675.317 s
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

FYI, the audit of the generation of all up to 7 piece EGTBs by version 3.401.
**All 134 databases match Michel Grimminck’s statistics—including every published mate-distance frequency for both WTM and BTM.**

I selected the latest completed run for each material from 476 logs. All selected runs use **revision 3.401**; no databases were missing.

### Correctness

- **268 WTM/BTM comparisons: no differences.**
- Win/draw/loss totals and full DTM histograms match Michel’s “All positions” tables, with moves converted to plies and BTM compared through mirroring.
- Every log reports **`passes=1 updates=0/0`**.
- Logged verification covers **1,172,183,085,800 side-positions**, with **nothing skipped**.

The [full audit report](/tmp2/gwies/endgame7/reports/2026-09-16-all-2-to-7-piece-audit.md) links every selected log and its two reference pages. This was a log audit, not another scan of the DTM files.

### Cache performance

| Seven-piece family | Databases | Summed runtime | Dependency hit rate: generation / verification |
|---|---:|---:|---:|
| 4×3 | 20 | 17h59m | 98.886% / 99.049% |
| 5×2 | 18 | 11h26m | 99.760% / 99.961% |
| 6×1 | 14 | 4h23m | 99.925% / 99.950% |

All 134 jobs together took **35h05m of summed job time**.

**One dependency is the clear hotspot:** `2wX-1wO-1bX-2bO.dtm`. It accounts for **17.06 billion decompressions—70.5% of all dependency decompressions**.

Its worst behaviour occurs in:

| Database being generated | Hot dependency hit rate, generation / verification | Hot dependency decompressions, both phases |
|---|---:|---:|
| `1wX-3wO-2bX-1bO` | 75.77% / 75.74% | 11.21 billion |
| `2wX-2wO-2bX-1bO` | 87.52% / 87.67% | 5.73 billion |

Those nearly unchanged verification miss rates show **persistent cache pressure, not merely warm-up**.

Other findings:

- **Growth stalls are small:** 443 seconds overall, about **0.35%** of runtime.
- Coordinator totals: **182 shrinks, 19 rollbacks, zero recorded transfers**. Idle reclamation works, but these runs do not demonstrate successful paired memory transfers.
- Current-database verification still incurred **5.35 billion decompressions**.
- Frontier compilation is now only **2.15% of total runtime**—that earlier bottleneck is substantially resolved.

### My recommendation

Benchmark those two hotspot jobs with more shared-cache capacity, or with the hot dependency resident. It needs **7,940 MiB uncompressed**, but the current **1,024 MiB per-database residency limit excludes it**.

In the worst job, the shared cache is almost full while the separate 8 GiB residency allowance uses only **2.28 GiB**. That makes **better allocation between the two budgets** a promising next step—without blindly increasing total memory consumption.

**Bottom line: correctness is excellent; the remaining dependency-cache problem is highly concentrated and gives us a concrete benchmark target.**
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

Full verification of the final EGTB did not find any inconsistencies for all 7-piece EGTBs. Full verification takes a very long time for the 4x4 EGTBs, much longer than generation of the EGTBs itself: 4 kings vs 3 kings and 1 man would take 4 days on a 16 core VPS, so you can disable verification now and do a full verification later. I am generating the 4x4 EGTBs on a 64-core NUMA VPS with 512GB RAM, lets see how far we can get in a month:

Code: Select all

generated 4wX-0wO-4bX-0bO.dtm: material=4 0 4 0 positions=37581505500 maximum-index=37581505499 passes=39 maximum-dtm=39 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                        202632056820
  Hits                           202632056820
  Misses                                    0
  Hit rate                            100.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  4wX-0wO-1bX-0bO.dtm             17907193560               0               0   100.00         40.41 resident
  4wX-0wO-2bX-0bO.dtm             71365116672               0               0   100.00        909.27 resident
  4wX-0wO-3bX-0bO.dtm            113359746588               0               0   100.00      13336.01 resident
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  4wX-0wO-1bX-0bO.dtm                40.41        40.41          40.41     100.00 resident
  4wX-0wO-2bX-0bO.dtm               909.27       909.27         909.27     100.00 resident
  4wX-0wO-3bX-0bO.dtm             13336.01     13336.01       13336.01     100.00 resident
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=14285.69 MiB loaded=3 cached=0
optimistic dependency caches: initial-database=256 MiB used=0.00 MiB databases=0
adaptive shared-cache budget: 65536 MiB allocated=0.00 MiB growths=0 (metadata included)
shared-cache growth stalls: 0.000000 s total
shared-cache coordinator: shrinks=0 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=spare-budget-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
WTM: wins=3916965780 losses=55858469 draws=33608681251
WTM DTM statistics:
     DTM            Frequency
     -36                   20
     -34                  188
     -32                  916
     -30                 2384
     -28                 2936
     -26                 4278
     -24                 6042
     -22                 7470
     -20                 9810
     -18                16866
     -16               132301
     -14               598460
     -12              1624982
     -10              1832427
      -8              6566184
      -6              7089677
      -4             18292002
      -2             19671526
      -1          33608681251
       1            577942958
       3            355101700
       5            384795448
       7            305759996
       9            514490445
      11           1075233279
      13            599088625
      15             69563208
      17             11516247
      19              7707348
      21              6309378
      23              4212676
      25              2233408
      27              1422964
      29              1011554
      31               382120
      33               132036
      35                50642
      37                10472
      39                 1276
BTM: wins=3916965780 losses=55858469 draws=33608681251
BTM DTM statistics:
     DTM            Frequency
     -36                   20
     -34                  188
     -32                  916
     -30                 2384
     -28                 2936
     -26                 4278
     -24                 6042
     -22                 7470
     -20                 9810
     -18                16866
     -16               132301
     -14               598460
     -12              1624982
     -10              1832427
      -8              6566184
      -6              7089677
      -4             18292002
      -2             19671526
      -1          33608681251
       1            577942958
       3            355101700
       5            384795448
       7            305759996
       9            514490445
      11           1075233279
      13            599088625
      15             69563208
      17             11516247
      19              7707348
      21              6309378
      23              4212676
      25              2233408
      27              1422964
      29              1011554
      31               382120
      33               132036
      35                50642
      37                10472
      39                 1276
DTM example positions:
  WTM longest win      W:WK23,K28,K48,K49:BK33,K43,K46,K47 {39}
  WTM longest loss     W:WK27,K38,K39,K41:BK15,K16,K20,K50 {-36}
  BTM longest win      B:WK33,K43,K46,K47:BK23,K28,K48,K49 {39}
  BTM longest loss     B:WK15,K16,K20,K50:BK27,K38,K39,K41 {-36}
  draw                 W:WK43,K44,K45,K46:BK47,K48,K49,K50 {-1}
storage: raw=150326022000 payload=9938147555 file=10945232659 bytes overall=7.28% (13.73:1)
wall-clock timings:
  setup                             0.108 s
  initialization                 1982.381 s
  backpropagation                 886.210 s
  frontier compilation             48.031 s
  generation subtotal            2918.798 s
  statistics only (unverified)     29.612 s
  storage metadata                  0.118 s
  durable publication               0.302 s
  total                          2949.302 s
GWDEGTB revision 3.505 completed
The cache policy has greatly improved again in version 3.505.

GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

The next one has finished:

Code: Select all

generated 4wX-0wO-3bX-1bO.dtm: material=4 0 3 1 positions=135293419800 maximum-index=135293419799 passes=67 maximum-dtm=67 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                        691135842996
  Hits                           683086458279
  Misses                           8049384717
  Hit rate                             98.84%
  Decompressions                   7225370601
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  3wX-1wO-1bX-0bO.dtm             24339549669               0               0   100.00        145.48 resident
  3wX-1wO-2bX-0bO.dtm            102660307125               0               0   100.00       3273.38 resident
  3wX-1wO-3bX-0bO.dtm            186253918815      7815370351      7003019309    95.80      48009.62 shared
  4wX-0wO-0bX-1bO.dtm              7600819444               0               0   100.00         36.37 resident
  4wX-0wO-1bX-0bO.dtm             26878715364               0               0   100.00         40.41 resident
  4wX-0wO-1bX-1bO.dtm             61181744565               0               0   100.00       1636.69 resident
  4wX-0wO-2bX-0bO.dtm             71508500809               0               0   100.00        909.27 resident
  4wX-0wO-2bX-1bO.dtm            144438764162        64458863        61325366    99.96      36007.22 shared
  4wX-0wO-3bX-0bO.dtm             57729185312               0               0   100.00      13336.01 resident
  4wX-0wO-4bX-0bO.dtm              8544337731       169555503       161025926    98.02     143362.07 shared
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
optimistic dependency cache activity (whole run):
  Busy reads                          14816241
  Invalidated reads                      28373
  Publication conflicts               28339226
  Pages published                   8021045491
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  4wX-0wO-4bX-0bO.dtm            143362.07      8585.25        8853.54       5.99 cached
  4wX-0wO-2bX-0bO.dtm               909.27       909.27         909.27     100.00 resident
  3wX-1wO-1bX-0bO.dtm               145.48       145.48         145.48     100.00 resident
  4wX-0wO-0bX-1bO.dtm                36.37        36.37          36.37     100.00 resident
  4wX-0wO-3bX-0bO.dtm             13336.01     13336.01       13336.01     100.00 resident
  3wX-1wO-2bX-0bO.dtm              3273.38      3273.38        3273.38     100.00 resident
  4wX-0wO-1bX-0bO.dtm                40.41        40.41          40.41     100.00 resident
  3wX-1wO-3bX-0bO.dtm             48009.62     33215.06       34253.03      69.18 cached
  4wX-0wO-2bX-1bO.dtm             36007.22     15188.75       15663.39      42.18 cached
  4wX-0wO-1bX-1bO.dtm              1636.69      1636.69        1636.69     100.00 resident
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=19377.62 MiB loaded=7 cached=3
optimistic dependency caches: initial-database=256 MiB used=56989.06 MiB databases=3
adaptive shared-cache budget: 65536 MiB allocated=58769.97 MiB growths=15 (metadata included)
shared-cache growth stalls: 52.516214 s total
shared-cache coordinator: shrinks=0 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=spare-budget-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
WTM: wins=30076181317 losses=124038373 draws=105093200110
WTM DTM statistics:
     DTM            Frequency
     -52                    3
     -50                    4
     -48                   48
     -46                  104
     -44                   46
     -42                   59
     -40                  115
     -38                  180
     -36                  137
     -34                  395
     -32                 4410
     -30                18838
     -28                32060
     -26                13688
     -24                17435
     -22                25588
     -20                42547
     -18               125713
     -16               181949
     -14               629730
     -12              1943117
     -10              2959241
      -8              9748732
      -6             13484813
      -4             41328473
      -2             53480948
      -1         105093200110
       1           2334143271
       3           3042623376
       5           3387934792
       7           2585361379
       9           2889756708
      11           4777858460
      13           5102511536
      15           4010170409
      17           1568045092
      19            252180599
      21             55585271
      23             26178712
      25             16016071
      27             10069250
      29              6945643
      31              4333386
      33              2571328
      35              1509941
      37               916867
      39               539680
      41               322932
      43               223203
      45               139458
      47                83268
      49                49643
      51                36824
      53                30075
      55                21228
      57                11104
      59                 6148
      61                 2518
      63                 2133
      65                  895
      67                  117
BTM: wins=10075690738 losses=935635687 draws=124282093375
BTM DTM statistics:
     DTM            Frequency
     -66                    3
     -64                   14
     -62                    9
     -60                   29
     -58                   93
     -56                  204
     -54                  177
     -52                  321
     -50                  318
     -48                  500
     -46                 1179
     -44                 2008
     -42                 2850
     -40                 4335
     -38                 7499
     -36                12580
     -34                22325
     -32                36593
     -30                80003
     -28               107994
     -26               233746
     -24               507424
     -22              1116521
     -20              4168552
     -18             16411403
     -16             29293750
     -14             32226298
     -12             45730669
     -10             97900321
      -8            175630542
      -6            196532007
      -4            179182460
      -2            156422909
      -1         124282093375
       0                   51
       1           1572963595
       3            875996731
       5            808141760
       7            442106344
       9            475833709
      11           1090540393
      13           2153355618
      15           1851996475
      17            663668122
      19            106866001
      21             19174837
      23              4986153
      25              2256293
      27              1762080
      29              1691668
      31              1330733
      33               915996
      35               620813
      37               436975
      39               316361
      41               230376
      43               208989
      45               147162
      47                85830
      49                37486
      51                14158
      53                 4705
      55                 1279
      57                   96
DTM example positions:
  WTM longest win      W:WK8,K35,K39,K41:B29,K14,K20,K46 {67}
  WTM longest loss     W:WK8,K19,K21,K32:B35,K2,K5,K49 {-52}
  BTM longest win      B:WK9,K14,K43,K46:B33,K5,K30,K49 {57}
  BTM longest loss     B:WK5,K25,K26,K35:B29,K20,K34,K37 {-66}
  draw                 W:WK44,K45,K46,K47:B43,K48,K49,K50 {-1}
storage: raw=541173679200 payload=45249361270 file=48904340650 bytes overall=9.04% (11.07:1)
wall-clock timings:
  slice phases: sums for newly generated slices; 0 slices reused
  setup                             0.111 s
  initialization                 8530.029 s
  backpropagation                4707.878 s
  frontier compilation            191.579 s
  slice verification/fallback       0.000 s
  full-index merge                389.009 s
  generation subtotal           13851.353 s
  statistics only (unverified)    110.627 s
  storage metadata                  0.324 s
  durable publication               1.028 s
  total                         13964.569 s
GWDEGTB revision 3.505 completed
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

The next one:

Code: Select all

generated 4wX-0wO-2bX-2bO.dtm: material=4 0 2 2 positions=182231953200 maximum-index=182231953199 passes=83 maximum-dtm=83 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                        869424107749
  Hits                           854493124083
  Misses                          14930983666
  Hit rate                             98.28%
  Decompressions                  14048865604
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  2wX-2wO-1bX-0bO.dtm             22156994807               0               0   100.00        195.96 resident
  2wX-2wO-2bX-0bO.dtm            100255333140               0               0   100.00       4409.05 resident
  2wX-2wO-3bX-0bO.dtm            217033972993     12498178987     11937276935    94.24      64666.02 shared
  3wX-1wO-1bX-0bO.dtm                49311647               0               0   100.00        145.48 resident
  3wX-1wO-2bX-0bO.dtm               409055457               0               0   100.00       3273.38 resident
  3wX-1wO-3bX-0bO.dtm              3268934311      1501735203      1194099913    54.06      48009.62 shared
  4wX-0wO-0bX-1bO.dtm             22802458332               0               0   100.00         36.37 resident
  4wX-0wO-0bX-2bO.dtm             26086020713               0               0   100.00        734.84 resident
  4wX-0wO-1bX-0bO.dtm             26860790340               0               0   100.00         40.41 resident
  4wX-0wO-1bX-1bO.dtm            122363489130               0               0   100.00       1636.69 resident
  4wX-0wO-1bX-2bO.dtm            122042094167        96983013        96862459    99.92      32333.01 shared
  4wX-0wO-2bX-0bO.dtm             35682558336               0               0   100.00        909.27 resident
  4wX-0wO-2bX-1bO.dtm            144438764162       251831680       242570562    99.83      36007.22 shared
  4wX-0wO-3bX-1bO.dtm             25974330214       582254783       578055735    97.76     516103.44 shared
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
optimistic dependency cache activity (whole run):
  Busy reads                           2219329
  Invalidated reads                       9850
  Publication conflicts                3441591
  Pages published                  14927542075
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  3wX-1wO-1bX-0bO.dtm               145.48       145.48         145.48     100.00 resident
  3wX-1wO-2bX-0bO.dtm              3273.38      3273.38        3273.38     100.00 resident
  3wX-1wO-3bX-0bO.dtm             48009.62       864.00         891.00       1.80 cached
  4wX-0wO-3bX-1bO.dtm            516103.44       242.99         250.58       0.05 cached
  2wX-2wO-1bX-0bO.dtm               195.96       195.96         195.96     100.00 resident
  2wX-2wO-3bX-0bO.dtm             64666.02     33215.06       34253.03      51.36 cached
  4wX-0wO-0bX-1bO.dtm                36.37        36.37          36.37     100.00 resident
  2wX-2wO-2bX-0bO.dtm              4409.05      4409.05        4409.05     100.00 resident
  4wX-0wO-1bX-2bO.dtm             32333.01     14762.25       15223.57      45.66 cached
  4wX-0wO-1bX-1bO.dtm              1636.69      1636.69        1636.69     100.00 resident
  4wX-0wO-1bX-0bO.dtm                40.41        40.41          40.41     100.00 resident
  4wX-0wO-0bX-2bO.dtm               734.84       734.84         734.84     100.00 resident
  4wX-0wO-2bX-0bO.dtm               909.27       909.27         909.27     100.00 resident
  4wX-0wO-2bX-1bO.dtm             36007.22      5670.66        5847.86      15.75 cached
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=11381.46 MiB loaded=9 cached=5
optimistic dependency caches: initial-database=256 MiB used=54754.96 MiB databases=5
adaptive shared-cache budget: 65536 MiB allocated=56466.05 MiB growths=27 (metadata included)
shared-cache growth stalls: 118.158789 s total
shared-cache coordinator: shrinks=27 transfers=0 rollbacks=8 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=spare-budget-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
WTM: wins=79922300425 losses=90723002 draws=102218929773
WTM DTM statistics:
     DTM            Frequency
     -44                    1
     -42                    8
     -40                    1
     -38                    8
     -36                   93
     -34                  976
     -32                 5463
     -30                20867
     -28                35753
     -26                18568
     -24                21439
     -22                25684
     -20                16973
     -18                30752
     -16                86789
     -14               329274
     -12               426043
     -10              1316977
      -8              3688295
      -6              7737336
      -4             28620428
      -2             48341274
      -1         102218929773
       1           3533805757
       3           7166565762
       5           9487575693
       7           9670805881
       9           7788983928
      11           8263418065
      13           9408841331
      15           9435231549
      17           7117455987
      19           4640491640
      21           2254245039
      23            728114152
      25            235817050
      27            101070951
      29             44462844
      31             21483535
      33             10739473
      35              5215811
      37              2881256
      39              1811335
      41              1107544
      43               757280
      45               468802
      47               314245
      49               206526
      51               139427
      53               103530
      55                70348
      57                47474
      59                34957
      61                19163
      63                 6369
      65                 3608
      67                 2092
      69                 1038
      71                  496
      73                  146
      75                  215
      77                   90
      79                   26
      81                    9
      83                    1
BTM: wins=8710678358 losses=5779699277 draws=167741575565
BTM DTM statistics:
     DTM            Frequency
     -82                    2
     -80                    7
     -78                   14
     -76                   24
     -74                   94
     -72                   99
     -70                  208
     -68                  394
     -66                  719
     -64                 1296
     -62                 2277
     -60                 4867
     -58                 7459
     -56                11038
     -54                15782
     -52                22851
     -50                32565
     -48                47889
     -46                68880
     -44               105359
     -42               148535
     -40               218953
     -38               319738
     -36               523403
     -34               959490
     -32              2325701
     -30              5706268
     -28             13179678
     -26             26859592
     -24             55429095
     -22            130558779
     -20            227681811
     -18            292431029
     -16            314585022
     -14            306171309
     -12            461798704
     -10            923269210
      -8           1065928241
      -6            888981535
      -4            621566300
      -2            440706565
      -1         167741575565
       0                28495
       1           1430312061
       3            701578468
       5            502393880
       7            182174789
       9            123711245
      11            160548308
      13            399351831
      15            797791889
      17            982484264
      19            901518822
      21            802321527
      23            675229943
      25            494829403
      27            301095976
      29            163615875
      31             68642377
      33             17636447
      35              3896875
      37              1158133
      39               266708
      41                60343
      43                18300
      45                11199
      47                13829
      49                 9651
      51                 3264
      53                 2112
      55                  581
      57                  258
DTM example positions:
  WTM longest win      W:WK7,K12,K23,K33:B6,15,K18,K46 {83}
  WTM longest loss     W:WK8,K14,K18,K28:B1,45,K2,K25 {-44}
  BTM longest win      B:WK27,K36,K42,K46:B33,39,K5,K48 {57}
  BTM longest loss     B:WK5,K7,K12,K33:B6,15,K18,K46 {-82}
  draw                 W:WK45,K46,K47,K48:B43,44,K49,K50 {-1}
storage: raw=728927812800 payload=83805177450 file=88763055358 bytes overall=12.18% (8.21:1)
wall-clock timings:
  slice phases: sums for newly generated slices; 0 slices reused
  setup                             0.109 s
  initialization                12470.560 s
  backpropagation                8875.488 s
  frontier compilation            290.764 s
  slice verification/fallback       0.000 s
  full-index merge                573.400 s
  generation subtotal           22262.649 s
  statistics only (unverified)    156.192 s
  storage metadata                  0.380 s
  durable publication               1.424 s
  total                         22422.410 s
GWDEGTB revision 3.505 completed
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

Here is the next one:

Code: Select all

generated 4wX-0wO-1bX-3bO.dtm: material=4 0 1 3 positions=108832972050 maximum-index=108832972049 passes=85 maximum-dtm=84 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                        483812552016
  Hits                           479365298178
  Misses                           4447253838
  Hit rate                             99.08%
  Decompressions                   4323618980
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  1wX-3wO-1bX-0bO.dtm              6903533103               0               0   100.00        117.03 resident
  1wX-3wO-2bX-0bO.dtm             35051470345               0               0   100.00       2633.18 resident
  1wX-3wO-3bX-0bO.dtm            101636406461      2685314247      2662087758    97.36      38619.99 shared
  2wX-2wO-1bX-0bO.dtm                45141745               0               0   100.00        195.96 resident
  2wX-2wO-2bX-0bO.dtm               388838201               0               0   100.00       4409.05 resident
  2wX-2wO-3bX-0bO.dtm              3402546405       708050259       607851439    79.19      64666.02 shared
  4wX-0wO-0bX-1bO.dtm             22802458332               0               0   100.00         36.37 resident
  4wX-0wO-0bX-2bO.dtm             52172041426               0               0   100.00        734.84 resident
  4wX-0wO-0bX-3bO.dtm             34179191523               0               0   100.00       9655.00 resident
  4wX-0wO-1bX-0bO.dtm              8953596780               0               0   100.00         40.41 resident
  4wX-0wO-1bX-1bO.dtm             61181744565               0               0   100.00       1636.69 resident
  4wX-0wO-1bX-2bO.dtm            122042094167       178853327       178666460    99.85      32333.01 shared
  4wX-0wO-2bX-2bO.dtm             35053488963       875036005       875013323    97.50     695159.73 shared
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
optimistic dependency cache activity (whole run):
  Busy reads                            494828
  Invalidated reads                       3101
  Publication conflicts                 639669
  Pages published                   4446614169
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  2wX-2wO-1bX-0bO.dtm               195.96       195.96         195.96     100.00 resident
  2wX-2wO-2bX-0bO.dtm              4409.05      4409.05        4409.05     100.00 resident
  2wX-2wO-3bX-0bO.dtm             64666.02      6561.00        6766.03      10.15 cached
  1wX-3wO-1bX-0bO.dtm               117.03       117.03         117.03     100.00 resident
  1wX-3wO-3bX-0bO.dtm             38619.99     33215.06       34253.03      86.00 cached
  1wX-3wO-2bX-0bO.dtm              2633.18      2633.18        2633.18     100.00 resident
  4wX-0wO-0bX-3bO.dtm              9655.00      9655.00        9655.00     100.00 resident
  4wX-0wO-0bX-1bO.dtm                36.37        36.37          36.37     100.00 resident
  4wX-0wO-1bX-1bO.dtm              1636.69      1636.69        1636.69     100.00 resident
  4wX-0wO-1bX-2bO.dtm             32333.01     11016.50       11360.76      34.07 cached
  4wX-0wO-2bX-2bO.dtm            695159.73      9841.50       10149.05       1.42 cached
  4wX-0wO-0bX-2bO.dtm               734.84       734.84         734.84     100.00 resident
  4wX-0wO-1bX-0bO.dtm                40.41        40.41          40.41     100.00 resident
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=19458.53 MiB loaded=9 cached=4
optimistic dependency caches: initial-database=256 MiB used=60634.06 MiB databases=4
adaptive shared-cache budget: 65536 MiB allocated=62528.87 MiB growths=16 (metadata included)
shared-cache growth stalls: 47.476255 s total
shared-cache coordinator: shrinks=0 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=spare-budget-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
WTM: wins=80096763016 losses=22428814 draws=28713780220
WTM DTM statistics:
     DTM            Frequency
     -32                    3
     -20                  338
     -18                  345
     -16                 5087
     -14                14896
     -12                23725
     -10               179315
      -8               466656
      -6              1388297
      -4              5734104
      -2             14616048
      -1          28713780220
       1           2376140736
       3           6618683514
       5          10329571214
       7          12807378749
       9          11128124157
      11           8577823522
      13           6507755008
      15           6296334744
      17           5745233892
      19           4589248384
      21           2751440290
      23           1289001693
      25            581727777
      27            260075141
      29            116575155
      31             56459317
      33             29180355
      35             15295401
      37              8060172
      39              4454632
      41              2620780
      43              1888594
      45              1486000
      47               994510
      49               510502
      51               250224
      53               158494
      55               103405
      57                69166
      59                53923
      61                35100
      63                15222
      65                 5629
      67                 3074
      69                 1936
      71                 1233
      73                  549
      75                  231
      77                  352
      79                  188
      81                   48
      83                    3
BTM: wins=2518041015 losses=21297407614 draws=85017523421
BTM DTM statistics:
     DTM            Frequency
     -84                    3
     -82                   43
     -80                  164
     -78                  407
     -76                  360
     -74                  607
     -72                 1093
     -70                 1796
     -68                 2315
     -66                 4055
     -64                 9155
     -62                19712
     -60                33081
     -58                43655
     -56                65331
     -54               100585
     -52               164393
     -50               335571
     -48               718082
     -46              1399981
     -44              2066637
     -42              2866238
     -40              4315212
     -38              7433715
     -36             13179180
     -34             24884467
     -32             50529014
     -30            109501909
     -28            270323410
     -26            646304563
     -24           1278707869
     -22           2016493061
     -20           2375341922
     -18           2064025897
     -16           1690996805
     -14           1516807125
     -12           1800868602
     -10           2301611998
      -8           2179520115
      -6           1496056823
      -4            914758266
      -2            527891000
      -1          85017523421
       0                23397
       1            440671608
       3            182707583
       5             88024293
       7             23779912
       9             10443520
      11              6297474
      13             10939639
      15             33129149
      17             70473635
      19            106893416
      21            134719057
      23            153446516
      25            162357199
      27            161156050
      29            151595673
      31            139478994
      33            123852057
      35            109184504
      37             95880726
      39             82098212
      41             69122993
      43             54744002
      45             40881388
      47             27409169
      49             16774604
      51              9348207
      53              5116653
      55              3041645
      57              1825081
      59              1121533
      61               646372
      63               415058
      65               264619
      67               136318
      69                51156
      71                 9992
      73                 2896
      75                  112
DTM example positions:
  WTM longest win      W:WK7,K18,K40,K44:B6,15,37,K38 {83}
  WTM longest loss     W:WK22,K29,K33,K44:B1,17,34,K11 {-32}
  BTM longest win      B:WK12,K23,K34,K49:B8,9,40,K37 {75}
  BTM longest loss     B:WK1,K13,K44,K45:B6,15,32,K47 {-84}
  draw                 W:WK46,K47,K48,K50:B43,44,45,K49 {-1}
storage: raw=435331888200 payload=72090542454 file=75065349734 bytes overall=17.24% (5.80:1)
wall-clock timings:
  slice phases: sums for newly generated slices; 0 slices reused
  setup                             0.113 s
  initialization                 6124.681 s
  backpropagation                7704.548 s
  frontier compilation            218.219 s
  slice verification/fallback       0.000 s
  full-index merge                373.769 s
  generation subtotal           14471.782 s
  statistics only (unverified)     99.736 s
  storage metadata                  0.214 s
  durable publication               0.835 s
  total                         14573.603 s
GWDEGTB revision 3.505 completed
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

The next one:

Code: Select all

generated 4wX-0wO-0bX-4bO.dtm: material=4 0 0 4 positions=24313749075 maximum-index=24313749074 passes=85 maximum-dtm=85 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                        102192916744
  Hits                           101809637470
  Misses                            383279274
  Hit rate                             99.62%
  Decompressions                    382065556
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  0wX-4wO-1bX-0bO.dtm               135968424               0               0   100.00         26.15 resident
  0wX-4wO-2bX-0bO.dtm              1775821120               0               0   100.00        588.26 resident
  0wX-4wO-3bX-0bO.dtm             14198025518               0               0   100.00       8627.87 resident
  1wX-3wO-1bX-0bO.dtm                13750358               0               0   100.00        117.03 resident
  1wX-3wO-2bX-0bO.dtm               123139368               0               0   100.00       2633.18 resident
  1wX-3wO-3bX-0bO.dtm              1182395182         8561417         7347699    99.28      38619.99 shared
  4wX-0wO-0bX-1bO.dtm              7600819444               0               0   100.00         36.37 resident
  4wX-0wO-0bX-2bO.dtm             26086020713               0               0   100.00        734.84 resident
  4wX-0wO-0bX-3bO.dtm             34179191523               0               0   100.00       9655.00 resident
  4wX-0wO-1bX-3bO.dtm             16897785094       374717857       374717857    97.78     415164.84 shared
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
optimistic dependency cache activity (whole run):
  Busy reads                             11622
  Invalidated reads                        125
  Publication conflicts                   6611
  Pages published                    383272663
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  1wX-3wO-1bX-0bO.dtm               117.03       117.03         117.03     100.00 resident
  1wX-3wO-2bX-0bO.dtm              2633.18      2633.18        2633.18     100.00 resident
  1wX-3wO-3bX-0bO.dtm             38619.99      9841.50       10149.05      25.48 cached
  0wX-4wO-1bX-0bO.dtm                26.15        26.15          26.15     100.00 resident
  0wX-4wO-3bX-0bO.dtm              8627.87      8627.87        8627.87     100.00 resident
  4wX-0wO-1bX-3bO.dtm            415164.84     33215.06       34253.03       8.00 cached
  0wX-4wO-2bX-0bO.dtm               588.26       588.26         588.26     100.00 resident
  4wX-0wO-0bX-3bO.dtm              9655.00      9655.00        9655.00     100.00 resident
  4wX-0wO-0bX-1bO.dtm                36.37        36.37          36.37     100.00 resident
  4wX-0wO-0bX-2bO.dtm               734.84       734.84         734.84     100.00 resident
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=22418.70 MiB loaded=8 cached=2
optimistic dependency caches: initial-database=256 MiB used=43056.56 MiB databases=2
adaptive shared-cache budget: 65536 MiB allocated=44402.08 MiB growths=7 (metadata included)
shared-cache growth stalls: 28.470771 s total
shared-cache coordinator: shrinks=0 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=spare-budget-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
WTM: wins=23500190638 losses=267332 draws=813291105
WTM DTM statistics:
     DTM            Frequency
     -16                   37
     -14                   13
     -12                  277
     -10                  945
      -8                 6157
      -6                29719
      -4               145464
      -2                84720
      -1            813291105
       1            598577841
       3           2137509105
       5           3829742884
       7           5335393227
       9           5092674654
      11           3384858811
      13           1333371251
      15            724665074
      17            506517107
      19            318337544
      21            144309184
      23             53489486
      25             21092437
      27              9610787
      29              4484415
      31              2358038
      33              1309648
      35               780055
      37               417704
      39               243542
      41               139905
      43               103167
      45                74351
      47                54057
      49                38325
      51                16341
      53                 8060
      55                 4296
      57                 4460
      59                 3138
      61                  827
      63                  345
      65                  292
      67                   58
      69                   29
      71                   54
      73                   94
      75                   41
      77                    2
      79                    2
BTM: wins=50164530 losses=17566064496 draws=6697520049
BTM DTM statistics:
     DTM            Frequency
     -84                    2
     -82                   11
     -80                   50
     -78                   86
     -76                   86
     -74                  269
     -72                  264
     -70                  226
     -68                  296
     -66                  719
     -64                 1473
     -62                 2873
     -60                 7187
     -58                 9750
     -56                12149
     -54                20432
     -52                46580
     -50               105037
     -48               195208
     -46               337654
     -44               528273
     -42               816790
     -40              1331419
     -38              2147940
     -36              3726409
     -34              6849395
     -32             12977043
     -30             26067460
     -28             55257486
     -26            115322687
     -24            233113784
     -22            441322024
     -20            705346831
     -18            908289795
     -16           1236208290
     -14           2243999488
     -12           4026746737
     -10           3617227362
      -8           2200246951
      -6           1005263162
      -4            493718795
      -2            228815051
      -1           6697520049
       0                  972
       1              5590940
       3              5868955
       5              2395722
       7               515093
       9               184310
      11                69013
      13                32515
      15                92824
      17               276286
      19               561191
      21               918814
      23              1295829
      25              1695987
      27              2037044
      29              2282919
      31              2497184
      33              2647164
      35              2703085
      37              2712864
      39              2620473
      41              2508547
      43              2289330
      45              2008810
      47              1677362
      49              1323979
      51               992167
      53               724328
      55               505742
      57               346490
      59               244299
      61               171136
      63               121428
      65                81968
      67                58050
      69                42434
      71                26553
      73                17581
      75                11073
      77                 6221
      79                 4658
      81                 2636
      83                 1267
      85                  259
DTM example positions:
  WTM longest win      W:WK9,K20,K38,K42:B3,14,25,44 {79}
  WTM longest loss     W:WK40,K41,K42,K43:B2,12,36,45 {-16}
  BTM longest win      B:WK9,K11,K20,K21:B4,5,16,25 {85}
  BTM longest loss     B:WK1,K13,K44,K45:B6,15,37,42 {-84}
  draw                 W:WK44,K46,K47,K48:B41,42,43,45 {-1}
storage: raw=97254996300 payload=19405218140 file=20070047288 bytes overall=20.64% (4.85:1)
wall-clock timings:
  slice phases: sums for newly generated slices; 0 slices reused
  setup                             0.110 s
  initialization                 1173.634 s
  backpropagation                2038.767 s
  frontier compilation             60.048 s
  slice verification/fallback       0.000 s
  full-index merge                 85.077 s
  generation subtotal            3375.643 s
  statistics only (unverified)     21.816 s
  storage metadata                  0.053 s
  durable publication               0.196 s
  total                          3398.029 s
GWDEGTB revision 3.505 completed
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

The next one:

Code: Select all

generated 3wX-1wO-3bX-1bO.dtm: material=3 1 3 1 positions=487179026400 maximum-index=487179026399 passes=77 maximum-dtm=76 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                        702211162577
  Hits                           691368929957
  Misses                          10842232620
  Hit rate                             98.46%
  Decompressions                   9877598028
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  3wX-1wO-0bX-1bO.dtm             14770592602               0               0   100.00        130.97 resident
  3wX-1wO-1bX-0bO.dtm             39323064242               0               0   100.00        145.48 resident
  3wX-1wO-1bX-1bO.dtm            121076176452               0               0   100.00       5893.57 resident
  3wX-1wO-2bX-0bO.dtm            104379066832               0               0   100.00       3273.38 resident
  3wX-1wO-2bX-1bO.dtm            325239658605      5287620417      4999971966    98.37     129658.64 shared
  3wX-1wO-3bX-0bO.dtm             89084077375      1241535465      1089295143    98.61      48009.62 shared
  4wX-0wO-0bX-1bO.dtm                 4036899               0               0   100.00         36.37 resident
  4wX-0wO-1bX-0bO.dtm                21557014               0               0   100.00         40.41 resident
  4wX-0wO-1bX-1bO.dtm                74818660               0               0   100.00       1636.69 resident
  4wX-0wO-2bX-0bO.dtm               143384137               0               0   100.00        909.27 resident
  4wX-0wO-2bX-1bO.dtm               563755954       314656283       304883157    44.19      36007.22 shared
  4wX-0wO-3bX-0bO.dtm              1049312018               0               0   100.00      13336.01 resident
  4wX-0wO-3bX-1bO.dtm              6481661787      3998420455      3483447762    38.31     516103.44 shared
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
optimistic dependency cache activity (whole run):
  Busy reads                          67113216
  Invalidated reads                     139451
  Publication conflicts               56938199
  Pages published                   9701970478
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  4wX-0wO-2bX-0bO.dtm               909.27       909.27         909.27     100.00 resident
  4wX-0wO-2bX-1bO.dtm             36007.22         1.00           1.03       0.00 cached
  4wX-0wO-1bX-0bO.dtm                40.41        40.41          40.41     100.00 resident
  4wX-0wO-3bX-0bO.dtm             13336.01     13336.01       13336.01     100.00 resident
  4wX-0wO-3bX-1bO.dtm            516103.44         1.00           1.03       0.00 cached
  4wX-0wO-0bX-1bO.dtm                36.37        36.37          36.37     100.00 resident
  4wX-0wO-1bX-1bO.dtm              1636.69      1636.69        1636.69     100.00 resident
  3wX-1wO-1bX-1bO.dtm              5893.57      5893.57        5893.57     100.00 resident
  3wX-1wO-0bX-1bO.dtm               130.97       130.97         130.97     100.00 resident
  3wX-1wO-2bX-0bO.dtm              3273.38      3273.38        3273.38     100.00 resident
  3wX-1wO-3bX-0bO.dtm             48009.62         1.00           1.03       0.00 cached
  3wX-1wO-2bX-1bO.dtm            129658.64     63547.05       65532.90      49.01 cached
  3wX-1wO-1bX-0bO.dtm               145.48       145.48         145.48     100.00 resident
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=25402.16 MiB loaded=9 cached=4
optimistic dependency caches: initial-database=256 MiB used=63550.05 MiB databases=4
adaptive shared-cache budget: 65536 MiB allocated=65535.99 MiB growths=22 (metadata included)
shared-cache growth stalls: 271.025539 s total
shared-cache coordinator: shrinks=8 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=idle-reclaim-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
WTM: wins=80587901533 losses=2160695259 draws=404430429608
WTM DTM statistics:
     DTM            Frequency
     -76                    1
     -72                    3
     -70                    2
     -66                    5
     -64                    6
     -62                    6
     -60                    6
     -58                   13
     -56                   46
     -54                  187
     -52                  458
     -50                  476
     -48                 1433
     -46                 2445
     -44                 2509
     -42                 3681
     -40                 7434
     -38                14506
     -36                36184
     -34                78802
     -32               161066
     -30               407013
     -28               695551
     -26              1988952
     -24              7015495
     -22             14665786
     -20             18900276
     -18             18148169
     -16             15726305
     -14             29403859
     -12             80816138
     -10            223682597
      -8            438809359
      -6            464781365
      -4            416978811
      -2            428366115
      -1         404430429608
       0                  199
       1           6355351516
       3           7315590781
       5           8509412138
       7           5915183342
       9           4533087085
      11           5387598446
      13           8589950921
      15          10027219079
      17           9308945196
      19           7730057657
      21           4498269616
      23           1591142028
      25            437126892
      27            180944373
      29            107623977
      31             57057914
      33             24583379
      35              8021750
      37              3232329
      39              2146563
      41              1629621
      43              1336919
      45              1044214
      47               593879
      49               304021
      51               195085
      53               127201
      55                46613
      57                19840
      59                12682
      61                10266
      63                 7619
      65                12280
      67                 7482
      69                 4224
      71                 3019
      73                 1016
      75                  570
BTM: wins=80587901533 losses=2160695259 draws=404430429608
BTM DTM statistics:
     DTM            Frequency
     -76                    1
     -72                    3
     -70                    2
     -66                    5
     -64                    6
     -62                    6
     -60                    6
     -58                   13
     -56                   46
     -54                  187
     -52                  458
     -50                  476
     -48                 1433
     -46                 2445
     -44                 2509
     -42                 3681
     -40                 7434
     -38                14506
     -36                36184
     -34                78802
     -32               161066
     -30               407013
     -28               695551
     -26              1988952
     -24              7015495
     -22             14665786
     -20             18900276
     -18             18148169
     -16             15726305
     -14             29403859
     -12             80816138
     -10            223682597
      -8            438809359
      -6            464781365
      -4            416978811
      -2            428366115
      -1         404430429608
       0                  199
       1           6355351516
       3           7315590781
       5           8509412138
       7           5915183342
       9           4533087085
      11           5387598446
      13           8589950921
      15          10027219079
      17           9308945196
      19           7730057657
      21           4498269616
      23           1591142028
      25            437126892
      27            180944373
      29            107623977
      31             57057914
      33             24583379
      35              8021750
      37              3232329
      39              2146563
      41              1629621
      43              1336919
      45              1044214
      47               593879
      49               304021
      51               195085
      53               127201
      55                46613
      57                19840
      59                12682
      61                10266
      63                 7619
      65                12280
      67                 7482
      69                 4224
      71                 3019
      73                 1016
      75                  570
DTM example positions:
  WTM longest win      W:W33,K26,K36,K49:B40,K31,K37,K43 {75}
  WTM longest loss     W:W16,K17,K19,K20:B18,K6,K15,K25 {-76}
  BTM longest win      B:W17,K19,K44,K47:B18,K15,K25,K50 {75}
  BTM longest loss     B:W33,K26,K36,K45:B35,K31,K32,K34 {-76}
  draw                 W:W43,K45,K46,K47:B44,K48,K49,K50 {-1}
storage: raw=1948716105600 payload=181239565803 file=194436890687 bytes overall=9.98% (10.02:1)
wall-clock timings:
  slice phases: sums for newly generated slices; 56 slices reused
  setup                             0.113 s
  initialization                 9634.478 s
  backpropagation                8266.208 s
  frontier compilation            215.514 s
  slice verification/fallback       0.001 s
  full-index merge               1638.854 s
  generation subtotal           20070.517 s
  statistics only (unverified)    402.949 s
  storage metadata                  1.072 s
  durable publication               3.685 s
  total                         20482.605 s
GWDEGTB revision 3.603 completed
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

The next one:

Code: Select all

generated 3wX-1wO-2bX-2bO.dtm: material=3 1 2 2 positions=656372498100 maximum-index=656372498099 passes=97 maximum-dtm=97 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                       2121993626532
  Hits                          2090900613816
  Misses                          31093012716
  Hit rate                             98.53%
  Decompressions                  29418583052
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  2wX-2wO-0bX-1bO.dtm             14036766683               0               0   100.00        176.45 resident
  2wX-2wO-1bX-0bO.dtm             47739011815               0               0   100.00        195.96 resident
  2wX-2wO-1bX-1bO.dtm            128504422165               0               0   100.00       7940.37 resident
  2wX-2wO-2bX-0bO.dtm            146647034305               0               0   100.00       4409.05 resident
  2wX-2wO-2bX-1bO.dtm            418326718388     12639290929     11932096617    96.98     174688.07 shared
  2wX-2wO-3bX-0bO.dtm            158164896393      9719269823      9220561545    93.85      64666.02 shared
  3wX-1wO-0bX-1bO.dtm             45388995811               0               0   100.00        130.97 resident
  3wX-1wO-0bX-2bO.dtm             55758750876               0               0   100.00       2646.79 resident
  3wX-1wO-1bX-0bO.dtm             53150351157               0               0   100.00        145.48 resident
  3wX-1wO-1bX-1bO.dtm            259807869178               0               0   100.00       5893.57 resident
  3wX-1wO-1bX-2bO.dtm            302371584659      1828073701      1823622233    99.40     116458.72 shared
  3wX-1wO-2bX-0bO.dtm             75900527593               0               0   100.00       3273.38 resident
  3wX-1wO-2bX-1bO.dtm            359839434919      3751568436      3474549706    98.96     129658.64 shared
  3wX-1wO-3bX-0bO.dtm              3268934311       833857087       673849928    74.49      48009.62 shared
  3wX-1wO-3bX-1bO.dtm             52268836836      2320952740      2293903023    95.56    1858440.50 shared
  4wX-0wO-0bX-1bO.dtm                29754678               0               0   100.00         36.37 resident
  4wX-0wO-0bX-2bO.dtm               109717452               0               0   100.00        734.84 resident
  4wX-0wO-1bX-0bO.dtm                33887478               0               0   100.00         40.41 resident
  4wX-0wO-1bX-1bO.dtm               502747698               0               0   100.00       1636.69 resident
  4wX-0wO-2bX-0bO.dtm               143384137               0               0   100.00        909.27 resident
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
optimistic dependency cache activity (whole run):
  Busy reads                          23112893
  Invalidated reads                      96936
  Publication conflicts               23540414
  Pages published                  31013935150
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  3wX-1wO-3bX-0bO.dtm             48009.62         1.00           1.03       0.00 cached
  4wX-0wO-1bX-0bO.dtm                40.41        40.41          40.41     100.00 resident
  4wX-0wO-0bX-1bO.dtm                36.37        36.37          36.37     100.00 resident
  4wX-0wO-2bX-0bO.dtm               909.27       909.27         909.27     100.00 resident
  4wX-0wO-0bX-2bO.dtm               734.84       734.84         734.84     100.00 resident
  4wX-0wO-1bX-1bO.dtm              1636.69      1636.69        1636.69     100.00 resident
  3wX-1wO-3bX-1bO.dtm           1858440.50         1.00           1.03       0.00 cached
  2wX-2wO-0bX-1bO.dtm               176.45       176.45         176.45     100.00 resident
  2wX-2wO-1bX-1bO.dtm              7940.37      7940.37        7940.37     100.00 resident
  2wX-2wO-2bX-1bO.dtm            174688.07     52021.21       53646.87      29.78 cached
  3wX-1wO-0bX-2bO.dtm              2646.79      2646.79        2646.79     100.00 resident
  2wX-2wO-2bX-0bO.dtm              4409.05      4409.05        4409.05     100.00 resident
  2wX-2wO-1bX-0bO.dtm               195.96       195.96         195.96     100.00 resident
  2wX-2wO-3bX-0bO.dtm             64666.02         1.00           1.03       0.00 cached
  3wX-1wO-0bX-1bO.dtm               130.97       130.97         130.97     100.00 resident
  3wX-1wO-2bX-0bO.dtm              3273.38      3273.38        3273.38     100.00 resident
  3wX-1wO-1bX-2bO.dtm            116458.72      1787.34        1843.20       1.53 cached
  3wX-1wO-2bX-1bO.dtm            129658.64      9738.50       10042.83       7.51 cached
  3wX-1wO-1bX-0bO.dtm               145.48       145.48         145.48     100.00 resident
  3wX-1wO-1bX-1bO.dtm              5893.57      5893.57        5893.57     100.00 resident
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=28169.61 MiB loaded=14 cached=6
optimistic dependency caches: initial-database=256 MiB used=63550.05 MiB databases=6
adaptive shared-cache budget: 65536 MiB allocated=65535.99 MiB growths=142 (metadata included)
shared-cache growth stalls: 2365.034406 s total
shared-cache coordinator: shrinks=21 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=idle-reclaim-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
shared-cache admission headroom: 3276.80 MiB (5%; reclaimable loan after pressure qualification; one borrower; repayment cooldown=60s); returning-cache pressure-windows=1
shared-cache outstanding loan: database=3wX-1wO-2bX-1bO.dtm protected-MiB=6561.00 borrowed-payload-MiB=3177.50
WTM: wins=229477165420 losses=1676797129 draws=425218535551
WTM DTM statistics:
     DTM            Frequency
     -90                    3
     -88                    6
     -86                    8
     -84                    8
     -82                    6
     -80                    5
     -78                   20
     -76                    1
     -74                    9
     -72                   46
     -70                  207
     -68                  550
     -66                 1858
     -64                 2536
     -62                 3144
     -60                 4334
     -58                 8851
     -56                15174
     -54                18627
     -52                23526
     -50                32758
     -48                45507
     -46               105395
     -44               233449
     -42               399059
     -40               642942
     -38               885671
     -36              1098509
     -34              1408982
     -32              1607799
     -30              1667834
     -28              1661661
     -26              1599111
     -24              1641682
     -22              1631247
     -20              1678201
     -18              2932990
     -16              5499652
     -14             14893317
     -12             46587356
     -10            162500144
      -8            377754972
      -6            353341842
      -4            306632438
      -2            390235401
      -1         425218535551
       0                  291
       1           9625445768
       3          17156091333
       5          23895706931
       7          25103297671
       9          20709143758
      11          14297315569
      13          14409467231
      15          16635205420
      17          18768256382
      19          19298458550
      21          16187980807
      23          12059535244
      25           9006488386
      27           5948800589
      29           3139300004
      31           1426942598
      33            662527498
      35            363158550
      37            242186442
      39            178227022
      41            132723571
      43             93049460
      45             59123650
      47             32314710
      49             18030269
      51             12136422
      53              7645060
      55              4015565
      57              2379586
      59              1427384
      61               552240
      63               125847
      65                46034
      67                26729
      69                15521
      71                 9845
      73                 4476
      75                 2114
      77                  699
      79                  379
      81                   79
      83                   27
BTM: wins=71731447962 losses=13627196767 draws=571013853371
BTM DTM statistics:
     DTM            Frequency
     -82                    2
     -80                    2
     -78                   18
     -76                   54
     -74                   89
     -72                  293
     -70                  495
     -68                 1001
     -66                 2399
     -64                 3631
     -62                11225
     -60                28354
     -58                49726
     -56                86891
     -54               176451
     -52               265320
     -50               358350
     -48               663014
     -46              1178754
     -44              1731433
     -42              2326632
     -40              3097653
     -38              4365969
     -36              7116601
     -34             13963833
     -32             33720838
     -30             79874879
     -28            154060295
     -26            234119941
     -24            298956735
     -22            357748554
     -20            362319743
     -18            324547502
     -16            314235286
     -14            465975669
     -12           1164169877
     -10           2405426515
      -8           2592469980
      -6           2125446019
      -4           1464311472
      -2           1214280657
      -1         571013853371
       0               104615
       1           5781979352
       3           5713099155
       5           6754029618
       7           4906638936
       9           2942674944
      11           1812868790
      13           1738648188
      15           2917727874
      17           3990607517
      19           4680560241
      21           5182147134
      23           5006515915
      25           4311905631
      27           3544451485
      29           2963842279
      31           2496125976
      33           2088094071
      35           1699093895
      37           1281932843
      39            860472364
      41            507835462
      43            257384325
      45            118130656
      47             61773532
      49             38130194
      51             25376035
      53             17121229
      55             11326300
      57              6786318
      59              4645215
      61              3753792
      63              2800693
      65              1418915
      67               510789
      69               249160
      71               156988
      73               102090
      75               119697
      77               101647
      79                74752
      81                72256
      83                59628
      85                55972
      87                28233
      89                11863
      91                 4125
      93                 1220
      95                  476
      97                  192
DTM example positions:
  WTM longest win      W:W28,K13,K47,K49:B35,36,K16,K42 {83}
  WTM longest loss     W:W29,K30,K33,K44:B2,14,K25,K50 {-90}
  BTM longest win      B:W29,K7,K44,K47:B8,9,K26,K50 {97}
  BTM longest loss     B:W7,K5,K12,K33:B6,15,K18,K46 {-82}
  draw                 W:W43,K46,K47,K49:B44,45,K48,K50 {-1}
storage: raw=2625489992400 payload=312127299308 file=329989993124 bytes overall=12.57% (7.96:1)
wall-clock timings:
  slice phases: sums for newly generated slices; 20 slices reused
  setup                             0.112 s
  initialization                29787.961 s
  backpropagation               27587.929 s
  frontier compilation            835.663 s
  slice verification/fallback       0.002 s
  full-index merge               2341.381 s
  generation subtotal           60870.917 s
  statistics only (unverified)    569.013 s
  storage metadata                  1.400 s
  durable publication               0.279 s
  total                         61492.181 s
GWDEGTB revision 3.607 completed
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

Each EGTB leads to improvements of the cache algorithm. These are the times per slice for the current EGTB:
Codex Image Sep 21, 2026, 01_07_11 AM.png
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

The next one:

Code: Select all

generated 3wX-1wO-1bX-3bO.dtm: material=3 1 1 3 positions=392107445400 maximum-index=392107445399 passes=131 maximum-dtm=131 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                       1497399377825
  Hits                          1469472877470
  Misses                          27926500355
  Hit rate                             98.13%
  Decompressions                  27048203856
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  1wX-3wO-0bX-1bO.dtm              5561072012               0               0   100.00        105.41 resident
  1wX-3wO-1bX-0bO.dtm             19517512708               0               0   100.00        117.03 resident
  1wX-3wO-1bX-1bO.dtm             57380943989               0               0   100.00       4743.46 resident
  1wX-3wO-2bX-0bO.dtm             66743671491               0               0   100.00       2633.18 resident
  1wX-3wO-2bX-1bO.dtm            251209812954     11796626451     11492961014    95.30     104356.13 shared
  1wX-3wO-3bX-0bO.dtm             96534263216      4720251176      4675074228    95.11      38619.99 shared
  2wX-2wO-0bX-1bO.dtm                36505153               0               0   100.00        176.45 resident
  2wX-2wO-1bX-0bO.dtm               135425235               0               0   100.00        195.96 resident
  2wX-2wO-1bX-1bO.dtm               655047917               0               0   100.00       7940.37 resident
  2wX-2wO-2bX-0bO.dtm               777676402               0               0   100.00       4409.05 resident
  2wX-2wO-2bX-1bO.dtm              7910501734      2736388095      2342824341    65.41     174688.07 shared
  2wX-2wO-3bX-0bO.dtm              3402546405       745525080       615658495    78.09      64666.02 shared
  3wX-1wO-0bX-1bO.dtm             58125911358               0               0   100.00        130.97 resident
  3wX-1wO-0bX-2bO.dtm            142558697188               0               0   100.00       2646.79 resident
  3wX-1wO-0bX-3bO.dtm            109120131465       722903188       722903188    99.34      34785.38 shared
  3wX-1wO-1bX-0bO.dtm             22721764418               0               0   100.00        145.48 resident
  3wX-1wO-1bX-1bO.dtm            166066593738               0               0   100.00       5893.57 resident
  3wX-1wO-1bX-2bO.dtm            385414824914      2622141214      2616682355    99.32     116458.72 shared
  3wX-1wO-2bX-2bO.dtm             95541138162      4484146422      4483880535    95.31    2503862.37 shared
  4wX-0wO-0bX-1bO.dtm                47231472               0               0   100.00         36.37 resident
  4wX-0wO-0bX-2bO.dtm               219434904               0               0   100.00        734.84 resident
  4wX-0wO-0bX-3bO.dtm               679706496         3320045         3320045    99.51       9655.00 cached
  4wX-0wO-1bX-0bO.dtm                17925024               0               0   100.00         40.41 resident
  4wX-0wO-1bX-1bO.dtm               251373849               0               0   100.00       1636.69 resident
  4wX-0wO-1bX-2bO.dtm              2368177150        10235244        10224200    99.57      32333.01 cached
  4wX-0wO-1bX-3bO.dtm              4401488471        84963440        84675455    98.07     415164.84 shared
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
optimistic dependency cache activity (whole run):
  Busy reads                          42487210
  Invalidated reads                     208056
  Publication conflicts               36879939
  Pages published                  27853739822
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  2wX-2wO-3bX-0bO.dtm             64666.02         1.00           1.03       0.00 cached
  2wX-2wO-2bX-0bO.dtm              4409.05      4409.05        4409.05     100.00 resident
  4wX-0wO-0bX-2bO.dtm               734.84       734.84         734.84     100.00 resident
  4wX-0wO-1bX-1bO.dtm              1636.69      1636.69        1636.69     100.00 resident
  2wX-2wO-1bX-0bO.dtm               195.96       195.96         195.96     100.00 resident
  4wX-0wO-1bX-0bO.dtm                40.41        40.41          40.41     100.00 resident
  4wX-0wO-0bX-1bO.dtm                36.37        36.37          36.37     100.00 resident
  2wX-2wO-2bX-1bO.dtm            174688.07         1.00           1.03       0.00 cached
  4wX-0wO-0bX-3bO.dtm              9655.00            -              -          - private
  4wX-0wO-1bX-2bO.dtm             32333.01            -              -          - private
  3wX-1wO-2bX-2bO.dtm           2503862.37         1.00           1.03       0.00 cached
  2wX-2wO-0bX-1bO.dtm               176.45       176.45         176.45     100.00 resident
  2wX-2wO-1bX-1bO.dtm              7940.37      7940.37        7940.37     100.00 resident
  1wX-3wO-2bX-0bO.dtm              2633.18      2633.18        2633.18     100.00 resident
  1wX-3wO-1bX-0bO.dtm               117.03       117.03         117.03     100.00 resident
  1wX-3wO-0bX-1bO.dtm               105.41       105.41         105.41     100.00 resident
  1wX-3wO-3bX-0bO.dtm             38619.99         1.00           1.03       0.00 cached
  1wX-3wO-2bX-1bO.dtm            104356.13     43045.47       44390.64      41.25 cached
  3wX-1wO-0bX-1bO.dtm               130.97       130.97         130.97     100.00 resident
  3wX-1wO-0bX-2bO.dtm              2646.79      2646.79        2646.79     100.00 resident
  3wX-1wO-0bX-3bO.dtm             34785.38      4369.06        4505.60      12.56 cached
  4wX-0wO-1bX-3bO.dtm            415164.84         1.00           1.03       0.00 cached
  3wX-1wO-1bX-2bO.dtm            116458.72     16130.52       16634.60      13.85 cached
  1wX-3wO-1bX-1bO.dtm              4743.46      4743.46        4743.46     100.00 resident
  3wX-1wO-1bX-0bO.dtm               145.48       145.48         145.48     100.00 resident
  3wX-1wO-1bX-1bO.dtm              5893.57      5893.57        5893.57     100.00 resident
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=31586.04 MiB loaded=16 cached=10
optimistic dependency caches: initial-database=256 MiB used=63550.05 MiB databases=8
adaptive shared-cache budget: 65536 MiB allocated=65535.99 MiB growths=216 (metadata included)
shared-cache growth stalls: 2686.573589 s total
shared-cache coordinator: shrinks=57 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=idle-reclaim-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
shared-cache admission headroom: 3276.80 MiB (5%; reclaimable loan after pressure qualification; one borrower; repayment cooldown=60s); returning-cache pressure-windows=1
shared-cache outstanding loan: database=3wX-1wO-0bX-3bO.dtm protected-MiB=1191.56 borrowed-payload-MiB=3177.50
WTM: wins=257182052858 losses=445019514 draws=134480373028
WTM DTM statistics:
     DTM            Frequency
    -118                    2
    -116                    2
    -114                    1
    -112                    2
    -110                    1
    -108                   15
    -106                   12
    -104                   11
    -102                   36
    -100                   54
     -98                   84
     -96                  141
     -94                  175
     -92                  272
     -90                  388
     -88                  492
     -86                  613
     -84                  867
     -82                  998
     -80                 1164
     -78                 1618
     -76                 1659
     -74                 2006
     -72                 2278
     -70                 2650
     -68                 2499
     -66                 2751
     -64                 2898
     -62                 3007
     -60                 3062
     -58                 2977
     -56                 3018
     -54                 3024
     -52                 3034
     -50                 3270
     -48                 3822
     -46                 4003
     -44                 4555
     -42                 5120
     -40                 6014
     -38                 6373
     -36                 6647
     -34                 6975
     -32                 5643
     -30                 3678
     -28                 3881
     -26                 4245
     -24                20655
     -22                97579
     -20               252050
     -18               740792
     -16              1492965
     -14              3559160
     -12              9230870
     -10             38442878
      -8            115678560
      -6             86207734
      -4             70297034
      -2            118893011
      -1         134480373028
       0                  189
       1           6474155417
       3          15870106712
       5          25633691320
       7          34156345755
       9          33894401323
      11          26795477581
      13          16647758420
      15          12867233154
      17          13197363197
      19          13954682856
      21          13369202570
      23          11907359165
      25          10187344566
      27           7727112412
      29           5102379628
      31           3183781741
      33           2016860619
      35           1307331462
      37            861620905
      39            582194772
      41            405559741
      43            288207972
      45            204809994
      47            142923178
      49            100757238
      51             73947926
      53             54326090
      55             39268052
      57             29112481
      59             22045194
      61             17041460
      63             13661262
      65             11170502
      67              9161388
      69              7363364
      71              5783589
      73              4428817
      75              3361216
      77              2590399
      79              1988573
      81              1525548
      83              1235134
      85              1028548
      87               887997
      89               736081
      91               558900
      93               426602
      95               331635
      97               246600
      99               192065
     101               159007
     103               151246
     105               141094
     107               128469
     109               130007
     111               118392
     113                80965
     115                42559
     117                14498
     119                 3909
     121                 1151
     123                  301
     125                   87
     127                   32
     129                   20
BTM: wins=19014278851 losses=56374467086 draws=316718699463
BTM DTM statistics:
     DTM            Frequency
    -130                   33
    -128                   13
    -126                  116
    -124                  267
    -122                  941
    -120                 3098
    -118                13061
    -116                33448
    -114                69945
    -112               104316
    -110               115235
    -108               115787
    -106               123293
    -104               129712
    -102               136613
    -100               161242
     -98               200161
     -96               264367
     -94               347696
     -92               473761
     -90               646462
     -88               780370
     -86               912088
     -84              1096015
     -82              1374654
     -80              1785719
     -78              2328977
     -76              2963018
     -74              3888783
     -72              5108956
     -70              6442227
     -68              8017799
     -66              9799984
     -64             11935919
     -62             14532311
     -60             18221700
     -58             23549740
     -56             31207974
     -54             42371635
     -52             56866610
     -50             76772972
     -48            107758461
     -46            151265601
     -44            209676685
     -42            298706926
     -40            449116286
     -38            707648612
     -36           1120777175
     -34           1696496043
     -32           2385243854
     -30           3096348089
     -28           3658892445
     -26           3821428972
     -24           3499665373
     -22           2971897442
     -20           2404417950
     -18           2061712943
     -16           2247657712
     -14           2853319319
     -12           4040851296
     -10           5935254469
      -8           5141950842
      -6           3557113939
      -4           2171884484
      -2           1462398295
      -1         316718699463
       0                86855
       1           1782909926
       3           1478013313
       5           1696991866
       7           1553026600
       9            816145920
      11            335806154
      13            139564233
      15            155079017
      17            262427860
      19            397760216
      21            537518300
      23            670706536
      25            771356614
      27            827306454
      29            842654447
      31            838838716
      33            815431857
      35            776406502
      37            721190576
      39            642001495
      41            549744947
      43            449052994
      45            353091727
      47            269448115
      49            205768363
      51            159465394
      53            129702526
      55            110705881
      57             96975852
      59             86776328
      61             78511572
      63             70876531
      65             63775182
      67             55553612
      69             48512975
      71             41483938
      73             35396659
      75             29562054
      77             25211730
      79             21050444
      81             17772271
      83             14138282
      85             11008613
      87              8499479
      89              6455124
      91              4690503
      93              2968043
      95              1993366
      97              1381863
      99              1006485
     101               783274
     103               564656
     105               360398
     107               276532
     109               214166
     111               155875
     113               105620
     115                47514
     117                19813
     119                 4535
     121                 6934
     123                 6614
     125                10659
     127                 4530
     129                  275
     131                    1
DTM example positions:
  WTM longest win      W:W46,K21,K43,K48:B3,6,40,K24 {129}
  WTM longest loss     W:W49,K12,K21,K41:B2,5,26,K46 {-118}
  BTM longest win      B:W48,K7,K10,K21:B1,2,15,K26 {131}
  BTM longest loss     B:W46,K21,K43,K48:B3,6,35,K24 {-130}
  draw                 W:W46,K47,K48,K50:B43,44,45,K49 {-1}
storage: raw=1568429781600 payload=260662037798 file=271376238746 bytes overall=17.30% (5.78:1)
wall-clock timings:
  slice phases: sums for newly generated slices; 2 slices reused
  setup                             0.111 s
  initialization                24276.800 s
  backpropagation               29350.715 s
  frontier compilation            769.799 s
  slice verification/fallback       0.003 s
  full-index merge               1491.572 s
  generation subtotal           56089.291 s
  statistics only (unverified)    345.512 s
  storage metadata                  0.627 s
  durable publication               1.564 s
  total                         56464.958 s
GWDEGTB revision 3.608 completed
GW
gwiesenekker
Posts: 115
Joined: Sun Feb 20, 2011 21:04
Real name: Gijsbert Wiesenekker

Re: EGTB generator

Post by gwiesenekker »

The next one:

Code: Select all

generated 3wX-1wO-0bX-4bO.dtm: material=3 1 0 4 positions=87623462850 maximum-index=87623462849 passes=129 maximum-dtm=129 threads=64
self-consistency: passes=0 updates=0/0
final read-only consistency verification: SKIPPED — NOT VERIFIED (mode=none)
consistency current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches:
  Metric                                Value
  Lookups                        258015055165
  Hits                           253960160132
  Misses                           4054895033
  Hit rate                             98.43%
  Decompressions                   3974851726
  Dirty evictions                           0
  Compressed writes                         0
final verification current-DB cache:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
final verification dependency caches:
  Metric                                Value
  Lookups                                   0
  Hits                                      0
  Misses                                    0
  Hit rate                              0.00%
  Decompressions                            0
  Dirty evictions                           0
  Compressed writes                         0
generator dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
  0wX-4wO-0bX-1bO.dtm                93928368               0               0   100.00         23.56 resident
  0wX-4wO-1bX-0bO.dtm               322504916               0               0   100.00         26.15 resident
  0wX-4wO-1bX-1bO.dtm              2462938144               0               0   100.00       1060.01 resident
  0wX-4wO-2bX-0bO.dtm              2733774980               0               0   100.00        588.26 resident
  0wX-4wO-2bX-1bO.dtm             29645591688       685095155       683904475    97.69      23320.25 shared
  0wX-4wO-3bX-0bO.dtm             10000862872               0               0   100.00       8627.87 resident
  1wX-3wO-0bX-1bO.dtm                 8907512               0               0   100.00        105.41 resident
  1wX-3wO-1bX-0bO.dtm                41251074               0               0   100.00        117.03 resident
  1wX-3wO-1bX-1bO.dtm               163002196               0               0   100.00       4743.46 resident
  1wX-3wO-2bX-0bO.dtm               246278736               0               0   100.00       2633.18 resident
  1wX-3wO-2bX-1bO.dtm              2390754194       332114549       282778691    86.11     104356.13 shared
  1wX-3wO-3bX-0bO.dtm              1182395182       300009107       270492549    74.63      38619.99 shared
  3wX-1wO-0bX-1bO.dtm             16028182848               0               0   100.00        130.97 resident
  3wX-1wO-0bX-2bO.dtm             58927699637               0               0   100.00       2646.79 resident
  3wX-1wO-0bX-3bO.dtm             90783017339       574483692       574483692    99.37      34785.38 shared
  3wX-1wO-1bX-3bO.dtm             42864329801      2163192530      2163192319    94.95    1495771.20 shared
  4wX-0wO-0bX-1bO.dtm                 9918226               0               0   100.00         36.37 resident
  4wX-0wO-0bX-2bO.dtm               109717452               0               0   100.00        734.84 resident
final verification dependency caches by material (summed across workers):
  Database                            Lookups          Misses  Decompressions    Hit %      Full MiB Mode
optimistic dependency cache activity (whole run):
  Busy reads                          26627329
  Invalidated reads                     165085
  Publication conflicts               13532713
  Pages published                   4041362320
dependency memory at report time (shared allocations counted once):
  Database                        Full MiB  Payload MiB  Allocated MiB Coverage % Mode
  1wX-3wO-3bX-0bO.dtm             38619.99         1.00           1.03       0.00 cached
  4wX-0wO-0bX-1bO.dtm                36.37        36.37          36.37     100.00 resident
  1wX-3wO-2bX-0bO.dtm              2633.18      2633.18        2633.18     100.00 resident
  1wX-3wO-1bX-0bO.dtm               117.03       117.03         117.03     100.00 resident
  4wX-0wO-0bX-2bO.dtm               734.84       734.84         734.84     100.00 resident
  1wX-3wO-0bX-1bO.dtm               105.41       105.41         105.41     100.00 resident
  1wX-3wO-1bX-1bO.dtm              4743.46      4743.46        4743.46     100.00 resident
  0wX-4wO-0bX-1bO.dtm                23.56        23.56          23.56     100.00 resident
  0wX-4wO-1bX-1bO.dtm              1060.01      1060.01        1060.01     100.00 resident
  0wX-4wO-1bX-0bO.dtm                26.15        26.15          26.15     100.00 resident
  1wX-3wO-2bX-1bO.dtm            104356.13     18551.99       19131.74      17.78 cached
  0wX-4wO-2bX-0bO.dtm               588.26       588.26         588.26     100.00 resident
  0wX-4wO-2bX-1bO.dtm             23320.25     10626.78       10958.87      45.57 cached
  0wX-4wO-3bX-0bO.dtm              8627.87      8627.87        8627.87     100.00 resident
  3wX-1wO-1bX-3bO.dtm           1495771.20         1.00           1.03       0.00 cached
  3wX-1wO-0bX-1bO.dtm               130.97       130.97         130.97     100.00 resident
  3wX-1wO-0bX-3bO.dtm             34785.38     34369.28       35443.32      98.80 cached
  3wX-1wO-0bX-2bO.dtm              2646.79      2646.79        2646.79     100.00 resident
  Coverage is capacity/full size, not occupancy or hit rate. Allocated includes shared-slot metadata; excludes contexts and private views.
shared dependency residency: budget=32768 MiB maximum-database=16384 MiB used=21473.90 MiB loaded=13 cached=5
optimistic dependency caches: initial-database=256 MiB used=63550.05 MiB databases=5
adaptive shared-cache budget: 65536 MiB allocated=65535.99 MiB growths=118 (metadata included)
shared-cache growth stalls: 1675.816047 s total
shared-cache coordinator: shrinks=32 transfers=0 rollbacks=0 recovery-reserve=0.00 MiB assessing=no
shared-cache policy: active=idle-reclaim-v1 shadows=all-other-policies snapshot=active-cache-state spare-floor=0.100% dense-jump=half-free-budget
shared-cache growth admission: minimum-load-share=0.500% minimum-timed-loads=16 growth-factor=1.500 one-growth-per-checkpoint
shared-cache admission headroom: 3276.80 MiB (5%; reclaimable loan after pressure qualification; one borrower; repayment cooldown=60s); returning-cache pressure-windows=1
shared-cache outstanding loan: database=0wX-4wO-2bX-1bO.dtm protected-MiB=5858.52 borrowed-payload-MiB=4768.26
WTM: wins=82473392054 losses=7139882 draws=5142930914
WTM DTM statistics:
     DTM            Frequency
     -26                   95
     -24                  541
     -22                 3240
     -20                10516
     -18                29535
     -16                63805
     -14               199393
     -12               516009
     -10              1823617
      -8              1493452
      -6               917767
      -4              1477792
      -2               604074
      -1           5142930914
       0                   46
       1           1631219638
       3           5148999070
       5           9410582972
       7          14413603359
       9          16303439314
      11          14692031522
      13           7924042855
      15           3742974872
      17           2371687872
      19           1903186173
      21           1556944570
      23           1208933255
      25            857768558
      27            537350659
      29            304339540
      31            165973593
      33             95459085
      35             60431335
      37             41351438
      39             29619242
      41             21555457
      43             15517721
      45             10900095
      47              7401378
      49              4960280
      51              3517452
      53              2545581
      55              1800215
      57              1276011
      59               927767
      61               692302
      63               542285
      65               428967
      67               333479
      69               256367
      71               189849
      73               136082
      75               101194
      77                78864
      79                59243
      81                43018
      83                33432
      85                27024
      87                23018
      89                20854
      91                16985
      93                12222
      95                10798
      97                 8976
      99                 5674
     101                 5363
     103                 4644
     105                 3604
     107                 4030
     109                 5452
     111                 3968
     113                 1975
     115                  838
     117                  379
     119                  239
     121                   42
     123                    5
     125                    3
BTM: wins=466684247 losses=56886396021 draws=30270382582
BTM DTM statistics:
     DTM            Frequency
    -124                   19
    -122                  116
    -120                  539
    -118                 1026
    -116                 3043
    -114                 6423
    -112                12228
    -110                13387
    -108                12752
    -106                12192
    -104                14006
    -102                14919
    -100                17261
     -98                24183
     -96                31608
     -94                44601
     -92                62345
     -90                82849
     -88                95664
     -86               106405
     -84               125907
     -82               163013
     -80               219396
     -78               284331
     -76               361540
     -74               498536
     -72               656786
     -70               858769
     -68              1114248
     -66              1414770
     -64              1739083
     -62              2090951
     -60              2633757
     -58              3489221
     -56              4797276
     -54              6680895
     -52              9161580
     -50             12705553
     -48             18230414
     -46             26160350
     -44             37090951
     -42             53884523
     -40             80722975
     -38            125166133
     -36            198724594
     -34            315649723
     -32            493563383
     -30            753402165
     -28           1098325915
     -26           1469992325
     -24           1789681542
     -22           2106917661
     -20           2548212134
     -18           3477335718
     -16           5806466757
     -14           9612360737
     -12          10701829720
     -10           7773281963
      -8           4361827364
      -6           2190273375
      -4           1161091634
      -2            636649114
      -1          30270382582
       0                 3673
       1             22989099
       3             43050565
       5             45627818
       7             53953329
       9             51731756
      11             22651543
      13              8303971
      15              3698087
      17              2572092
      19              3055793
      21              4303994
      23              6093754
      25              8205913
      27             10218933
      29             11957534
      31             13429041
      33             14576844
      35             15280783
      37             15649329
      39             15258215
      41             14523708
      43             13250079
      45             11614208
      47              9756949
      49              7927577
      51              6246611
      53              4967636
      55              3981318
      57              3206382
      59              2679626
      61              2298605
      63              2020918
      65              1811680
      67              1560419
      69              1357433
      71              1162813
      73              1012048
      75               882319
      77               733930
      79               624840
      81               553261
      83               449141
      85               363007
      87               305165
      89               230684
      91               175974
      93               131541
      95                80498
      97                54668
      99                32893
     101                21271
     103                18247
     105                11921
     107                 8511
     109                 8165
     111                 5549
     113                 3185
     115                 1285
     117                  497
     119                  518
     121                  312
     123                   44
     125                   95
     127                  227
     129                   96
DTM example positions:
  WTM longest win      W:W46,K8,K24,K26:B1,3,34,45 {125}
  WTM longest loss     W:W37,K23,K24,K33:B30,31,35,36 {-26}
  BTM longest win      B:W49,K8,K19,K43:B4,7,24,37 {129}
  BTM longest loss     B:W46,K27,K32,K42:B3,6,35,41 {-124}
  draw                 W:W41,K46,K48,K50:B42,43,44,45 {-1}
storage: raw=350493851400 payload=73069534562 file=75465486798 bytes overall=21.53% (4.64:1)
wall-clock timings:
  slice phases: sums for newly generated slices; 18 slices reused
  setup                             0.110 s
  initialization                 4164.818 s
  backpropagation                7320.478 s
  frontier compilation            166.658 s
  slice verification/fallback       0.002 s
  full-index merge                335.138 s
  generation subtotal           12056.388 s
  statistics only (unverified)     80.896 s
  storage metadata                  0.166 s
  durable publication               0.702 s
  total                         12139.023 s
GWDEGTB revision 3.609 completed
GW
Post Reply