[onerng talk] Dieharder Test Failed with 256MB/512MB samples
Jim Cheetham
jim at gonzul.net
Thu Oct 4 00:37:37 BST 2018
Hi Victor,
I'd normally wait for Paul to answer you, but I didn't want you to think
we're ignoring your email :-)
The first question I have is "how did you collect the data you are
analysing?"
It looks like you're collecting it from /media/sf_Downloads/OneRNG - what
is that, on your system? Is this just some data that you collected from
another machine and brought across on a USB stick or something?
Assuming that you have collected data from an OneRNG earlier, what mode was
it operating in? Which internal entropy source were you using, and were you
using the AES whitening?
OneRNG doesn't produce "100% random data"; have a read of
http://moonbaseotago.com/onerng/ or perhaps
http://moonbaseotago.com/onerng/theory.html to get a good idea of the
caveats. As such, there's no expectation that data from OneRNG would pass a
strict test from a suite like DieHarder - although in practice we do, when
used with the right settings, that's more an indictment of these tests,
which don't actually prove data is random (that's probably philosophically
impossible), so much as they detect patterns that are known to come from
non-random systems.
Here for example is a published DieHarder test, which is similar to yours;
you'll note that there's a slightly different set of "weak" and "failed"
tests.
http://moonbaseotago.com/onerng/cmd0.html
We generally recommend that OneRNG data is used to feed some other
software-based RNG, rather than to be used directly.
-jim
On Tue, Oct 2, 2018 at 11:25 PM victor.sun <victor.sun at econet-inc.com>
wrote:
> OneRNG <http://lists.onerng.info>
>
> [image: Photo of victor.sun]
> <http://lists.onerng.info/p/4mDynGrgC3a4zwIyyZJMFI>
> *Dieharder Test Failed with 256MB/512MB samples*
> <http://lists.onerng.info/r/topic/3EeNY9InOlQvkQHlKhK8Qs>
> by *victor.sun* <http://lists.onerng.info/p/4mDynGrgC3a4zwIyyZJMFI>
> in *OneRNG Talk* <http://lists.onerng.info/groups/onerng-talk>
> ------------------------------
> I test OneRNG with 256MB/512MB/1G sampls
>
> 256MB: 2 FAILED / 8 WEAK
> 512MB: 1 FAILED / 2 WEAK
> 1G: 0 FAILED / 2 WEAK
>
> But other device generate 256MB sample is passed with dieharder.
>
> How much sample need by dieharder test
>
> [root at localhost shm]# dd if=/media/sf_Downloads/OneRNG of=gdmp_256.raw
> bs=256 count=1M skip=0
> 1048576+0 records in
> 1048576+0 records out
> 268435456 bytes (268 MB) copied, 268.984 s, 998 kB/s
> [root at localhost shm]# dieharder -a -g 201 -f gdmp_256.raw
>
> #=============================================================================#
> # dieharder version 3.31.1 Copyright 2003 Robert G. Brown #
>
> #=============================================================================#
> rng_name | filename |rands/second|
> file_input_raw| gdmp_256.raw| 5.11e+07 |
>
> #=============================================================================#
> test_name |ntup| tsamples |psamples| p-value |Assessment
>
> #=============================================================================#
> diehard_birthdays| 0| 100| 100|0.99784788| WEAK
> # The file file_input_raw was rewound 1 times
> diehard_operm5| 0| 1000000| 100|0.15487578| PASSED
> # The file file_input_raw was rewound 3 times
> diehard_rank_32x32| 0| 40000| 100|0.11785763| PASSED
> # The file file_input_raw was rewound 4 times
> diehard_rank_6x8| 0| 100000| 100|0.78643681| PASSED
> # The file file_input_raw was rewound 4 times
> diehard_bitstream| 0| 2097152| 100|0.38866708| PASSED
> # The file file_input_raw was rewound 8 times
> diehard_opso| 0| 2097152| 100|0.08747060| PASSED
> # The file file_input_raw was rewound 10 times
> diehard_oqso| 0| 2097152| 100|0.06000432| PASSED
> # The file file_input_raw was rewound 11 times
> diehard_dna| 0| 2097152| 100|0.35554038| PASSED
> # The file file_input_raw was rewound 11 times
> diehard_count_1s_str| 0| 256000| 100|0.00162548| WEAK
> # The file file_input_raw was rewound 13 times
> diehard_count_1s_byt| 0| 256000| 100|0.27872951| PASSED
> # The file file_input_raw was rewound 13 times
> diehard_parking_lot| 0| 12000| 100|0.11929168| PASSED
> # The file file_input_raw was rewound 13 times
> diehard_2dsphere| 2| 8000| 100|0.52282959| PASSED
> # The file file_input_raw was rewound 13 times
> diehard_3dsphere| 3| 4000| 100|0.85537832| PASSED
> # The file file_input_raw was rewound 16 times
> diehard_squeeze| 0| 100000| 100|0.09975014| PASSED
> # The file file_input_raw was rewound 16 times
> diehard_sums| 0| 100| 100|0.17925678| PASSED
> # The file file_input_raw was rewound 16 times
> diehard_runs| 0| 100000| 100|0.01413461| PASSED
> diehard_runs| 0| 100000| 100|0.55422489| PASSED
> # The file file_input_raw was rewound 18 times
> diehard_craps| 0| 200000| 100|0.26294876| PASSED
> diehard_craps| 0| 200000| 100|0.16292117| PASSED
> # The file file_input_raw was rewound 48 times
> marsaglia_tsang_gcd| 0| 10000000| 100|0.00000113| WEAK
> marsaglia_tsang_gcd| 0| 10000000| 100|0.54219492| PASSED
> # The file file_input_raw was rewound 48 times
> sts_monobit| 1| 100000| 100|0.97959128| PASSED
> # The file file_input_raw was rewound 48 times
> sts_runs| 2| 100000| 100|0.69797802| PASSED
> # The file file_input_raw was rewound 49 times
> sts_serial| 1| 100000| 100|0.70309850| PASSED
> sts_serial| 2| 100000| 100|0.56922346| PASSED
> sts_serial| 3| 100000| 100|0.50272993| PASSED
> sts_serial| 3| 100000| 100|0.48214221| PASSED
> sts_serial| 4| 100000| 100|0.11358721| PASSED
> sts_serial| 4| 100000| 100|0.79990442| PASSED
> sts_serial| 5| 100000| 100|0.05374403| PASSED
> sts_serial| 5| 100000| 100|0.57341670| PASSED
> sts_serial| 6| 100000| 100|0.47946377| PASSED
> sts_serial| 6| 100000| 100|0.97151692| PASSED
> sts_serial| 7| 100000| 100|0.68573640| PASSED
> sts_serial| 7| 100000| 100|0.18025037| PASSED
> sts_serial| 8| 100000| 100|0.69651529| PASSED
> sts_serial| 8| 100000| 100|0.93083901| PASSED
> sts_serial| 9| 100000| 100|0.84173293| PASSED
> sts_serial| 9| 100000| 100|0.90768920| PASSED
> sts_serial| 10| 100000| 100|0.94327238| PASSED
> sts_serial| 10| 100000| 100|0.89503835| PASSED
> sts_serial| 11| 100000| 100|0.93323363| PASSED
> sts_serial| 11| 100000| 100|0.79854688| PASSED
> sts_serial| 12| 100000| 100|0.53184906| PASSED
> sts_serial| 12| 100000| 100|0.59873701| PASSED
> sts_serial| 13| 100000| 100|0.99279878| PASSED
> sts_serial| 13| 100000| 100|0.23087253| PASSED
> sts_serial| 14| 100000| 100|0.99535154| WEAK
> sts_serial| 14| 100000| 100|0.53125833| PASSED
> sts_serial| 15| 100000| 100|0.18648848| PASSED
> sts_serial| 15| 100000| 100|0.21394501| PASSED
> sts_serial| 16| 100000| 100|0.37476136| PASSED
> sts_serial| 16| 100000| 100|0.73706901| PASSED
> # The file file_input_raw was rewound 49 times
> rgb_bitdist| 1| 100000| 100|0.98726105| PASSED
> # The file file_input_raw was rewound 49 times
> rgb_bitdist| 2| 100000| 100|0.23424867| PASSED
> # The file file_input_raw was rewound 50 times
> rgb_bitdist| 3| 100000| 100|0.99964851| WEAK
> # The file file_input_raw was rewound 51 times
> rgb_bitdist| 4| 100000| 100|0.11569850| PASSED
> # The file file_input_raw was rewound 53 times
> rgb_bitdist| 5| 100000| 100|0.88116822| PASSED
> # The file file_input_raw was rewound 55 times
> rgb_bitdist| 6| 100000| 100|0.97683669| PASSED
> # The file file_input_raw was rewound 57 times
> rgb_bitdist| 7| 100000| 100|0.83106661| PASSED
> # The file file_input_raw was rewound 59 times
> rgb_bitdist| 8| 100000| 100|0.69112315| PASSED
> # The file file_input_raw was rewound 62 times
> rgb_bitdist| 9| 100000| 100|0.39990121| PASSED
> # The file file_input_raw was rewound 65 times
> rgb_bitdist| 10| 100000| 100|0.17367736| PASSED
> # The file file_input_raw was rewound 68 times
> rgb_bitdist| 11| 100000| 100|0.39521763| PASSED
> # The file file_input_raw was rewound 72 times
> rgb_bitdist| 12| 100000| 100|0.95669054| PASSED
> # The file file_input_raw was rewound 72 times
> rgb_minimum_distance| 2| 10000| 1000|0.51511691| PASSED
> # The file file_input_raw was rewound 72 times
> rgb_minimum_distance| 3| 10000| 1000|0.60048210| PASSED
> # The file file_input_raw was rewound 73 times
> rgb_minimum_distance| 4| 10000| 1000|0.60798874| PASSED
> # The file file_input_raw was rewound 74 times
> rgb_minimum_distance| 5| 10000| 1000|0.02546089| PASSED
> # The file file_input_raw was rewound 74 times
> rgb_permutations| 2| 100000| 100|0.83331118| PASSED
> # The file file_input_raw was rewound 75 times
> rgb_permutations| 3| 100000| 100|0.39331372| PASSED
> # The file file_input_raw was rewound 75 times
> rgb_permutations| 4| 100000| 100|0.67948301| PASSED
> # The file file_input_raw was rewound 76 times
> rgb_permutations| 5| 100000| 100|0.27067040| PASSED
> # The file file_input_raw was rewound 77 times
> rgb_lagged_sum| 0| 1000000| 100|0.84647548| PASSED
> # The file file_input_raw was rewound 80 times
> rgb_lagged_sum| 1| 1000000| 100|0.40037758| PASSED
> # The file file_input_raw was rewound 85 times
> rgb_lagged_sum| 2| 1000000| 100|0.19321388| PASSED
> # The file file_input_raw was rewound 91 times
> rgb_lagged_sum| 3| 1000000| 100|0.00213971| WEAK
> # The file file_input_raw was rewound 98 times
> rgb_lagged_sum| 4| 1000000| 100|0.72757050| PASSED
> # The file file_input_raw was rewound 107 times
> rgb_lagged_sum| 5| 1000000| 100|0.41563933| PASSED
> # The file file_input_raw was rewound 118 times
> rgb_lagged_sum| 6| 1000000| 100|0.46224486| PASSED
> # The file file_input_raw was rewound 130 times
> rgb_lagged_sum| 7| 1000000| 100|0.07528432| PASSED
> # The file file_input_raw was rewound 143 times
> rgb_lagged_sum| 8| 1000000| 100|0.40442416| PASSED
> # The file file_input_raw was rewound 158 times
> rgb_lagged_sum| 9| 1000000| 100|0.76217932| PASSED
> # The file file_input_raw was rewound 174 times
> rgb_lagged_sum| 10| 1000000| 100|0.25170451| PASSED
> # The file file_input_raw was rewound 192 times
> rgb_lagged_sum| 11| 1000000| 100|0.00246864| WEAK
> # The file file_input_raw was rewound 212 times
> rgb_lagged_sum| 12| 1000000| 100|0.90574597| PASSED
> # The file file_input_raw was rewound 232 times
> rgb_lagged_sum| 13| 1000000| 100|0.63314210| PASSED
> # The file file_input_raw was rewound 255 times
> rgb_lagged_sum| 14| 1000000| 100|0.40714694| PASSED
> # The file file_input_raw was rewound 279 times
> rgb_lagged_sum| 15| 1000000| 100|0.00000000| FAILED
> # The file file_input_raw was rewound 304 times
> rgb_lagged_sum| 16| 1000000| 100|0.88010175| PASSED
> # The file file_input_raw was rewound 331 times
> rgb_lagged_sum| 17| 1000000| 100|0.52188048| PASSED
> # The file file_input_raw was rewound 359 times
> rgb_lagged_sum| 18| 1000000| 100|0.75870863| PASSED
> # The file file_input_raw was rewound 389 times
> rgb_lagged_sum| 19| 1000000| 100|0.02718346| PASSED
> # The file file_input_raw was rewound 420 times
> rgb_lagged_sum| 20| 1000000| 100|0.69006095| PASSED
> # The file file_input_raw was rewound 453 times
> rgb_lagged_sum| 21| 1000000| 100|0.36742983| PASSED
> # The file file_input_raw was rewound 487 times
> rgb_lagged_sum| 22| 1000000| 100|0.90263792| PASSED
> # The file file_input_raw was rewound 523 times
> rgb_lagged_sum| 23| 1000000| 100|0.02195668| PASSED
> # The file file_input_raw was rewound 560 times
> rgb_lagged_sum| 24| 1000000| 100|0.48794939| PASSED
> # The file file_input_raw was rewound 599 times
> rgb_lagged_sum| 25| 1000000| 100|0.07821953| PASSED
> # The file file_input_raw was rewound 639 times
> rgb_lagged_sum| 26| 1000000| 100|0.91372828| PASSED
> # The file file_input_raw was rewound 681 times
> rgb_lagged_sum| 27| 1000000| 100|0.00001335| WEAK
> # The file file_input_raw was rewound 724 times
> rgb_lagged_sum| 28| 1000000| 100|0.37945842| PASSED
> # The file file_input_raw was rewound 769 times
> rgb_lagged_sum| 29| 1000000| 100|0.30295123| PASSED
> # The file file_input_raw was rewound 815 times
> rgb_lagged_sum| 30| 1000000| 100|0.27811010| PASSED
> # The file file_input_raw was rewound 863 times
> rgb_lagged_sum| 31| 1000000| 100|0.00000000| FAILED
> # The file file_input_raw was rewound 912 times
> rgb_lagged_sum| 32| 1000000| 100|0.69521459| PASSED
> # The file file_input_raw was rewound 912 times
> rgb_kstest_test| 0| 10000| 1000|0.17507479| PASSED
> # The file file_input_raw was rewound 914 times
> dab_bytedistrib| 0| 51200000| 1|0.64840284| PASSED
> # The file file_input_raw was rewound 915 times
> dab_dct| 256| 50000| 1|0.23901286| PASSED
> Preparing to run test 207. ntuple = 0
> # The file file_input_raw was rewound 916 times
> dab_filltree| 32| 15000000| 1|0.60360801| PASSED
> dab_filltree| 32| 15000000| 1|0.45466538| PASSED
> Preparing to run test 208. ntuple = 0
> # The file file_input_raw was rewound 917 times
> dab_filltree2| 0| 5000000| 1|0.19429149| PASSED
> dab_filltree2| 1| 5000000| 1|0.17569667| PASSED
> Preparing to run test 209. ntuple = 0
> # The file file_input_raw was rewound 918 times
> dab_monobit2| 12| 65000000| 1|0.99309655| PASSED
> ------------------------------
> ⮪ Reply
> <onerng-talk at lists.onerng.info?subject=Re%3A%20Dieharder%20Test%20Failed%20with%20256MB/512MB%20samples>
> 🖂 New topic <onerng-talk at lists.onerng.info> View topic…
> <http://lists.onerng.info/r/topic/3EeNY9InOlQvkQHlKhK8Qs>
> Unsubscribe
> <onerng-talk at lists.onerng.info?subject=Unsubscribe&body=Hello%2C%0A%0APlease%20remove%20me%20from%20OneRNG%20Talk%0A%3Chttp%3A//lists.onerng.info/groups/onerng-talk%3E%0A%0AThank%20you.>
> • Switch to a daily digest
> <onerng-talk at lists.onerng.info?subject=Digest%20on&body=Hello%2C%0A%0APlease%20switch%20me%20from%20receiving%20one%20email%20per%20post%20to%20the%20daily%0Adigest%2C%20which%20summarises%20the%20all%20the%20posts%20made%20each%20day%20in%0AOneRNG%20Talk%0A%3Chttp%3A//lists.onerng.info/groups/onerng-talk%3E%0A%0AThank%20you.>
>
> - Privacy <http://lists.onerng.info/policies/privacy/>
> - Acceptable Use <http://lists.onerng.info/policies/aup/>
> - Terms of Service <http://lists.onerng.info/policies/tos/>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ourshack.com/pipermail/discuss/attachments/20181004/867ca9a2/attachment.html>
More information about the Discuss
mailing list