Rainer Gerhards
63145387cb
testbench: modernize and make more robust
...
This also modernizes the testbench framework
2020-01-23 18:52:48 +01:00
Rainer Gerhards
4a4a09c5a0
testbench: improve dynstats tests and make them more portable
2019-10-09 12:21:14 +02:00
Rainer Gerhards
69ef6e329b
fix bad bash coding style and disable shellcheck false positives
...
Also now permit interactivly running tests without explicitly setting
$srcdir. This now works if we are inside ./tests and fails, as before,
when we are in a different directory.
Detected by shellcheck via CodeFactor.io
2018-10-23 13:27:37 +02:00
Rainer Gerhards
ca1af1b459
cleanup: shellcheck-found minor issues
2018-10-19 12:55:59 +02:00
Rainer Gerhards
c096f21c46
testbench: some more modernization
2018-09-07 17:56:22 +02:00
Rainer Gerhards
27cc298a3d
squash: content-check
2018-09-03 10:05:18 +02:00
Rainer Gerhards
d051a9bdb6
squash: more changes
2018-09-02 17:46:16 +02:00
Rainer Gerhards
4adfefe090
testbench: another step towards parallel testing
...
Merging in multiple steps to avoid getting new tests with non-correct
plumbing.
- some more dynamic file names
- convert more commands to pure bash functions
- cleanup no longer neede files
2018-08-22 14:56:07 +02:00
Rainer Gerhards
8ea166d89d
testbench: fix some hardcoded names ( #2895 )
...
* testbench: fix some hardcoded names
This is prework to make parallel execution of tests possible.
2018-08-01 12:52:17 +02:00
Florian Riedl
e13dc61049
Test refactor part 6
2018-07-25 17:32:05 +02:00
Rainer Gerhards
2ba3c8ddde
testbench: modernize testbench plumbing
...
changes some of the test commands to use bash functions
includes some small bug fixes to tests where bugs were
previously not seen due to different plumbing.
2018-07-23 17:26:34 +02:00
Janmejay Singh
6983bd3414
Make elapsed-time dependent dynstats tests run with relaxed time constraints as they sometimes fail on arm & hppa (and sometimes on other slow envs too)
2017-11-26 23:56:42 +05:30
PascalWithopf
bd8a1b8136
freeBSD: disable tests that are not working
...
FreeBSD is not able to run all tests, therefore all tests that can't be run will be disabled.
2017-10-27 12:18:59 +02:00
Janmejay Singh
da8c0b9e92
Double impstats flush-interval because 1-flush-per-second does not give the test enough tolerance on slow machines.
2017-04-20 12:26:55 +05:30
Janmejay Singh
5f071af97f
Fixed dyn-stats unused-metric-ttl bug which was was expected to garbage-collect accumulators that were unused for time-period >= ttl, but used to wipe all accumulators. This worked from memory-footprint and metric-life point-of-view, but used to reset accumulators even when they were configured to not be reset. Now it maintains survivor(shadow) table which keeps the accumulator value around from ttl up-to (2 * ttl) and reclaims it only if no dyn_inc call resurrects it by the end of this period. This allows us to resurrect surviving counters if they are used within ttl duration. This keeps a counter alive up-to (2 * ttl) in the worst case(late eviction) and ttl(timely eviction) in the best case.
2016-04-14 21:03:35 +05:30
Janmejay Singh
7a96794b12
made some changes to dyn-stats tests to make it more resillient to timing-problems (prevents bad-timing introduced occasional failures)
2015-11-17 17:48:59 +05:30
Janmejay Singh
d94abbf49f
created a control to bump stats counter for batch-operations in one shot + some asthetic space->tab conversion
2015-11-17 16:16:24 +05:30
Janmejay Singh
0daa59c2fd
check behavior of dyn-stats provided meta-counters
2015-11-17 15:09:33 +05:30
Janmejay Singh
33cb11db57
dynstats reset-of-accumulated-dyn-metric-names and more-metrics-than-expected flows fixed and tested
2015-11-16 16:43:51 +05:30
Janmejay Singh
e24c175cae
- fixed vg-tests to actually check exit code
...
- fixed and excercised reset dyn-metrics-table flow (where dynamic-metric names are discarded. this excercises unusedMetricLife timer expiry.)
2015-11-13 20:59:07 +05:30
Janmejay Singh
6da7aeb975
- dynstats basic-test first-cut
...
- vg-test caught a minor issue in impstats (fixed)
- placeholder created for other dynstats tests
- a new assertion in diag.sh which allows extracting a particular column and expecting sum-up to match given value
- imdiag supports injecting litteral messages now (test can send a fully formed syslog message through imdiag, its a backward compatible change in protocol, allows for richer things to be build while being fully backward compatible)
2015-11-13 17:45:07 +05:30
